The Blues have lost their past two Premier League matches and are already nine points adrift of leaders Manchester City, having suffered defeats to Pep Guardiola's side and bottom side Crystal Palace.
That's despite winning the Premier League title last season, and he thinks that the players need to do more - as does he in order to win the games.
"We are trying to rebuild something important at Chelsea with some big players having left".
"First of all, there are a lot of foreigners who come into the Premier League and not all these buyers have been successful because everybody wants instant success".
It could mean Cesc Fabregas is the only fit midfielder available for Conte, and Chelsea defender Cesar Azpilicueta summed up the glum feeling after the Roma game when he said: "The mood at the moment is not the best".
Conte's side have not won in three matches since beating Atletico Madrid in the Champions League in September, but the former Juventus boss is hoping he can rise to the challenge of bridging the gaps to the Manchester clubs at the top of the Premier League table.
He said: "I'm not happy to change the roles of my players".
"It is a problem to play every game with the same players so it is impossible for these players to work - the game is not training".
Watford weren't done there though, and they fought back once again two minutes after Batshuayi scored through defender Daryl Janmaat and the visitors equalised with just over 15 minutes to go through substitute Stefano Okaka.
With the League Cup game against Everton on Wednesday providing the flawless opportunity to rotate and rest, Saturday's match should see as strong of a lineup as possible once again.
There was some positive news on Kante. It's different. You can train only a part of your fitness, metabolic, but you lose the strength.
"Watford did a very good transfer market", Conte said.
"I hope to have Kante back very soon, before the global break".
"I try to give all myself and put everything into the job". It's very hard because we have just started our season.
"For my players we must look inside and not outside and respect ourselves as well".