Poyet said that he is remaining focused on Brighton for the time being, despite hoping to lead the Blues to glory in the future.
"That is my aim, everyone knows and I don't hide it," BBC Sport quotes Poyet as saying. "I want to go to the highest level and if it is in the Premier League with Chelsea then fantastic. If it is with someone else, then we shall see.
"I can assure you I was not paying attention to Chelsea yesterday. I was not paying attention to the game, who played or who didn't play. I was paying attention to Huddersfield in quite a competitive game at Burnley. I had to watch for 90 minutes and it was interesting. That was my job."
Poyet's Brighton are hoping to stay in the playoff places in the Championship with a win over Huddersfield Town on Saturday.