The Premier League side signed the USA international over the summer, but loaned him back to the Seattle Sounders for the 2014 Major League Soccer season, with a view to him joining Spurs in January or June next year.
After recently revealing that the move could come sooner rather than later, the 21-year-old told the MLS website: "It depends on the situation. I think if I'm still playing a lot with Seattle then it's something I have to think about, there's no reason to have me go in.
"Ultimately it comes down to what [Pochettino] wants. He's making the decision on when I come. Obviously he has confidence in me, but these guys have experience at this level.
"It's going to take me time to adjust. I'm not expecting to go in right away first day and start. So if I'm playing, there's no reason to take me out of that environment."
Yedlin was part of America's squad at this summer's World Cup in Brazil.