The 33-year-old will meet Khan on the undercard of Mayweather's welterweight unification showdown with Argentina's Marcos Maidana on May 3, and he is keen to only concentrate on his British opponent.
"A win over Khan does put me in the Mayweather sweepstakes, but my sights are set on Khan," Collazo told members of the media.
"I am not looking beyond Amir Khan. He is my main focus.
"This fight is my whole career right in front of me. If I beat Amir Khan I have a bigger future in boxing and if I don't, I have to start from the bottom again."
Collazo has won 35 of his 40 professional bouts.