The gymnast, who is competing on BBC One show Strictly Come Dancing, took to Twitter to complain that people are getting him confused with the 60-year-old music manager.
Smith tweeted: "hey um are you Louis Walsh?!" excuse me !!"sorry! Are you Louis Walsh?! No!! I'm not!! He's a judge off X-factor..."
Smith is currently rehearsing for this Saturday's dance with his professional partner Flavia Cacace.