Lambert joined up with the England squad for the third time this week after featuring in games against Scotland, Moldova and Ukraine this season.
The 31-year-old, who scored against both Scotland and Moldova, believes that his rise through the leagues at a relatively late age can help inspire others to strive for the same.
He told The Mirror: "I think I've realised lately that, over the years, I have been driven on by remarks like that. To be honest, that's the sort of thing that drives me on, to try and prove these people wrong.
"I couldn't pay someone to give me motivation like that. Obviously I'm driven inside anyway, I want to do well. So it doesn't actually bother me what people say.
"I'm hoping to inspire other people to not give up because if you are good enough you will get to where you want to go. You never know what could happen in a year, two years. It can change."
Lambert has added two goals for Saints to his England haul ahead of Friday's crucial World Cup qualifier against Montenegro.