The rival nations lock horns on Friday evening with three Group F points on the line - the first time that they have faced off in a competitive fixture since 1999.
It is the visitors who are in more desperate need of a win, having taken just four points from the first nine on offer - a run that includes a heavy 3-0 defeat to Slovakia last time out - but Martin claims that Scotland cannot afford to be fearful of their opponents.
"We have got to look at every team as beatable, we can't fear too many," he told Sky Sports News. "Everybody has got their strengths and weaknesses and we know it's going to be a really tough game.
"We know the quality they possess week in, week out in the Premier League and their qualifying campaigns over the last few years. We know it's going to be a tough game but there is no reason why we can't go into it and give it a good go and see where it takes us."
Martin, who was selected for the 1-1 draw against Lithuania last month, has scored four times in his past five games on loan at Fulham.