The Baggies face the League One outfit on Tuesday night in the second round of the Capital One Cup after enjoying a strong start to their Premier League campaign.
Ridgwell, who won the trophy with Birmingham City in 2011, wants his side to go into the fixture against the Glovers with the same attitude as they did when beating Liverpool and drawing at Tottenham Hotspur.
"I don't think we have exceeded ourselves, but they were obviously tough league games. You're playing against two of the top five teams in the country in Liverpool and Tottenham," said Ridgewell. "You always try to think you can win at home and get a draw away, so I think we've done well, and we need to build on that.
"Obviously I've won the League Cup before with Blues - and it's a great thing to win.
"Our main priority is the Premier League and I'm sure the gaffer will say that but we want to go out and play well in every game that we play, and I'm sure we'll be going down there to put a good display on."
The game kicks off at 7.45pm this evening.