Mulumbu thinks that despite their indifferent recent run of results, the Baggies can take advantage of City's looming FA Cup final commitment to earn a victory on the road.
He said: "These days we don't need to be scared about the likes of City. We show some good things against big teams and I'm really confident we're going to win.
"We need to bounce back after losing to Wigan Athletic so it's exciting to play against one of the league's big sides.
"We don't even need the gaffer to speak a lot any more when we play against big sides, we know we will be ready to do something."
Mulumbu has been a consistent performer for West Brom this season, making 27 appearances in all competitions.