The Midlands outfit have succumbed to defeat in their last four matches, and are without injured striker Christian Benteke for the remainder of the campaign.
"I really believe it is Villa down," Dowie told talkSPORT. "It is going to be very difficult for Paul. Ian Culverhouse did a lot of the coaching and now he isn't there.
"It will be something a little alien to Paul Lambert. I just wonder where the goals are going to come from."
Villa are currently four points above the relegation zone.