The ex-Chelsea star believes that the 54-year-old should leave his post because the pressure on him will be too great in the coming months.
"The contract with him was extended so that no annoying questions arose during the World Cup," Ballack told The Express.
"This was wise from the German Football Association but I think that Low should not continue at this juncture. The pressure and burden on him would be too great."
He added: "[Even if they win] he'll probably go because there's no possible improvement after winning a World Cup."
Germany will take on Ghana, USA and Portugal in Group G of the 2014 World Cup finals.