However, following Saturday's Saturday's 2-0 defeat to Arsenal, the former striker wants to see the stylish Agger make a comeback.
"The vice-captain has been patiently waiting for his chance over the past month and deserves a recall," Aldridge said in his Liverpool Echo column.
"Agger has been at the club a long time and is a real stalwart. [He] is so comfortable bringing the ball out from the back, he reads the game well and also provides a goal threat.
"Kolo Toure, Martin Skrtel and Mamadou Sakho haven't done much wrong and I'm not sure which one will make way, but I just think the backline will be stronger with Agger in it."