The Red Devils have failed to defend their Premier League title as they currently reside seventh in the table, 18 points behind leaders Chelsea.
With the likelihood that David Moyes's side will miss out on a Champions League spot, Ferdinand has revealed that the team's poor form has begun affecting his life away from the pitch.
"It's embarrassing," Ferdinand told BT Sport. "I don't want to go out when the game is finished and you even stop watching TV. I don't want to take my kids to school. I don't want to fill my car up with petrol or go to the shops.
"I don't want to walk on the school path and think I'm hearing things or seeing people look at me because we lost a game.
"It gets personal with everyone looking at you and talking about the results and the form and stuff. You don't want to live like that. You want to live freely and comfortably."
United, who are 12 points adrift of a Champions League spot, will take on Aston Villa this Saturday at Old Trafford, where disgruntled fans are planning to arrange for a plane to carry a 'Wrong One - Moyes Out' banner over the stadium.