Villa are currently 18th in the league and face Manchester City on Monday night.
The 26-year-old says that although it is a scary thought, he believes that Villa can gain survival this season.
"I think [the prospect of relegation] would scare anyone," Agbonlahor told ESPN.
"If I am asked if I'm thinking about relegation, I am not. I am thinking about helping the team to get out of where we are now.
"As long as you're in the bottom three it's in your mind, but if it was a massive gap you'd be scared. It's only a point or two [to safety]. We are in it together and we will fight for each other."
Villa take on City tomorrow at 8pm.