Villa are currently 17th in the Premier League and three points ahead of 18th-placed Wigan Athletic, whom they will face on the final day of the season. However, the Latics have two games in hand.
However, Baker is remaining positive about his side's chances.
"The main thing we have to think about is ourselves," Baker told the club's official website. "It's about us and what we do for the rest of the season. It's in our hands. If we carry on playing like we have been we're confident that we'll be okay.
"Obviously we're hoping to be safe by the time we go to Wigan, that's what everyone wants to do. But if we had to go there and get a result we'd just keep going and doing what we've been doing.
"We're confident and we know we can do it."
The 21-year-old came through the ranks at Aston Villa, and has played 33 times for the club.