Allen exonerated his goalkeeper of any blame for Leicester's equaliser but admitted that Stoke are in dire need of wins to drag them out of the Premier League relegation zone.
"At the stage where we need three points from every game, to not come away with that today is naturally disappointing," Allen told Sky Sports News after the game.
"Up until their goal, we dealt with everything comfortably and they were frustrated, obviously their goal gave them a boost and it flipped the game on its head with us holding on in the last 15 minutes or so, with a couple of openings on the break. But to come here and get a draw it's not a bad point.
"Jack pulled off a great save moments later so that cancels that out. We're not going to feel sorry for ourselves and make excuses. From our point of view it is about getting to points, we need to get out of trouble and hopefully we can do that with a few games to spare.
"We're working every day to improve ourselves, especially defensively. It was really our Achilles heel. The signs from our general play are encouraging, we just need points now."
Stoke remain 19th in the table and return to action next Saturday away at Southampton.