The League Two side took the lead from the penalty spot inside the opening 10 minutes, but Stephen O'Halloran levelled the scores before half time to set up the replay.
The manager told BBC Sport: "We've been so, so lucky. We didn't turn up in the first half, our only shot was the penalty. My voice is killing me from shouting at half time.
"We were a bit better in the second half, not good, but we still probably had the best chances in the game. It's unacceptable. These are professional players. We've brought a crowd here, the game was on TV.
"I could have gone out there and given more than some of them in that first half, honestly. In the end we are happy we are still in the hat. But I'm not having that. And believe me, the players know."
The replay will take place at Victoria Park later this month, while the draw for the third round of the competition takes place on Monday.