"I'll turn it round. We will turn it round," he told BBC Sport.
"We're not giving up - we'll just keep going and try to find a consistent run of wins.
"We'll have to turn it round very quickly. You can see that there's talent in the team and belief in the team, but we have to stop giving away silly goals."
The result has left Celtic third in the SPL table, 10 points behind leaders Rangers, although Lennon's side have a game in hand.