Morgan believes that Leicester can have no excuses after they spurned several chances at St James' Park.
"We are very disappointed," he told the Leicester Mercury. "We felt the first half was pretty even and in the second half we were starting to turn the screw a little bit and put the pressure on, so to concede from our corner with them going down the field to punish us was very hard to take.
"I think there is always room for improvement and we definitely weren't at our full capacity, but I felt we had done enough to come away with something from the game.
"It was a game we wanted to pick up some points from and, in general, I thought we played really well. We created some chances and could have won, so to come away without anything is hard to take."
Leicester have dropped to 14th in the table following the defeat.