Tries from Francois Steyn and Jean De Villiers, along with four penalties from Steyn, consigned England to defeat in their series opener in Durban, but Robshaw was encouraged by aspects of his side's performance.
He told Sky Sports News: "We went in 6-6 at half time, we came out all guns blazing but unfortunately they got an early score and managed to build pressure on us.
"South African sides, you always know they're going to be very physical but if you looking at the game we were never more than a score away, but unfortunately we were the wrong side of that score.
"We have to start building for next week, there's been a lot of positives and a couple negatives you can pick out today."
England's next fixture of the tour is against a SA Barbarians South team in Kimberley on Wednesday.