Richardson was drafted by the Browns last summer, but Brown said that he was not confident he could have carried the burden that the team required.
"I was surprised," Brown told CBSSports. "But then I thought it was a brilliant move. Because first of all, Trent couldn't have carried the kind of load that Cleveland needed."
Richardson carried for 35 yards in his first game for the Colts.