The Shrimpers were beaten by a second-half brace by Matty Fryatt, but Brown believes that his team showed what they are capable of.
"We gave a good account of ourselves. We asked them to test themselves against top flight players and we did that," he told BBC Sport.
"At 0-0 we were in the game but the first goal on the hour mark knocked the wind out of our sails. In the end it looks comfortable for them but we threw caution to the wind and went for the equaliser."
Southend are back in League Two action on Tuesday against Dagenham & Redbridge.