Despite his comments, Broad believes that "worse" remarks have been made on a cricket field and that the banter between the two sides has not overstepped the mark.
"I suppose with the TV cameras and the stump mics picking it up so clearly the ICC felt like they had too take action, but certainly back on the field there's a lot of respect between the two sides," Broad told BBC Radio 5 live.
"You are playing country v country and you're in a battle and passions run high and it can go overboard from time to time.
"It is up to the players to take responsibility and make sure it doesn't go too far. Just from a personal point of view, I thought this Test match was hard fought and aggressive but from my experience being out in the middle it didn't feel like it was over the top."
England, who are currently 1-0 down in the series, are preparing for the second Test, which gets underway next week in Adelaide.