A host of Tottenham Hotspur fans responded to accusations of anti-Semitism by chanting "we sing what we want" during the North London club's Europa League tie against Maribor last night.
The supporters have been accused of showing discrimination towards the Jewish community by the Society of Black Lawyers due to their references in chants and by calling themselves the "Yid army".
"Why on earth do they think it is acceptable?" BBC Sport quotes Herbert as saying. "We heard lots of 'We're Tottenham Hotspur, we sing what we want', which is a clear reference to the club chants featuring the word 'Yid' that the Society of Black Lawyers say they will report to the police if they continue to be heard at the ground.
"If the fans wish to continue, if Tottenham wishes to continue, then we will use every means at our disposal to make sure they do get the message which many in the Jewish community have already told us is unacceptable.
"Fans are there to watch football and we are actually deeply saddened that fans are more concerned with what they chant than, in a sense, the game they are supposed to be watching."
Tottenham came to the defence of their supporters earlier this week, stating that the chants and term "Yid" is not used in a derogatory way.