The entire Swans squad did not wear anti-racism T-shirts ahead of their 2-1 win over Wigan Athletic at the weekend, while a host of other Premier League players, including Manchester United defender Rio Ferdinand, decided to snub the annual tradition.
"I think for the group to wear the T-shirts it has to be a unanimous decision and not everyone wanted to wear them," Wales Online quotes Vorm as saying.
"We are either all together or we're not. Of course, everybody is against racism, but it's not like we wear a T-shirt and then it's gone.
"They have to do something about it. They have to really do something to stop racism, it's not going to change because you wear a shirt."