Swansea City full-back Taylor has been ruled out for the season after suffering a fractured ankle against Sunderland.
Key forward Bellamy is also sidelined after tearing a calf muscle in Cardiff City's win over Wolverhampton Wanderers.
Brighton midfielder Crofts completes the trio on the treatment table with an ankle problem.
Coleman has been forced to add veteran striker Rob Earnshaw to his squad for their 2014 qualifying double header.
Wales host Belgium on Friday, September 7 before facing a daunting trip to Serbia the following Tuesday.