After taking the lead and creating a host of other chances, the visitors were made to hang on at the end as Columbus looked to follow their late equaliser with a winner.
Philadelphia put their hosts under pressure from the kickoff, forcing several early corners. They almost scored from one in the fourth minute, but Amobi Okugo missed the target with a free header.
They continued to miss good chances throughout the first half, but on 34 minutes they finally made the breakthrough. Danny Cruz played in Jack McInerney, and the striker made no mistake from just inside the box.
After being put clean through, Dominic Oduro missed a good chance to get Columbus level five minutes later, and the home side went in behind at the break.
The second half began in scrappy fashion, with both teams giving the ball away, before the home side gained their composure and took control.
Their pressure told with 20 minutes to go when Gaven delicately put the ball through for Oduro, who smashed it into the top corner from the middle of the penalty area.
Ten minutes later they could have been ahead when Oduro's cross found the head of Josh Williams. However, the defender could only watch as his effort bounced back off the crossbar.
They were unable to find a winner in the final minutes, though, and the two teams remain in the playoff positions.