The League Two outfit controlled the opening 10 minutes, with Chris Hackett looking particularly dangerous.
Jacob Blyth was next to threaten and miss with a scuffed shot after he had twisted and turned on the edge of the box.
Bishop's Stortford were struggling to deal with their opponents, and whenever they cleared the ball, it was soon coming back at them.
However, Stortford nearly stole an unlikely lead with 22 minutes gone. Cliff Akurang put the ball into the box and Sean Francis was unlucky to see his header hit the crossbar.
Kyle Vassell continued the home side's improvement with a turn and shot that went over.
The chances carried on coming for Northampton, though, and Emerton fizzed one wide from long range. Nevertheless, the hosts' performance gradually improved as the first half drew to a close.
The second half saw Northampton finally take their chances, first through Danny Emerton who struck low into the corner, and then through Norris, who finished well.
However, the home side found a way back into the game when captain Reece Prestedge smashed the ball into the top corner.
They came forward after that, but were unable to force an equaliser.