Rangers' first game in the Scottish Third Division against East Stirlingshire sees them leading 2-1 at half-time.
Ally McCoist's side had the worst possible start to life in the lower league, conceding a penalty after just two minutes.
The Shire took full advantage, going a goal up after Quinn slotted the penalty into the back of the net.
A minute later, Rangers flew forward in a bid to find an equaliser and Ian Black came close, crashing the bar with a drive.
The equaliser finally came in the 14th minute after some tidy football in the final third. Andy Little slipped through and cooly slotted the ball past the goalkeeper.
The home side continued to mount the pressure on East Stirlingshire and Fran Sandaza came close after 35 minutes, curling a shot to the far post that was saved well.
Rangers took the lead in the 41st minute thanks to a second goal from Little. A cross from Kirk Broadfoot found the 23-year-old, who headed past the goalkeeper to send the Ibrox crowd wild.
The half-time whistle blew with Rangers deservedly ahead at 2-1.