Lord Moynihan has said that the Royal and Ancient Golf Club should start accepting women members.
The Chairman of the British Olympic Association wants the club, which is based at St Andrews, to give equal opportunities to men and women.
Lord Moynihan told BBC Radio 5 Live: "To me, the Royal and Ancient should change.
"It is remarkable that Augusta has changed, but the Royal and Ancient is still there having not entitled and allowed complete equality of opportunity for women in this country.
"Let's get real and let's get on with the job of providing equality of opportunity across sports, sports administration as well as sporting opportunity."
Golf will make its debut as an Olympic sport in Rio in 2016.