The 29-year-old is thought to have been targeted by West Ham United last summer and Queens Park Rangers in January respectively, but the Sweden international has claimed that he is "happy" at The Hawthorns.
"I made it quite clear in October that I feel for the club and I'm happy here," London 24 quotes Olsson as saying.
"I've got another three years on my contract. It's always important to have dreams you want to [fulfil]
"I said in the past that at some point in my career I would like to play for a London club. But I'm almost 30 and that's not a big age for a centre-half. Hopefully I have a lot of years ahead. I am not in a rush."
Olsson signed a new four-year contract in October.