Villa's vulnerability defending set pieces was exposed again at the weekend as Peter Odemwingie netted a late equaliser for West Bromwich Ablion, after Gareth McAuley had won the initial header from Chris Brunt's corner.
"It does drive you mad," said Lambert. "It's not rocket science. You go man for man. If it's your man who scores, then we know who was supposed to pick them up.
"If you're up against an opponent, you just have to make sure that you go and put your head on it.
"Is it a mental thing? I'm not sure why it is. It's just a bog-standard ball into the box [for Odemwingie's equaliser].
"We saw it against Bradford. We have to make sure we get a head on the ball. Does it drive me potty? Yes, it does."
Villa have conceded more goals than any other team in the Premier League this season.