The Hornets, who currently sit third in the Championship table, appear to be locked in a battle with Hull City for the second automatic promotion place behind leaders Cardiff City.
Following successive defeats, the club have picked up four points from their last two matches, with the former Arsenal goalkeeper issuing a rallying cry.
"We have shown we can face any team, we can beat any team, and we are a very solid team with quality, with strength, with many positive things," he told the club's official website.
"We cannot be scared about being at the top, it's a beautiful thing. We've been working very hard during the whole season and we deserve to be where we are. It's a good moment for the club but we have to take it naturally.
"We don't have to put unnecessary pressure on our shoulders, this is what we've been fighting for all year and we have to enjoy it, but always focusing on our work."
Almunia has recently returned from a hamstring injury.