The Reds are currently in 17th, seven points ahead of the Millers, who occupy the final spot in the bottom three in 22nd.
Forest continued their push away from danger on Saturday as they won 1-0 against Blackburn Rovers courtesy of teenager Alex Mighten's first-half deflected strike, with Brice Samba saving a penalty from Adam Armstrong after the break to keep the three points intact.
The result means that Chris Hughton's side have lost just twice in their last 13 league games, and the threat of dropping into League One now seems a faint one.
The Reds may be able to put their fears to bed in the next week with this game against Rotherham and then a trip to East Midlands rivals Derby County, who are currently two points behind them in 19th.
Forest have the best defensive record in the bottom half, having conceded 31 goals in 31 games but have tended to struggle at the other end, with only five clubs scoring fewer goals.
Hughton's team lost 1-0 to Swansea City in their last away game but that brought to an end three successive victories on the road in the league; prior to that, the Reds had won only one of their first 11 away games of the campaign.
Forest have never actually won at the New York Stadium in four attempts since it opened in 2012, last winning away at Rotherham in 2002.
Despite that statistic, the Millers have only won once in the last 25 meetings between the two sides, and this season's reverse fixture finished 1-1 in October.
Paul Warne's men currently find themselves on a run of three successive defeats, which has left them back in the relegation zone and two points adrift of safety following Birmingham City's win over Sheffield Wednesday on Saturday.
Rotherham themselves were beaten 1-0 by league leaders Norwich City, but it was by no means comfortable for the league leaders as the Millers had a Clark Robertson goal ruled out while Ben Wiles hit the bar.
It was their second successive narrow defeat to a top-six side after they lost by the same scoreline to Bournemouth three days earlier, and Warne will take confidence from his side's performances against strong opposition.
Rotherham have won just one of their last five games at the New York Stadium, while only Birmingham City have conceded more goals at home in the Championship this season.
Rotherham United Championship form: LWWLLL
Nottingham Forest Championship form: DWWDLW
After two demanding away trips in the space of four days, Warne may look to freshen his side up on Tuesday night. Players such as Richard Wood, Matthew Olosunde and Freddie Ladapo may be handed spots in the XI after starting on the bench against Norwich on Saturday.
Matt Crooks suffered an ankle knock in the defeat at Carrow Road, but Warne is hopeful that the makeshift striker will be fit to play.
Lewis Grabban missed Forest's win over Blackburn with a hamstring problem, while Lyle Taylor appeared to be holding his back towards the end of the game, leaving Glenn Murray as the likely option to start upfront for the Reds.
Ryan Yates made his return from a month-long calf injury as a substitute on Saturday and could now start at the New York Stadium. Mighten's goal on his first start for a month, meanwhile, should ensure he keeps his place on the left wing over Luke Freeman.
Rotherham United possible starting lineup:
Johansson; Wood, Ihiekwe, Robertson; Olosunde, Wing, Sadlier, Wiles, Giles; Ladapo, Smith
Nottingham Forest possible starting lineup:
Samba; Christie, Figueiredo, Worrall, Ribeiro; Garner, Yates; Knockaert, Krovinovic, Mighten; Murray
We say: Rotherham United 0-1 Nottingham Forest
The busy Championship schedule is beginning to take its toll on Rotherham's small squad again and this could be a tricky evening for them. Forest are finding their rhythm and growing in confidence by the game so we are backing the visitors to take all three points.