The Ravens dominated the NFC South side as they shut down Matt Ryan's offense for the majority of the match in a 29-7 victory at M&T Bank Stadium, moving two games clear of the Cincinnati Bengals at the top of the AFC North.
"It's good to be there at this time," Harbaugh said, according to ESPN. "But you have to build on it, you have to keep getting better.
"We're not a good enough team to do the things that we want to do right now, so we have to keep improving."
Harbaugh's side face the Bengals in their week eight clash on Sunday.