Before that, David Healy had given Sunderland an early lead on seven minutes before Aaron Mokoena equalised 30 minutes later with his first goal in almost two years.
That makes it nine games unbeaten since Allardyce took charge, but Rovers are still in trouble when it comes to the league, and that is something that the boss wants to alter quickly.
He said: "I want us to build on this victory and keep that winning habit. Let's go on from here.
"Of course it will be very difficult against Villa but we are growing in confidence. There is a lot of quality in our squad.
"Hopefully we can give them a hard game and come out of it with something to show for our efforts."
On Benni McCarthy, Allardyce added: "Benni has started a few games and got a few goals in the process.
"He had been frustrated at his lack of starts.
"But it is difficult with three quality front men. I am really pleased about the creativity in the team but a little bit disappointed we are not scoring more."