Andreas Weimann had scored Villa's first goal in 547 minutes to put them in front in the first half and they looked set to end a run of five consecutive defeats by securing an elusive victory.
The game changed 25 minutes from time, though, when Benteke inexplicably raised his hand into Ryan Mason's face off the ball and was shown a straight red card.
An unmarked Nacer Chadli converted an Erik Lamela corner from close range six minutes from time to draw Mauricio Pochettino's side level at Villa Park.
And Harry Kane's deflected free-kick in the 90th minute rubbed salt into the Villa wounds as Tottenham secured only their second win in eight top-flight games.
It was Kane's ninth goal in 13 appearances across all competitions this season and will lead to more calls for the England Under-21 striker to be given his first Premier League start under Pochettino.
Charles N'Zogbia and Nathan Baker returned to Villa's starting line-up at the expense of Gabriel Agbonlahor and Ciaran Clark.
There were also two changes to the Tottenham side beaten by Newcastle United last weekend, as Roberto Soldado and Kyle Naughton replaced Lamela and Eric Dier, who was ruled out due to illness.
Both sides looked dangerous going forward and Soldado somehow failed to hit the target with a header from close range after Christian Eriksen's shot had deflected into his path.
The lively N'Zogbia then cut the ball back for an unmarked Benteke, who took a touch before unleashing a venomous left-foot strike that rattled the post.
N'Zogbia was the architect, as he surged into the penalty area from the right touchline unchallenged and picked out the onrushing Austrian forward, who slid over the slick turf to finish with his right foot from six yards out.
Referee Neil Swarbrick did brandish a red 65 minutes in, though, as Benteke was punished for raising his hand into Mason's face as tempers frayed.
