Second-half goals from Fabian Delph and Scott Sinclair secured a semi-final trip to Wembley for the hosts on the back of a 2-1 win over West Brom in the Premier League during midweek.
But the closing stages of the Villa Park contest were marred by a group of Villa fans entering the field of play and a mass pitch invasion followed
Pulis told BBC Sport: "It's disgraceful. We don't want to see those scenes. They've beaten us and for that to happen, that's just mindless idiots.
"If you're Villa, you need to look at the stewards as they came over to our fans and there was nobody there."
"I don't know why Jack Grealish was sent off, but I cannot understand why Claudio Yacob was sent off," Pulis said.
"That's a block tackle, something you're taught at five years of age. The referee lets it run on for a few seconds and the disappointing thing is it's two yellows and we can't appeal it. That's going to cost us again when he misses the game against Stoke.
"The referee says Yacob's jumped in to that challenge, but there's enough people moaning about refs without me going on too much."
"We switched off from a throw-in deep in their half of the pitch," he added
"There's two or three things that happened in that movement, which haven't happened since I've been here.
"Up to that point, I thought we were well in control of the game. We've had our chances and not taken them."
