The league leaders left Upton Park with the points after Steven Gerrard converted a penalty in each half to keep their title challenge on track.
Although Allardyce had few complaints with the call to penalise James Tomkins for handball in the first instance, he questioned referee Anthony Taylor's judgement in punishing Adrian for a 70th-minute challenge on Jon Flanagan - with television replays confirming that the West Ham goalkeeper had got a touch on the ball first.
The home boss also conceded his side got some luck on Guy Demel's equaliser in first-half stoppage time, when Liverpool goalkeeper Simon Mignolet dropped Mark Noble's corner under a robust challenge from Andy Carroll.
"Unfortunately we are talking about the officials and not the game,” Allardyce told Sky Sports. "We took the game to Liverpool whenever we could and really tested them.
"There were fouls given by the referee when he was 60 yards away; the second penalty was not a penalty, Adrian plays the ball. Controversially, we are talking about the referee and the effect he had on the game.
"He made big mistakes in the game. He thinks Adrian hasn't played the ball and he has. He has to be 100 per cent certain. He was in a bad position but gave it.
"It looked like Andy Carroll fouled the goalkeeper for our goal but we got it. We don't want that, nobody wants that. My real concern is that we are talking about referees every week.
"We don't have enough quality referees. They try their best but something has to be done about it."
