The England international striker was controversially given his marching orders by referee Howard Webb in the game on February 1, after the official deemed he struck opposition defender Chico Flores with his arm.
West Ham saw an initial appeal rejected by the FA, before an independent tribunal upheld that ruling on Friday.
Carroll subsequently served the first game of his three-match ban in the club's 2-0 victory at Aston Villa on Saturday.
And Nolan - who scored both goals in that fixture to add to his brace against Swansea - believes his team-mate has been the victim of an "injustice".
"We have nothing against the FA, they've just got to get it right," the 31-year-old said.
"When people get things wrong, we expect them to hold up their hands and say, 'yeah, I got it wrong' and move on, like we all have to do.
"We have to hold our hands up as footballers when we get it wrong and take the stick that comes with it. I think they had a chance to redeem themselves and they haven't taken it.
"We were disappointed with the outcome. We thought it was an injustice. Andy is also frustrated, he's a good mate of mine and I felt really sorry for him.
"We've got to forget about Andy for the next couple of weeks now. He has to work hard and get himself ready because if we keep winning games it's going to be hard for him to get back into the team."
West Ham have taken seven points from their last three Premier League outings and now sit in 15th place, two points clear of the relegation zone, ahead of their home clash with Norwich City on Tuesday.
Get the best features, fun and footballing frolics straight to your inbox every week.
Thank you for signing up to Four Four Two. You will receive a verification email shortly.
There was a problem. Please refresh the page and try again.