Pardew's men were undone by a header from Olivier Giroud 20 minutes into the second half at St James' Park, the France international capitalising on poor marking from the hosts to glance home Theo Walcott's free-kick.
Newcastle were unable to break down the Arsenal defence despite going close on a number of occasions, and Pardew felt that his side were unfortunate not to have claimed a share of the spoils.
"I'm disappointed for the players and our fans because I don't think we've done much wrong to get a defeat against our name," he said.
"My overall feeling is that we've come out the wrong side. A few things went against us in terms of decisions and that was probably the difference.
"It's just frustrating a little bit that we've not got something on the scoreboard in terms of a point, no more than that, where one set play where we didn't defend has cost us and we've been good at them all year."
"It was a really tight game, a really interesting game," he added.
"A lot of my players can take massive credit from the way they've played in that game - we had some outstanding performances, unfortunately we have nothing to show for it.
"But our confidence has perhaps even improved I would suggest, certainly on reflection the players will feel that."
