Rafael Benitez's men fell behind following Iker Muniain's first-half goal, but Higuain's 68th-minute effort ensured honours were even heading into next week's play-off second leg in Spain.
However, the Argentina forward felt his side should have done more and was enraged at the prospect of the club missing out on the competition proper.
"The truth is I don't feel like talking right now," Higuain – who was visibly angered after the final whistle – told Sky Sport Italia.
"Napoli have to play in the Champions League.
"We'll have prepare well for the next match. We have to go there to win and Napoli have to do it.
"We have the team to achieve this."
Winning in Bilbao will be no easy task for the Naples-based Serie A club, with Athletic dropping just two La Liga matches at home last term.
Get the best features, fun and footballing frolics straight to your inbox every week.
Thank you for signing up to Four Four Two. You will receive a verification email shortly.
There was a problem. Please refresh the page and try again.