Peter Odemwingie scored twice to lift West Brom up to fifth place as they inflicted Saints' eighth defeat in 10 league games since their promotion from the Championship.
"Someone is always going to be the favourite to be sacked," Adkins told reporters. "If you're bottom of the league, you should be the favourite probably.
"I'm very positive though. I know I'm a better manager today than when I joined Southampton."
Southampton have collected four out of a possible 30 points, have lost all five away games, conceded 28 goals, are five points behind 17th-placed Aston Villa and are set for a long battle against an immediate return to the second tier.
"If I don't believe we can do it, then the players aren't going to believe we can do it," said Adkins, whose team have not played all that badly but have not had the breaks.
Adkins, 47, took over at Southampton two years ago and has led the side to two successive promotions.
They host Swansea City on Saturday before travelling to Loftus Road to face fellow strugglers Queens Park Rangers on November 17 ahead of matches against Newcastle United and Norwich City.
‘Arteta, Alonso, Emery, me… none of us were physical players – we needed the understanding of the game. That probably helped us move into management’: Premier League boss reveals reasons for natural career progression
‘England have the players to win the World Cup – it’ll be tough for Thomas Tuchel to do a bad job, with the squad he has at his disposal’ Former Three Lions winger backs new boss after gentle qualifying draw
