Spurs are currently third in the Premier League and have gone unbeaten in their last 11 games, winning 10, and taking 31 points from a possible 33.
Kaboul and club captain Ledley King have been imperious at the heart of the Spurs defence in recent weeks, forming a superb partnership that has provided the backbone for their rise up the table.
"It's a great achievement of course, but me and the lads are not looking at where we are now, we're looking at May," he said.
"The most important thing is to see what's going to happen at the end of the season.
"If we're second or third now and then we finish fifth or sixth in May then it will be disappointing for us, so we'll concentrate and focus on winning every game now."
Harry Redknapp’s side travel to Stoke City on Sunday in a game that will see a number of Spurs players come up against former colleagues Wilson Palacios and Peter Crouch.
"It's always nice to play against players that you've played with and he's going to be very tough for us on Sunday, but we have to go there and take the three points."
