Slovakia are bottom of the group with one point but could still qualify for the second round if they beat the Azzurri and New Zealand take no more than a point against Paraguay.
"We will do everything to get through. We want to be bold but we have to be rational because our opponents are the world champions," Weiss told a news conference on Wednesday.
"All the players are fit and in good physical condition but there will be some changes in tomorrow's lineup."
Slovakia only had one shot on target in Sunday's 2-0 loss to Paraguay so the nippy Miroslav Stoch, back after injury, could come in against faltering Italy at Johannesburg's Ellis Park.
"In his first two matches he did not reach his and my expectations. Tomorrow he can shine just like he does in the Italian league," Weiss said.
"We want to surprise them with our boldness."
"I'm sorry for what happened, sorry for our relationship at the moment," he said.
He added that he worked in football to make people happy while some in the media work to make people sad.
Weiss had earlier been in a much friendlier mood than in previous days at Slovakia's final training session in Pretoria.
"(Don't write about it being) a catastrophe or a shame. Maybe acknowledge that there are some big teams like France who are already at home," he said.
