The Bundesliga outfit are on a run of one win in 13 matches in the league, although that victory was a thumping 5-0 triumph over Paderborn.
That sequence has seen Mainz slip to 14th in the top flight, one point clear of the relegation zone, and a 4-2 defeat at fellow strugglers Borussia Dortmund on Friday turned out to be the final straw.
Under-23 coach Martin Schmidt has stepped into the void left by Dane Hjulmand and will take training on Tuesday.
Mainz finished seventh under Thomas Tuchel last season, but struggled to replicate that form following the arrival of Hjulmand from Nordsjaelland in May.
Mainz next face Eintracht Frankfurt on Saturday.
‘Maybe I’ll be signed by Wrexham, who knows? English football would suit me – if an offer came, I wouldn’t think twice, I’d go immediately’ Euro 2024 cult hero reveals his UK dream
‘Managing Leeds? It was an option that appeared, but it wasn’t the right timing. I decided it wasn’t a good idea to leave the club I was at mid-season’: Premier League boss admits to turning down opportunity to replace Jesse Marsch in 2023
