Abdul Mahdi said he would submit a new list of ministers to parliament next week for approval.
The move was the latest attempt to appease protesters, who called for the removal of the government and a political class it views as corrupt, during a week of bloody protests.
At least 110 people were killed and more than 6,000 wounded in the capital and the south in a violent crackdown by security forces.