Economic Freedom Fighters (EFF) MPs were physically removed from the National Assembly on Wednesday after they refused to let President Jacob Zuma speak.

Parliament could allow an illegitimate president to speak in the House, EFF chief whip Floyd Shivambu said on Wednesday, a demand that eventually led to their forced removal.

Zuma was due to give his budget vote in the National Assembly, but it got off to a slow start when the EFF called for debate on him being allowed to speak.

The EFF said there was evidence that the president had not respected the Constitution.

The EFF's Godrich Gardee said they had written a letter to the speaker, calling for Zuma not to be allowed to speak.

Speaker Baleka Mbete refused their request to debate the matter.

EFF MP Mbuyiseni Ndlozi said they had not asked Zuma to "break the law".

"We are going to debate giving him money today, when he is facing over 700 charges of corruption," he said.

All EFF MPs shouted over the microphones that Zuma should not be allowed to speak, and were all asked to leave.

The Parliament protection services were called in, which resulted in physical scuffles between them and EFF MPs.

Chairs, and desk were shifted as Gardee and Ndlozi had to be physically lifted and removed.

The Democratic Alliance called for Zuma to apologise to the nation.