After Modi's statement, leader of Congress Mallikarjun Kharge said the opposition wanted to know why such a thing happened.
"We are not against any individual" nor their background but the issue is that many BJP leaders have been making controversial statements, he said.
Such statements are creating a situation in the country where social unity is threatened, he said and wanted to know what action government is taking in this regard.
While opposition members continued to agitate after the Prime Minister's statement, Speaker Sumitra Mahajan said the protests have to stop.
E Ahamed (IUMl) was heard saying that the government was not listening to the opposition.
Soon, members from Congress, left parties, IUMl, BSP and AAP staged a walk out.