The Maharashtra Government on Tuesday set up a committee headed by a retired judge of High Court to probe the corruption allegations levelled by former Mumbai Police Commissioner Param Bir Singh against State Home Minister Anil Deshmukh.