Congress today filed a complaint with the Election Commission against Prime Minister Narendra Modi's reported remarks on former Prime Minister Rajiv Gandhi.