The Delhi High Court has ordered the Congress party to vacate the decades-old Herald House, which belongs to the party's mouthpiece National Herald.