“Would they not fear that citizens not less tenacious than conscious of their rights would flock from the remotest extremes of their respective states to the places of election, to overthrow their tyrants, and to substitute men who would be disposed to avenge the violated majesty of the people?”