The property changed hands once more in the 16th century when, again through marriage, the Manners family took hold of Haddon. In 1703 the Manners became Duke and Duchess of Rutland. They chose to make their primary home in the spectacular Belvoir Castle in Leicestershire so left Haddon house unused. As a result, Haddon Hall stood abandoned and neglected for more than 200 years, between 1702 and 1920.