Sway House on South Sway Lane was owned from 1817 by the Lys family. In 1869 the estate was broken up and sold off in lots. The house was gifted to Captain Frederick Yateman in 1918 but his new bride thought it too big and had a smaller property built not too far away. By the 1930s Sway House was let out to Mr and Mrs Millbank-Watson and became Sway House Hotel, however at the outbreak of the Second World War it was requisitioned for military use.
During the war troops from the Sherwood Foresters were billeted there, and there may even have been anti-aircraft defence within the grounds. It is said that Sway House was haunted and even rumoured that the Sentries always patrolled in twos. In 1946 the house was purchased by Dr and Mrs McNair-Wilson, parents of Patrick McNair-Wilson, the New Forest MP. It has now been converted into flats while the name has been changed to Sway Court