Rayleigh Mount is a scheduled ancient monument and as previously mentioned was presented to the National Trust in 1923. It is the site of a celebrated castle most certainly built by Swein of Essex. Excavations in 1959, 1961 and 1969 revealed a sequence of six stages of occupation commencing in the 11th century.

Many interesting items were found during the excavations including medieval pottery, worked metal, and dress fittings. Evidence shows that the castle, either the present motte or bailey, or both, were occupied from c 1070 to the middle of the 14th century. No record appears to be in evidence indicating the deliberate demolition of the castle, although as previously mentioned there is reference to the removal of foundation materials for the repair of the Parish Church.
Entrance to the Mount can be made either from Bellingham Lane, Castle Terrace or Castle Drive. The Mount may be closed for safety reasons during periods of bad weather.