Swerford is older than the Domesday Book, in which it is called Surford. At that time it was owned by one of William the Conqueror's henchmen, Robert D'Oily. His rent to the king for the land was a tablecloth, and according to a local guidebook, this could be the origin of the term doily for a small tablecloth.
More information is provided on the West Oxfordshire Conservation Area Character Appraisal document, which, from pages 2-4, gives an excellent description of the character of the village and further information on its history. Click here to see this document.