The warm and versatile honey colour of the older buildings is due to construction using the local Bargate stone, which is relatively rare and high in iron oxide.  Godalming still retains evidence of early mediaeval Bargate quarries

More Info:

• Wikipedia