The limekilns at Scarlett Point on the west side of Castletown Bay date from 1808. These kilns have been extended at some time in their history and would have served local demand. The Carboniferous limestone is exposed in a fairly extensive quarry behind the kilns. Coal would have been brought in by sea and offloaded across the beach or on a stone jetty of which there are some remains.

By 1901 the kilns were already disused and proposals were being made for their infilling.