The Castertons came from the village of Empingham in Rutland County, England. This lies a few miles west of the villages of Great Casterton and Little Casterton. Presumably the name
comes from association with those villages.
The place name Casterton is a combination of "castra," the
Latin word for "military camps," and "ton," which means
"town." The Romans occupied England from AD 43 to about AD 400;
they most likely had an encampment in the place that became known as Casterton.
Wikipedia entry for Great Casterton, England.

Saints Peter and Paul Church, Great Casterton, England