Town of Caswell is a civil located in Forest County, Wisconsin. It appears on the Newald USGS 7.5-minute topographic quadrangle. The elevation at this location is approximately 1,496.06 feet (456.00 m) above sea level. The nearest populated place is Cavour, approximately 2.5 miles to the ESE.