Town of Lafayette is a civil located in Walworth County, Wisconsin. It appears on the Springfield USGS 7.5-minute topographic quadrangle. The elevation at this location is approximately 905.51 feet (276.00 m) above sea level. The nearest populated place is Bowers, approximately 2.5 miles to the SE.