Downsville is an unincorporated census-designated place in the town of Dunn, in Dunn County, Wisconsin, United States. The community was founded at a crossing of the Red Cedar River in 1855. As of the 2010 census, its population was 146.The Empire in Pine Museum is located in Downsville. About 3 miles south of the community lies the girlhood home of Caddie Woodlawn, preserved at the Caddie Woodlawn Park.