Columbia County is a county located in the U.S. state of Wisconsin. As of the 2010 census, the population was 56,833. Its county seat and largest city is Portage. The county was created in 1846. At the time, it was in the Wisconsin Territory.