Swan's Island is an island town in Hancock County, Maine, United States. It is named after Colonel James Swan of Fife, Scotland, who purchased this island and some surrounding areas and organized their colonization in the 18th century. The population was 332 at the 2010 census. The town is accessible by ferry from Bass Harbor.