Columbus Day is a federal holiday and is observed as such by all federal government, and banks.
Columbus Day became an official state holiday in Colorado in 1905 and later became a federal holiday in 1934. People have celebrated Columbus voyage since the colonial era. It makes for an unexpected fall holiday closure for most state, and federal governments, and it always seems to sneak up on us unnoticed.
Some people would like to remove Columbus Day from its status as a federal holiday because of racial reasons although it has never gained much backing from members of Congress. In the mean time it's another day that many kids get off of school, and many employees get counted as a holiday to enjoy the fall weather.