Albert Cadwallader was born in Milton, Pennsylvania on October 11, 1841. He was the son of Seth Cadwallader and Elizabeth Hammond, who married on February 3, 1824.
During the Civil War, Albert enlisted in Company A of the Third Pennsylvania Militia. He later was appointed agent for the United States Sanitary Commission to distribute supplies to sick and wounded soldiers at the front.
Albert's father, Seth Cadwallader, was engaged in the mercantile business in Milton from 1812 to 1854, when he retired. He was a prosperous merchant. Albert was engaged in the grocery and provision business in Milton until 1879, succeeding his father. After the great Milton fire, he conducted a grocery business in the Cadwallader Block on Broadway for some years. In 1910 he built the Milton Realty building on the corner of Broadway and Front Street.
Albert Cadwallader married Annie Louisa Supplee on October 20, 1868 in Germantown, PA. Albert and Annie had eight children.