George Driver was born in Salem, Massachusetts, on May 7, 1805, the son of Stephen, Jr. and Ruth (Metcalf) Driver. After briefly working as a cabinetmaker, Driver entered the family business of shoemaking, joining the house of his oldest brother, Stephen III, as a limited partner in 1827. At this time Stephen Driver's business was a retail store doing only custom work. In 1836 Stephen sold his interest to his brother-in-law, Ebenezer Buswell, and began a wholesale business in boots and shoes. George Driver stayed with Buswell under the name of Driver & Buswell until 1847, when George withdrew to join Stephen's wholesale trade. He remained there, principally as a shoecutter, until Stephen's death in 1867.

George married Mary Pittman (1806-1830) on April 28, 1829; they had no children. On August 12, 1835, Driver married Sophia Derby Field (1805-1870) in Salem. They had three daughters: Sophia Osgood, Ruth Helen, and Sarah Ellen. He died in Salem on April 7, 1887.