Vesta is the Roman goddess of hearth and home.  Each city had a public hearth sacred to Vesta where the fire was never allowed to go out.  Of all the Olympians, she is the most upright and most charitable.

Vesta was also the name of a great grandmother of the company's founder.

And we liked the sound of the name.