"Your great great grandfather was once the richest man in Boston."