This house has suffered through several extensive fires since Oliver S. Lovell first began building the house. For a while, Judge John L. Minor was the owner and he was followed by Dr. Alfred Shepherd who greatly enlarged the house. Dr. Shepherd practiced in the Village and was considered an authority on Asiatic Cholera.