The C.H. Allen House is a Pivotal Structure located at 780 Congress Avenue. It is also known as The Pillars. There is an old gazebo or summer house on the property with an underground basement thought to be a remnant of tunnels that once connected the home to other nearby homes which were used to hide runaway slaves. The Riddle farmhouse, already on the property, was incorporated into the existing house.