The Ye Olde Pepper Companie is located across the street from the House of Seven Gables. You would most likely be coming from the downtown area, so you would walk down Derby Street until you arrive at the Ye Olde Pepper Companie on your left. The tour meets outside of the Ye Olde Pepper Companie.
The tour ends outside of the Kakawa Chocolate House, which is right in the heart of the downtown area.