Captain Joseph P. Fish was born in Noank, Connecticut on March 1, 1857 and, as a boy, he was exposed to the maritime industry of Noank. In the late 1800's, Fish moved to the Gulf Coast due to the profitable fishing industry, primarily the fishing of Red Snapper. It was during this time that Pensacola became known as the "Red Snapper Capital of the World" with ships bringing in over a million pounds of fish a year.

Capt. Fish contracted the Spanish flu during the worldwide flu pandemic of 1918-1919. At the time, he owned a meat shop at 505 De Villiers Street and a home at 133 Government Street. Shortly after contracting the Spanish flu, Miss Philomene Monroe, an African American seamstress and acquaintance, moved into his home to care for him. Fish died on May 2, 1919 of complications that led to pneumonia. In his Will, he left his home to Miss Monroe who continued to work as a seamstress and lived in the house until her death in 1937. Following Monroe's death, the property passed on to Fish's niece, Mrs. Abbie F. Fish Watrons of Connecticut.