Brown was born in Dallas in 1927 and attended Texas University (N.T.A.C.) before joining the U.S. Navy, where he served as a radar instructor (ground control approach). After being honorably discharged, Brown worked for his father, who was a candy manufacturer. He later became a contract sales manager for seven furniture factories, with a sales force covering the United States and Canada, in the sale of furniture to hotels, apartments, condos and motels. He retired in 1986.
He was a member of Northridge Presbyterian Church in Dallas and attended the Community Presbyterian Church in Port Aransas.
Brown is survived by his wife, Mary Ann Brown; son, Fisher Brown III; two daughters, Susan Doman and Becky Campbell; three grandsons, Garrett Campbell, Cole Campbell and Scott Doman; and one granddaughter Erin Doman.
Funeral services were held Tuesday, March 22, at Restland Funeral Home and Memorial Park in Dallas.