Remembered best for establishing a sculpture and folk art-based Georgia museum venue called Paradise Gardens, Finster also designed album covers for the bands Talking Heads and R.E.M.
He began giving sermons in his early teens and, before becoming a full-time artist, served as Pastor of Fort Payne, Alabama's Mount Carmel Baptist Church.
His Paradise Gardens museum contains close to 50,000 sculptures and other works of folk art.
He and his twelve siblings grew up on a farm in Valley Head, Alabama.
His pop art pieces include images of UFOs, war, and singer Elvis Presley.