As Hardinder pointed out, Steve Martin apparently was not the first one to come up with the idea to write a song tribute to atheism – or at least to freedom of thought.
Die Gedanken sind frei (Thoughts are free) is a German song believed to have been written in the early 1800s and celebrates the basic right to think for oneself.