I found the conversation of religion in the early U.S. fascinating. Much of it I knew from my readings over the years, but for example I would have said MA did away with its "state church" in 1850 rather than 1833. Of course it was a mess long before that with the Unitarian - Trinitarian split -- and ironically today the congregational church is part of the liberal UCC.
Jefferson, according to Jon Meacham's recent biography did believe in the afterlife, and continued to know his Episcopal prayer book, in spite of his unitarian stance.
I think that Washington was sworn in on a Masonic bible, not sure how it differs from standard Genesis - Revelation bible.
States differed in their religion in the public schools. KY for example required Bible reading every morning. OH simply allowed some type of devotional to begin the school day.
My personal stance is for complete separation of religion from the public sphere -- more to keep the various religious institutions pure than anything else. "Civil religion" as practiced in the U.S. is a mile wide and an inch deep.
More information about text formats