- The Wesleyan Sacred Harp: a Collection of Choice Tunes and Hymns for Prayer Class, and Camp Meetings, Choirs, and Congregational Singing
- The American Hymn And Tune Book: Containing Nearly 1000 Hymns: Adapted To 280 Popular And Useful Tunes, Ancient And Modern
- The Wesleyan Minstrel: A Collection of Hymns and Tunes for the Use of Sunday Schools and Social Worship
- History of Methodism in Providence, Rhode Island, from its Introduction in 1787 to 1867
- Songs of Joy and Gladness (Classic Reprint)