The canting use of this word came in with the Elizabethan Puritans. See examples 1574, 1592, 1594, 1604, &c., N.E.D.
1808. [Governor Sullivan] was fervent in his devotional exercises.—Mass. Spy, Dec. 14.
1810. There was a sermon at the Meetinghouse, and after the Exercise the Ladies met at Mr. G.’s house.—Id., Aug. 1.
1830. The exercises [at an Anti-masonic meeting] will commence at eleven o’clock.—Id., June 23.
