Without apology or ceremony. Ray (ed. 1813) has “To handle without mittens.”

1

1828.  The Baltimore Republican handles Mr. C[lay] with gloves off.Richmond Enquirer, May 20, p. 3/4.

2

1892.  The prophets and practitioners of the naturalistic school … are here handled without gloves.The Nation (N.Y.), May 5, p. 345/2. (N.E.D.)

3