Not to speak of. This is perhaps American.

1

1816.  We shall have no bed in the house—for Charles himself—let alone Henry.—Jane Austen, ‘Letters’ (1884), ii. 263. (N.E.D.)

2

1825.  I won’t be tumbled about, by any body; that’s what I wont—let alone a Yankee.—John Neal, ‘Brother Jonathan,’ i. 185.

3

1842.  Mr. Wise did not profess to be a man of any taste at all, let alone a man of exquisite taste and judgment in the fine arts.—House of Repr., May 11: Cong. Globe, p. 491.

4