Not to speak of. This is perhaps American.
1816. We shall have no bed in the housefor Charles himselflet alone Henry.Jane Austen, Letters (1884), ii. 263. (N.E.D.)
1825. I wont be tumbled about, by any body; thats what I wontlet alone a Yankee.John Neal, Brother Jonathan, i. 185.
1842. Mr. Wise did not profess to be a man of any taste at all, let alone a man of exquisite taste and judgment in the fine arts.House of Repr., May 11: Cong. Globe, p. 491.