rhetorical device that uses an ostensible self-contradiction to illustrate a rhetorical point or to reveal a paradox
An oxymoron is a rhetorical device that uses an ostensible self-contradiction to illustrate a rhetorical point or to reveal a paradox.
A more general meaning of "contradiction in terms" is recorded by the OED for 1902.