'arch-' originates from Greek, specifically the element 'arkh-'/'arkhos', where 'arkhos' meant 'chief' or 'leader'; 'criminal' originates from Latin 'criminalis', from 'crimen' meaning 'charge' or 'accusation'.

'arch-' entered English as a combining form via Medieval Latin and Old French and appears in compounds such as 'arch-enemy'; 'criminal' came into English from Old French 'criminal' and Latin 'criminalis'; the modern compound 'arch-criminal' developed in English by combining these elements to mean a chief or foremost criminal.

Initially it meant 'the principal or foremost criminal'; over time the usage has remained similar but is sometimes used more emphatically or figuratively to denote the most notorious offender.