Ternan was born aboard a paddle steamer in Delaware Bay, the eldest of three surviving daughters of the actors Thomas Lawless Ternan and Frances Eleanor Ternan (née Jarman); her younger sister Ellen Ternan achieved some notoriety as the mistress of Charles Dickens.