One. The stress on KLEM is strong enough to invite a doubled m, the way it is doubled in lemming or in summit. But the doubling convention marks a short vowel in a native English word, and this is a French given name that English took whole. Clément has one m and so does the fruit.