You will hear both from gardeners, and the split goes back to what happened to the Latin digraph. Classical Latin said ae as a diphthong, closer to the vowel in aisle; later Latin flattened it, and English scientific Latin flattened it further to ee. Someone writing elayagnus has heard a speaker using the older value. Neither pronunciation changes the letters.