I checked onelook.com, search terms *mary, *mery, *mory, and *mury, and got:
GEMMARY, n. A receptacle for jewels or gems; a jewel house; jewels or gems, collectively.
GREMORY, in demonology, a strong Duke of Hell that governs twenty-six legions of demons. She tells all things past, present and future, about hidden treasures, and procures the love of women, young and old, but especially maidens. She is depicted as appearing in the form of a beautiful woman with the crown of a duchess tied around her waist, and riding a camel. Other spellings: Gamory, Gemory, Gomory
BLOMERY, n. (Manuf.) A furnace and forge in which wrought iron in the form of blooms is made directly from the ore, or (more rarely) from cast iron.
GRAMARY, magic; enchantment
(NOTE-
http://phrontistery.info/ for obscure words. It's ace.)
NUMMARY, a. Of or relating to coins or money.
FLUMMERY, n, Meaningless or deceptive language; humbug. Any of several soft, sweet, bland foods, such as custard.
BUMMERY, n. See Bottomery. [Obs.] There was a scivener of Wapping brought to hearing for relief against a bummery bond. --R. North.
STEMMERY, n. A large building in which tobacco is stemmed
Also, SUMMARY, PRIMARY, INFIRMARY.
If you want to use an obscure word for the rhyme, try the Dylan trick of using the obscure word for the first appearance of the sound, followed by the obvious rhyme (rather than looking like you forced yourself to resort to an obscure word to finish the rhyme.)