IIRC, they are held on with little metal tabs bent over like an envelope clasp. But CharlieFoxtrot is right, they can be removed and recovered if you remove the entire door panel.
As long as you're doing all this, and it sounds very nice, you might consider having your leather insert pieces custom embroidered with whatever trips yer trigger. A personalized touch.