I successfully used electronic grade silicone to hold the batteries in place, without resorting to glue, and to add extra sealant to the seals.

iFixit - Including this gasket on the replacement Home Button sure would be a good call. Getting this original off in pristine condition is a chore. Reinstalling it evenly and in position on the new one is even more challenging.