Once the batteries have been removed, you can check to see if they have any charge left in them with a battery tester.

If they are in fact dead, replace them with standard AA type batteries in the correct orientation.