Exercise extra caution here. Lithium ion batteries can be dangerous if punctured or bent.

Just like the rest of the mouse, the battery is held in entirely by glue. Judicious applications of isopropyl alcohol and Adhesive Remove or more heat from underneath may be necessary to free it.

Get a spudger under the battery and pry it up off the glue.

Pull the charging port out of place.