I tore mine to shreds, but luckily there are tons of 3ds xl rubber screw cover replacements online super cheap. I couldn't get the shiny silver part up but my screwdriver head poked through it easy enough and I just brought it up with the screw itself. DEF don't use anything too sharp with this if you're afraid of damaging the face plate because the grip slips sooo easily here.
I was able to remove mine that were being very difficult with some dull tweezers. I used dull ones because I didn't want to scratch anything. First I wedged it between the plastic and the bumper, wiggled it a tiny bit, pulled it out, wedged it again in another spot and continued this until I got it out with my fingernail. Neither the bumper nor my shell were damaged.