Since I don't want to get in there again, I put this extra retaining screw and washers (there is a spacing washer underneath the washer you can see here) in place to make it impossible for that spring loaded button to come out again. I think this was an M4 screw, with a hole tapped all the way through, and the washer cut to fit as it does.