Now that's what we've been looking for!

Grab the black harness around the battery and pull it directly up and away from the circuit board. The battery will come out with the harness. Take note which way the battery is facing. Pull out the old one and shove in the new. Replace the harness onto the motherboard. Viola!