Yikes, no gloves in that youtube vid, hehe.
I try to scrape off a bit of rock if I can. I cut around the polyps first with an exacto knife (scalpel would probably be better), then slide the blade under the mat and try to slice some rock off with the polyps.
I wear safety glasses too. The mean greens I have love to squirt, and once it nearly nailed me.