I think its fine to scrape it off.
As far as eating it, i know sea urchins are known to eat coralline algea and anything else in their way