I would think only if rust develops or if something is stuck to it would it be likely to scratch the glass.
I can't imagine what a pain it would be with a plastic scraper thingy!