It would be more beneficial to add a fish or critter that eats bristle worms rather than take a chance on killing you beneficial bacteria by cleaning the rock.
Just my opinion. Same with the sand. Wash in saltwater if you want to keep the beneficial bacteria.