Yes, once dry it is just rock.

Holey rock is very common around here and looks great in chiclid tanks. I have some large tank ready pieces if you are interested.