Mushrooms are very resilient. More than likely it is reacting to the glue and stress of being moved. Mushrooms are almost impossible to glue to anyting, they slime way too much. The best thing to do is put rubble in a small cup or dish and place the muchroom in ther and allow it to attach to the rubble. You can then glue the rock to the desired spot.