Try putting food in there at the bottom for the shrimp to eat. If they shrimp have food then maybe they will not eat your xenia (hopefully).

Also try searching at night for odd looking snails, slugs, or even a spider looking critter. Saw a few hitchikers in my invertebrate book that could be eating them.