not at all, some of the nicest grown in tanks i have seen have been full of softies. paul28 has a really nice one (here is a thread of his)

i have had all types of coral myself, and have shifted back towards a mixed reef with lots of softies - i have really enjoyed keeping them again.

got a pic of your tank?