Unless it is killing stuff, sponge is a very good water filter. I would leave it, unless it is bad!