Even when I rinse old sand I still get some of the detritus layer you mentioned. Just imagine if you had not rinsed it. It has always taken about 4 days for the "dust" to settle out of the water for me.