Yes, I had that with the first of my two pieces of wood - I gave it a scrub during every water change regime with an unused toothbrush bought specifically for fishtank cleaning purposes but it eventually disappeared of its own accord after 6-8 weeks. With the second piece of wood, I kept it in a bucket of boiling water which I kept topping up with more boiling water for the first day or two, and didn't have any white fluffy stuff on it.