It's probably from spores that have made it to the moist fabric and stuck there. The moist wood chips and leaves on the ground are prime real estate for mushrooms. I'd just make sure that water is draining well and that the pots are off the ground. If the plant(s) is/are growing well, then if it ain't broke, don't fix it (as they say).