Some years, I had to harvest because of snow. Flowers are pretty touhg, the other question is, how they can mature in such weather.
Look carefully for their condition.
This year, september is so shity. Raining almost everyday and temps were 6°C this morning. All my friends doing outdoor are desperate. I gave up autumn, doing light deprivation and harvesting in august.