Just don't over do it. I see alot that defoliates in week 1 and 3 of flower. I pick a handful whenever I think they need it (if it's blocking a flower site from light, yellow, etc,,)
It’s fine, as long as you do it in moderation. Remove the big leaves blocking light only. The rest propel growth. Don’t overdo it. I defoliate all throughout flowering.