Well, in general, seeds harvested before four weeks after pollenization will have a low viability rate.
So you'll need to wait at least four weeks. Five weeks is better, and six is better yet.
Its also perfectly reasonable to harvest the seeds at the same time as you harvest the buds.