Actually, that's not too bad of an idea to do that. Because once your plants start flowering they will become prone to more and more things, like bud mold if it rains too much on them. And also bugs and rodents will try to eat your crop.
But bringing them inside will surely eliminate these...