Depends on what u have to work with. Is there any air vent at all in the closet itself? If so, then you can push hot air out that duct with a small fan. If no vent, can you cut a hole in the wall to access your home's hvac ducts?
If no vents and no holes then your closet is always going to be a little warmer than the room it's in, and you have to cool the whole room down low enough for the closet to be no warmer than about 80 f. That means either central ac or a window ac if u want to grow during the warm months of the year.