They say a gallon of soil for every foot of growth. I would highly reccomend the 5 gal. size. More forgiving, and the roots can spread out more. Marijuana loves the space.Bigger is better but a 3 or 5 gallon container can support quite a large plant.
If space isn't a problem I'd use the 5.