sounds like fungus gnats. they're common. your options are to a) let your soil dry out really well. they like the moisture. deny that to them and they may go away. or b) you can try pyrethrin, which is an insecticide, and meets the organic standards. or fly paper or gnat stix. a few options...