Sure it's ants? Except leaf cutters, ants don't usually eat vegetation. Actually they're good predators and they aerate the soil. Even if they're crawling all over a plant, it's usually an indication of some other pest like aphids or scales. Most of the time ants are beneficial to outdoor gardens.