Lavender from seed is a pain in the balls for sure. Did you stratify the seed? That helps a little. Also depends on where you got the seeds. if they were from a box store, hardware or supermarket etc, they were likely sitting on the shelf in a very subpar environment for weeks, or even months...