Geez, it's just a plant. Get a bigger pot of dirt. Put the smaller pot in the dirt and pull out, that will leave the perfect hole. Remove whole pot together and put into hole.
If your plant has outgrown its pot make sure it is not root bound , wen you take it out of the 4" make sure the roots are loose and not in a tight ball , be genital with them .