Don't let those late-onset balls force you into doing anything. Stick with whatever your preference on trichome condition is.. Generally, if hermie balls come on after week 4-5 or so, there isn't enough time for seed to form. If they're just a few, pick them off for piece of mind maybe... or not. Shouldn't matter at this point.