You're not wrong thinking that. There are many growers who falsely believe that removing fan leaves to get the budsites more light is actually beneficial. By removing fan leaves, you're completely reducing the amount of energy the plant can produce, and therefore, stunt growth and bud formation.