Leave these plants alone, they are not very strong ones, and you will later decide what to do with smaller buds, which are no use if you have smaller quantities.
It is really hard to say, what is direct influence of cutting small branches and what amount of hard buds you get instead of some more little ones. I have heard specialists, that are sure removing leaves and smaller branches make better yield. But it is true that their plants are perfectly grown and perfectly grown plants can stand much, much more troubles as sick ones.
I always cut smaller branches, because there is growth everywere down. Tomorrow I will manicure them modestly again. If I cut them earlier, I affect plant more in earlier stages, but there is less material to cut off. Decisions are always hard. Mostly I let them grow and then, when I imagine that small buds down there, which I throw away, I cut some branches and pull out some smaller grow.
What I do now is maybe not the most productive way, but small buds make me nervous and I do not want to see many. And I used to have mould on top of soil, so I like down area of plant to be more airy.
My advice is to wait and see what disturbs you and act next time.