It sounds like he's just pushing the boundaries and you will have to continue being very firm with him.
I would stop hand feeding him entirely. If you want to give him a treat, put it in a dish and offer it that way. If you need to, safely tether him somewhere or put him in a separate pen when you're putting out hay, grain, etc. That way, he can't take advantage of you by being bad while you have your hands full and are unable to correct him.
Do you have an older goat that wouldn't let him push them around? You obviously don't want him to get injured or kept entirely from eating. But an older goat could help teach him his manners.
I would stop hand feeding him entirely. If you want to give him a treat, put it in a dish and offer it that way. If you need to, safely tether him somewhere or put him in a separate pen when you're putting out hay, grain, etc. That way, he can't take advantage of you by being bad while you have your hands full and are unable to correct him.
Do you have an older goat that wouldn't let him push them around? You obviously don't want him to get injured or kept entirely from eating. But an older goat could help teach him his manners.