It is possible that just by doing what you did and rejecting the package you drew even more unwanted attention your way. He was probably just doing his job like others have said. It is most likely very uncommon for people to reject mail in their name. I bet the mailman will be rememebering your name now.