It is only because your caddie gives you the wrong club, a bad plan to approach the hole, the wind is in your face every time, and you get no protection from the trees. Those things are right in your face before you even get all the way to the top of your back swing.
Learn how to make excuses for your terrible golf game. Do not even consider that the trees are a bigger factor for you because you can not hit it long with any accuracy. Do not consider that your caddie advises you to lay up and not be aggressive because your game is limited and he must plan around those limitations. You probably play a lot better at easier courses like the ones in Jacksonville as opposed to the tough courses NY offers. Just take your scores from the easy courses and pretend that is the norm and what you should expect every year going forward. You can be a scratch golfer because you shot well a few times on the soft courses. Ignore everything else.