Possibly the gun OP, but likely considering the fact that you think it's tough to hold on to, it's most likely moving on you because of your grip/anticipation...
I own the 9 and just shoot the. 45 last week and it really
want that big of a deal and def not inaccurate.