I have been hand-loading for almost forty years. In MOST rifles (but not all), changing the load recipe changes the point of aim, and sometimes VERY dramatically. Even with the same case, primer, and powder type, a change of bullet weight and/or powder charge will change things in most guns.
So I think everything is normal for the first poster, if he or she found consistency within a lot of loaded ammo. This is why a lot of folks keep pretty good data on what they have tried, and when they hit that sweet load or loads that THAT RIFLE shoots, they scream "Hallelujah!" One of the biggest joys of handloading, actually.............
Doug