Only negative with the bigger calibres is that the recoil is such that you loose your target in the sight picture in the scope, therefore you never get to see the splat! In my experience anything larger than .22-250 will be a problem unless you keep your scope magnification below about 8x.
Bookmarks