The muzzle climb is primarily due to torque. Yup, the same RxF torque we used to study at 11th standard.
And with any case involving torque, there exist a point of application of force and a point about which the object (in this case the rifle) rotates, both lying in the same plane...