An adaptive modelling technique for estimating an optimal image motion field based on hypothesis testing is proposed. The effect of ill-conditioning is reduced by principal component regression (PCR), followed by the partial F-test to overcome the instability caused by insufficient variation of the image gradient. Experimental results confirm that the proposed method achieves better accuracy compared to the existing nonadaptive image motion model.