In this paper, we describe a method for estimating and compensating 3D camera motion in image sequences for the applications to the video coding system. To improve the estimation accuracy of the global motion parameter, we propose a robust algorithm which selects the reliable observation points adaptively and eliminates the bad observation points effectively. Unlike the existing linear recursive algorithms with an arbitrary thresholding, the proposed algorithm converges fast and is robust to feature matching error. Experimental results show that the proposed method improves the coding efficiency and reduces the computation time.