In this letter, we investigate an efficient Gaussian elimination decoding scheme of Raptor codes used over the binary erasure channel. It will be shown that the proposed incremental Gaussian elimination decoding significantly improves on the decoding time over the usual Gaussian elimination decoding while maintaining the same decoding performance.