The color filter array (CFA) sensor is widely used in many consumer electronics, including digital still cameras, digital camcorders, and mobile phones. The sensor with CFA produces sampled color images, which are first interpolated to produce full color images. These full color images or videos are encoded using compression technologies. Since the interpolation process increases the data size by 50∼100%, it may not be efficient to encode the interpolated images with larger sizes than the original sampled color images. In this paper, we propose to encode video sequences with sampled colors without interpolation to improve coding efficiency. Preliminary experiments show that improvement was observed in certain cases.