Digital images and videos are used in many digital devices recently. Also, the resolution of display became larger than that of previous years. Image up-scaling algorithm is important issue since original input source is limited in transferring within data bandwidth. Among various up-scaling algorithms, Super-Resolution (SR) image reconstruction method is able to estimate high-resolution (HR) image using multiple low-resolution (LR) images. Conventional approaches to estimate HR image with Least Square (LS) method and Weighted Least Square (WLS) method are not able to reconstruct high-frequency region effectively in case its blur kernel is assumed Gaussian kernel in unknown system. Also, these methods produce jagging artifacts from the deficiency of LR frames. The proposed SR algorithm uses edge adaptive WLS method to reconstruct high-frequency region considering local properties and is applied to video sequence with block process to cope with local motions. Moreover, to apply video sequence with complex motions, we use selectively the correct information of reference frame to avoid errors from incorrect information. For accurate additional information from reference frames, the proposed algorithm determines additional information in reference frame by comparing with current frame and reference frame. The experiments demonstrate the superior performance of the proposed algorithm.