Many image segmentation techniques are available in the literature. One of the most popular techniques is region growing. Research on region growing, however, has focused primarily on the design of feature extraction and on growing and merging criterion. Most of these methods have an inherent dependence on the order in which the points and regions are examined. This weakness implies that a desired segmented result is sensitive to the selection of the initial growing points and prone to over-segmentation. This paper presents a novel framework for avoiding anomalies like over-segmentation. In this article, we have proposed an edge preserving segmentation technique for segmenting aerial images. The approach implicates the preservation of edges prior to segmentation of images, thereby detecting even the feeble discontinuities. The proposed scheme is tested on two challenging aerial images. Its effectiveness is provided by comparing its results with those of the state-of-the-art techniques and the results are found to be better.