The detection and classification of local structures (i.e., edges, corners, an T-junctions) in color images is important for many applications, such as image segmentation, image matching, object recognition, and visual tracking in the fields of image processing and computer vision. In general, those local image structures are detected by differential operators that are commonly restricted to luminance information. However, most of the images recorded today are in color. Therefore, in this chapter, the focus is on the use of color information to detect and classify local image features.