The scalable extension of High Efficiency Video Coding (SHVC) is now being developed by the Joint Collaborative Team on Video (JCT-VC). In SHVC, the enhancement layer (EL) employs the same coding methods as the base layer (BL) for different color components, namely one luminance (luma) and two chrominance (chroma) color components, which causes heavy computation cost. This paper proposes a fast EL luma and chroma intra coding algorithm for all intra configuration in SHVC. The correlation of prediction modes and transform unit (TU) depth between different color channels from different layers are exploited to simplify the intra prediction process in EL. Experimental results show that approximately 30% and 27% encoding time can be saved in All intra 2x and 1.5x respectively, while the BD-rate degradation are 0.4% and -0.1% compared with SHVC Test Model (SHM) 8.0.