One of the main features of The Language Grid is its support for service composition, i.e. creating new language services that meet user requirements by combining the existing ones. Despite the potential of service composition, such a service-oriented computing (SOC) application may experience cascading failure when a disruption on one or more component services is propagated to the composite services that combine them. As the number of language services grows, composite language services will become more common, and thus understanding cascading failure among language services becomes more important. This chapter investigates how failure may propagate among language services and how to improve language service tolerance to cascading failure. To this end, the dependency between language services is modeled as service network on which cascading failure is simulated and analyzed. We also generated service networks in scale-free, exponential, and random topology to analyze how cascading failure occurs in different topology. The simulation reveals that service networks with scale-free topology have better cascading-failure tolerance compares to that of other topology.