Participants at both end of the communication channel must share common pictogram interpretation to communicate. However, because pictogram interpretation can be ambiguous, pictogram communication can sometimes be difficult. To assist human task of selecting pictograms more likely to be interpreted as intended, we propose a semantic relevance measure which calculates how relevant a pictogram is to a given interpretation. The proposed measure uses pictogram interpretations and frequencies gathered from a web survey to define probability and similarity measurement of interpretation words. Moreover, the proposed measure is applied to categorized pictogram interpretations to enhance retrieval performance. Five pictogram categories are created using the five first level categories defined in the Concept Dictionary of EDR Electronic Dictionary. Retrieval performance among not-categorized interpretations, categorized and not-weighted interpretations, and categorized and weighted interpretations using semantic relevance measure were compared, and the categorized and weighted semantic relevance retrieval approach exhibited the highest F 1 measure and recall.