It has been suggested that the association between multiple sensory modalities can occur among non-synesthetic people. In a previous study , we showed that non-synesthetes exhibited an association between spatial direction and color. In the present study, we explored the factors that influence the degree of association between spatial direction and color. Specifically, we focused on the association between the degree of color-direction association and cognitive processes related to discriminating spatial direction. One-hundred ninety-nine Japanese university students completed questionnaires on color-direction association, left-right confusion, mirror image imitation, and autistic traits. People who showed stronger color- direction association found it easier to discriminate left from right and to imitate others' actions as mirrored images. In addition, people with higher autistic traits experienced a greater degree of left-right confusion and greater difficulty imitating others' mirrored images.