Surveillance cameras are commonly used for security purpose. However, most of them are used for verification after incidents happen. In this paper, we propose a method for proactive video surveillance system using human pose estimation. Our method estimates anomaly scores of human actions using the video descriptors (human pose and bounding box) extracted by pose estimation and tracking methods. We estimate human poses, apply PCA, estimate GMM parameters, and finally calculate anomaly scores based on the GMM. We evaluate our method and compare with higher-level recognition-based method. Experimental results demonstrate effectiveness of human pose for video anomaly detection.