Cricshotclassify: An approach to classifying batting shots from cricket videos using a convolutional neural network and gated recurrent unit

Anik Sen, Kaushik Deb, Pranab Kumar Dhar, Takeshi Koshiba

Research output: Contribution to journalArticlepeer-review

Abstract

Recognizing the sport of cricket on the basis of different batting shots can be a significant part of context-based advertisement to users watching cricket, generating sensor-based commentary systems and coaching assistants. Due to the similarity between different batting shots, manual feature extraction from video frames is tedious. This paper proposes a hybrid deep-neural-network architecture for classifying 10 different cricket batting shots from offline videos. We composed a novel dataset, CricShot10, comprising uneven lengths of batting shots and unpredictable illumination conditions. Impelled by the enormous success of deep-learning models, we utilized a convolutional neural network (CNN) for automatic feature extraction, and a gated recurrent unit (GRU) to deal with long temporal dependency. Initially, conventional CNN and dilated CNN-based architectures were developed. Following that, different transfer-learning models were investigated—namely, VGG16, InceptionV3, Xception, and DenseNet169—which freeze all the layers. Experiment results demonstrated that the VGG16–GRU model outperformed the other models by attaining 86% accuracy. We further explored VGG16 and two models were developed, one by freezing all but the final 4 VGG16 layers, and another by freezing all but the final 8 VGG16 layers. On our CricShot10 dataset, these two models were 93% accurate. These results verify the effectiveness of our proposed architecture compared with other methods in terms of accuracy.

Original languageEnglish
Article number2846
JournalSensors
Volume21
Issue number8
DOIs
Publication statusPublished - 2021 Apr 2

Keywords

  • Batting shots
  • Convolutional neural network
  • Deep learning
  • Gated recurrent unit
  • Transfer learning

ASJC Scopus subject areas

  • Analytical Chemistry
  • Information Systems
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Cricshotclassify: An approach to classifying batting shots from cricket videos using a convolutional neural network and gated recurrent unit'. Together they form a unique fingerprint.

Cite this