Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings

Hiroki Sayama, Farnaz Zamani Esfahlani, Ali Jazayeri, J. Scott Turner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a novel computational method to extract information about interactions among individuals with different behavioral states in a biological collective from ordinary video recordings. Assuming that individuals are acting as finite state machines, our method first detects discrete behavioral states of those individuals and then constructs a model of their state transitions, taking into account the positions and states of other individuals in the vicinity. We have tested the proposed method through applications to two real-world biological collectives: termites in an experimental setting and human pedestrians in a university campus. For each application, a robust tracking system was developed in-house, utilizing interactive human intervention (for termite tracking) or online agent-based simulation (for pedestrian tracking). In both cases, significant interactions were detected between nearby individuals with different states, demonstrating the effectiveness of the proposed method.

Original languageEnglish
Title of host publication2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-8
Number of pages8
Volume2018-January
ISBN (Electronic)9781538627259
DOIs
Publication statusPublished - 2018 Feb 2
Event2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Honolulu, United States
Duration: 2017 Nov 272017 Dec 1

Other

Other2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017
CountryUnited States
CityHonolulu
Period17/11/2717/12/1

    Fingerprint

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Control and Optimization

Cite this

Sayama, H., Esfahlani, F. Z., Jazayeri, A., & Turner, J. S. (2018). Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings. In 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings (Vol. 2018-January, pp. 1-8). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SSCI.2017.8285238