Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings

Hiroki Sayama, Farnaz Zamani Esfahlani, Ali Jazayeri, J. Scott Turner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a novel computational method to extract information about interactions among individuals with different behavioral states in a biological collective from ordinary video recordings. Assuming that individuals are acting as finite state machines, our method first detects discrete behavioral states of those individuals and then constructs a model of their state transitions, taking into account the positions and states of other individuals in the vicinity. We have tested the proposed method through applications to two real-world biological collectives: termites in an experimental setting and human pedestrians in a university campus. For each application, a robust tracking system was developed in-house, utilizing interactive human intervention (for termite tracking) or online agent-based simulation (for pedestrian tracking). In both cases, significant interactions were detected between nearby individuals with different states, demonstrating the effectiveness of the proposed method.

Original languageEnglish
Title of host publication2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-8
Number of pages8
Volume2018-January
ISBN (Electronic)9781538627259
DOIs
Publication statusPublished - 2018 Feb 2
Event2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Honolulu, United States
Duration: 2017 Nov 272017 Dec 1

Other

Other2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017
CountryUnited States
CityHonolulu
Period17/11/2717/12/1

Fingerprint

Behavioral Modeling
Video recording
Finite automata
Computational methods
Agent-based Simulation
Tracking System
State Transition
State Machine
Interaction
Computational Methods
Movement
Human
Model

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Control and Optimization

Cite this

Sayama, H., Esfahlani, F. Z., Jazayeri, A., & Turner, J. S. (2018). Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings. In 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings (Vol. 2018-January, pp. 1-8). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SSCI.2017.8285238

Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings. / Sayama, Hiroki; Esfahlani, Farnaz Zamani; Jazayeri, Ali; Turner, J. Scott.

2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. p. 1-8.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sayama, H, Esfahlani, FZ, Jazayeri, A & Turner, JS 2018, Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings. in 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings. vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 1-8, 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017, Honolulu, United States, 17/11/27. https://doi.org/10.1109/SSCI.2017.8285238
Sayama H, Esfahlani FZ, Jazayeri A, Turner JS. Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings. In 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings. Vol. 2018-January. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1-8 https://doi.org/10.1109/SSCI.2017.8285238
Sayama, Hiroki ; Esfahlani, Farnaz Zamani ; Jazayeri, Ali ; Turner, J. Scott. / Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings. 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1-8
@inproceedings{8b866ac2069642f79e3c257c8e200254,
title = "Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings",
abstract = "We propose a novel computational method to extract information about interactions among individuals with different behavioral states in a biological collective from ordinary video recordings. Assuming that individuals are acting as finite state machines, our method first detects discrete behavioral states of those individuals and then constructs a model of their state transitions, taking into account the positions and states of other individuals in the vicinity. We have tested the proposed method through applications to two real-world biological collectives: termites in an experimental setting and human pedestrians in a university campus. For each application, a robust tracking system was developed in-house, utilizing interactive human intervention (for termite tracking) or online agent-based simulation (for pedestrian tracking). In both cases, significant interactions were detected between nearby individuals with different states, demonstrating the effectiveness of the proposed method.",
author = "Hiroki Sayama and Esfahlani, {Farnaz Zamani} and Ali Jazayeri and Turner, {J. Scott}",
year = "2018",
month = "2",
day = "2",
doi = "10.1109/SSCI.2017.8285238",
language = "English",
volume = "2018-January",
pages = "1--8",
booktitle = "2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Robust tracking and behavioral modeling of movements of biological collectives from ordinary video recordings

AU - Sayama, Hiroki

AU - Esfahlani, Farnaz Zamani

AU - Jazayeri, Ali

AU - Turner, J. Scott

PY - 2018/2/2

Y1 - 2018/2/2

N2 - We propose a novel computational method to extract information about interactions among individuals with different behavioral states in a biological collective from ordinary video recordings. Assuming that individuals are acting as finite state machines, our method first detects discrete behavioral states of those individuals and then constructs a model of their state transitions, taking into account the positions and states of other individuals in the vicinity. We have tested the proposed method through applications to two real-world biological collectives: termites in an experimental setting and human pedestrians in a university campus. For each application, a robust tracking system was developed in-house, utilizing interactive human intervention (for termite tracking) or online agent-based simulation (for pedestrian tracking). In both cases, significant interactions were detected between nearby individuals with different states, demonstrating the effectiveness of the proposed method.

AB - We propose a novel computational method to extract information about interactions among individuals with different behavioral states in a biological collective from ordinary video recordings. Assuming that individuals are acting as finite state machines, our method first detects discrete behavioral states of those individuals and then constructs a model of their state transitions, taking into account the positions and states of other individuals in the vicinity. We have tested the proposed method through applications to two real-world biological collectives: termites in an experimental setting and human pedestrians in a university campus. For each application, a robust tracking system was developed in-house, utilizing interactive human intervention (for termite tracking) or online agent-based simulation (for pedestrian tracking). In both cases, significant interactions were detected between nearby individuals with different states, demonstrating the effectiveness of the proposed method.

UR - http://www.scopus.com/inward/record.url?scp=85046082053&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046082053&partnerID=8YFLogxK

U2 - 10.1109/SSCI.2017.8285238

DO - 10.1109/SSCI.2017.8285238

M3 - Conference contribution

VL - 2018-January

SP - 1

EP - 8

BT - 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -