Optimizing crowdsourcing workflow for language services

Shinsuke Goto, Toru Ishida, Donghui Lin

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Recently, attempts have been to request translation services from anonymous crowds. Compared with platform-based language services, services performed by humans have the advantages of flexibility and quality. However, due to the nature of human services the results are not consistent and quality is not assured. This research tries to solve this problem by creating workflows that make collaboration among crowdsourcing workers far more effective and efficient. We model workers and tasks, and calculate the optimal workflow. To confirm the feasibility of this model, we conduct a computational experiment to calculate the best workflow under various parameters. The results are consistent with existing research so the model is useful in understanding crowdsourcing workflows. In addition, a system is developed for realizing crowdsourcing workflows for translation services. Finally, we develop a translation interface that demonstrates the feasibility of the proposed method.

Original languageEnglish
Title of host publicationCognitive Technologies
PublisherSpringer-Verlag
Pages75-89
Number of pages15
Edition9789811077920
DOIs
Publication statusPublished - 2018 Jan 1
Externally publishedYes

Publication series

NameCognitive Technologies
Number9789811077920
ISSN (Print)1611-2482

Fingerprint

Experiments

Keywords

  • Crowdsourcing
  • Human services
  • Workflow modeling
  • Workflow optimization

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this

Goto, S., Ishida, T., & Lin, D. (2018). Optimizing crowdsourcing workflow for language services. In Cognitive Technologies (9789811077920 ed., pp. 75-89). (Cognitive Technologies; No. 9789811077920). Springer-Verlag. https://doi.org/10.1007/978-981-10-7793-7_5

Optimizing crowdsourcing workflow for language services. / Goto, Shinsuke; Ishida, Toru; Lin, Donghui.

Cognitive Technologies. 9789811077920. ed. Springer-Verlag, 2018. p. 75-89 (Cognitive Technologies; No. 9789811077920).

Research output: Chapter in Book/Report/Conference proceedingChapter

Goto, S, Ishida, T & Lin, D 2018, Optimizing crowdsourcing workflow for language services. in Cognitive Technologies. 9789811077920 edn, Cognitive Technologies, no. 9789811077920, Springer-Verlag, pp. 75-89. https://doi.org/10.1007/978-981-10-7793-7_5
Goto S, Ishida T, Lin D. Optimizing crowdsourcing workflow for language services. In Cognitive Technologies. 9789811077920 ed. Springer-Verlag. 2018. p. 75-89. (Cognitive Technologies; 9789811077920). https://doi.org/10.1007/978-981-10-7793-7_5
Goto, Shinsuke ; Ishida, Toru ; Lin, Donghui. / Optimizing crowdsourcing workflow for language services. Cognitive Technologies. 9789811077920. ed. Springer-Verlag, 2018. pp. 75-89 (Cognitive Technologies; 9789811077920).
@inbook{571f3504d98f4bea92a2c76701f01092,
title = "Optimizing crowdsourcing workflow for language services",
abstract = "Recently, attempts have been to request translation services from anonymous crowds. Compared with platform-based language services, services performed by humans have the advantages of flexibility and quality. However, due to the nature of human services the results are not consistent and quality is not assured. This research tries to solve this problem by creating workflows that make collaboration among crowdsourcing workers far more effective and efficient. We model workers and tasks, and calculate the optimal workflow. To confirm the feasibility of this model, we conduct a computational experiment to calculate the best workflow under various parameters. The results are consistent with existing research so the model is useful in understanding crowdsourcing workflows. In addition, a system is developed for realizing crowdsourcing workflows for translation services. Finally, we develop a translation interface that demonstrates the feasibility of the proposed method.",
keywords = "Crowdsourcing, Human services, Workflow modeling, Workflow optimization",
author = "Shinsuke Goto and Toru Ishida and Donghui Lin",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-981-10-7793-7_5",
language = "English",
series = "Cognitive Technologies",
publisher = "Springer-Verlag",
number = "9789811077920",
pages = "75--89",
booktitle = "Cognitive Technologies",
edition = "9789811077920",

}

TY - CHAP

T1 - Optimizing crowdsourcing workflow for language services

AU - Goto, Shinsuke

AU - Ishida, Toru

AU - Lin, Donghui

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Recently, attempts have been to request translation services from anonymous crowds. Compared with platform-based language services, services performed by humans have the advantages of flexibility and quality. However, due to the nature of human services the results are not consistent and quality is not assured. This research tries to solve this problem by creating workflows that make collaboration among crowdsourcing workers far more effective and efficient. We model workers and tasks, and calculate the optimal workflow. To confirm the feasibility of this model, we conduct a computational experiment to calculate the best workflow under various parameters. The results are consistent with existing research so the model is useful in understanding crowdsourcing workflows. In addition, a system is developed for realizing crowdsourcing workflows for translation services. Finally, we develop a translation interface that demonstrates the feasibility of the proposed method.

AB - Recently, attempts have been to request translation services from anonymous crowds. Compared with platform-based language services, services performed by humans have the advantages of flexibility and quality. However, due to the nature of human services the results are not consistent and quality is not assured. This research tries to solve this problem by creating workflows that make collaboration among crowdsourcing workers far more effective and efficient. We model workers and tasks, and calculate the optimal workflow. To confirm the feasibility of this model, we conduct a computational experiment to calculate the best workflow under various parameters. The results are consistent with existing research so the model is useful in understanding crowdsourcing workflows. In addition, a system is developed for realizing crowdsourcing workflows for translation services. Finally, we develop a translation interface that demonstrates the feasibility of the proposed method.

KW - Crowdsourcing

KW - Human services

KW - Workflow modeling

KW - Workflow optimization

UR - http://www.scopus.com/inward/record.url?scp=85042558811&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85042558811&partnerID=8YFLogxK

U2 - 10.1007/978-981-10-7793-7_5

DO - 10.1007/978-981-10-7793-7_5

M3 - Chapter

AN - SCOPUS:85042558811

T3 - Cognitive Technologies

SP - 75

EP - 89

BT - Cognitive Technologies

PB - Springer-Verlag

ER -