Development of Deep Learning Models for Predicting In-Hospital Mortality Using an Administrative Claims Database: Retrospective Cohort Study

Hiroki Matsui*, Hayato Yamana, Kiyohide Fushimi, Hideo Yasunaga

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review


Background: Administrative claims databases have been used widely in studies because they have large sample sizes and are easily available. However, studies using administrative databases lack information on disease severity, so a risk adjustment method needs to be developed. Objective: We aimed to develop and validate deep learning-based prediction models for in-hospital mortality of acute care patients. Methods: The main model was developed using only administrative claims data (age, sex, diagnoses, and procedures on the day of admission). We also constructed disease-specific models for acute myocardial infarction, heart failure, stroke, and pneumonia using common severity indices for these diseases. Using the Japanese Diagnosis Procedure Combination data from July 2010 to March 2017, we identified 46,665,933 inpatients and divided them into derivation and validation cohorts in a ratio of 95:5. The main model was developed using a 9-layer deep neural network with 4 hidden dense layers that had 1000 nodes and were fully connected to adjacent layers. We evaluated model discrimination ability by an area under the receiver operating characteristic curve (AUC) and calibration ability by calibration plot. Results: Among the eligible patients, 2,005,035 (4.3%) died. Discrimination and calibration of the models were satisfactory. The AUC of the main model in the validation cohort was 0.954 (95% CI 0.954-0.955). The main model had higher discrimination ability than the disease-specific models. Conclusions: Our deep learning-based model using diagnoses and procedures produced valid predictions of in-hospital mortality.

Original languageEnglish
Article numbere27936
JournalJMIR Medical Informatics
Issue number2
Publication statusPublished - 2022 Feb 1
Externally publishedYes


  • Acute care
  • Claims data
  • Deep learning
  • Heart failure
  • Myocardial infarction
  • Pneumonia
  • Prognostic model
  • Real-world data
  • Stroke

ASJC Scopus subject areas

  • Health Informatics
  • Health Information Management


Dive into the research topics of 'Development of Deep Learning Models for Predicting In-Hospital Mortality Using an Administrative Claims Database: Retrospective Cohort Study'. Together they form a unique fingerprint.

Cite this