Wikipedia

EMRBots


EMRBots are experimental artificially generated electronic medical records (EMRs).[1][2] The aim of EMRBots is to allow non-commercial entities (such as universities) to use the artificial patient repositories to practice statistical and machine-learning algorithms. Commercial entities can also use the repositories for any purpose, as long as they do not create software products using the repositories.

Uri Kartoun presenting EMRBots at Stanford University, Feb. 2019.

A letter published in Communications of the ACM emphasizes the importance of using synthetic medical data, "... EMRBots can generate a synthetic patient population of any size, including demographics, admissions, comorbidities, and laboratory values. A synthetic patient has no confidentiality restrictions and thus can be used by anyone to practice machine learning algorithms."[3]

Background

edit

EMRs contain sensitive personal information. For example, they may include details about infectious diseases, such as human immunodeficiency virus (HIV), or they may contain information about a mental disorder. They may also contain other sensitive information such as medical details related to fertility treatments. Because EMRs are subject to confidentiality requirements, accessing and analyzing EMR databases is a privilege given to only a small number of individuals. Individuals who work at institutions that do not have access to EMR systems have no opportunity to gain hands-on experience with this valuable resource. Simulated medical databases are currently available; however, they are difficult to configure and are limited in their resemblance to real clinical databases. Generating highly accessible repositories of artificial patient EMRs while relying only minimally on real patient data is expected to serve as a valuable resource to a broader audience of medical personnel, including those who reside in underdeveloped countries.

Use in Schools

edit

In March 2022, Ishani Das, a student researcher from Cupertino High School, used EMRBots to develop an Artificial Intelligence-based Clinical Decision Support Tool which is available via the open-source community AI-Assist.[4]

Academic Use

edit

In April 2018 Bioinformatics (journal) published a study that relied on EMRBots data to create a new R package denoted as "comoRbidity".[5] Co-authors on the study included scientists from Universitat Pompeu Fabra and Harvard University. The repositories have been used to accelerate research, e.g., researchers from Michigan State University, IBM Research, and Cornell University published a study in the Knowledge Discovery and Data Mining (KDD) conference.[6][7][8][9] Their study describes a novel neural network that performs better than the widely used long short-term memory neural network developed by Sepp Hochreiter and Jürgen Schmidhuber in 1997.[10] In May 2018 scientists from IBM Research and Cornell University have used the repositories to test a new deep architecture denoted as Health-ATM. To demonstrate superiority over traditional neural networks, they applied their architecture to a congestive heart failure use case.[11] Additional use includes The University of Chicago creating a highly detailed tutorial demonstrating how to use R using the repositories,[12] University of California Merced,[13][14] and The University of Tampere, Finland.[15][16] Additional resources include.[17][18][19][20][21][22][23][24][25][26][27][28][29][30][31][32][33][34][35][36][37][38][39][40][41][42][43][44][45][46]

In March 2019 the repositories were used to enhance "Computationally-Enabled Medicine", a course given by Harvard Medical School.[47] Further in March, scientists from multiple institutions, including Peking University, University of Tokyo, and Polytechnic University of Milan used the repositories to develop a new framework focused on medical information privacy.[48]

Use in Hackathons

edit

Researchers from Carnegie Mellon University used EMRBots data at the CMU HackAuton hackathon to create a prediction tool.[49] Additional uses are available.[50]

EMRBots were presented at HackPrinceton 2018 organized by Princeton University.[51][52][53]

EMRBots were presented at TreeHacks 2019 organized by Stanford University.[54]

Availability

edit

The repositories can be downloaded after registration.[55]

The repositories are available to download from Figshare without registration.[56][57][58]

Full source code for creating the repositories is available to download from Figshare.[59]

All source code for EMRBots is available in Elsevier's Software Impacts GitHub site.[60][61]

Northwell Health's EMRBot

edit

In May 2018 Northwell Health funded a project denoted as EMRBot in the health system's third annual innovation challenge. Northwell Health's EMRBot, however, is neither related to Uri Kartoun's website (registered as a domain name in April 2015; www.emrbots.org) nor to any of its repositories or applications.

Criticism

edit

"[EMRBots] are ... pregenerated datasets of synthetic EHR with an insufficient explanation of how the datasets were generated. These datasets exhibit several inconsistencies between health problems, age, and gender."[62][63] An additional criticism is described in a thesis ("Realism in Synthetic Data Generation") granted by Massey University.[64]

Other Synthetic Medical Data Resources

edit

CareCloud

MDClone[65]

SyntheticMass[66]

SynTReN[67]

References

edit
  1. ^ Kartoun, Uri (September 2019). "Advancing informatics with electronic medical records bots (EMRBots)". Software Impacts. 2: 100006. doi:10.1016/j.simpa.2019.100006.
  2. ^ Kartoun, Uri (2016). "A methodology to generate virtual patient repositories". arXiv:1608.00570 [cs.CY].
  3. ^ CACM Staff (1 January 2018). "A leap from artificial to intelligence". Communications of the ACM. 61 (1): 10–11. doi:10.1145/3168260.
  4. ^ Das, Ishani. "Clinical Decision Support Tool (CDST)". AI Assist. Archived from the original on 6 October 2022. Retrieved 4 April 2022.
  5. ^ Gutiérrez-Sacristán, Alba; Bravo, Àlex; Giannoula, Alexia; Mayer, Miguel A; Sanz, Ferran; Furlong, Laura I; Kelso, Janet (15 September 2018). "comoRbidity: an R package for the systematic analysis of disease comorbidities". Bioinformatics. 34 (18): 3228–3230. doi:10.1093/bioinformatics/bty315. PMC 6137966. PMID 29897411.
  6. ^ "Patient Subtyping via Time-Aware LSTM Networks". Kdd.org. Archived from the original on 26 May 2018. Retrieved 24 May 2018.
  7. ^ "SIGKDD". Kdd.org. Archived from the original on 26 May 2018. Retrieved 24 May 2018.
  8. ^ "Patient subtyping" (PDF). biometrics.cse.msu.edu. Archived (PDF) from the original on 2024-07-06. Retrieved 2020-02-03.
  9. ^ "Thesis" (PDF). biometrics.cse.msu.edu. Archived (PDF) from the original on 2020-02-10. Retrieved 2020-02-03.
  10. ^ Hochreiter, Sepp; Schmidhuber, Jürgen (1997). "Long short-term memory". Neural Comput. 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. S2CID 1915014.
  11. ^ Ma, Tengfei; Xiao, Cao; Wang, Fei (2018). "Health-ATM: A Deep Architecture for Multifaceted Patient Health Record Representation and Risk Prediction". Proceedings of the 2018 SIAM International Conference on Data Mining. pp. 261–269. doi:10.1137/1.9781611975321.30. ISBN 978-1-61197-532-1.
  12. ^ "Statistical Modeling of Clinical Data" (PDF). Cri.uchicago.edu. Archived (PDF) from the original on 11 March 2018. Retrieved 24 May 2018.
  13. ^ Bahrami, Mehdi; Singhal, Mukesh (2015). "A dynamic cloud computing platform for eHealth systems". A dynamic cloud computing platform for eHealth systems - IEEE Conference Publication. pp. 435–438. doi:10.1109/HealthCom.2015.7454539. ISBN 978-1-4673-8325-7. S2CID 25042895.
  14. ^ "Publication - UC Merced Cloud Lab". Cloudlab.ucmerced.edu. Archived from the original on 2018-03-18. Retrieved 2018-03-17.
  15. ^ "Fairness in Group Recommendations in the Health Domain" (PDF). People.uta.fi. Retrieved 24 May 2018.
  16. ^ "MLARAPP". Devpost.com. 29 October 2017. Archived from the original on 18 July 2018. Retrieved 24 May 2018.
  17. ^ "illidanlab/T-LSTM". GitHub. Archived from the original on 9 September 2023. Retrieved 24 May 2018.
  18. ^ Stratigi, Maria; Kondylakis, Haridimos; Stefanidis, Kostas (2018). Database and Expert Systems Applications. Lecture Notes in Computer Science. Vol. 11030. pp. 147–155. doi:10.1007/978-3-319-98812-2_11. hdl:10024/104308. ISBN 978-3-319-98811-5.
  19. ^ "Teaching data science fundamentals through realistic synthetic clinical cardiovascular data". bioRxiv 10.1101/232611.
  20. ^ Bhuiyan, Mansurul A.; Hasan, Mohammad Al (2016). "PRIIME: A generic framework for interactive personalized interesting pattern discovery". PRIIME: A generic framework for interactive personalized interesting pattern discovery - IEEE Conference Publication. pp. 606–615. arXiv:1607.05749. doi:10.1109/BigData.2016.7840653. ISBN 978-1-4673-9005-7. S2CID 8454336.
  21. ^ "Generic frameworks for interactive personalized interesting pattern discovery" (PDF). Dmgroup.cs.iupui.edu. Retrieved 24 May 2018.
  22. ^ "Obstacle Avoider Robotic Vehicle" (PDF). Repository.sustech.edu. Archived (PDF) from the original on 13 March 2018. Retrieved 24 May 2018.
  23. ^ Nithya, M.; Sheela, T. (2019). "Predictive delimiter for multiple sensitive attribute publishing". Cluster Computing. 22: 12297–12304. doi:10.1007/s10586-017-1612-y. S2CID 12093722.
  24. ^ Janaswamy, Sreya; Kent, Robert D. (2016). "Semantic Interoperability and Data Mapping in EHR Systems". 2016 IEEE 6th International Conference on Advanced Computing (IACC). pp. 117–122. doi:10.1109/IACC.2016.31. ISBN 978-1-4673-8286-1. S2CID 17062479. Archived from the original on 2018-11-12. Retrieved 2018-11-11.
  25. ^ "Improving patient screening by applying predictive analytics to electronic medical records.: Big data conference & machine learning training | Strata Data". Archived from the original on 2018-09-19. Retrieved 2018-09-19.
  26. ^ "Technical Program". insticc.org. Archived from the original on 2019-04-17. Retrieved 2019-04-17.
  27. ^ "Data" (PDF). xuc.me. Archived (PDF) from the original on 2019-04-17. Retrieved 2020-02-03.
  28. ^ Chen, J; Chun, D; Patel, M; Chiang, E; James, J (2019). "The validity of synthetic clinical data: a validation study of a leading synthetic data generator (Synthea) using clinical quality measures". BMC Med Inform Decis Mak. 19 (1): 44. doi:10.1186/s12911-019-0793-0. PMC 6416981. PMID 30871520.
  29. ^ "Paper" (PDF). www.ijitee.org. Archived (PDF) from the original on 2022-01-28. Retrieved 2020-02-03.
  30. ^ "Info" (PDF). sutir.sut.ac.th:8080. Archived (PDF) from the original on 2019-09-16. Retrieved 2020-02-03.
  31. ^ "Full issue" (PDF). sigmodrecord.org. Archived (PDF) from the original on 2019-12-15. Retrieved 2020-02-03.
  32. ^ "Publication" (PDF). uclab.khu.ac.kr. Archived (PDF) from the original on 2020-01-14. Retrieved 2020-02-03.
  33. ^ "Media" (PDF). api.sunlab.org. Archived (PDF) from the original on 2020-02-02. Retrieved 2020-02-03.
  34. ^ Ayala Solares, Jose Roberto; Diletta Raimondi, Francesca Elisa; Zhu, Yajie; Rahimian, Fatemeh; Canoy, Dexter; Tran, Jenny; Pinho Gomes, Ana Catarina; Payberah, Amir H.; Zottoli, Mariagrazia; Nazarzadeh, Milad; Conrad, Nathalie; Rahimi, Kazem; Salimi-Khorshidi, Gholamreza (January 1, 2020). "Deep learning for electronic health records: A comparative review of multiple deep neural architectures". Journal of Biomedical Informatics. 101: 103337. doi:10.1016/j.jbi.2019.103337. PMID 31916973.
  35. ^ Reiner Benaim, Anat; Almog, Ronit; Gorelik, Yuri; Hochberg, Irit; Nassar, Laila; Mashiach, Tanya; Khamaisi, Mogher; Lurie, Yael; Azzam, Zaher S.; Khoury, Johad; Kurnik, Daniel; Beyar, Rafael (2020). "Analyzing Medical Research Results Based on Synthetic Data and Their Relation to Real Data Results: Systematic Comparison from Five Observational Studies". JMIR Medical Informatics. 8 (2): e16492. doi:10.2196/16492. PMC 7059086. PMID 32130148. Archived from the original on 2020-02-21. Retrieved 2020-02-21.
  36. ^ Multidimensional Group Recommendations in the Health Domain
  37. ^ Satti, Fahad Ahmed; Ali Khan, Wajahat; Ali, Taqdir; Hussain, Jamil; Yu, Hyeong Won; Kim, Seoungae; Lee, Sungyoung (2020). "Semantic Bridge for Resolving Healthcare Data Interoperability". 2020 International Conference on Information Networking (ICOIN). pp. 86–91. doi:10.1109/ICOIN48656.2020.9016461. ISBN 978-1-7281-4199-2. S2CID 212634693.
  38. ^ Satti, Fahad Ahmed; Ali, Taqdir; Hussain, Jamil; Khan, Wajahat Ali; Khattak, Asad Masood; Lee, Sungyoung (2020). "Ubiquitous Health Profile (UHPr): A big data curation platform for supporting health data interoperability". Computing. 102 (11): 2409–2444. doi:10.1007/s00607-020-00837-2.
  39. ^ Al-Qahtani, Meshal; Katsigiannis, Stamos; Ramzan, Naeem (2021). "Information Retrieval from Electronic Health Records". Engineering and Technology for Healthcare. pp. 117–127. doi:10.1002/9781119644316.ch6. ISBN 9781119644248. S2CID 229413648. Archived from the original on 2024-07-06. Retrieved 2020-12-17.
  40. ^ "Archived copy". Archived from the original on 2023-09-09. Retrieved 2021-04-06.{{cite web}}: CS1 maint: archived copy as title (link)
  41. ^ Satti, Fahad Ahmed; Hussain, Musarrat; Hussain, Jamil; Ali, Syed Imran; Ali, Taqdir; Bilal, Hafiz Syed Muhammad; Chung, Taechoong; Lee, Sungyoung (2021). "Unsupervised Semantic Mapping for Healthcare Data Storage Schema". IEEE Access. 9: 107267–107278. Bibcode:2021IEEEA...9j7267S. doi:10.1109/ACCESS.2021.3100686. S2CID 236940396.
  42. ^ Abbasi, Afsoon; Mohammadi, Behnaz (2021). "A clustering-based anonymization approach for privacy-preserving in the healthcare cloud". Concurrency and Computation: Practice and Experience. 34. doi:10.1002/cpe.6487. S2CID 237767088. Archived from the original on 2021-08-03. Retrieved 2021-08-03.
  43. ^ "Fast Healthcare Interoperability Resources" (PDF). Archived (PDF) from the original on 8 May 2024. Retrieved 4 July 2024.
  44. ^ Tan, T. L.; Salam, I.; Singh, M. (2022). "Blockchain-based healthcare management system with two-side verifiability". PLOS ONE. 17 (4): e0266916. Bibcode:2022PLoSO..1766916T. doi:10.1371/journal.pone.0266916. PMC 9009638. PMID 35421184.
  45. ^ Sathish Kumar, L.; Routray, Sidheswar; Prabu, A. V.; Rajasoundaran, S.; Pandimurugan, V.; Mukherjee, Amrit; Al-Numay, Mohammed S. (23 August 2022). "Artificial intelligence based health indicator extraction and disease symptoms identification using medical hypothesis models". Cluster Computing. 26 (4): 2325–2337. doi:10.1007/s10586-022-03697-x. PMC 9396605. PMID 36034677.
  46. ^ "Archived copy". Archived from the original on 2024-07-06. Retrieved 2023-09-09.{{cite web}}: CS1 maint: archived copy as title (link)
  47. ^ "kartoun/IBM-Harvard-Workshop". August 18, 2019. Archived from the original on October 11, 2020. Retrieved March 14, 2019 – via GitHub.
  48. ^ "POET: Privacy on the Edge with Bidirectional Data Transformations" (PDF). Archived (PDF) from the original on 2019-04-05. Retrieved 2020-02-03.
  49. ^ Gebert, Theresa; Jiang, Shuli; Sheng, Jiaxian (2018). "Characterizing Allegheny County opioid overdoses with an interactive data explorer and synthetic prediction tool". arXiv:1804.08830 [stat.AP].
  50. ^ "GitHub - gyaneshanand/Rajasthan_Hackathon_5.0". GitHub. 2018-07-26. Archived from the original on 2024-07-06. Retrieved 2018-09-11.
  51. ^ "HackPrinceton Fall 2018 Workshops". 2018-11-10. Archived from the original on 2018-11-07. Retrieved 2018-11-06.
  52. ^ Kartoun, Uri (2018-11-10). "Advancing informatics with electronic medical records bots (HackPrinceton 2018)". doi:10.6084/m9.figshare.7325903.v1. Archived from the original on 2018-11-13. Retrieved 2018-11-12. {{cite journal}}: Cite journal requires |journal= (help)
  53. ^ "Web Resources". hackprinceton.com. Archived from the original on 17 December 2018. Retrieved 17 January 2022.
  54. ^ "TreeHacks 2020". live.treehacks.com. Archived from the original on 2024-07-06. Retrieved 2019-02-20.
  55. ^ "EMRBOTS.ORG". EMRBOTS.ORG. Archived from the original on 2020-02-03. Retrieved 2020-02-03.
  56. ^ Kartoun, Uri (2018-09-03). "EMRBots: A 100-patient database". figshare. doi:10.6084/m9.figshare.7040039.v3. Archived from the original on 2018-09-25. Retrieved 2018-09-24. {{cite journal}}: Cite journal requires |journal= (help)
  57. ^ Kartoun, Uri (2018-09-03). "EMRBots: A 10,000-patient database". figshare. doi:10.6084/m9.figshare.7040060.v3. Archived from the original on 2018-09-24. Retrieved 2018-09-24. {{cite journal}}: Cite journal requires |journal= (help)
  58. ^ Kartoun, Uri (2018-09-03). "EMRBots: A 100,000-patient database". figshare. doi:10.6084/m9.figshare.7040198.v1. Archived from the original on 2018-09-25. Retrieved 2018-09-24. {{cite journal}}: Cite journal requires |journal= (help)
  59. ^ Kartoun, Uri (2018-09-03). "EMRBots: Full source code". doi:10.6084/m9.figshare.7040204.v2. Archived from the original on 2018-09-25. Retrieved 2018-09-24. {{cite journal}}: Cite journal requires |journal= (help)
  60. ^ "SoftwareImpacts/SIMPAC-2019-8". November 20, 2019. Archived from the original on November 24, 2020. Retrieved September 9, 2019 – via GitHub.
  61. ^ "Software Impacts". Archived from the original on 2019-09-30. Retrieved 2019-09-09 – via www.journals.elsevier.com.
  62. ^ Walonoski, J; et al. (2018). "Synthea: An approach, method, and software mechanism for generating synthetic patients and the synthetic electronic health care record". J Am Med Inform Assoc. 25 (3): 230–238. doi:10.1093/jamia/ocx079. PMC 7651916. PMID 29025144.
  63. ^ "Corrigendum". Journal of the American Medical Informatics Association. 25 (7): 921. 2017. doi:10.1093/jamia/ocx147. PMC 6016640. PMID 29253166.
  64. ^ "Realism in Synthetic Data Generation" (PDF). Mro.massey.ac.nz. Archived (PDF) from the original on 6 July 2024. Retrieved 24 May 2018.
  65. ^ "Israeli healthcare data engine firm MDClone raises $26 mln". Reuters. August 22, 2019. Archived from the original on October 9, 2019. Retrieved February 3, 2020 – via www.reuters.com.
  66. ^ "Data". synthea.mitre.org. Archived from the original on 2019-10-19. Retrieved 2020-02-03.
  67. ^ Van Den Bulcke, Tim; Van Leemput, Koenraad; Naudts, Bart; Van Remortel, Piet; Ma, Hongwu; Verschoren, Alain; De Moor, Bart; Marchal, Kathleen (2006). "SynTReN: A generator of synthetic gene expression data for design and analysis of structure learning algorithms". BMC Bioinformatics. 7: 43. doi:10.1186/1471-2105-7-43. PMC 1373604. PMID 16438721.
Retrieved from "https://en.wikipedia.org/w/index.php?title=EMRBots&oldid=1232976227"