RECENT HIGHLIGHTED PUBLICATIONS

Changes in Clinician Time Expenditure and Visit Quantity with Adoption of Artificial Intelligence-Powered Scribes: A Multi-Site Study with Lisa Rotenstein and the ACDC Collaborative in JAMA.

In a multi-site evaluation of ambient AI scribes using EHR audit log data from 8,581 clinicians across five US academic health systems, we measure how AI scribe adoption changed clinician time use with a staggered difference-in-differences framework using a Callaway and Sant’Anna estimator. We find adoption was associated with 13.4 fewer minutes of total EHR time and 16.0 fewer minutes of documentation time per eight scheduled patient-hours, along with a modest increase of 0.49 visits per week. Benefits were largest for primary care clinicians, advanced practice clinicians, and those using the scribe in at least half of their visits, providing evidence that generative AI can meaningfully reduce documentation burden in real-world practice.

Physician EHR Time and Visit Volume Following Adoption of Team-Based Documentation Support with Nate Apathy and Dori Cross in JAMA Internal Medicine.

Using a novel national dataset of EHR metadata and newly developed difference-in-differences event study estimators for staggered treatment adoption, we evaluate the causal impact of physician adoption of team-based documentation support on their productivity and EHR burden. We find that team-based documentation support increased visit volume by 6.0% while reducing EHR documentation time by 9.1%. These effects intensified over time as physicians adapted to the new workflow, and the EHR burden reductions were realized only by physicians with greater team-based documentation intensity.

Electronic Health Record Documentation Burden Crowds Out Health Information Exchange Use By Primary Care Physicians with Julia Adler-Milstein and Nate Apathy in Health Affairs.

Documentation burden is well known to be associated with clinician burnout, but does it also crowd out other high-value EHR-based work? Using EHR audit log data on primary care physicians, we test whether days with heavier documentation load reduce physicians' review of patient records from outside organizations via health information exchange using a novel instrumental variable strategy leveraging same-day no-shows as a natural experiment. We find that each additional hour of documentation time reduced the share of a physician's patients with an outside record reviewed that day by 7.1 percent — evidence that documentation burden is not just a clinician wellness problem, but directly displaces information gathering that supports clinical decision-making.


See below for a full list of peer-reviewed research publications. * Indicates equal contribution (e.g., co-first authorship):

Peer Reviewed journal articles

  1. Nguyen, L. M., Sebok-Syer, S. S., Jacobson, D., Mariano, K., Grunyk, J., Burk, S., Nourkhalaj, Y., Kirk, K., Profit, J., Rose, C., Holmgren, A. J., Kannampallil, T., & Tawfik, D. (2026) Using Electronic Health Record Audit Logs to Identify Pediatric Intensive Care Unit Teams. JAMIA Open. 2026;9(5):ooag126. doi:10.1093/jamiaopen/ooag126

  2. Holmgren, A. J., Apathy, N. C., Mehrotra, A., & Chernew, M. E. (2026) The Uneven Distribution of Patient Portal Messages Across Patients and Physicians. Health Affairs, 45:8, 862-870. doi:10.1377/hlthaff.2025.01416

  3. Figueroa, J. F., Adler, L., Feldman, W. B., Feyman, Y., Haeder, S. F., Holmgren, A. J., Ippolito, B., Marshall, D. A., Shafer, P. R., & Phillips, K. A. (2026) Ten High-Priority Areas for Health Policy Research in 2026-2027. Health Affairs Scholar, 4(7), qxag154. doi:10.1093/haschl/qxag154

  4. Pourian J., Michaels B., Vo A., Holmgren A. J., Garcia-Agundez A., Flaherman V. (2026) Characterising ‘Watch and Wait’ prescribing patterns in paediatric otitis media using large language models and pharmacy dispense data. BMJ Health & Care Informatics. 2026;33:e101948. doi:10.1136/bmjhci-2025-101948

  5. Ashtari, S., Holmgren, A. J., & Rodriguez, H. P. (2026) Patterns and Predictors of Clinician Use of Interoperability Tools. JAMIA Open. 2026;ooag116 doi:10.1093/jamiaopen/ooag116

  6. Halvorson, R., Wang, S., Wong, L., Vasanthan, A., Thombley, R., Feeley, B. T., & Holmgren, A. J. (2026) Patient Digital Engagement with After Visit Summary in Ambulatory Care. JAMA Network Open. 2026;9;(5):e2615020. doi:10.1001/jamanetworkopen.2026.15020

  7. Rosenbloom, T., Holmgren, A. J., & Steitz, B. D. (2026) Building Toward a Future for Electronic Health Record Systems. Annual Review Biomedical Data Science. doi:10.1146/annurev-biodatasci-092724-050949

  8. Li H., Khanna V. V., Apathy N. C., Holmgren A. J., Loza A. J., Melnick E. R. (2026) Electronic health record use factors linked to efficiency and productivity: an explainable machine learning analysis. JAMIA Open. 2026;9(1):ooag018. doi:10.1093/jamiaopen/ooag018

  9. Rotenstein, L. S.*, Holmgren, A. J.*, Thombley, R., Sriram, A., Dbouk, R. H., Jost, M., Aizenberg, D., MacDonald, S., Kanaparthy, N., Williams, B., Hsiao, A., Schwamm, L., Murray, S., Byron, M., You, J. G., Centi, A. J., Iannaccone, C., Frits, M., Landman, A. B., Singh, K., Tai-Seale, M., Cao, J., Lawrence, K., Mann, D., Holland, C., Blanchette, B., Ehrenfeld, J., Melnick, E. R., Bates, D. W., Adler-Milstein, J., & Mishuris, R. G. (2026) Changes in Clinician Time Expenditure and Visit Quantity with Adoption of Artificial Intelligence-Powered Scribes: A Multi-Site Study. JAMA: Journal of the American Medical Association. 2026;335(16):1408–1417. doi:10.1001/jama.2026.2253

  10. Smith, J. A., Everson, J. E., Siegel, N. M., Huffstetler, A., Holmgren, A. J., Apathy, N. C. (2026) A Retrospective Study Evaluating the Utilization of G2211. Annals of Internal Medicine. Epub 7 April 2026. doi:10.7326/ANNALS-25-05105

  11. Weinreb, G. G., Holmgren, A. J., Apathy, N. C., Bates, D. W., Landon, B. E., & Rotenstein, L. S. (2026) Changes in Primary Care Physicians’ Electronic Health Record Patterns After Clinical Visit Reductions. Health Affairs. 2026;45(2):138-145. doi:10.1377/hlthaff.2025.00734

  12. Holmgren, A. J., Fenton, C. L., Thombley, R., Soleimani, H., Croci, R., DeMasi, O., Byron, M., Murray, S. G., Adler-Milstein, J., & Yazdany, J. (2026) Ambient Artificial Intelligence Scribes and Physician Financial Productivity. JAMA Network Open. 2026;9(1):e2553233. doi:10.1001/jamanetworkopen.2025.53233

  13. Kanaparthy, N. S., Holmgren, A. J., Sun, Y., Paek, H., Williams, B., McLean, R., Doolan, R., Goodman, K. E., Rotenstein, L. S., Melnick, E. R. (2025) Protected Time for Electronic Health Record Work and Physician Productivity in Ambulatory Internal Medicine Physicians. JAMA Network Open. 2025;8(12):e2546550. doi:10.1001/jamanetworkopen.2025.46550

  14. Holmgren, A. J. (2025) Rapid Growth in Patient Portal Messages Underscores the Need for Actionable Paths Forward. JCO Clinical Cancer Informatics. e2500283(2025). doi:10.1200/CCI-25-00283

  15. Pourian, J. J., Michaels, B., Vo, A., Holmgren, A. J., Garcia-Agundez, A., & Flaherman, V. (2025) A SNAPpy Use of Large Language Models: Using LLMs to Classify Treatment Plans in Pediatric Acute Otitis Media. Journal of the American Medical Informatics Association. 2025;, ocaf170, https://doi.org/10.1093/jamia/ocaf170

  16. Apathy, N. C., Yan, A., & Holmgren, A. J. (2025) The Impact of Team-based Ordering Workflows on Ambulatory Physician EHR time, Order Volume, and Visit Volume. Health Services Research. e70038, doi:10.1111/1475-6773.70038.

  17. Holmgren, A. J., Apathy, N. C., & Kanter, G. P. (2025) Electronic Health Record Market Consolidation and Implications for Cybersecurity. Health Affairs Scholar. qxaf164, doi:10.1093/haschl/qxaf164

  18. Xian, R. P., Baker, N. R., David, T., Cui, Q., Holmgren, A. J., Bauer, S., Sushil, M., & Abbasi-Asl, R. (2025) Robustness Tests for Biomedical Foundation Models Should Tailor to Specification. npj Digital Medicine. 8, 557 (2025). doi:10.1038/s41746-025-01926-2

  19. Kim, S., Thombley, R., Eiden, E., Lou, S. S., Adler-Milstein, J., Kannampallil, T., & Holmgren, A. J. (2025) Differences in Physician EHR Use by Telemedicine Intensity: Evidence from Two Academic Medical Centers. Journal of the American Medical Informatics Association. ocaf122 doi: 10.1093/jamia/ocaf122.

  20. Kim, S., Kannampallil, T., Wick, B. D., Holmgren, A. J., Thombley, R., & Lou, S. S. (2025) Exploring Task Patterns in EHR Workflows using Action Sequence Embedding and Graph-Based Analysis. Studies in Health Technology and Informatics. 1281-1285. doi:10.3233/SHTI251045.

  21. Tawfik, D., Rule, A., Alexanian, A., Cross, D. A., Holmgren, A. J., Lou, S. S., McPeek Hinz, E., Rose, C., Viswanadham, R., Mishuris, R. G., Rodriguez-Fernandez, J. M., Ford, E., Florig, S., Sinsky, C. A., & Apathy, N. C. (2025) Emerging Domains for Measuring Healthcare Delivery with Electronic Health Record Metadata. Journal of Medical Internet Research. 2025;27:e64721. doi: 10.2196/64721.

  22. Sandhu, S., Liu, M., Gottlieb, L. M., Holmgren, A. J., Rotenstein, L. S., Pantell, M. S. (2025) Interoperability of Health-Related Social Needs Data at US Hospitals. Journal of the American Medical Informatics Association. Volume 32, Issue 5, May 2025, Pages 914–919. doi:10.1093/jamia/ocaf049

  23. Holmgren, A. J., Apathy, N. C., Crews, J., & Shanafelt, T. D. (2025) National Trends in Oncology Specialists’ EHR Inbox Work, 2019 – 2022. Journal of the National Cancer Institute. 2025;, djaf052, doi:10.1093/jnci/djaf052.

  24. Li, H., Apathy, N. C., Holmgren, A. J., Melnick, E. R., & MacDougal, R. A. (2025) Imputation of Missing Aggregate EHR Audit Log Data Across Individual and Multiple Organizations. Journal of Biomedical Informatics. 2025;163:104805. doi:10.1016/j.jbi.2025.104805

  25. Holmgren, A. J.,* Apathy, N. C.,* Sinsky, C. A., Adler-Milstein, J., Bates, D. W., & Rotenstein, L. S. (2025) Trends in Physician Electronic Health Record Time and Message Volume. JAMA Internal Medicine. Published online February 24, 2025. doi:10.1001/jamainternmed.2024.8138.

  26. Nong, P., Adler-Milstein, J., Apathy, N. C., Holmgren, A. J., & Everson, J. E. (2025) Current Use and Evaluation of AI and Predictive Models in US Hospitals. Health Affairs. 2025;44(1):90-98. doi:10.1377/hlthaff.2024.00842

  27. Apathy, N. C., Holmgren, A. J., Nong, P., Adler-Milstein, J., & Everson, J. E. (2025) Trending in the Right Direction: Critical Access Hospitals Increased Adoption of Advanced EHR Functions from 2018 to 2023. Journal of the American Medical Informatics Association. ocae267, doi:10.1093/jamia/ocae267.

  28. Strawley, C. E., Adler-Milstein, J., Holmgren, A. J., & Everson, J. E. (2024) New Indices to Track Interoperability Among U.S. Hospitals. Journal of the American Medical Informatics Association. ocae289, doi:/10.1093/jamia/ocae289.

  29. Sinsky, C. A., Rotenstein, L. S., Holmgren, A. J., & Apathy, N. C. (2024) The Number of Patient Scheduled Hours Resulting in a 40-Hour Work Week by Physician Specialty and Setting: A Cross-Sectional Study using EHR Event Log Data. Journal of the American Medical Informatics Association. ocae266, doi:10.1093/jamia/ocae266

  30. Holmgren, A. J., Adler-Milstein, J & Apathy, N. C. (2024) Electronic Health Record Documentation Burden Crowds Out Health Information Exchange Use. Health Affairs. 024;43(11):1538-1545. doi:10.1377/hlthaff.2024.00398

  31. Apathy, N. C., Holmgren, A. J., & Cross, D. A. (2024) Physician EHR Time and Visit Volume Following Adoption of Team-Based Documentation Support. JAMA Internal Medicine. Published online August 26, 2024. doi:10.1001/jamainternmed.2024.4123

  32. Holmgren, A. J., Sinsky, C., Rotenstein, L. S., & Apathy, N. C. (2024) National Comparison of Ambulatory Physician Electronic Health Record Use Across Specialties. Journal of General Internal Medicine. doi:10.1007/s11606-024-08930-4

  33. Holmgren, A. J., Grouse, C. K., Oates, A., O’Brien, J., & Byron, M. E. (2024) Changes in Secure Messaging Following Implementation of Billing ‘E-Visits’ by Demographic Groups. JAMA Network Open. 2024;7(8):e2427053. doi:10.1001/jamanetworkopen.2024.27053

  34. Holmgren, A. J., Hendrix, N., Maisel, N., Everson, J. E., Bazemore, A., Rotenstein, L. S., Phillips, R. L., & Adler-Milstein, J. (2024) Assessing the Relationship Between Electronic Health Record Usability, Satisfaction, and Burnout for Family Physicians. JAMA Network Open. 2024;7(8):e2426956. doi:10.1001/jamanetworkopen.2024.26956

  35. Apathy, N. C., Biro, J., & Holmgren, A. J. (2024) Consistency is Key: Documentation distribution and efficiency in primary care. Journal of the American Medical Informatics Association. ocae156, doi:10.1093/jamia/ocae156.

  36. Hendrix, N., Maisel, N., Everson, J. E., Patel, V., Bazemore, A., Rotenstein, L. S., Holmgren, A. J., Krist, A. H., Adler-Milstein, J., & Phillips, R. L. (2024) Impact of Response Bias in Three Surveys on Primary Care Providers’ Experiences with Electronic Health Records. Journal of the American Medical Informatics Association. ocae148, doi:10.1093/jamia/ocae148.

  37. Liu, T., Zhu, Z., Holmgren, A. J., & Ellimoottil, C. (2024) National Trends in Billing Patient Portal Messages as E-Visit Services in Traditional Medicare. Health Affairs Scholar. Volume 2, Issue 4, April 2024, qxae040, doi:10.1093/haschl/qxae040.

  38. Apathy, N. C., Patel, V. P., Rolle, T. L., & Holmgren, A. J. (2024) Physicians in ACOs Report Greater Documentation Burden. American Journal of Managed Care. 2024;30:SP452-SP458.

  39. Holmgren, A. J., Oakes, A. H., Miller, A., Adler-Milstein, J., & Mehrotra, A. (2024) National Trends in Billing Secure Messages as E-Visits. JAMA: Journal of the American Medical Association. Published online January 10, 2024. doi:10.1001/jama.2023.26584

  40. Rotenstein, L. S., Holmgren, A. J., Horn, D. M., Lipsitz, S., Phillips, R., Gitomer, R., & Bates, D. W. (2023) System-Level Factors and Time Spent on Electronic Health Records by Primary Care Physicians. JAMA Network Open. 2023;6(11):e2344713. doi:10.1001/jamanetworkopen.2023.44713

  41. Holmgren, A. J., Thombley, R., Sinsky, C., & Adler-Milstein, J. (2023) Changes in Physician Electronic Health Record Use With the Expansion of Telemedicine. JAMA Internal Medicine. Published online October 30, 2023. doi:10.1001/jamainternmed.2023.5738

  42. Pantell, M. S., Holmgren, A. J., Iott, B., Neuhas, J., Adler-Milstein, J., & Gottlieb, L. M. (2023) Social and Medical Care Integration Practices Among Children’s Hospitals. Hospital Pediatrics. October 2023; 13 (10): 886–894. doi:10.1542/hpeds.2023-007246

  43. Sinha, S., Holmgren, A. J., Hong, J. C., & Rotenstein, L. S. (2023) Ctrl-C: A Cross-Sectional Study of the EHR Usage Patterns of US Oncology Clinicians. JNCI Cancer Spectrum. 2023;, pkad066, doi:10.1093/jncics/pkad066.

  44. Rotenstein, L. S.*, & Holmgren, A. J.* (2023) COVID Exacerbated the Gender Disparity in Physician Electronic Inbox Burden. Journal of the American Medical Informatics Association. Published online July 12, 2023:ocad141. doi:10.1093/jamia/ocad141

  45. Cross, D. A., Holmgren, AJ., & Apathy, N. C. (2023) The Role of Organizations in Shaping Physician Use of Electronic Health Records (EHRs). Health Services Research. doi:10.1111/1475-6773.14203

  46. Holmgren, A. J., Esdar, M., Hüsers, J, & Coutinho-Almeida, J. (2023) Health Information Exchange: Understanding the Policy Landscape and Future of Data Interoperability. IMIA Yearbook of Medical Informatics. Published online July 6, 2023. doi:10.1055/s-0043-1768719.

  47. Hendrix, N., Bazemore, A., Holmgren, A. J., Rotenstein, L. S., Eden, A. R., Krist, A. H., Phillips, R. L. (2023) Variation in Family Physicians’ Experiences Across Different Electronic Health Record Platforms: a Descriptive Study. Journal of General Internal Medicine. doi:10.1007/s11606-023-08169-5

  48. Holmgren, A. J., Byron, M. E., Grouse, C. K., & Adler-Milstein, J. (2023) Association Between Billing Patient Portal Messages as E-Visits and Patient Messaging Volume. JAMA: Journal of the American Medical Association. Published online January 06, 2023. doi:10.1001/jama.2022.24710

  49. Grouse, C. K., Waung, M. W., Holmgren, A. J., Mongan, J., Neinstein, A., Josephson, A. S., & Khanna, R. R. (2022) Behavioral “Nudges” in the Electronic Health Record to Reduce Waste and Misuse: Three Interventions. Journal of the American Medical Informatics Association. ocac238, doi:10.1093/jamia/ocac238.

  50. Apathy, N.C., Rotenstein, L. S., Bates, D. W., & Holmgren, A. J. (2022) Documentation Dynamics: EHR note composition, burden, and physician efficiency. Health Services Research. doi:10.1111/1475-6773.14097

  51. Holmgren, A. J., & Apathy, N. C. (2022.) Trends in US Hospital Electronic Health Record Vendor Market Concentration, 2012 – 2021. Journal of General Internal Medicine. doi:10.1007/s11606-022-07917-3.

  52. Tang, M., Holmgren, A. J., McElerath, E. E., Bhatt, A. S., Varshney, A. S., Lee, S. G., Vaduganathan, M, Adler, D. S., & Huckman, R. S. (2022) Investigating the Association Between Telemedicine Use and Timely Follow-up Care after Acute Cardiovascular Hospital Encounters. JACC: Advances. Dec, 1 (5) 1–12. doi:10.1016/j.jacadv.2022.100156

  53. Rotenstein, L. S., Apathy, N. C., Holmgren, A. J., & Bates, D. W. (2022) Physician Note Composition Patterns and Time on the EHR Across Specialty Types: a National, Cross-sectional Study. Journal of General Internal Medicine. doi:10.1007/s11606-022-07834-5

  54. Rotenstein, L. S., Holmgren, A. J., Healey, M. J., Horn, D., Ting, D. Y., Lipsitz, S., Salmasian, H., Gitomer, R., & Bates, D. W. (2022) Association Between Electronic Health Record Time and Quality of Care Metrics in Primary Care. JAMA Network Open. 2022;5(10):e2237086. doi:10.1001/jamanetworkopen.2022.37086

  55. Cross, D. A., Adler-Milstein, J., & Holmgren, A. J. (2022) Management Opportunities and Challenges after Achieving Widespread Health System Digitization. Advances in Health Care Management. 2022:67-87. doi:10.1108/S1474-823120220000021004

  56. Holmgren, A. J., & Apathy, N. C. (2022) Assessing the Impact of Patient Access to Electronic Health Information on Clinician Electronic Health Record Documentation. Journal of the American Medical Informatics Association. ocac120, doi:10.1093/jamia/ocac120.

  57. Kutza, J. O., Hubner, U, Holmgren, A. J., & Esdar, M. (2022) Patient Safety Informatics: Criteria development for assessing the maturity of digital patient safety in hospitals. Studies in Health Technology and Informatics. IOS Press; 2022. doi:10.3233/SHTI220618.

  58. Holmgren, A. J.*, Rotenstein, L. S.*, Downing, N. L., Bates, D. W., & Schulman, K. (2022) Association Between State-level Medical Malpractice and Clinician Electronic Health Record Use. Journal of the American Medical Informatics Association. ocac034, doi:10.1093/jamia/ocac034

  59. Arvisais-Anhalt, S., Lau, M., Lehmann, C. U., Holmgren, A. J., Medford, R. J., Ramirez, C. M., & Chen, C. (2022) The 21st Century Cures Act and Multi-User Electronic Health Record Access. Journal of Medical Internet Research. 2022;24(2):e34085. doi:10.2196/34085

  60. Holmgren, A. J., Everson, J., & Adler-Milstein, J. (2022) Association of Hospital Interoperable Data Sharing and Alternative Payment Model Participation. JAMA Health Forum. 2022;3(2):e215199. doi:10.1001/jamahealthforum.2021.5199

  61. Apathy, N. C., Holmgren, A. J., & Werner, R. M. (2022) Growth in Health Information Exchange with ACO Market Penetration. American Journal of Managed Care. 2022;28(1):e7-e13. doi:10.37765/ajmc.2022.88815

  62. Holmgren, A. J.*, Downing, N. L.*, Tang, M., Sharp, C., Longhurst, C., & Huckman, R. S. (2021) Assessing the Impact of the COVID-19 Pandemic on Clinician Electronic Health Record Use. Journal of the American Medical Informatics Association. ocab268, https://doi.org/10.1093/jamia/ocab268

  63. Holmgren, A. J., & Bates, D. W. (2021) Association of Hospital Public Quality Reporting With Electronic Health Record Medication Safety Performance. JAMA Network Open. 2021;4(9):e2125173. doi:10.1001/jamanetworkopen.2021.25173

  64. Holmgren, A. J., Lindeman, B., & Ford, E. W. (2021) Resident Physician Experience and Duration of Electronic Health Record Use. Applied Clinical Informatics. 12(4):8. doi:10.1055/s-0041-1732403

  65. Holmgren, A. J., Kuznetsova, M, Classen, D. C., & Bates, D. W. (2021) Assessing Hospital Electronic Health Record Vendor Performance Across Publicly Reported Quality Measures. Journal of the American Medical Informatics Association. ocab120, doi.org/10.1093/jamia/ocab120

  66. Holmgren, A. J., Cutler, D., Mehrotra, A. (2021) The Increasing Role of Physicians as Bill Collectors: Destined for Failure. JAMA: Journal of the American Medical Association. Published online July 30, 2021. doi:10.1001/jama.2021.12191

  67. Rotenstein, L. S.*, Holmgren, A. J.*, Downing, N. L., Longhurst, C. A., & Bates, D. W. (2021) Differences in EHR Use Between Adult and Pediatric Primary Care Ambulatory Clinicians. JAMA Network Open. 2021;4(7):e2116375. doi:10.1001/jamanetworkopen.2021.16375

  68. Apathy, N. C., Holmgren, A. J., & Adler-Milstein, J. (2021) A Decade Post-HITECH: Critical Access Hospitals have EHRs but Struggle to Keep Up with Other Advanced Functions. Journal of the American Medical Informatics Association. ocab102, doi.org/10.1093/jamia/ocab102

  69. Holmgren, A. J., Phelan, J., Jha, A. K., & Adler-Milstein, J. (2021) Hospital Organizational Strategies Associated With Advanced EHR Adoption. Health Services Research. 2021;00:1–11. https://doi.org/10.1111/1475-6773.13655

  70. Rotenstein, L.S., Holmgren, A. J., Downing, N. L., & Bates, D. W. (2021) Differences in Total and After-Hours Electronic Health Record Time Across Ambulatory Specialties. JAMA Internal Medicine. Published online March 22, 2021. doi:10.1001/jamainternmed.2021.0256

  71. Co, Z., Holmgren, A. J., Classen, D. C., Newmark, L. P., Seger, D., Cole, J. M., Zimmer, K. P., Pon, B., & Bates, D. W. (2021) The Development and Piloting of the Ambulatory Electronic Health Record (EHR) Evaluation Tool: Lessons Learned. Applied Clinical Informatics. doi:10.1055/s-0041-1722917

  72. Thompson, S. C., Holmgren, A. J., & Ford, E. W. (2021) Information System Use Antecedents of Nursing Employee Turnover in a Hospital Setting. Health Care Management Review.

  73. Holmgren, A. J.,* Downing, N. L.,* Bates, D. W., Shanafelt, T., Milstein, A., Sharp, C., Cutler, D., Huckman, R. S, & Schulman, K. (2020) Assessment of Electronic Health Record Use Between US and Non-US Health Systems. JAMA Internal Medicine. Published online December 14, 2020. doi:10.1001/jamainternmed.2020.7071. Featured Editorial: Sinsky, Christine. (2020) Advancing Practice Science With Electronic Health Record Use Data.

  74. Co, Z., Holmgren, A. J., Classen, D. C., Newmark, L. P., Seger, D., Danforth, M., & Bates, D. W. (2020) The Tradeoffs Between Safety and Alert Fatigue: Data from a National Evaluation of Hospital Medication-related Clinical Decision Support. Journal of the American Medical Informatics Association. ocaa098, https://doi.org/10.1093/jamia/ocaa098

  75. Holmgren, A. J., & Apathy, N. C. (2020) Evaluation of Prescription Drug Monitoring Program Integration with Hospital Electronic Health Records by US County-level Opioid Prescribing Rates. JAMA Network Open. 2020;3(6):e209085. doi:10.1001/jamanetworkopen.2020.9085

  76. Holmgren, A. J., Botelho, A., & Brandt, A. M. (2020) A History of Prescription Drug Monitoring Programs in the United States: Political Appeal and Public Health Efficacy. American Journal of Public Health. no.(): pp. e1-e7. doi:10.2105/AJPH.2020.305696

  77. Classen, D. C., Holmgren, A. J., Co, Z., Newmark, L. P., Seger, D., Danforth, M., & Bates, D. W. (2020) National Trends in the Safety Performance of Electronic Health Record Systems: 2009-2018. JAMA Network Open. 2020;3(5):e205547. doi:10.1001/jamanetworkopen.2020.5547. Featured Editorial: Ratwani, Raj. (2020) Modest Progress on the Path to Electronic Health Record Medication Safety.

  78. Holmgren, A. J., Apathy, N. C., & Adler-Milstein, J. (2020) Barriers to Hospital Public Health Reporting and Implications for the COVID-19 Pandemic. Journal of the American Medical Informatics Association ocaa112, https://doi.org/10.1093/jamia/ocaa112

  79. Levine, D. M., Co, Z., Newmark, L.P., Groisser, A. R., Holmgren, A. J., Haas, J.S., & Bates, D.W. (2020) Design and Testing of a Mobile Health Application Rating Tool. npj Digital Medicine. 3, 74 (2020). https://doi.org/10.1038/s41746-020-0268-9

  80. Apathy, N. C., & Holmgren, A. J. (2020) Opt-in Consent Policies: Potential Barriers to Hospital Health Information Exchange. American Journal of Managed Care, 26(1), e14-e20. Health IT Special Issue.

  81. Holmgren, A. J., & Apathy, N. C. (2019) Hospital Adoption of API-Enabled Patient Data Access. Healthcare. (2019/08/27/ 2019): 100377. doi:10.1016/j.hjdsi.2019.100377

  82. Holmgren, A. J. & Adler-Milstein, J. (2019) Does Electronic Health Record Consolidation Follow Hospital Consolidation? Health Affairs Forefront. Published Online March 7, 2019. doi:10.1377/forefront.20190304.998205.

  83. Holmgren, A. J., Co, Z., Newmark, L. P., Danforth, M., Classen, D. C., & Bates, D. W. (2019) Assessing the Safety of Electronic Health Records: A National Longitudinal Study of Medication-Related Decision Support. BMJ Quality & Safety, Published Online First: 18 July 2019. doi: 10.1136/bmjqs-2019-009609. Featured Editorial: Sheikh, Aziz. (2019) Realising the Potential of Health Information Technology to Enhance Medication Safety.

  84. Holmgren, A. J., Adler-Milstein, J., & Chen, L.M. (2018) Participation in a Voluntary Bundled Payment Program by Organizations Providing Care After an Acute Hospitalization. JAMA: Journal of the American Medical Association, 320(4), 402-404. doi:10.1001/jama.2018.8666.

  85. Holmgren, A. J., & Ford, E.W. (2018) Assessing the Impact of Health System Organizational Structure on Hospital Electronic Data Sharing. Journal of the American Medical Informatics Association, 25(9), 1147-1152. doi:10.1093/jamia/ocy084

  86. Holmgren, A. J., Adler-Milstein, J., & McCullough, J. (2018). Are all certified EHRs created equal? Assessing the relationship between EHR vendor and hospital meaningful use performance. Journal of the American Medical Informatics Association, 25(6), 654-660. doi:10.1093/jamia/ocx135. Awarded Editor’s Choice.

  87. Holmgren, A. J., Patel, V., & Adler-Milstein, J. (2017) Progress in Interoperability: Measuring US Hospital Engagement in Sharing Patient Data. Health Affairs, 36(10), 1820-1827. 

  88. Adler-Milstein, J., Holmgren, A. J., Kralovec, P., Worzala, C., Searcy, T., & Patel, V. (2017) Electronic Health Record Adoption in US Hospitals: The Emergence of a Digital “Advanced Use” Divide. Journal of the American Medical Informatics Association. ocx080, doi: 10.1093/jamia/ocx080. Awarded Editor’s Choice.

  89. Holmgren, A. J., & Adler-Milstein, J. (2017) Health Information Exchange in U.S. Hospitals: The Current Landscape and a Path to Improved Information Sharing. Journal of Hospital Medicine, 12(3), 193-198. doi:10.12788/jhm.2704

  90. Holmgren, A. J., Pfeifer, E., Manojlovich, M., & Adler-Milstein, J. (2016). A Novel Survey to Examine the Relationship between Health IT Adoption and Nurse-Physician Communication. Applied Clinical Informatics, 7(4), 1182-1201. doi:10.4338/ACI-2016-08-RA-0145

  91. Holmgren, A. J., Patel, V., Charles, D., & Adler-Milstein, J. (2016). US hospital engagement in core domains of interoperability. American Journal of Managed Care, 22(12), e395-e402. Health IT Special Issue.

*Indicates co-first authorship.

OTHER RESEARCH PUBLICATIONS

  1. Gale, B., Mossburg, S., Holmgren, A. J., & McBride, S. (2023) Technology as a Tool for Improving Patient Safety. AHRQ Patient Safety Network Annual Perspective.

  2. Holmgren, A. J. (2023) The Health Information Technology Special Issue: Tackling New Challenges to Digital Transformation. The American Journal of Managed Care.

  3. Holmgren, A. J. (2019) The Prescribing Panopticon: A History of Prescription Drug Monitoring Programs. The Opioid Epidemic in Historical Perspective: An Anthology.

  4. Holmgren, A. J., & Ford, E.W. (2018) Health System Organizational Structure and Hospital Electronic Data Sharing. Proceedings of the Seventy-Eighth Annual Meeting of the Academy of Management.

TEXTBOOK CHAPTERS

  1. Holmgren, A. J., Steitz, B. D., Lou, S. S., & Apathy, N. C. Using Electronic Health Record Metadata to Understand Clinician Work and Behavior. In: Zheng, K., Westbrook, J., Patel, V. L. Editors. Cognitive Informatics in Biomedicine and Healthcare. Springer Nature Press. 2025:299-317. doi:10.1007/978-3-031-82971-0_15.

  2. Dixon, B.E., Holmgren, A. J., Adler-Milstein, J, & Grannis, S. J. (2022) Health Information Exchange and Interoperability. In: Finnell, J. T.; Dixon, B. E. Editors. Clinical Informatics Study Guide. Springer Nature Switzerland. 2022. doi:10.1007/978-3-030-93765-2_14, ISBN 978-3-030-93764-5