The expertise required for complex trauma procedures and specializd surgeries isn't always available when needed - especially in rural and resource-strapped regions. Timely access to telemedicine in these scenarios can empower novice medics or surgeons to perform complex procedures to improve both patients' quality of care and survival outcomes. This project involves designing and developing an extended reality trauma and casualty care environment with a focus on guidance for collaborative remote surgery.

With ARTEMIS, expert surgeons in remote locations use Virtual Reality to access a live 3D reconstruction of a patient’s body and guide novice surgeons on complex procedures as if they were together in the operating room. They also have access to multiple video feeds, annotation tools, and pre-loaded procedure clips. Novice surgeons receive in-situ expert guidancethrough an intuitive Augmented Reality interface. The ARTEMIS system was developed in collaboration with the Naval Medical Center San Diego and evaluated using cadaver studies for a number of trauma procedures. More information can be found here.

Publications

M.D. Tadlock, E.J. Olson, D. Gasques, R. Champagne, M.J. Krzyzaniak, S.A. Belverud, V. Ravindra, J. Kerns, P. M Choi, J. Deveraux, J. Johnson, T. Sharkey, M. Yip, N. Weibel, K. Davis Mixed reality surgical mentoring of combat casualty care related procedures in a perfused cadaver model: Initial results of a randomized feasibility study. Surgery 2022.

Danilo Gasques, Janet G Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, Konrad Davis, Michael Yip, and Nadir Weibel. ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. CHI '21, Yokohama, Japan.

Nadir Weibel, Danilo Gasques Rodrigues, Janet G. Johnson, Thomas Sharkey, Zhuoqun Xu, Xinming Zhang, Michael Yip, and Konrad Davis. ARTEMIS: Mixed-Reality Environment for Immersive Surgial Telementoring. CHI '20 Extended Abstracts, Honolulu, HI, USA.

K.L. Davis, D. Gasques, Y.Zhang, W. Xie, J. Johnson, Y. Feng, Z. Xu, J. Riback, T. Sharkey, M. Yip, N. Weibel. ARTEMIS, Augmented Reality Technology to Enable reMote Integrated Surgery: A Review of Technical Consideration and Study Design. MHSRS '19, Orlando, USA.

Thomas Sharkey, Janet G. Johnson, Danilo Gasques, and Nadir Weibel. I Want to Be a Surgeon! Role Playing for Remote Surgery in Mixed Reality. Workshop on Interactive Systems for Healthcare, CHI '19, Glasgow, UK.