More Than Meets the Eye: Physicians’ Visual Attention in the Operating Room

Sapir Gershov; Fadi Mahameed; Aeyal Raz; Shlomi Laufer

doi:10.1007/978-3-031-47076-9_2

More Than Meets the Eye: Physicians’ Visual Attention in the Operating Room

Sapir Gershov, Fadi Mahameed, Aeyal Raz, Shlomi Laufer

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

During surgery, the patient’s vital signs and the field of endoscopic view are displayed on multiple screens. As a result, both surgeons’ and anesthesiologists’ visual attention (VA) is crucial. Moreover, the distribution of said VA and the acquisition of specific cues might directly impact patient outcomes. Recent research utilizes portable, head-mounted eye-tracking devices to gather precise and comprehensive information. Nevertheless, these technologies are not feasible for enduring data acquisition in an operating room (OR) environment. This is particularly the case during medical emergencies. This study presents an alternative methodology: a webcam-based gaze target prediction model. Such an approach may provide continuous visual behavioral data with minimal interference to the physicians’ workflow in the OR. The proposed end-to-end framework is suitable for both standard and emergency surgeries. In the future, such a platform may serve as a crucial component of context-aware assistive technologies in the OR.

Original language	English
Title of host publication	Applications of Medical Artificial Intelligence - AMAI 2023
Subtitle of host publication	2nd International Workshop - Held in Conjunction with MICCAI 2023
Editors	Shandong Wu, Behrouz Shabestari, Lei Xing
Pages	11-20
Number of pages	10
DOIs	https://doi.org/10.1007/978-3-031-47076-9_2
State	Published - 26 Oct 2023
Event	2nd International Workshop on Applications of Medical Artificial Intelligence, AMAI 2023 - Vancouver, Canada Duration: 8 Oct 2023 → 8 Oct 2023

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	14313
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	2nd International Workshop on Applications of Medical Artificial Intelligence, AMAI 2023
Country/Territory	Canada
City	Vancouver
Period	8/10/23 → 8/10/23

Keywords

Anesthesia
Deep Learning
Eye-tracking
Operation Room
Surgery
Visual Attention
Webcams

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-031-47076-9_2

Cite this

Gershov, S., Mahameed, F., Raz, A., & Laufer, S. (2023). More Than Meets the Eye: Physicians’ Visual Attention in the Operating Room. In S. Wu, B. Shabestari, & L. Xing (Eds.), Applications of Medical Artificial Intelligence - AMAI 2023: 2nd International Workshop - Held in Conjunction with MICCAI 2023 (pp. 11-20). (Lecture Notes in Computer Science; Vol. 14313). https://doi.org/10.1007/978-3-031-47076-9_2

Gershov, Sapir ; Mahameed, Fadi ; Raz, Aeyal et al. / More Than Meets the Eye : Physicians’ Visual Attention in the Operating Room. Applications of Medical Artificial Intelligence - AMAI 2023: 2nd International Workshop - Held in Conjunction with MICCAI 2023. editor / Shandong Wu ; Behrouz Shabestari ; Lei Xing. 2023. pp. 11-20 (Lecture Notes in Computer Science).

@inproceedings{97e1dccfcdf4443680d232be57c84b0c,

title = "More Than Meets the Eye: Physicians{\textquoteright} Visual Attention in the Operating Room",

abstract = "During surgery, the patient{\textquoteright}s vital signs and the field of endoscopic view are displayed on multiple screens. As a result, both surgeons{\textquoteright} and anesthesiologists{\textquoteright} visual attention (VA) is crucial. Moreover, the distribution of said VA and the acquisition of specific cues might directly impact patient outcomes. Recent research utilizes portable, head-mounted eye-tracking devices to gather precise and comprehensive information. Nevertheless, these technologies are not feasible for enduring data acquisition in an operating room (OR) environment. This is particularly the case during medical emergencies. This study presents an alternative methodology: a webcam-based gaze target prediction model. Such an approach may provide continuous visual behavioral data with minimal interference to the physicians{\textquoteright} workflow in the OR. The proposed end-to-end framework is suitable for both standard and emergency surgeries. In the future, such a platform may serve as a crucial component of context-aware assistive technologies in the OR.",

keywords = "Anesthesia, Deep Learning, Eye-tracking, Operation Room, Surgery, Visual Attention, Webcams",

author = "Sapir Gershov and Fadi Mahameed and Aeyal Raz and Shlomi Laufer",

note = "Publisher Copyright: {\textcopyright} 2024, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 2nd International Workshop on Applications of Medical Artificial Intelligence, AMAI 2023 ; Conference date: 08-10-2023 Through 08-10-2023",

year = "2023",

month = oct,

day = "26",

doi = "10.1007/978-3-031-47076-9_2",

language = "אנגלית",

isbn = "9783031470752",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "11--20",

editor = "Shandong Wu and Behrouz Shabestari and Lei Xing",

booktitle = "Applications of Medical Artificial Intelligence - AMAI 2023",

}

Gershov, S, Mahameed, F, Raz, A & Laufer, S 2023, More Than Meets the Eye: Physicians’ Visual Attention in the Operating Room. in S Wu, B Shabestari & L Xing (eds), Applications of Medical Artificial Intelligence - AMAI 2023: 2nd International Workshop - Held in Conjunction with MICCAI 2023. Lecture Notes in Computer Science, vol. 14313, pp. 11-20, 2nd International Workshop on Applications of Medical Artificial Intelligence, AMAI 2023, Vancouver, Canada, 8/10/23. https://doi.org/10.1007/978-3-031-47076-9_2

More Than Meets the Eye: Physicians’ Visual Attention in the Operating Room. / Gershov, Sapir; Mahameed, Fadi; Raz, Aeyal et al.
Applications of Medical Artificial Intelligence - AMAI 2023: 2nd International Workshop - Held in Conjunction with MICCAI 2023. ed. / Shandong Wu; Behrouz Shabestari; Lei Xing. 2023. p. 11-20 (Lecture Notes in Computer Science; Vol. 14313).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - More Than Meets the Eye

T2 - 2nd International Workshop on Applications of Medical Artificial Intelligence, AMAI 2023

AU - Gershov, Sapir

AU - Mahameed, Fadi

AU - Raz, Aeyal

AU - Laufer, Shlomi

PY - 2023/10/26

Y1 - 2023/10/26

N2 - During surgery, the patient’s vital signs and the field of endoscopic view are displayed on multiple screens. As a result, both surgeons’ and anesthesiologists’ visual attention (VA) is crucial. Moreover, the distribution of said VA and the acquisition of specific cues might directly impact patient outcomes. Recent research utilizes portable, head-mounted eye-tracking devices to gather precise and comprehensive information. Nevertheless, these technologies are not feasible for enduring data acquisition in an operating room (OR) environment. This is particularly the case during medical emergencies. This study presents an alternative methodology: a webcam-based gaze target prediction model. Such an approach may provide continuous visual behavioral data with minimal interference to the physicians’ workflow in the OR. The proposed end-to-end framework is suitable for both standard and emergency surgeries. In the future, such a platform may serve as a crucial component of context-aware assistive technologies in the OR.

AB - During surgery, the patient’s vital signs and the field of endoscopic view are displayed on multiple screens. As a result, both surgeons’ and anesthesiologists’ visual attention (VA) is crucial. Moreover, the distribution of said VA and the acquisition of specific cues might directly impact patient outcomes. Recent research utilizes portable, head-mounted eye-tracking devices to gather precise and comprehensive information. Nevertheless, these technologies are not feasible for enduring data acquisition in an operating room (OR) environment. This is particularly the case during medical emergencies. This study presents an alternative methodology: a webcam-based gaze target prediction model. Such an approach may provide continuous visual behavioral data with minimal interference to the physicians’ workflow in the OR. The proposed end-to-end framework is suitable for both standard and emergency surgeries. In the future, such a platform may serve as a crucial component of context-aware assistive technologies in the OR.

KW - Anesthesia

KW - Deep Learning

KW - Eye-tracking

KW - Operation Room

KW - Surgery

KW - Visual Attention

KW - Webcams

UR - http://www.scopus.com/inward/record.url?scp=85177213193&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-47076-9_2

DO - 10.1007/978-3-031-47076-9_2

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85177213193

SN - 9783031470752

T3 - Lecture Notes in Computer Science

SP - 11

EP - 20

BT - Applications of Medical Artificial Intelligence - AMAI 2023

A2 - Wu, Shandong

A2 - Shabestari, Behrouz

A2 - Xing, Lei

Y2 - 8 October 2023 through 8 October 2023

ER -

Gershov S, Mahameed F, Raz A, Laufer S. More Than Meets the Eye: Physicians’ Visual Attention in the Operating Room. In Wu S, Shabestari B, Xing L, editors, Applications of Medical Artificial Intelligence - AMAI 2023: 2nd International Workshop - Held in Conjunction with MICCAI 2023. 2023. p. 11-20. (Lecture Notes in Computer Science). doi: 10.1007/978-3-031-47076-9_2