The University at Buffalo Data Augmented Research Technology in Surgery (DARTS) laboratory is a unique collaboration between surgeon innovators and machine learning scientists. We inspire to democratize surgery by building a scalable and accessible surgical data science paradigm. We develop and deliver novel applications of computer vision, advanced intraoperative imaging, and artificial intelligence including multimodal large language models in surgery to improve patient outcomes, to educate and train the next generation of surgeons, and to enhance surgical expertise and excellence.
Surgical Intelligence
Creating AI models with expert level understanding of surgery
Using machine learning, deep neural networks, and multi-modal large language models, our group trains AI models to understand surgical video at an expert level. Such models are used to investigate perception of surgical video information, supplement surgical education and assist with prospective surgical action decision making (Skinner et al., 2024).
Indocyanine Green Fluorescence
Investigating novel applications and quantification of ICG
Our group investigates the application of indocyanine green fluorescence for perfusion assessment and biliary structure identification (Skinner et al., 2024). We investigate objective quantification of indocyanine green which has shown higher correlation with important clinical outcomes like anastomotic leak compared to subjective interpretation.
Laser Speckle Contrast Imaging (LCSI)
Investigating clinically novel LSCI technology
Our group investigates the application of the clinically novel laser speckle contrast imaging. This technology helps surgeons assess tissue perfusion without the use of contrast dye, that is required with indocyanine green fluorescence. (Nwaiwu et al., 2023)
We have shown that subjective interpretation of LSCI is equivalent to ICG in left-sided colorectal resections.(Skinner et al., 2024), and that objective quantification of LSCI is equivalent to quantification of ICG in pre-clinical porcine model. (Skinner et al., 2024)
Surgical Video Digital Commons
Bringing blockchain technology to surgical video enhance privacy and security
Our group has recently received seed funding from the competitive, interdisciplinary UB AI and Health fund in order to develop software to more safely collect and store and surgical videos while simultaneously making these videos accessible and analyzable for researchers in the field.
Peter C. Kim MD PhD
Vice Chair - Research & Innovation Department of Surgery
Professor of Surgery
Dr. Kim also has developed, validated, and de-risked complex technologies and FDA-cleared advanced visualization devices, including surgical robots. Dr. Kim’s team was the first to show autonomous robotic soft tissue surgical tasks.
Steven D. Schwaitzberg MD, FACS
SUNY Distinguished Service
Professor and Chairman - Department of Surgery
Dr. Schwaitzberg has developed, validated, and de-risked several complex technologies, and chaired the FDA human factors committee for medical devices. Dr. Schwaitzberg will co-lead preclinical/clinical validation and data accrual, segmentation, and validation.
Jinjun Xiong PhD
SUNY Empire Innovation Professor
Professor
Department of Computer Science and Engineering
School of Engineering and Applied Sciences
Dr. Xiong is an expert in the application of cognitive computing from industrial solutions and is the director for the SUNY at Buffalo Institute for Artificial Intelligence and Data Science. Dr. Xiong serves as a technical supervisor for the UB DARTS multiple AI and computer vision projects.
Gene Yang MD, MS
Clinical Assistant Professor
Department of Surgery
Dr. Yang is a MIS surgeon and former Medtronics Innovation fellow with deep interests in data accrual, transparency and traceability. He has been exploring advanced local hashing techniques, providing a framework that respects the confidentiality and integrity of patient information while facilitating educational and research opportunities in the surgical field.
P. Ben Ham III MD, MS
Assistant Professor
Department of Surgery
Dr. Ham is a pediatric surgeon and Director of IT for Kaleida Health affiliated with the University at Buffalo. As a clinician champion, he leads and manages IT infrastructure, data security and usability of the Cerner EHR at the Oshei Children’s Hospital.
Brian Quaranto MD
Surgical Innovation Fellow
Dr. Quaranto is a recent graduate from the UB General Surgery Residency program and will be working to support all functions of the UB DARTS team. Dr. Quaranto has developed hardware and software solutions to capture and analyze the surgeon’s unique visual perspective in the operating room and is working on developing pathways to commercialization for surgical computer vision tools.
Garrett Skinner MD
3rd Year General Surgery Resident
Dr. Skinner was Surgical Innovator-in-Residence at Activ Surgical from 2022-2024 where he helped investigate clinically novel near-infrared imaging quantification and surgical artificial intelligence . Now returning to complete his residency in General Surgery, he will continue breaking new ground integrating multi-modal large language models with surgical computer vision models.
Jiajie Li
3rd Year Computer Vision PhD Student
Department of Computer Science and Engineering
School of Engineering and Applied Sciences
Emily Hannah
4th Year Medical Student
Jacobs School of Medicine and Biomedical Sciences
Ascharya Balaji
4th Year Medical Student
Jacobs School of Medicine and Biomedical Sciences
Joshua Marek
2nd Year Medical Student
Jacobs School of Medicine and Biomedical Sciences
Gabriela Miletsky
2nd Year Medical Student
Jacobs School of Medicine and Biomedical Sciences