Overview

We are exploring using virtual characters to help educate patient-doctor communication skills. Our current system allows medical students to interview DIANA, a virtual patient. Students interact with DIANA naturally using speech and gestures. A virtual instructor, VIC, provides immediate feedback on the student’s performance.


DIANA, the virtual patient, complains of acute abdominal pain.


Head tracking data shows where the medical student is looking during the interview. This student looked mostly at DIANA's head and thus maintained adequate eye-contact for the scenario.

Extended Project Description

Project Poster

Publications

Media Coverage

Team Members

  • University of Florida, College of Engineering, Department of Computer and Information Science and Engineering
    • Benjamin Lok, Ph.D. Assistant Professor
    • Kyle Johnsen, Ph.D. Student
    • Andrew Raij, Ph.D. Student
    • Robert Dickerson, Undergraduate Student
  • University of Florida, College of Medicine
    • D. Scott Lind, MD
    • Amy Stevens, MD
    • Marc S. Cohen, MD
    • Margaret Duerson, Ph.D.
    • Juan Cendan, MD
    • Jonathan Hernandez, Medical Student
  • University of Florida, College of Education
    • Richard Ferdig, Ph.D., Assistant Professor
    • Meredith DiPietro, Ph.D. Student
    • Sebastian Foti, Ph.D. (UF Foundation)
  • Medical College of Georgia
    • Peggy Wagner, MD
    • Ruth Fincher, MD
  • University of North Carolina at Charlotte
    • Min Shin, Ph.D. Assistant Professor
    • Jonathan Jackson, MS

Research Sponsors

  • Medical College of Georgia
  • College of Medicine Chapman Education Center
  • University of Florida, CISE Department

This project uses Haptek, Inc. characters.