• Popular
    • Medicine
    • Radiology
    • Cardiology
    • Surgery
    • Nanomedicine
    • Military Medicine
    • Rehab
  • Categories
    • Exclusive
    • A-D
      • Anesthesiology
      • Art
      • Cardiac Surgery
      • Cardiology
      • Critical Care
      • Dentistry
      • Dermatology
      • Diagnostics
    • E-I
      • Emergency Medicine
      • ENT
      • Genetics
      • Geriatrics
      • GI
      • Informatics
    • M-N
      • Medicine
      • Military Medicine
      • Nanomedicine
      • Net News
      • Neurology
      • Neurosurgery
      • Nuclear Medicine
    • O-P
      • Ob/Gyn
      • Oncology
      • Ophthalmology
      • Orthopedic Surgery
      • Pathology
      • Pediatrics
      • Plastic Surgery
      • Psychiatry
      • Public Health
    • R-V
      • Radiation Oncology
      • Radiology
      • Rehab
      • Reproductive Medicine
      • Space Medicine
      • Sports Medicine
      • Surgery
      • Thoracic Surgery
      • Urology
      • Vascular Surgery
  • SUBSCRIBE
  • Submit PR
  • About
  • Follow
    • Facebook
    • Twitter
    • Linkedin
    • Youtube
    • Instagram
    • RSS
  • Submit PR
  • Log in
Medgadget
Medgadget
  • Popular
    • Medicine
      Investigating Bacterial Motion for New Treatment Strategies

      Investigating Bacterial Motion for New Treatment Strategies

      Smart Sutures Sense Inflammation, Deliver Drugs, Cells

      Smart Sutures Sense Inflammation, Deliver Drugs, Cells

      siRNA as a COVID-19 Treatment

      siRNA as a COVID-19 Treatment

      Cancer Organoids Offer Insights into Treatment Outcomes

      Cancer Organoids Offer Insights into Treatment Outcomes

    • Radiology
      Implanted Ultrasound Lets Chemo Access Brain

      Implanted Ultrasound Lets Chemo Access Brain

      Wearable Ultrasound Measures Tissue Stiffness Under Skin

      Wearable Ultrasound Measures Tissue Stiffness Under Skin

      Brain Decoder Spells Out Thoughts

      Brain Decoder Spells Out Thoughts

      RF Technology for Health Monitoring: Michael Leabman, CTO of Movano Health

      RF Technology for Health Monitoring: Michael Leabman, CTO of Movano Health

    • Cardiology
      Pencil-on-Paper Wearable Sensor

      Pencil-on-Paper Wearable Sensor

      Cell Culture Chamber Mimics Mechanical States of Disease

      Cell Culture Chamber Mimics Mechanical States of Disease

      Chest Wearable Provides Key Heart Measurements

      Chest Wearable Provides Key Heart Measurements

      Vein on a Chip Includes Flexible Valves

      Vein on a Chip Includes Flexible Valves

    • Surgery
      Smart Sutures Sense Inflammation, Deliver Drugs, Cells

      Smart Sutures Sense Inflammation, Deliver Drugs, Cells

      Automated Computer Assistant for Kidney Transplant Rejection Diagnostics: Interview with Study Authors

      Automated Computer Assistant for Kidney Transplant Rejection Diagnostics: Interview with Study Authors

      Soft Robotic Electrode Enables Minimally Invasive Placement

      Soft Robotic Electrode Enables Minimally Invasive Placement

      Wound Dressing Detects Infection, Changes Color

      Wound Dressing Detects Infection, Changes Color

    • Nanomedicine
      Bottlebrush Nanoparticles Deliver Immunostimulatory Drugs

      Bottlebrush Nanoparticles Deliver Immunostimulatory Drugs

      Nanoparticles Deliver mRNA Therapy to the Lungs

      Nanoparticles Deliver mRNA Therapy to the Lungs

      Nanoparticles Get Lymphatic Vessels Pumping

      Nanoparticles Get Lymphatic Vessels Pumping

      Bottlebrush Particle for Synergistic Drug Combinations

      Bottlebrush Particle for Synergistic Drug Combinations

    • Military Medicine
      Wearable Can Take Multiple Sweat Samples

      Wearable Can Take Multiple Sweat Samples

      Wound Dressing Detects Infection, Changes Color

      Wound Dressing Detects Infection, Changes Color

      Device Measures Hemoglobin More Accurately in Dark Skin

      Device Measures Hemoglobin More Accurately in Dark Skin

      Fingertip Sensor Measures Lithium Levels in Sweat

      Fingertip Sensor Measures Lithium Levels in Sweat

    • Rehab
      Brain Decoder Spells Out Thoughts

      Brain Decoder Spells Out Thoughts

      Knitted Glove Massages the Hand to Treat Edema

      Knitted Glove Massages the Hand to Treat Edema

      Empowering Stroke Survivors: Interview with Kirsten Carroll, CEO at Kandu Health

      Empowering Stroke Survivors: Interview with Kirsten Carroll, CEO at Kandu Health

      Smart Walking Stick for Visually Impaired People

      Smart Walking Stick for Visually Impaired People

  • Categories
    • Exclusive
    • A-D
      • Anesthesiology
      • Art
      • Cardiac Surgery
      • Cardiology
      • Critical Care
      • Dentistry
      • Dermatology
      • Diagnostics
    • E-I
      • Emergency Medicine
      • ENT
      • Genetics
      • Geriatrics
      • GI
      • Informatics
    • M-N
      • Medicine
      • Military Medicine
      • Nanomedicine
      • Net News
      • Neurology
      • Neurosurgery
      • Nuclear Medicine
    • O-P
      • Ob/Gyn
      • Oncology
      • Ophthalmology
      • Orthopedic Surgery
      • Pathology
      • Pediatrics
      • Plastic Surgery
      • Psychiatry
      • Public Health
    • R-V
      • Radiation Oncology
      • Radiology
      • Rehab
      • Reproductive Medicine
      • Space Medicine
      • Sports Medicine
      • Surgery
      • Thoracic Surgery
      • Urology
      • Vascular Surgery
  • SUBSCRIBE
  • Submit PR
  • About
  • Log in
  • Submit PR
  • Follow
    • Facebook
    • Twitter
    • Linkedin
    • Youtube
    • Instagram
    • RSS

New System for Hands-Free Control of Image Viewer During Surgery (VIDEO)

January 10th, 2013 Medgadget Editors etc., Radiology, Surgery

Using a computer with blood on your hands can be a messy affair, so surgeons typically have another clinician navigate radiologic images during an operation. A few teams around the world have been working on using gesture recognition technology coupled with 3D cameras to allow for hands-free interaction with image viewers (see flashbacks below).

Some of the challenges of creating a practical gesture based interface for the OR is the complexity of the environment, the constant movement of the people within it, and the importance that context plays in interpreting what’s going on. Researchers at Purdue University have developed a system that uses a Microsoft Kinect 3D camera to continuously track a surgeon and make smart decisions based on the context of hand movements.

From Purdue:

The researchers validated the system, working with veterinary surgeons to collect a set of gestures natural for clinicians and surgeons. The surgeons were asked to specify functions they perform with MRI images in typical surgeries and to suggest gestures for commands. Ten gestures were chosen: rotate clockwise and counterclockwise; browse left and right; up and down; increase and decrease brightness; and zoom in and out.

Critical to the system’s accuracy is the use of “contextual information” in the operating room – cameras observe the surgeon’s torso and head – to determine and continuously monitor what the surgeon wants to do.

“A major challenge is to endow computers with the ability to understand the context in which gestures are made and to discriminate between intended gestures versus unintended gestures,” Wachs said. “Surgeons will make many gestures during the course of a surgery to communicate with other doctors and nurses. The main challenge is to create algorithms capable of understanding the difference between these gestures and those specifically intended as commands to browse the image-viewing system. We can determine context by looking at the position of the torso and the orientation of the surgeon’s gaze. Based on the direction of the gaze and the torso position we can assess whether the surgeon wants to access medical images.”

Findings showed that integrating context allows the algorithms to accurately distinguish image-browsing commands from unrelated gestures, reducing false positives from 20.8 percent to 2.3 percent.

“If you are getting false alarms 20 percent of the time, that’s a big drawback,” Wachs said. “So we’ve been able to greatly improve accuracy in distinguishing commands from other gestures.”

The system also has been shown to have a mean accuracy of about 93 percent in translating gestures into specific commands, such as rotating and browsing images.

The algorithm takes into account what phase the surgery is in, which aids in determining the proper context for interpreting the gestures and reducing the browsing time.

 

Press release: Surgeons may use hand gestures to manipulate MRI images in OR

Study in Journal of the American Medical Informatics Association: Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

Flashbacks: Siemens Kinect Based Hands-Free Radiological Image Browser; Coolest Radiological Image Browsing Just Got Cooler; Kinect-Powered Surgical Robot to Replace Scrub Nurses?; Microsoft Kinect 3D Camera for Hands-Free Radiologic Image Browsing

Medgadget Editors

Medical technologies transform the world! Join us and see the progress in real time. At Medgadget, we report the latest technology news, interview leaders in the field, and file dispatches from medical events around the world since 2004.

Sponsored

Packaging Compliance Labs (PCL) Celebrates Site Expansion in Grand Rapids, MI

Novel Approach to Assessing Lung Function Enables Improved Detection, Diagnosis and Treatment Decisions in Subject Exposed to Military Burn Pits

U.S. Patent Office Grants Additional Patent Protection For  Exoskeleton Focal-Force Angioplasty Platform

U.S. Patent Office Grants Additional Patent Protection For Exoskeleton Focal-Force Angioplasty Platform

Reliefband® State of Nausea Study Reveals More Than Three-Quarters of Americans Are Prevented from Enjoying Life As a Result of Regular Nausea

Reliefband® State of Nausea Study Reveals More Than Three-Quarters of Americans Are Prevented from Enjoying Life As a Result of Regular Nausea

New AI-Powered Voice Controls Streamline Ultrasound Imaging with All Clarius Handheld Systems

New AI-Powered Voice Controls Streamline Ultrasound Imaging with All Clarius Handheld Systems

interviews & reviews
Automated Computer Assistant for Kidney Transplant Rejection Diagnostics: Interview with Study Authors

Automated Computer Assistant for Kidney Transplant Rejection Diagnostics: Interview with Study Authors

RF Technology for Health Monitoring: Michael Leabman, CTO of Movano Health

RF Technology for Health Monitoring: Michael Leabman, CTO of Movano Health

AI’s role in Healthcare: Exclusive Interview with Catherine Estrampes, President & CEO at GE Healthcare

AI’s role in Healthcare: Exclusive Interview with Catherine Estrampes, President & CEO at GE Healthcare

Digital Self-Neuromodulation Therapy for PTSD: Interview with Oded Kraft, CEO of GrayMatters Health

Digital Self-Neuromodulation Therapy for PTSD: Interview with Oded Kraft, CEO of GrayMatters Health

Levels Is Making Metabolism and Blood Glucose Tracking Accessible To Everyone

Levels Is Making Metabolism and Blood Glucose Tracking Accessible To Everyone

Imagene Profiles Cancer Biomarkers in Real Time

Imagene Profiles Cancer Biomarkers in Real Time

Empowering Stroke Survivors: Interview with Kirsten Carroll, CEO at Kandu Health

Empowering Stroke Survivors: Interview with Kirsten Carroll, CEO at Kandu Health

  • Subscribe
  • Contact us
  • Submit
  • About
  • Back to top
Medgadget

Medical technologies transform the world! Join us and see the progress in real time. At Medgadget, we report the latest technology news, interview leaders in the field, and file dispatches from medical events around the world since 2004.

  • About
  • Editorial policies
  • Contact
  • Terms of Service
  • Privacy
  • Submit press release
  • Advertise
© Medgadget, Inc. All rights reserved. | The Medical Revolution Will Be Blogged.
Please support this website by adding us to your whitelist in your ad blocker. Ads are what helps us bring you premium content! Thank you!
  • Facebook
  • Twitter
  • LinkedIn
  • Reddit
  • Email