Medical and Hospital News
SPACE MEDICINE
Robot learns surgery skills by watching videos, matches human precision
illustration only
Robot learns surgery skills by watching videos, matches human precision
by Clarence Oxford
Los Angeles CA (SPX) Nov 12, 2024

A surgical robot trained by observing videos of experienced surgeons has successfully executed surgical tasks with a level of skill matching human doctors.

This breakthrough in robotic training employs imitation learning, significantly simplifying the process of programming surgical robots. By using visual input rather than coding each movement, this approach advances the potential for robots to perform complex surgeries autonomously.

"It's really magical to have this model and all we do is feed it camera input and it can predict the robotic movements needed for surgery," said senior author Axel Krieger. "We believe this marks a significant step forward toward a new frontier in medical robotics."

The research, highlighted at the Conference on Robot Learning in Munich, showcases collaboration between Johns Hopkins University and Stanford University. The team trained the da Vinci Surgical System, known for its widespread use but also its precision limitations, to perform tasks like needle manipulation, tissue lifting, and suturing. Unlike traditional training, which requires precise, step-by-step programming, this model uses machine learning similar to that behind ChatGPT. Instead of processing language, this model interprets kinematic data - breaking robotic motion into mathematical expressions.

Researchers trained their model using hundreds of wrist camera recordings from da Vinci robots during surgeries. These recordings, collected globally for postoperative analysis, provide a vast dataset for imitation learning. The da Vinci system, employed in nearly 7,000 units worldwide and familiar to over 50,000 surgeons, offered ample video data.

The innovation lies in training the model to recognize and execute relative motions, avoiding inaccuracies associated with absolute actions. "All we need is image input and then this AI system finds the right action," explained lead author Ji Woong "Brian" Kim. With just a few hundred demonstrations, the model can learn and adapt to new environments.

The robot demonstrated proficiency in performing the selected surgical tasks, mirroring human skill levels. Remarkably, it adapted to unexpected situations, such as picking up a dropped needle autonomously. "Here the model is so good learning things we haven't taught it," Krieger noted.

The researchers envision rapid training for various surgical procedures, contrasting with the lengthy hand-coding previously required. "It's very limiting," Krieger said. "What is new here is we only have to collect imitation learning of different procedures, and we can train a robot to learn it in a couple days. It allows us to accelerate to the goal of autonomy while reducing medical errors and achieving more accurate surgery."

The team is now working on expanding this method to train robots for complete surgeries. Contributors from Johns Hopkins included PhD student Samuel Schmidgall, Associate Research Engineer Anton Deguet, and Associate Professor Marin Kobilarov. The Stanford team included PhD student Tony Z. Zhao.

Related Links
Johns Hopkins University
Space Medicine Technology and Systems

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
SPACE MEDICINE
Oxford space lab sends first human tissue samples to ISS for ageing study
London, UK (SPX) Nov 05, 2024
The first human tissue samples from Oxford's Space Innovation Lab (SIL) are now en route to the International Space Station (ISS) to support a study examining how space microgravity influences human ageing. Researchers from SIL traveled to the Kennedy Space Centre in Florida, USA, where they integrated the samples into a payload ahead of the Tuesday morning launch (UK time). Housed within a Science Cube, the samples will be installed in the ICE Cubes Facility upon arrival at the ISS. This platform ... read more

SPACE MEDICINE
Cuba says arrests made over hurricane blackout protests; 2 quakes jolt island

Tens of thousands protest in Spain over handling of deadly floods

Online disinformation exacerbates Spain flood disaster

Fukushima trial nuclear debris removal complete

SPACE MEDICINE
Successful demo showcases BAE Systems' next-gen M-Code GNSS technology

BeiDou remote sensing experiment enhances ecological monitoring in Yellow River

Aerodata earns EASA certification for GPS anti-jamming and anti-spoofing tech

Axient secures contract for Resilient GPS Constellation under USSF Initiative

SPACE MEDICINE
Memories extend beyond the brain in new NYU study

Gentrification Fuels Alienation Among East Asian Urban Residents, Study Finds

Colombia's Awa people resist violence, maintain 'spiritual bond' with nature

A SMART method to enhance effectiveness of cartilage repair therapy

SPACE MEDICINE
New tools give researchers hope for fungus-ravaged US bats

Critically endangered Sumatran elephant calf born in Indonesia

Young Again: Study Shows Comb Jellies Can Reverse Aging

Summit to save nature enters final day with disagreement on funding

SPACE MEDICINE
Spread of dengue fever in Bangladesh worries medics

Climate shifts and urbanisation drive Nepal dengue surge

Covid lessons learned? UN summit mulls plan for healthy planet, and humans

WHO launches plan to rein in 'alarming' dengue spread

SPACE MEDICINE
Chinese slimmers trim down at weight-loss camps

China's Myanmar consulate hit with explosive device: Junta chief to visit China next month

China to almost double support for unfinished housing projects

Myanmar junta chief to travel to China next month: sources close to military

SPACE MEDICINE
El Salvador troops target gangs in large-scale operation

Hungary's Orban says corks will pop if Trump wins US election

SPACE MEDICINE
Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.