We use cookies to understand how you use our site and to improve your experience. This includes personalizing content and advertising. To learn more, click here. By continuing to use our site, you accept our use of cookies. Cookie Policy.

Features Partner Sites Information LinkXpress hp
Sign In
Advertise with Us
LGC Clinical Diagnostics

Download Mobile App





Robotic VR System to Teleoperate Robots for Performing COVID-19 Swab Tests

By LabMedica International staff writers
Posted on 23 Feb 2022
Print article
Image: Newly developed Robotic VR human-machine interface system (Photo courtesy of City University of Hong Kong)
Image: Newly developed Robotic VR human-machine interface system (Photo courtesy of City University of Hong Kong)

A newly-developed robotic virtual reality (VR) human-machine interface (HMI) system can teleoperate the robot to imitate the user's actions to perform complicated tasks such as COVID-19 swab tests.

A research team co-led by City University of Hong Kong (CityU Hong Kong) has developed an innovative HMI system, which consists of flexible, multi-layered electronic skin and provides both visual and haptic feedback to users. The system can teleoperate the robot to imitate the user's actions to perform complicated tasks. It demonstrates the potential for conducting COVID-19 swab tests and nursing patients with infectious diseases.

The HMI system links users to robotics or computers and plays a significant role in teleoperating robotics. However, conventional HMIs are based on bulky, rigid and expensive machines, and the lack of adequate feedback to users limits their application for conducting complicated tasks. The closed-loop HMI system is based on soft, skin-integrated electronics, which enable wireless motion capture and haptic feedback via Bluetooth, Wi-Fi and the internet.

The advanced HMI system, named Robotic VR, is an integration of visual, auditory and haptic VR via skin-integrated electronics. It uses a layout of multilayer stacking, where the bottom layer of skin-tone elastomeric silicon serves as a soft adhesive interface, which can be mounted on the skin and joints of the user. The layers are interconnected with a collection of chip-scale integrated circuits and sensing components, including resistors, capacitors, a Bluetooth module, a microcontroller unit (MCU), and soft sensors and actuators developed by the team.

The sensors of the robotic VR system can accurately detect and convert subtle human motion into electrical signals, which are processed by the MCU and wirelessly transmitted to the target robot. In this way, the user can teleoperate the robot to imitate his motion to accomplish tasks remotely. The pressure sensors on the robot can send feedback signals to control the vibration intensity of the haptic actuators through the Bluetooth module, thus providing haptic feedback to the user. The user can then precisely control and adjust the motion of the robot’s arm according to the intensity of the feedback.

The HMI system supports three wireless transmission methods – Bluetooth (up to tens of meters), Wi-Fi (up to about 100 meters), and the Internet (worldwide) – which can be adjusted according to the practical applications. The new system is stretchable and can be tightly mounted on human skin and even the whole human body for a long time. In addition, the interface provides both haptic and visual feedback systems, providing an immersive experience for users. The HMIs could teleoperate various machines. With the advanced circuit design and outstanding mechanical characteristics, the newly invented HMI system has great potential for applications in commercial and biomedical engineering fields. For example, it can be used to remotely drive unmanned cars. A user with a hand disability can remotely manipulate a robot to carry heavy goods using the HMI system. The sensors attached to the user can monitor and transmit muscle signals to control the robot.

On the biomedical engineering side, doctors can remotely control robots to conduct surgery by wearing the HMI system with VR glasses. And medical workers can remotely manipulate the robot to look after infectious patients or collecting bio-samples, thus greatly decreasing the infection risk. The team conducted experiments to demonstrate the system's potential applications, such as remotely controlling the robotic hand to collect throat swab samples for COVID-19 tests, and to teleoperate humanoid robots to clean a room and even provide patient care. The team is developing a next-generation system to provide the robotic collection of swab tests. The researchers expect the new-generation HMI system to help provide a new approach in wirelessly connecting people to a robot or virtual character in the metaverse.

“This new-generation flexible human-machine interface system enables teleoperating robotics for conducting complicated tasks,” said Dr. Yu Xinge, Associate Professor in the Department of Biomedical Engineering (BME) at CityU.

Related Links:
City University of Hong Kong 

Gold Member
COVID-19 TEST READER
COVID-19-CHECK-1 EASY READER+
Verification Panels for Assay Development & QC
Seroconversion Panels
New
Auto Clinical Chemistry Analyzer
cobas c 703
New
Silver Member
HPV Molecular Controls
ZeptoMetrix® HPV Type 16, 18, 45 & 68 Molecular Controls

Print article

Channels

Clinical Chemistry

view channel
Image: The tiny clay-based materials can be customized for a range of medical applications (Photo courtesy of Angira Roy and Sam O’Keefe)

‘Brilliantly Luminous’ Nanoscale Chemical Tool to Improve Disease Detection

Thousands of commercially available glowing molecules known as fluorophores are commonly used in medical imaging, disease detection, biomarker tagging, and chemical analysis. They are also integral in... Read more

Immunology

view channel
Image: The cancer stem cell test can accurately choose more effective treatments (Photo courtesy of University of Cincinnati)

Stem Cell Test Predicts Treatment Outcome for Patients with Platinum-Resistant Ovarian Cancer

Epithelial ovarian cancer frequently responds to chemotherapy initially, but eventually, the tumor develops resistance to the therapy, leading to regrowth. This resistance is partially due to the activation... Read more

Microbiology

view channel
Image: The lab-in-tube assay could improve TB diagnoses in rural or resource-limited areas (Photo courtesy of Kenny Lass/Tulane University)

Handheld Device Delivers Low-Cost TB Results in Less Than One Hour

Tuberculosis (TB) remains the deadliest infectious disease globally, affecting an estimated 10 million people annually. In 2021, about 4.2 million TB cases went undiagnosed or unreported, mainly due to... Read more

Pathology

view channel
Image: The ready-to-use DUB enzyme assay kits accelerate routine DUB activity assays without compromising data quality (Photo courtesy of Adobe Stock)

Sensitive and Specific DUB Enzyme Assay Kits Require Minimal Setup Without Substrate Preparation

Ubiquitination and deubiquitination are two important physiological processes in the ubiquitin-proteasome system, responsible for protein degradation in cells. Deubiquitinating (DUB) enzymes contain around... Read more

Technology

view channel
Image: The HIV-1 self-testing chip will be capable of selectively detecting HIV in whole blood samples (Photo courtesy of Shutterstock)

Disposable Microchip Technology Could Selectively Detect HIV in Whole Blood Samples

As of the end of 2023, approximately 40 million people globally were living with HIV, and around 630,000 individuals died from AIDS-related illnesses that same year. Despite a substantial decline in deaths... Read more

Industry

view channel
Image: The collaboration aims to leverage Oxford Nanopore\'s sequencing platform and Cepheid\'s GeneXpert system to advance the field of sequencing for infectious diseases (Photo courtesy of Cepheid)

Cepheid and Oxford Nanopore Technologies Partner on Advancing Automated Sequencing-Based Solutions

Cepheid (Sunnyvale, CA, USA), a leading molecular diagnostics company, and Oxford Nanopore Technologies (Oxford, UK), the company behind a new generation of sequencing-based molecular analysis technologies,... Read more
Copyright © 2000-2025 Globetech Media. All rights reserved.