-
A Generalized Adaptive Jacobian Controller for Soft Robots
Authors:
Zixi Chen,
Xuyang Ren,
Yuya Hamamatsu,
Gastone Ciuti,
Cesare Stefanini
Abstract:
The nonlinearity and hysteresis of soft robot motions have posed challenges in control. The Jacobian controller is transferred from rigid robot controllers and exhibits conciseness, but the improper assumption of soft robots induces the feasibility only in a small local area. Accurate controllers like neural networks can deal with delayed and nonlinear motion, achieving high accuracy, but they suf…
▽ More
The nonlinearity and hysteresis of soft robot motions have posed challenges in control. The Jacobian controller is transferred from rigid robot controllers and exhibits conciseness, but the improper assumption of soft robots induces the feasibility only in a small local area. Accurate controllers like neural networks can deal with delayed and nonlinear motion, achieving high accuracy, but they suffer from the high data amount requirement and black-box property. Inspired by these approaches, we propose an adaptive generalized Jacobian controller for soft robots. This controller is constructed by the concise format of the Jacobian controller but includes more states and independent matrices, which is suitable for soft robotics. In addition, the initialization leverages the motor babbling strategy and batch optimization from neural network controllers. In experiments, we first analyze the online controllers, including the Jacobian controller, the Gaussian process regression, and our controller. Real experiments have validated that our controller outperforms the RNN controller even with fewer data samples, and it is adaptive to various situations without fine-tuning, like different control frequencies, softness, and even manufacturing errors. Future work may include online adjustment of the controller format and adaptability validation in more scenarios.
△ Less
Submitted 13 March, 2025; v1 submitted 6 June, 2024;
originally announced June 2024.
-
A Novel and Accurate BiLSTM Configuration Controller for Modular Soft Robots with Module Number Adaptability
Authors:
Zixi Chen,
Matteo Bernabei,
Vanessa Mainardi,
Xuyang Ren,
Gastone Ciuti,
Cesare Stefanini
Abstract:
Modular soft robots have shown higher potential in sophisticated tasks than single-module robots. However, the modular structure incurs the complexity of accurate control and necessitates a control strategy specifically for modular robots. In this paper, we introduce a data collection strategy and a novel and accurate bidirectional LSTM configuration controller for modular soft robots with module…
▽ More
Modular soft robots have shown higher potential in sophisticated tasks than single-module robots. However, the modular structure incurs the complexity of accurate control and necessitates a control strategy specifically for modular robots. In this paper, we introduce a data collection strategy and a novel and accurate bidirectional LSTM configuration controller for modular soft robots with module number adaptability. Such a controller can control module configurations in robots with different module numbers. Simulation cable-driven robots and real pneumatic robots have been included in experiments to validate the proposed approaches, and we have proven that our controller can be leveraged even with the increase or decrease of module number. This is the first paper that gets inspiration from the physical structure of modular robots and utilizes bidirectional LSTM for module number adaptability. Future work may include a planning method that bridges the task and configuration spaces and the integration of an online controller.
△ Less
Submitted 19 January, 2024;
originally announced January 2024.
-
A Hybrid Adaptive Controller for Soft Robot Interchangeability
Authors:
Zixi Chen,
Xuyang Ren,
Matteo Bernabei,
Vanessa Mainardi,
Gastone Ciuti,
Cesare Stefanini
Abstract:
Soft robots have been leveraged in considerable areas like surgery, rehabilitation, and bionics due to their softness, flexibility, and safety. However, it is challenging to produce two same soft robots even with the same mold and manufacturing process owing to the complexity of soft materials. Meanwhile, widespread usage of a system requires the ability to replace inner components without highly…
▽ More
Soft robots have been leveraged in considerable areas like surgery, rehabilitation, and bionics due to their softness, flexibility, and safety. However, it is challenging to produce two same soft robots even with the same mold and manufacturing process owing to the complexity of soft materials. Meanwhile, widespread usage of a system requires the ability to replace inner components without highly affecting system performance, which is interchangeability. Due to the necessity of this property, a hybrid adaptive controller is introduced to achieve interchangeability from the perspective of control approaches. This method utilizes an offline-trained recurrent neural network controller to cope with the nonlinear and delayed response from soft robots. Furthermore, an online optimizing kinematics controller is applied to decrease the error caused by the above neural network controller. Soft pneumatic robots with different deformation properties but the same mold have been included for validation experiments. In the experiments, the systems with different actuation configurations and the different robots follow the desired trajectory with errors of 3.3 +- 2.9% and 4.3 +- 4.1% compared with the working space length, respectively. Such an adaptive controller also shows good performance on different control frequencies and desired velocities. This controller is also compared with a model-based controller in simulation. This controller endows soft robots with the potential for wide application, and future work may include different offline and online controllers. A weight parameter adjusting strategy may also be proposed in the future.
△ Less
Submitted 22 November, 2023; v1 submitted 20 July, 2023;
originally announced July 2023.
-
Data-driven Methods Applied to Soft Robot Modeling and Control: A Review
Authors:
Zixi Chen,
Federico Renda,
Alexia Le Gall,
Lorenzo Mocellin,
Matteo Bernabei,
Théo Dangel,
Gastone Ciuti,
Matteo Cianchetti,
Cesare Stefanini
Abstract:
Soft robots show compliance and have infinite degrees of freedom. Thanks to these properties, such robots can be leveraged for surgery, rehabilitation, biomimetics, unstructured environment exploring, and industrial grippers. In this case, they attract scholars from a variety of areas. However, nonlinearity and hysteresis effects also bring a burden to robot modeling. Moreover, following their fle…
▽ More
Soft robots show compliance and have infinite degrees of freedom. Thanks to these properties, such robots can be leveraged for surgery, rehabilitation, biomimetics, unstructured environment exploring, and industrial grippers. In this case, they attract scholars from a variety of areas. However, nonlinearity and hysteresis effects also bring a burden to robot modeling. Moreover, following their flexibility and adaptation, soft robot control is more challenging than rigid robot control. In order to model and control soft robots, a large number of data-driven methods are utilized in pairs or separately. This review first briefly introduces two foundations for data-driven approaches, which are physical models and the Jacobian matrix, then summarizes three kinds of data-driven approaches, which are statistical method, neural network, and reinforcement learning. This review compares the modeling and controller features, e.g., model dynamics, data requirement, and target task, within and among these categories. Finally, we summarize the features of each method. A discussion about the advantages and limitations of the existing modeling and control approaches is presented, and we forecast the future of data-driven approaches in soft robots. A website (https://sites.google.com/view/23zcb) is built for this review and will be updated frequently.
△ Less
Submitted 15 March, 2024; v1 submitted 20 May, 2023;
originally announced May 2023.
-
Colonoscopy Navigation using End-to-End Deep Visuomotor Control: A User Study
Authors:
Ameya Pore,
Martina Finocchiaro,
Diego Dall'Alba,
Albert Hernansanz,
Gastone Ciuti,
Alberto Arezzo,
Arianna Menciassi,
Alicia Casals,
Paolo Fiorini
Abstract:
Flexible endoscopes for colonoscopy present several limitations due to their inherent complexity, resulting in patient discomfort and lack of intuitiveness for clinicians. Robotic devices together with autonomous control represent a viable solution to reduce the workload of endoscopists and the training time while improving the overall procedure outcome. Prior works on autonomous endoscope control…
▽ More
Flexible endoscopes for colonoscopy present several limitations due to their inherent complexity, resulting in patient discomfort and lack of intuitiveness for clinicians. Robotic devices together with autonomous control represent a viable solution to reduce the workload of endoscopists and the training time while improving the overall procedure outcome. Prior works on autonomous endoscope control use heuristic policies that limit their generalisation to the unstructured and highly deformable colon environment and require frequent human intervention. This work proposes an image-based control of the endoscope using Deep Reinforcement Learning, called Deep Visuomotor Control (DVC), to exhibit adaptive behaviour in convoluted sections of the colon tract. DVC learns a mapping between the endoscopic images and the control signal of the endoscope. A first user study of 20 expert gastrointestinal endoscopists was carried out to compare their navigation performance with DVC policies using a realistic virtual simulator. The results indicate that DVC shows equivalent performance on several assessment parameters, being more safer. Moreover, a second user study with 20 novice participants was performed to demonstrate easier human supervision compared to a state-of-the-art heuristic control policy. Seamless supervision of colonoscopy procedures would enable interventionists to focus on the medical decision rather than on the control problem of the endoscope.
△ Less
Submitted 30 June, 2022;
originally announced June 2022.
-
Towards a Computed-Aided Diagnosis System in Colonoscopy: Automatic Polyp Segmentation Using Convolution Neural Networks
Authors:
Patrick Brandao,
Odysseas Zisimopoulos,
Evangelos Mazomenos,
Gastone Ciuti,
Jorge Bernal,
Marco Visentini-Scarzanella,
Arianna Menciassi,
Paolo Dario,
Anastasios Koulaouzidis,
Alberto Arezzo,
David J Hawkes,
Danail Stoyanov
Abstract:
Early diagnosis is essential for the successful treatment of bowel cancers including colorectal cancer (CRC) and capsule endoscopic imaging with robotic actuation can be a valuable diagnostic tool when combined with automated image analysis. We present a deep learning rooted detection and segmentation framework for recognizing lesions in colonoscopy and capsule endoscopy images. We restructure est…
▽ More
Early diagnosis is essential for the successful treatment of bowel cancers including colorectal cancer (CRC) and capsule endoscopic imaging with robotic actuation can be a valuable diagnostic tool when combined with automated image analysis. We present a deep learning rooted detection and segmentation framework for recognizing lesions in colonoscopy and capsule endoscopy images. We restructure established convolution architectures, such as VGG and ResNets, by converting them into fully-connected convolution networks (FCNs), fine-tune them and study their capabilities for polyp segmentation and detection. We additionally use Shape from-Shading (SfS) to recover depth and provide a richer representation of the tissue's structure in colonoscopy images. Depth is incorporated into our network models as an additional input channel to the RGB information and we demonstrate that the resulting network yields improved performance. Our networks are tested on publicly available datasets and the most accurate segmentation model achieved a mean segmentation IU of 47.78% and 56.95% on the ETIS-Larib and CVC-Colon datasets, respectively. For polyp detection, the top performing models we propose surpass the current state of the art with detection recalls superior to 90% for all datasets tested. To our knowledge, we present the first work to use FCNs for polyp segmentation in addition to proposing a novel combination of SfS and RGB that boosts performance
△ Less
Submitted 15 January, 2021;
originally announced January 2021.
