-
The Interplay of Polar and Nematic Order in Active Matter: Implications for Non-Equilibrium Physics and Biology
Authors:
Varun Venkatesh,
Niels de Graaf Sousa,
Amin Doostmohammadi
Abstract:
Active matter has played a pivotal role in advancing our understanding of non-equilibrium systems, leading to a fundamental shift in the study of biophysical phenomena. The foundation of active matter research is built on assumptions regarding the symmetry of microscopic constituents. While these assumptions have been validated extensively, instances of mixed or joint symmetries are prevalent in b…
▽ More
Active matter has played a pivotal role in advancing our understanding of non-equilibrium systems, leading to a fundamental shift in the study of biophysical phenomena. The foundation of active matter research is built on assumptions regarding the symmetry of microscopic constituents. While these assumptions have been validated extensively, instances of mixed or joint symmetries are prevalent in biological systems. This review explores the coexistence of polar and nematic order in active matter, emphasizing the theoretical and experimental challenges associated with these systems. By integrating insights from recent studies, we highlight the importance of considering mixed symmetries to accurately describe biological processes. This exploration not only benefits the field of biology but could also open new horizons for non-equilibrium physics, offering a comprehensive framework for understanding complex behavior in active matter.
△ Less
Submitted 6 June, 2025;
originally announced June 2025.
-
Nematic ordering in active fluids driven by substrate deformations: Mechanisms and patterning regimes
Authors:
Varun Venkatesh,
Amin Doostmohammadi
Abstract:
The interplay between active matter and its environment is central to understanding emergent behavior in biological and synthetic systems. Here, we show that coupling active nematic flows to small-amplitude deformations of a compliant substrate can fundamentally reorganize the system's dynamics. Using a model that combines active nematohydrodynamics with substrate mechanics, we find that contracti…
▽ More
The interplay between active matter and its environment is central to understanding emergent behavior in biological and synthetic systems. Here, we show that coupling active nematic flows to small-amplitude deformations of a compliant substrate can fundamentally reorganize the system's dynamics. Using a model that combines active nematohydrodynamics with substrate mechanics, we find that contractile active nematics-normally disordered in flat geometries-undergo a sharp transition to long-range orientational order when the environment is deformable. This environmentally induced ordering is robust and enables distinct patterning regimes, with wrinkle morphologies reflecting the nature of the active stresses. Our results reveal a generic mechanism by which mechanical feedback from soft environments can lead to ordering in active systems.
△ Less
Submitted 30 May, 2025;
originally announced May 2025.
-
Reinforcement Learning for Machine Learning Model Deployment: Evaluating Multi-Armed Bandits in ML Ops Environments
Authors:
S. Aaron McClendon,
Vishaal Venkatesh,
Juan Morinelli
Abstract:
In modern ML Ops environments, model deployment is a critical process that traditionally relies on static heuristics such as validation error comparisons and A/B testing. However, these methods require human intervention to adapt to real-world deployment challenges, such as model drift or unexpected performance degradation. We investigate whether reinforcement learning, specifically multi-armed ba…
▽ More
In modern ML Ops environments, model deployment is a critical process that traditionally relies on static heuristics such as validation error comparisons and A/B testing. However, these methods require human intervention to adapt to real-world deployment challenges, such as model drift or unexpected performance degradation. We investigate whether reinforcement learning, specifically multi-armed bandit (MAB) algorithms, can dynamically manage model deployment decisions more effectively. Our approach enables more adaptive production environments by continuously evaluating deployed models and rolling back underperforming ones in real-time. We test six model selection strategies across two real-world datasets and find that RL based approaches match or exceed traditional methods in performance. Our findings suggest that reinforcement learning (RL)-based model management can improve automation, reduce reliance on manual interventions, and mitigate risks associated with post-deployment model failures.
△ Less
Submitted 28 March, 2025;
originally announced March 2025.
-
SafePlan: Leveraging Formal Logic and Chain-of-Thought Reasoning for Enhanced Safety in LLM-based Robotic Task Planning
Authors:
Ike Obi,
Vishnunandan L. N. Venkatesh,
Weizheng Wang,
Ruiqi Wang,
Dayoon Suh,
Temitope I. Amosa,
Wonse Jo,
Byung-Cheol Min
Abstract:
Robotics researchers increasingly leverage large language models (LLM) in robotics systems, using them as interfaces to receive task commands, generate task plans, form team coalitions, and allocate tasks among multi-robot and human agents. However, despite their benefits, the growing adoption of LLM in robotics has raised several safety concerns, particularly regarding executing malicious or unsa…
▽ More
Robotics researchers increasingly leverage large language models (LLM) in robotics systems, using them as interfaces to receive task commands, generate task plans, form team coalitions, and allocate tasks among multi-robot and human agents. However, despite their benefits, the growing adoption of LLM in robotics has raised several safety concerns, particularly regarding executing malicious or unsafe natural language prompts. In addition, ensuring that task plans, team formation, and task allocation outputs from LLMs are adequately examined, refined, or rejected is crucial for maintaining system integrity. In this paper, we introduce SafePlan, a multi-component framework that combines formal logic and chain-of-thought reasoners for enhancing the safety of LLM-based robotics systems. Using the components of SafePlan, including Prompt Sanity COT Reasoner and Invariant, Precondition, and Postcondition COT reasoners, we examined the safety of natural language task prompts, task plans, and task allocation outputs generated by LLM-based robotic systems as means of investigating and enhancing system safety profile. Our results show that SafePlan outperforms baseline models by leading to 90.5% reduction in harmful task prompt acceptance while still maintaining reasonable acceptance of safe tasks.
△ Less
Submitted 9 March, 2025;
originally announced March 2025.
-
REBEL: Rule-based and Experience-enhanced Learning with LLMs for Initial Task Allocation in Multi-Human Multi-Robot Teaming
Authors:
Arjun Gupte,
Ruiqi Wang,
Vishnunandan L. N. Venkatesh,
Taehyeon Kim,
Dezhong Zhao,
Ziqin Yuan,
Byung-Cheol Min
Abstract:
Multi-human multi-robot teams are increasingly recognized for their efficiency in executing large-scale, complex tasks by integrating heterogeneous yet potentially synergistic humans and robots. However, this inherent heterogeneity presents significant challenges in teaming, necessitating efficient initial task allocation (ITA) strategies that optimally form complementary human-robot pairs or coll…
▽ More
Multi-human multi-robot teams are increasingly recognized for their efficiency in executing large-scale, complex tasks by integrating heterogeneous yet potentially synergistic humans and robots. However, this inherent heterogeneity presents significant challenges in teaming, necessitating efficient initial task allocation (ITA) strategies that optimally form complementary human-robot pairs or collaborative chains and establish well-matched task distributions. While current learning-based methods demonstrate promising performance, they often incur high computational costs and lack the flexibility to incorporate user preferences in multi-objective optimization (MOO) or adapt to last-minute changes in dynamic real-world environments. To address these limitations, we propose REBEL, an LLM-based ITA framework that integrates rule-based and experience-enhanced learning to enhance LLM reasoning capabilities and improve in-context adaptability to MOO and situational changes. Extensive experiments validate the effectiveness of REBEL in both single-objective and multi-objective scenarios, demonstrating superior alignment with user preferences and enhanced situational awareness to handle unexpected team composition changes. Additionally, we show that REBEL can complement pre-trained ITA policies, further boosting situational adaptability and overall team performance. Website at https://sites.google.com/view/ita-rebel .
△ Less
Submitted 14 March, 2025; v1 submitted 24 September, 2024;
originally announced September 2024.
-
MetaPix: A Data-Centric AI Development Platform for Efficient Management and Utilization of Unstructured Computer Vision Data
Authors:
Sai Vishwanath Venkatesh,
Atra Akandeh,
Madhu Lokanath
Abstract:
In today's world of advanced AI technologies, data management is a critical component of any AI/ML solution. Effective data management is vital for the creation and maintenance of high-quality, diverse datasets, which significantly enhance predictive capabilities and lead to smarter business solutions. In this work, we introduce MetaPix, a Data-centric AI platform offering comprehensive data manag…
▽ More
In today's world of advanced AI technologies, data management is a critical component of any AI/ML solution. Effective data management is vital for the creation and maintenance of high-quality, diverse datasets, which significantly enhance predictive capabilities and lead to smarter business solutions. In this work, we introduce MetaPix, a Data-centric AI platform offering comprehensive data management solutions specifically designed for unstructured data. MetaPix offers robust tools for data ingestion, processing, storage, versioning, governance, and discovery. The platform operates on four key concepts: DataSources, Datasets, Extensions and Extractors. A DataSource serves as MetaPix top level asset, representing a narrow-scoped source of data for a specific use. Datasets are MetaPix second level object, structured collections of data. Extractors are internal tools integrated into MetaPix's backend processing, facilitate data processing and enhancement. Additionally, MetaPix supports extensions, enabling integration with external third-party tools to enhance platform functionality. This paper delves into each MetaPix concept in detail, illustrating how they collectively contribute to the platform's objectives. By providing a comprehensive solution for managing and utilizing unstructured computer vision data, MetaPix equips organizations with a powerful toolset to develop AI applications effectively.
△ Less
Submitted 18 September, 2024;
originally announced September 2024.
-
Learning from Demonstration Framework for Multi-Robot Systems Using Interaction Keypoints and Soft Actor-Critic Methods
Authors:
Vishnunandan L. N. Venkatesh,
Byung-Cheol Min
Abstract:
Learning from Demonstration (LfD) is a promising approach to enable Multi-Robot Systems (MRS) to acquire complex skills and behaviors. However, the intricate interactions and coordination challenges in MRS pose significant hurdles for effective LfD. In this paper, we present a novel LfD framework specifically designed for MRS, which leverages visual demonstrations to capture and learn from robot-r…
▽ More
Learning from Demonstration (LfD) is a promising approach to enable Multi-Robot Systems (MRS) to acquire complex skills and behaviors. However, the intricate interactions and coordination challenges in MRS pose significant hurdles for effective LfD. In this paper, we present a novel LfD framework specifically designed for MRS, which leverages visual demonstrations to capture and learn from robot-robot and robot-object interactions. Our framework introduces the concept of Interaction Keypoints (IKs) to transform the visual demonstrations into a representation that facilitates the inference of various skills necessary for the task. The robots then execute the task using sensorimotor actions and reinforcement learning (RL) policies when required. A key feature of our approach is the ability to handle unseen contact-based skills that emerge during the demonstration. In such cases, RL is employed to learn the skill using a classifier-based reward function, eliminating the need for manual reward engineering and ensuring adaptability to environmental changes. We evaluate our framework across a range of mobile robot tasks, covering both behavior-based and contact-based domains. The results demonstrate the effectiveness of our approach in enabling robots to learn complex multi-robot tasks and behaviors from visual demonstrations.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
ZeroCAP: Zero-Shot Multi-Robot Context Aware Pattern Formation via Large Language Models
Authors:
Vishnunandan L. N. Venkatesh,
Byung-Cheol Min
Abstract:
Incorporating language comprehension into robotic operations unlocks significant advancements in robotics, but also presents distinct challenges, particularly in executing spatially oriented tasks like pattern formation. This paper introduces ZeroCAP, a novel system that integrates large language models with multi-robot systems for zero-shot context aware pattern formation. Grounded in the princip…
▽ More
Incorporating language comprehension into robotic operations unlocks significant advancements in robotics, but also presents distinct challenges, particularly in executing spatially oriented tasks like pattern formation. This paper introduces ZeroCAP, a novel system that integrates large language models with multi-robot systems for zero-shot context aware pattern formation. Grounded in the principles of language-conditioned robotics, ZeroCAP leverages the interpretative power of language models to translate natural language instructions into actionable robotic configurations. This approach combines the synergy of vision-language models, cutting-edge segmentation techniques and shape descriptors, enabling the realization of complex, context-driven pattern formations in the realm of multi robot coordination. Through extensive experiments, we demonstrate the systems proficiency in executing complex context aware pattern formations across a spectrum of tasks, from surrounding and caging objects to infilling regions. This not only validates the system's capability to interpret and implement intricate context-driven tasks but also underscores its adaptability and effectiveness across varied environments and scenarios. The experimental videos and additional information about this work can be found at https://sites.google.com/view/zerocap/home.
△ Less
Submitted 4 March, 2025; v1 submitted 2 April, 2024;
originally announced April 2024.
-
DynaCon: Dynamic Robot Planner with Contextual Awareness via LLMs
Authors:
Gyeongmin Kim,
Taehyeon Kim,
Shyam Sundar Kannan,
Vishnunandan L. N. Venkatesh,
Donghan Kim,
Byung-Cheol Min
Abstract:
Mobile robots often rely on pre-existing maps for effective path planning and navigation. However, when these maps are unavailable, particularly in unfamiliar environments, a different approach become essential. This paper introduces DynaCon, a novel system designed to provide mobile robots with contextual awareness and dynamic adaptability during navigation, eliminating the reliance of traditiona…
▽ More
Mobile robots often rely on pre-existing maps for effective path planning and navigation. However, when these maps are unavailable, particularly in unfamiliar environments, a different approach become essential. This paper introduces DynaCon, a novel system designed to provide mobile robots with contextual awareness and dynamic adaptability during navigation, eliminating the reliance of traditional maps. DynaCon integrates real-time feedback with an object server, prompt engineering, and navigation modules. By harnessing the capabilities of Large Language Models (LLMs), DynaCon not only understands patterns within given numeric series but also excels at categorizing objects into matched spaces. This facilitates dynamic path planner imbued with contextual awareness. We validated the effectiveness of DynaCon through an experiment where a robot successfully navigated to its goal using reasoning. Source code and experiment videos for this work can be found at: https://sites.google.com/view/dynacon.
△ Less
Submitted 27 September, 2023;
originally announced September 2023.
-
SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models
Authors:
Shyam Sundar Kannan,
Vishnunandan L. N. Venkatesh,
Byung-Cheol Min
Abstract:
In this work, we introduce SMART-LLM, an innovative framework designed for embodied multi-robot task planning. SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models (LLMs), harnesses the power of LLMs to convert high-level task instructions provided as input into a multi-robot task plan. It accomplishes this by executing a series of stages, including task decomposition, coal…
▽ More
In this work, we introduce SMART-LLM, an innovative framework designed for embodied multi-robot task planning. SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models (LLMs), harnesses the power of LLMs to convert high-level task instructions provided as input into a multi-robot task plan. It accomplishes this by executing a series of stages, including task decomposition, coalition formation, and task allocation, all guided by programmatic LLM prompts within the few-shot prompting paradigm. We create a benchmark dataset designed for validating the multi-robot task planning problem, encompassing four distinct categories of high-level instructions that vary in task complexity. Our evaluation experiments span both simulation and real-world scenarios, demonstrating that the proposed model can achieve promising results for generating multi-robot task plans. The experimental videos, code, and datasets from the work can be found at https://sites.google.com/view/smart-llm/.
△ Less
Submitted 22 March, 2024; v1 submitted 18 September, 2023;
originally announced September 2023.
-
UPPLIED: UAV Path Planning for Inspection through Demonstration
Authors:
Shyam Sundar Kannan,
Vishnunandan L. N. Venkatesh,
Revanth Krishna Senthilkumaran,
Byung-Cheol Min
Abstract:
In this paper, a new demonstration-based path-planning framework for the visual inspection of large structures using UAVs is proposed. We introduce UPPLIED: UAV Path PLanning for InspEction through Demonstration, which utilizes a demonstrated trajectory to generate a new trajectory to inspect other structures of the same kind. The demonstrated trajectory can inspect specific regions of the structu…
▽ More
In this paper, a new demonstration-based path-planning framework for the visual inspection of large structures using UAVs is proposed. We introduce UPPLIED: UAV Path PLanning for InspEction through Demonstration, which utilizes a demonstrated trajectory to generate a new trajectory to inspect other structures of the same kind. The demonstrated trajectory can inspect specific regions of the structure and the new trajectory generated by UPPLIED inspects similar regions in the other structure. The proposed method generates inspection points from the demonstrated trajectory and uses standardization to translate those inspection points to inspect the new structure. Finally, the position of these inspection points is optimized to refine their view. Numerous experiments were conducted with various structures and the proposed framework was able to generate inspection trajectories of various kinds for different structures based on the demonstration. The trajectories generated match with the demonstrated trajectory in geometry and at the same time inspect the regions inspected by the demonstration trajectory with minimum deviation. The experimental video of the work can be found at https://youtu.be/YqPx-cLkv04.
△ Less
Submitted 24 July, 2023; v1 submitted 7 March, 2023;
originally announced March 2023.
-
Influence of AI in human lives
Authors:
Meenu Varghese,
Satheesh Raj,
Vigneshwaran Venkatesh
Abstract:
Artificial Intelligence is one of the most significant and prominent technological innovations which has reshaped all aspects of human life on the lines of ease from magnitudes like shopping, data collection, driving, everyday life, medical approach and many more. On the contrary, although recent developments in both subjects that are backed by technology, progress on AI alongside CE must have mos…
▽ More
Artificial Intelligence is one of the most significant and prominent technological innovations which has reshaped all aspects of human life on the lines of ease from magnitudes like shopping, data collection, driving, everyday life, medical approach and many more. On the contrary, although recent developments in both subjects that are backed by technology, progress on AI alongside CE must have mostly been undertaken in isolation, providing little understanding into how the two areas intersect. Artificial intelligence is now widely used in services, from back-office tasks to front-line interactions with customers. This trend has accelerated in recent years. Artificial intelligence (AI)-based virtual assistants are changing successful engagement away from being dominated by humans and toward being dominated by technologies. As a result, people are expected to solve their own problems before calling customer care representatives, eventually emerging as a crucial component of providing services as value co-creators. AI-powered chats may potentially go awry, which could enrage, perplex, and anger customers. Considering all these, the main objectives of this study will engage the following
1. To identify the alterations in the scope of human searches for information offered by the application of AI?
2. To analyse how AI helps in the way someone drives the car
3. To evaluate how AI has changed the way customer interact with the customers
△ Less
Submitted 15 December, 2022;
originally announced December 2022.
-
Robust and Explainable Identification of Logical Fallacies in Natural Language Arguments
Authors:
Zhivar Sourati,
Vishnu Priya Prasanna Venkatesh,
Darshan Deshpande,
Himanshu Rawlani,
Filip Ilievski,
Hông-Ân Sandlin,
Alain Mermoud
Abstract:
The spread of misinformation, propaganda, and flawed argumentation has been amplified in the Internet era. Given the volume of data and the subtlety of identifying violations of argumentation norms, supporting information analytics tasks, like content moderation, with trustworthy methods that can identify logical fallacies is essential. In this paper, we formalize prior theoretical work on logical…
▽ More
The spread of misinformation, propaganda, and flawed argumentation has been amplified in the Internet era. Given the volume of data and the subtlety of identifying violations of argumentation norms, supporting information analytics tasks, like content moderation, with trustworthy methods that can identify logical fallacies is essential. In this paper, we formalize prior theoretical work on logical fallacies into a comprehensive three-stage evaluation framework of detection, coarse-grained, and fine-grained classification. We adapt existing evaluation datasets for each stage of the evaluation. We employ three families of robust and explainable methods based on prototype reasoning, instance-based reasoning, and knowledge injection. The methods combine language models with background knowledge and explainable mechanisms. Moreover, we address data sparsity with strategies for data augmentation and curriculum learning. Our three-stage framework natively consolidates prior datasets and methods from existing tasks, like propaganda detection, serving as an overarching evaluation testbed. We extensively evaluate these methods on our datasets, focusing on their robustness and explainability. Our results provide insight into the strengths and weaknesses of the methods on different components and fallacy classes, indicating that fallacy identification is a challenging task that may require specialized forms of reasoning to capture various classes. We share our open-source code and data on GitHub to support further work on logical fallacy identification.
△ Less
Submitted 25 September, 2023; v1 submitted 12 December, 2022;
originally announced December 2022.
-
Distinct impacts of polar and nematic self-propulsion on active unjamming
Authors:
Varun Venkatesh,
Chandana Mondal,
Amin Doostmohammadi
Abstract:
Though jamming transitions are long studied in condensed matter physics and granular systems, much less is known about active jamming (or unjamming), which commonly takes place in living materials. In this paper, we explore, by molecular dynamic simulations, the jamming-unjamming transition in a dense system of active semi-flexible filaments. In particular we characterise the distinct impact of po…
▽ More
Though jamming transitions are long studied in condensed matter physics and granular systems, much less is known about active jamming (or unjamming), which commonly takes place in living materials. In this paper, we explore, by molecular dynamic simulations, the jamming-unjamming transition in a dense system of active semi-flexible filaments. In particular we characterise the distinct impact of polar versus nematic driving for different filament rigidity and at varying density. Our results show that high densities of dynamic active filaments can be achieved by only changing the nature of the active force, nematic or polar. Interestingly, while polar driving is more effective at unjamming the system at high densities below confluency, we find that at even higher densities nematic driving enhances unjamming compared to its polar counterpart. The effect of varying the rigidity of filaments is also significantly different in the two cases: while for nematic driving lowering bending rigidity unjams the system, we find an intriguing re-entrant jamming-unjamming-jamming transition for polar driving as the filament rigidity is lowered. While the first transition (unjamming) is driven by softening due to reduced rigidity, the second transition (jamming) is a cooperative effect of ordering and coincides with the emergence of nematic order in the system. Together, through a generic model of self-propelled flexible filaments, our results demonstrate how tuning the nature of self-propulsion and flexibility can be employed by active materials to achieve high densities without getting jammed.
△ Less
Submitted 25 October, 2022; v1 submitted 17 June, 2022;
originally announced June 2022.
-
A Comprehensive Survey on the Applications of Blockchain for Securing Vehicular Networks
Authors:
Tejasvi Alladi,
Vinay Chamola,
Nishad Sahu,
Vishnu Venkatesh,
Adit Goyal,
Mohsen Guizani
Abstract:
Vehicular networks promise features such as traffic management, route scheduling, data exchange, entertainment, and much more. With any large-scale technological integration comes the challenge of providing security. Blockchain technology has been a popular choice of many studies for making the vehicular network more secure. Its characteristics meet some of the essential security requirements such…
▽ More
Vehicular networks promise features such as traffic management, route scheduling, data exchange, entertainment, and much more. With any large-scale technological integration comes the challenge of providing security. Blockchain technology has been a popular choice of many studies for making the vehicular network more secure. Its characteristics meet some of the essential security requirements such as decentralization, transparency, tamper-proof nature, and public audit. This study catalogues some of the notable efforts in this direction over the last few years. We analyze around 75 blockchain-based security schemes for vehicular networks from an application, security, and blockchain perspective. The application perspective focuses on various applications which use secure blockchain-based vehicular networks such as transportation, parking, data sharing/ trading, and resource sharing. The security perspective focuses on security requirements and attacks. The blockchain perspective focuses on blockchain platforms, blockchain types, and consensus mechanisms used in blockchain implementation. We also compile the popular simulation tools used for simulating blockchain and for simulating vehicular networks. Additionally, to give the readers a broader perspective of the research area, we discuss the role of various state-of-the-art emerging technologies in blockchain-based vehicular networks. Lastly, we summarize the survey by listing out some common challenges and the future research directions in this field.
△ Less
Submitted 13 January, 2022;
originally announced January 2022.
-
A Non-Intrusive Machine Learning Solution for Malware Detection and Data Theft Classification in Smartphones
Authors:
Sai Vishwanath Venkatesh,
Prasanna D. Kumaran,
Joish J Bosco,
Pravin R. Kumaar,
Vineeth Vijayaraghavan
Abstract:
Smartphones contain information that is more sensitive and personal than those found on computers and laptops. With an increase in the versatility of smartphone functionality, more data has become vulnerable and exposed to attackers. Successful mobile malware attacks could steal a user's location, photos, or even banking information. Due to a lack of post-attack strategies firms also risk going ou…
▽ More
Smartphones contain information that is more sensitive and personal than those found on computers and laptops. With an increase in the versatility of smartphone functionality, more data has become vulnerable and exposed to attackers. Successful mobile malware attacks could steal a user's location, photos, or even banking information. Due to a lack of post-attack strategies firms also risk going out of business due to data theft. Thus, there is a need besides just detecting malware intrusion in smartphones but to also identify the data that has been stolen to assess, aid in recovery and prevent future attacks. In this paper, we propose an accessible, non-intrusive machine learning solution to not only detect malware intrusion but also identify the type of data stolen for any app under supervision. We do this with Android usage data obtained by utilising publicly available data collection framework- SherLock. We test the performance of our architecture for multiple users on real-world data collected using the same framework. Our architecture exhibits less than 9% inaccuracy in detecting malware and can classify with 83% certainty on the type of data that is being stolen.
△ Less
Submitted 12 February, 2021;
originally announced February 2021.
-
From the DESK (Dexterous Surgical Skill) to the Battlefield -- A Robotics Exploratory Study
Authors:
Glebys T. Gonzalez,
Upinder Kaur,
Masudur Rahma,
Vishnunandan Venkatesh,
Natalia Sanchez,
Gregory Hager,
Yexiang Xue,
Richard Voyles,
Juan Wachs
Abstract:
Short response time is critical for future military medical operations in austere settings or remote areas. Such effective patient care at the point of injury can greatly benefit from the integration of semi-autonomous robotic systems. To achieve autonomy, robots would require massive libraries of maneuvers. While this is possible in controlled settings, obtaining surgical data in austere settings…
▽ More
Short response time is critical for future military medical operations in austere settings or remote areas. Such effective patient care at the point of injury can greatly benefit from the integration of semi-autonomous robotic systems. To achieve autonomy, robots would require massive libraries of maneuvers. While this is possible in controlled settings, obtaining surgical data in austere settings can be difficult. Hence, in this paper, we present the Dexterous Surgical Skill (DESK) database for knowledge transfer between robots. The peg transfer task was selected as it is one of 6 main tasks of laparoscopic training. Also, we provide a ML framework to evaluate novel transfer learning methodologies on this database. The collected DESK dataset comprises a set of surgical robotic skills using the four robotic platforms: Taurus II, simulated Taurus II, YuMi, and the da Vinci Research Kit. Then, we explored two different learning scenarios: no-transfer and domain-transfer. In the no-transfer scenario, the training and testing data were obtained from the same domain; whereas in the domain-transfer scenario, the training data is a blend of simulated and real robot data that is tested on a real robot. Using simulation data enhances the performance of the real robot where limited or no real data is available. The transfer model showed an accuracy of 81% for the YuMi robot when the ratio of real-to-simulated data was 22%-78%. For Taurus II and da Vinci robots, the model showed an accuracy of 97.5% and 93% respectively, training only with simulation data. Results indicate that simulation can be used to augment training data to enhance the performance of models in real scenarios. This shows the potential for future use of surgical data from the operating room in deployable surgical robots in remote areas.
△ Less
Submitted 30 November, 2020;
originally announced November 2020.
-
Analysis of Dimensional Influence of Convolutional Neural Networks for Histopathological Cancer Classification
Authors:
Shreyas Rajesh Labhsetwar,
Alistair Michael Baretto,
Raj Sunil Salvi,
Piyush Arvind Kolte,
Veerasai Subramaniam Venkatesh
Abstract:
Convolutional Neural Networks can be designed with different levels of complexity depending upon the task at hand. This paper analyzes the effect of dimensional changes to the CNN architecture on its performance on the task of Histopathological Cancer Classification. The research starts with a baseline 10-layer CNN model with (3 X 3) convolution filters. Thereafter, the baseline architecture is sc…
▽ More
Convolutional Neural Networks can be designed with different levels of complexity depending upon the task at hand. This paper analyzes the effect of dimensional changes to the CNN architecture on its performance on the task of Histopathological Cancer Classification. The research starts with a baseline 10-layer CNN model with (3 X 3) convolution filters. Thereafter, the baseline architecture is scaled in multiple dimensions including width, depth, resolution and a combination of all of these. Width scaling involves inculcating greater number of neurons per CNN layer, whereas depth scaling involves deepening the hierarchical layered structure. Resolution scaling is performed by increasing the dimensions of the input image, and compound scaling involves a hybrid combination of width, depth and resolution scaling. The results indicate that histopathological cancer scans are very complex in nature and hence require high resolution images fed to a large hierarchy of Convolution, MaxPooling, Dropout and Batch Normalization layers to extract all the intricacies and perform perfect classification. Since compound scaling the baseline model ensures that all the three dimensions: width, depth and resolution are scaled, the best performance is obtained with compound scaling. This research shows that better performance of CNN models is achieved by compound scaling of the baseline model for the task of Histopathological Cancer Classification.
△ Less
Submitted 22 December, 2020; v1 submitted 8 November, 2020;
originally announced November 2020.
-
Predictive Analysis of Diabetic Retinopathy with Transfer Learning
Authors:
Shreyas Rajesh Labhsetwar,
Raj Sunil Salvi,
Piyush Arvind Kolte,
Veerasai Subramaniam venkatesh,
Alistair Michael Baretto
Abstract:
With the prevalence of Diabetes, the Diabetes Mellitus Retinopathy (DR) is becoming a major health problem across the world. The long-term medical complications arising due to DR have a significant impact on the patient as well as the society, as the disease mostly affects individuals in their most productive years. Early detection and treatment can help reduce the extent of damage to the patients…
▽ More
With the prevalence of Diabetes, the Diabetes Mellitus Retinopathy (DR) is becoming a major health problem across the world. The long-term medical complications arising due to DR have a significant impact on the patient as well as the society, as the disease mostly affects individuals in their most productive years. Early detection and treatment can help reduce the extent of damage to the patients. The rise of Convolutional Neural Networks for predictive analysis in the medical field paves the way for a robust solution to DR detection. This paper studies the performance of several highly efficient and scalable CNN architectures for Diabetic Retinopathy Classification with the help of Transfer Learning. The research focuses on VGG16, Resnet50 V2 and EfficientNet B0 models. The classification performance is analyzed using several performance metrics including True Positive Rate, False Positive Rate, Accuracy, etc. Also, several performance graphs are plotted for visualizing the architecture performance including Confusion Matrix, ROC Curve, etc. The results indicate that Transfer Learning with ImageNet weights using VGG 16 model demonstrates the best classification performance with the best Accuracy of 95%. It is closely followed by ResNet50 V2 architecture with the best Accuracy of 93%. This paper shows that predictive analysis of DR from retinal images is achieved with Transfer Learning on Convolutional Neural Networks.
△ Less
Submitted 21 December, 2020; v1 submitted 8 November, 2020;
originally announced November 2020.
-
Inspection-on-the-fly using Hybrid Physical Interaction Control for Aerial Manipulators
Authors:
Abbaraju Praveen,
Xin Ma,
Harikrishnan Manoj,
Vishnunandan LN. Venkatesh,
Mo Rastgaar,
Richard M. Voyles
Abstract:
Inspection for structural properties (surface stiffness and coefficient of restitution) is crucial for understanding and performing aerial manipulations in unknown environments, with little to no prior knowledge on their state. Inspection-on-the-fly is the uncanny ability of humans to infer states during manipulation, reducing the necessity to perform inspection and manipulation separately. This p…
▽ More
Inspection for structural properties (surface stiffness and coefficient of restitution) is crucial for understanding and performing aerial manipulations in unknown environments, with little to no prior knowledge on their state. Inspection-on-the-fly is the uncanny ability of humans to infer states during manipulation, reducing the necessity to perform inspection and manipulation separately. This paper presents an infrastructure for inspection-on-the-fly method for aerial manipulators using hybrid physical interaction control. With the proposed method, structural properties (surface stiffness and coefficient of restitution) can be estimated during physical interactions. A three-stage hybrid physical interaction control paradigm is presented to robustly approach, acquire and impart a desired force signature onto a surface. This is achieved by combining a hybrid force/motion controller with a model-based feed-forward impact control as intermediate phase. The proposed controller ensures a steady transition from unconstrained motion control to constrained force control, while reducing the lag associated with the force control phase. And an underlying Operational Space dynamic configuration manager permits complex, redundant vehicle/arm combinations. Experiments were carried out in a mock-up of a Dept. of Energy exhaust shaft, to show the effectiveness of the inspection-on-the-fly method to determine the structural properties of the target surface and the performance of the hybrid physical interaction controller in reducing the lag associated with force control phase.
△ Less
Submitted 19 October, 2020;
originally announced October 2020.
-
Extending Policy from One-Shot Learning through Coaching
Authors:
Mythra V. Balakuntala,
Vishnunandan L. N. Venkatesh,
Jyothsna Padmakumar Bindu,
Richard M. Voyles,
Juan Wachs
Abstract:
Humans generally teach their fellow collaborators to perform tasks through a small number of demonstrations. The learnt task is corrected or extended to meet specific task goals by means of coaching. Adopting a similar framework for teaching robots through demonstrations and coaching makes teaching tasks highly intuitive. Unlike traditional Learning from Demonstration (LfD) approaches which requir…
▽ More
Humans generally teach their fellow collaborators to perform tasks through a small number of demonstrations. The learnt task is corrected or extended to meet specific task goals by means of coaching. Adopting a similar framework for teaching robots through demonstrations and coaching makes teaching tasks highly intuitive. Unlike traditional Learning from Demonstration (LfD) approaches which require multiple demonstrations, we present a one-shot learning from demonstration approach to learn tasks. The learnt task is corrected and generalized using two layers of evaluation/modification. First, the robot self-evaluates its performance and corrects the performance to be closer to the demonstrated task. Then, coaching is used as a means to extend the policy learnt to be adaptable to varying task goals. Both the self-evaluation and coaching are implemented using reinforcement learning (RL) methods. Coaching is achieved through human feedback on desired goal and action modification to generalize to specified task goals. The proposed approach is evaluated with a scooping task, by presenting a single demonstration. The self-evaluation framework aims to reduce the resistance to scooping in the media. To reduce the search space for RL, we bootstrap the search using least resistance path obtained using resistive force theory. Coaching is used to generalize the learnt task policy to transfer the desired quantity of material. Thus, the proposed method provides a framework for learning tasks from one demonstration and generalizing it using human feedback through coaching.
△ Less
Submitted 12 May, 2019;
originally announced May 2019.
-
Self-Evaluation in One-Shot Learning from Demonstration of Contact-Intensive Tasks
Authors:
Mythra V. Balakuntala,
L. N. Vishnunandan Venkatesh,
Jyothsna Padmakumar Bindu,
Richard M. Voyles
Abstract:
Humans naturally "program" a fellow collaborator to perform a task by demonstrating the task few times. It is intuitive, therefore, for a human to program a collaborative robot by demonstration and many paradigms use a single demonstration of the task. This is a form of one-shot learning in which a single training example, plus some context of the task, is used to infer a model of the task for sub…
▽ More
Humans naturally "program" a fellow collaborator to perform a task by demonstrating the task few times. It is intuitive, therefore, for a human to program a collaborative robot by demonstration and many paradigms use a single demonstration of the task. This is a form of one-shot learning in which a single training example, plus some context of the task, is used to infer a model of the task for subsequent execution and later refinement. This paper presents a one-shot learning from demonstration framework to learn contact-intensive tasks using only visual perception of the demonstrated task. The robot learns a policy for performing the tasks in terms of a priori skills and further uses self-evaluation based on visual and tactile perception of the skill performance to learn the force correspondences for the skills. The self-evaluation is performed based on goal states detected in the demonstration with the help of task context and the skill parameters are tuned using reinforcement learning. This approach enables the robot to learn force correspondences which cannot be inferred from a visual demonstration of the task. The effectiveness of this approach is evaluated using a vegetable peeling task.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
DESK: A Robotic Activity Dataset for Dexterous Surgical Skills Transfer to Medical Robots
Authors:
Naveen Madapana,
Md Masudur Rahman,
Natalia Sanchez-Tamayo,
Mythra V. Balakuntala,
Glebys Gonzalez,
Jyothsna Padmakumar Bindu,
L. N. Vishnunandan Venkatesh,
Xingguang Zhang,
Juan Barragan Noguera,
Thomas Low,
Richard Voyles,
Yexiang Xue,
Juan Wachs
Abstract:
Datasets are an essential component for training effective machine learning models. In particular, surgical robotic datasets have been key to many advances in semi-autonomous surgeries, skill assessment, and training. Simulated surgical environments can enhance the data collection process by making it faster, simpler and cheaper than real systems. In addition, combining data from multiple robotic…
▽ More
Datasets are an essential component for training effective machine learning models. In particular, surgical robotic datasets have been key to many advances in semi-autonomous surgeries, skill assessment, and training. Simulated surgical environments can enhance the data collection process by making it faster, simpler and cheaper than real systems. In addition, combining data from multiple robotic domains can provide rich and diverse training data for transfer learning algorithms. In this paper, we present the DESK (Dexterous Surgical Skill) dataset. It comprises a set of surgical robotic skills collected during a surgical training task using three robotic platforms: the Taurus II robot, Taurus II simulated robot, and the YuMi robot. This dataset was used to test the idea of transferring knowledge across different domains (e.g. from Taurus to YuMi robot) for a surgical gesture classification task with seven gestures. We explored three different scenarios: 1) No transfer, 2) Transfer from simulated Taurus to real Taurus and 3) Transfer from Simulated Taurus to the YuMi robot. We conducted extensive experiments with three supervised learning models and provided baselines in each of these scenarios. Results show that using simulation data during training enhances the performance on the real robot where limited real data is available. In particular, we obtained an accuracy of 55% on the real Taurus data using a model that is trained only on the simulator data. Furthermore, we achieved an accuracy improvement of 34% when 3% of the real data is added into the training process.
△ Less
Submitted 3 March, 2019;
originally announced March 2019.
-
$*$-Ricci solitons and gradient almost $*$-Ricci solitons on Kenmotsu manifolds
Authors:
Venkatesha Venkatesh,
Devaraja Mallesha Naik,
H Aruna Kumara
Abstract:
In this paper, we consider $*$-Ricci soliton in the frame-work of Kenmotsu manifolds. First, we prove that if the metric of a Kenmotsu manifold $M$ is a $*$-Ricci soliton, then soliton constant $λ$ is zero. For 3-dimensional case, if $M$ admits a $*$-Ricci soliton, then we show that $M$ is of constant sectional curvature -1. Next, we show that if $M$ admits a $*$-Ricci soliton whose potential vect…
▽ More
In this paper, we consider $*$-Ricci soliton in the frame-work of Kenmotsu manifolds. First, we prove that if the metric of a Kenmotsu manifold $M$ is a $*$-Ricci soliton, then soliton constant $λ$ is zero. For 3-dimensional case, if $M$ admits a $*$-Ricci soliton, then we show that $M$ is of constant sectional curvature -1. Next, we show that if $M$ admits a $*$-Ricci soliton whose potential vector field is collinear with the characteristic vector field $ξ$, then $M$ is Einstein and soliton vector field is equal to $ξ$. Finally, we prove that if $g$ is a gradient almost $*$-Ricci soliton, then either $M$ is Einstein or the potential vector field is collinear with the characteristic vector field on an open set of $M$. We verify our result by constructing examples for both $*$-Ricci soliton and gradient almost $*$-Ricci soliton.
△ Less
Submitted 16 January, 2019;
originally announced January 2019.
-
Water Filtration Using Plant Xylem
Authors:
Jongho Lee,
Michael S. H. Boutilier,
Valerie Chambers,
Varsha Venkatesh,
Rohit Karnik
Abstract:
Effective point-of-use devices for providing safe drinking water are urgently needed to reduce the global burden of waterborne disease. Here we show that plant xylem from the sapwood of coniferous trees - a readily available, inexpensive, biodegradable, and disposable material - can remove bacteria from water by simple pressure-driven filtration. Approximately 3 cm3 of sapwood can filter water at…
▽ More
Effective point-of-use devices for providing safe drinking water are urgently needed to reduce the global burden of waterborne disease. Here we show that plant xylem from the sapwood of coniferous trees - a readily available, inexpensive, biodegradable, and disposable material - can remove bacteria from water by simple pressure-driven filtration. Approximately 3 cm3 of sapwood can filter water at the rate of several liters per day, sufficient to meet the clean drinking water needs of one person. The results demonstrate the potential of plant xylem to address the need for pathogen-free drinking water in developing countries and resource-limited settings.
△ Less
Submitted 17 October, 2013;
originally announced October 2013.
