-
OmniAcc: Personalized Accessibility Assistant Using Generative AI
Authors:
Siddhant Karki,
Ethan Han,
Nadim Mahmud,
Suman Bhunia,
John Femiani,
Vaskar Raychoudhury
Abstract:
Individuals with ambulatory disabilities often encounter significant barriers when navigating urban environments due to the lack of accessible information and tools. This paper presents OmniAcc, an AI-powered interactive navigation system that utilizes GPT-4, satellite imagery, and OpenStreetMap data to identify, classify, and map wheelchair-accessible features such as ramps and crosswalks in the…
▽ More
Individuals with ambulatory disabilities often encounter significant barriers when navigating urban environments due to the lack of accessible information and tools. This paper presents OmniAcc, an AI-powered interactive navigation system that utilizes GPT-4, satellite imagery, and OpenStreetMap data to identify, classify, and map wheelchair-accessible features such as ramps and crosswalks in the built environment. OmniAcc offers personalized route planning, real-time hands-free navigation, and instant query responses regarding physical accessibility. By using zero-shot learning and customized prompts, the system ensures precise detection of accessibility features, while supporting validation through structured workflows. This paper introduces OmniAcc and explores its potential to assist urban planners and mobility-aid users, demonstrated through a case study on crosswalk detection. With a crosswalk detection accuracy of 97.5%, OmniAcc highlights the transformative potential of AI in improving navigation and fostering more inclusive urban spaces.
△ Less
Submitted 8 September, 2025;
originally announced September 2025.
-
Mechanics Simulation with Implicit Neural Representations of Complex Geometries
Authors:
Samundra Karki,
Ming-Chen Hsu,
Adarsh Krishnamurthy,
Baskar Ganapathysubramanian
Abstract:
Implicit Neural Representations (INRs), characterized by neural network-encoded signed distance fields, provide a powerful means to represent complex geometries continuously and efficiently. While successful in computer vision and generative modeling, integrating INRs into computational analysis workflows, such as finite element simulations, remains underdeveloped. In this work, we propose a compu…
▽ More
Implicit Neural Representations (INRs), characterized by neural network-encoded signed distance fields, provide a powerful means to represent complex geometries continuously and efficiently. While successful in computer vision and generative modeling, integrating INRs into computational analysis workflows, such as finite element simulations, remains underdeveloped. In this work, we propose a computational framework that seamlessly combines INRs with the Shifted Boundary Method (SBM) for high-fidelity linear elasticity simulations without explicit geometry transformations. By directly querying the neural implicit geometry, we obtain the surrogate boundaries and distance vectors essential for SBM, effectively eliminating the meshing step. We demonstrate the efficacy and robustness of our approach through elasticity simulations on complex geometries (Stanford Bunny, Eiffel Tower, gyroids) sourced from triangle soups and point clouds. Our method showcases significant computational advantages and accuracy, underscoring its potential in biomedical, geophysical, and advanced manufacturing applications.
△ Less
Submitted 3 July, 2025;
originally announced July 2025.
-
Direct Flow Simulations with Implicit Neural Representation of Complex Geometry
Authors:
Samundra Karki,
Mehdi Shadkah,
Cheng-Hau Yang,
Aditya Balu,
Guglielmo Scovazzi,
Adarsh Krishnamurthy,
Baskar Ganapathysubramanian
Abstract:
Implicit neural representations have emerged as a powerful approach for encoding complex geometries as continuous functions. These implicit models are widely used in computer vision and 3D content creation, but their integration into scientific computing workflows, such as finite element or finite volume simulations, remains limited. One reason is that conventional simulation pipelines require exp…
▽ More
Implicit neural representations have emerged as a powerful approach for encoding complex geometries as continuous functions. These implicit models are widely used in computer vision and 3D content creation, but their integration into scientific computing workflows, such as finite element or finite volume simulations, remains limited. One reason is that conventional simulation pipelines require explicit geometric inputs (meshes), forcing INR-based shapes to be converted to meshes--a step that introduces approximation errors, computational overhead, and significant manual effort. Immersed boundary methods partially alleviate this issue by allowing simulations on background grids without body-fitted meshes. However, they still require an explicit boundary description and can suffer from numerical artifacts, such as sliver cut cells. The shifted boundary method (SBM) eliminates the need for explicit geometry by using grid-aligned surrogate boundaries, making it inherently compatible with implicit shape representations. Here, we present a framework that directly couples neural implicit geometries with SBM to perform high-fidelity fluid flow simulations without any intermediate mesh generation. By leveraging neural network inference, our approach computes the surrogate boundary and distance vectors required by SBM on-the-fly directly from the INR, thus completely bypassing traditional geometry processing. We demonstrate this approach on canonical 2D and 3D flow benchmarks (lid-driven cavity flows) and complex geometries (gyroids, the Stanford bunny, and AI-generated shapes), achieving simulation accuracy comparable to conventional mesh-based methods. This work highlights a novel pathway for integrating AI-driven geometric representations into computational physics, establishing INRs as a versatile and scalable tool for simulations and removing a long-standing bottleneck in geometry handling.
△ Less
Submitted 9 July, 2025; v1 submitted 10 March, 2025;
originally announced March 2025.
-
Performance Evaluation of LoRa Technology for Rural Connectivity: An Experimental Analysis in Nepal
Authors:
Atit Pokharel,
Pratik Sapkota,
Dilip Sapkota,
Shashank Dahal,
Sulav Karki,
Ram Kaji Budhathoki
Abstract:
LoRa technology has garnered significant interest in the Information and Communications Technology (ICT) field in recent years due to its ability to operate at low power while maintaining effective communication. Despite gaining attention, LoRa technology faces challenges in effectively facilitating communication in rural settings due to specific transmission and reception conditions. This researc…
▽ More
LoRa technology has garnered significant interest in the Information and Communications Technology (ICT) field in recent years due to its ability to operate at low power while maintaining effective communication. Despite gaining attention, LoRa technology faces challenges in effectively facilitating communication in rural settings due to specific transmission and reception conditions. This research paper provides an in-depth analysis of using a LoRa mesh network that accesses the performance of different LoRa configurations by varying parameters like Bandwidth (BW), Spreading Factor (SF), and Coding Rate (CR). Metrics, like the Received Signal Strength Indicator (RSSI), Signal-Noise Ratio (SNR), and packet loss, are analyzed to check the optimal configurations for LoRa nodes, specifically in the context of rural areas of Nepal. Furthermore, the varying propagation loss concerning the change in physical layer parameters is also discussed. The experimental setup utilizes Arduino Uno and ESP 32 microcontroller boards with LoRa modules to build the transmitter and receiver nodes, which are paired with a self-constructed monopole antenna, showing superior gain compared to commercially available options. This paper also explores the potential of integrating the acquired data with cloud platforms such as ThingSpeak. This integration establishes a strong backbone for the Internet of Things (IoT), which can gather and analyze remote data, providing the capacity for remote access to the data. This paper finally recommends specific values for the examined parameters for the specific case of a particular type of hilly and mountainous terrain in a country like Nepal, keeping in mind the unique trade-offs each one offers, thereby enabling optimal rural wireless communication.
△ Less
Submitted 5 December, 2024;
originally announced December 2024.
-
FlowBench: A Large Scale Benchmark for Flow Simulation over Complex Geometries
Authors:
Ronak Tali,
Ali Rabeh,
Cheng-Hau Yang,
Mehdi Shadkhah,
Samundra Karki,
Abhisek Upadhyaya,
Suriya Dhakshinamoorthy,
Marjan Saadati,
Soumik Sarkar,
Adarsh Krishnamurthy,
Chinmay Hegde,
Aditya Balu,
Baskar Ganapathysubramanian
Abstract:
Simulating fluid flow around arbitrary shapes is key to solving various engineering problems. However, simulating flow physics across complex geometries remains numerically challenging and computationally resource-intensive, particularly when using conventional PDE solvers. Machine learning methods offer attractive opportunities to create fast and adaptable PDE solvers. However, benchmark datasets…
▽ More
Simulating fluid flow around arbitrary shapes is key to solving various engineering problems. However, simulating flow physics across complex geometries remains numerically challenging and computationally resource-intensive, particularly when using conventional PDE solvers. Machine learning methods offer attractive opportunities to create fast and adaptable PDE solvers. However, benchmark datasets to measure the performance of such methods are scarce, especially for flow physics across complex geometries. We introduce FlowBench, a dataset for neural simulators with over 10K samples, which is currently larger than any publicly available flow physics dataset. FlowBench contains flow simulation data across complex geometries (\textit{parametric vs. non-parametric}), spanning a range of flow conditions (\textit{Reynolds number and Grashoff number}), capturing a diverse array of flow phenomena (\textit{steady vs. transient; forced vs. free convection}), and for both 2D and 3D. FlowBench contains over 10K data samples, with each sample the outcome of a fully resolved, direct numerical simulation using a well-validated simulator framework designed for modeling transport phenomena in complex geometries. For each sample, we include velocity, pressure, and temperature field data at 3 different resolutions and several summary statistics features of engineering relevance (such as coefficients of lift and drag, and Nusselt numbers). %Additionally, we include masks and signed distance fields for each shape. We envision that FlowBench will enable evaluating the interplay between complex geometry, coupled flow phenomena, and data sufficiency on the performance of current, and future, neural PDE solvers. We enumerate several evaluation metrics to help rank order the performance of neural PDE solvers. We benchmark the performance of several baseline methods including FNO, CNO, WNO, and DeepONet.
△ Less
Submitted 26 September, 2024;
originally announced September 2024.
-
Neuromorphic on-chip reservoir computing with spiking neural network architectures
Authors:
Samip Karki,
Diego Chavez Arana,
Andrew Sornborger,
Francesco Caravelli
Abstract:
Reservoir computing is a promising approach for harnessing the computational power of recurrent neural networks while dramatically simplifying training. This paper investigates the application of integrate-and-fire neurons within reservoir computing frameworks for two distinct tasks: capturing chaotic dynamics of the Hénon map and forecasting the Mackey-Glass time series. Integrate-and-fire neuron…
▽ More
Reservoir computing is a promising approach for harnessing the computational power of recurrent neural networks while dramatically simplifying training. This paper investigates the application of integrate-and-fire neurons within reservoir computing frameworks for two distinct tasks: capturing chaotic dynamics of the Hénon map and forecasting the Mackey-Glass time series. Integrate-and-fire neurons can be implemented in low-power neuromorphic architectures such as Intel Loihi. We explore the impact of network topologies created through random interactions on the reservoir's performance. Our study reveals task-specific variations in network effectiveness, highlighting the importance of tailored architectures for distinct computational tasks. To identify optimal network configurations, we employ a meta-learning approach combined with simulated annealing. This method efficiently explores the space of possible network structures, identifying architectures that excel in different scenarios. The resulting networks demonstrate a range of behaviors, showcasing how inherent architectural features influence task-specific capabilities. We study the reservoir computing performance using a custom integrate-and-fire code, Intel's Lava neuromorphic computing software framework, and via an on-chip implementation in Loihi. We conclude with an analysis of the energy performance of the Loihi architecture.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Deep Learning based Tomato Disease Detection and Remedy Suggestions using Mobile Application
Authors:
Yagya Raj Pandeya,
Samin Karki,
Ishan Dangol,
Nitesh Rajbanshi
Abstract:
We have developed a comprehensive computer system to assist farmers who practice traditional farming methods and have limited access to agricultural experts for addressing crop diseases. Our system utilizes artificial intelligence (AI) to identify and provide remedies for vegetable diseases. To ensure ease of use, we have created a mobile application that offers a user-friendly interface, allowing…
▽ More
We have developed a comprehensive computer system to assist farmers who practice traditional farming methods and have limited access to agricultural experts for addressing crop diseases. Our system utilizes artificial intelligence (AI) to identify and provide remedies for vegetable diseases. To ensure ease of use, we have created a mobile application that offers a user-friendly interface, allowing farmers to inquire about vegetable diseases and receive suitable solutions in their local language. The developed system can be utilized by any farmer with a basic understanding of a smartphone. Specifically, we have designed an AI-enabled mobile application for identifying and suggesting remedies for vegetable diseases, focusing on tomato diseases to benefit the local farming community in Nepal. Our system employs state-of-the-art object detection methodology, namely You Only Look Once (YOLO), to detect tomato diseases. The detected information is then relayed to the mobile application, which provides remedy suggestions guided by domain experts. In order to train our system effectively, we curated a dataset consisting of ten classes of tomato diseases. We utilized various data augmentation methods to address overfitting and trained a YOLOv5 object detector. The proposed method achieved a mean average precision of 0.76 and offers an efficient mobile interface for interacting with the AI system. While our system is currently in the development phase, we are actively working towards enhancing its robustness and real-time usability by accumulating more training samples.
△ Less
Submitted 16 August, 2023;
originally announced October 2023.
-
Preventing Discriminatory Decision-making in Evolving Data Streams
Authors:
Zichong Wang,
Nripsuta Saxena,
Tongjia Yu,
Sneha Karki,
Tyler Zetty,
Israat Haque,
Shan Zhou,
Dukka Kc,
Ian Stockwell,
Albert Bifet,
Wenbin Zhang
Abstract:
Bias in machine learning has rightly received significant attention over the last decade. However, most fair machine learning (fair-ML) work to address bias in decision-making systems has focused solely on the offline setting. Despite the wide prevalence of online systems in the real world, work on identifying and correcting bias in the online setting is severely lacking. The unique challenges of…
▽ More
Bias in machine learning has rightly received significant attention over the last decade. However, most fair machine learning (fair-ML) work to address bias in decision-making systems has focused solely on the offline setting. Despite the wide prevalence of online systems in the real world, work on identifying and correcting bias in the online setting is severely lacking. The unique challenges of the online environment make addressing bias more difficult than in the offline setting. First, Streaming Machine Learning (SML) algorithms must deal with the constantly evolving real-time data stream. Second, they need to adapt to changing data distributions (concept drift) to make accurate predictions on new incoming data. Adding fairness constraints to this already complicated task is not straightforward. In this work, we focus on the challenges of achieving fairness in biased data streams while accounting for the presence of concept drift, accessing one sample at a time. We present Fair Sampling over Stream ($FS^2$), a novel fair rebalancing approach capable of being integrated with SML classification algorithms. Furthermore, we devise the first unified performance-fairness metric, Fairness Bonded Utility (FBU), to evaluate and compare the trade-off between performance and fairness of different bias mitigation methods efficiently. FBU simplifies the comparison of fairness-performance trade-offs of multiple techniques through one unified and intuitive evaluation, allowing model designers to easily choose a technique. Overall, extensive evaluations show our measures surpass those of other fair online techniques previously reported in the literature.
△ Less
Submitted 15 February, 2023;
originally announced February 2023.