-
QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks
Authors:
Yaojie Hu,
Qiang Zhou,
Qihong Chen,
Xiaopeng Li,
Linbo Liu,
Dejiao Zhang,
Amit Kachroo,
Talha Oz,
Omer Tripp
Abstract:
We introduce QualityFlow, a dynamic agentic workflow for program synthesis. Given the English description of a programming problem and a set of unit tests, the model's goal is to synthesize the correct program that solves the problem and passes the tests. QualityFlow includes large language model (LLM) agents resembling a software development team, including code generation, testing, and self-debu…
▽ More
We introduce QualityFlow, a dynamic agentic workflow for program synthesis. Given the English description of a programming problem and a set of unit tests, the model's goal is to synthesize the correct program that solves the problem and passes the tests. QualityFlow includes large language model (LLM) agents resembling a software development team, including code generation, testing, and self-debugging. We propose the LLM Quality Checker, which explicitly "imagines" whether the synthesized programs' execution would conform to the unit tests. The Quality Checks dynamically control the workflow, including actions to submit the final answer, clarify the problem statement, and revert previous workflow steps. Our experiments show that the Quality Checker can precisely accept any correct program, mitigate faulty synthesized tests, and prevent potential workflow deviation. QualityFlow establishes the state-of-the-art results on four program synthesis benchmarks: MBPP, HumanEval, and stricter evaluations from MBPP-EvalPlus and HumanEval-EvalPlus.
△ Less
Submitted 24 March, 2025; v1 submitted 20 January, 2025;
originally announced January 2025.
-
Sub-Resolution mmWave FMCW Radar-based Touch Localization using Deep Learning
Authors:
Raghunandan M. Rao,
Amit Kachroo,
Koushik A. Manjunatha,
Morris Hsu,
Rohit Kumar
Abstract:
Touchscreen-based interaction on display devices are ubiquitous nowadays. However, capacitive touch screens, the core technology that enables its widespread use, are prohibitively expensive to be used in large displays because the cost increases proportionally with the screen area. In this paper, we propose a millimeter wave (mmWave) radar-based solution to achieve subresolution error performance…
▽ More
Touchscreen-based interaction on display devices are ubiquitous nowadays. However, capacitive touch screens, the core technology that enables its widespread use, are prohibitively expensive to be used in large displays because the cost increases proportionally with the screen area. In this paper, we propose a millimeter wave (mmWave) radar-based solution to achieve subresolution error performance using a network of four mmWave radar sensors. Unfortunately, achieving this is non-trivial due to inherent range resolution limitations of mmWave radars, since the target (human hand, finger etc.) is 'distributed' in space. We overcome this using a deep learning-based approach, wherein we train a deep convolutional neural network (CNN) on range-FFT (range vs power profile)-based features against ground truth (GT) positions obtained using a capacitive touch screen. To emulate the clutter characteristics encountered in radar-based positioning of human fingers, we use a metallic finger mounted on a metallic robot arm as the target. Using this setup, we demonstrate subresolution position error performance. Compared to conventional signal processing (CSP)-based approaches, we achieve a 2-3x reduction in positioning error using the CNN. Furthermore, we observe that the inference time performance and CNN model size support real-time integration of our approach on general purpose processor-based computing platforms.
△ Less
Submitted 6 August, 2024;
originally announced August 2024.
-
Quantifying Uncertainty with Probabilistic Machine Learning Modeling in Wireless Sensing
Authors:
Amit Kachroo,
Sai Prashanth Chinnapalli
Abstract:
The application of machine learning (ML) techniques in wireless communication domain has seen a tremendous growth over the years especially in the wireless sensing domain. However, the questions surrounding the ML model's inference reliability, and uncertainty associated with its predictions are never answered or communicated properly. This itself raises a lot of questions on the transparency of t…
▽ More
The application of machine learning (ML) techniques in wireless communication domain has seen a tremendous growth over the years especially in the wireless sensing domain. However, the questions surrounding the ML model's inference reliability, and uncertainty associated with its predictions are never answered or communicated properly. This itself raises a lot of questions on the transparency of these ML systems. Developing ML systems with probabilistic modeling can solve this problem easily, where one can quantify uncertainty whether it is arising from the data (irreducible error or aleotoric uncertainty) or from the model itself (reducible or epistemic uncertainty). This paper describes the idea behind these types of uncertainty quantification in detail and uses a real example of WiFi channel state information (CSI) based sensing for motion/no-motion cases to demonstrate the uncertainty modeling. This work will serve as a template to model uncertainty in predictions not only for WiFi sensing but for most wireless sensing applications ranging from WiFi to millimeter wave radar based sensing that utilizes AI/ML models.
△ Less
Submitted 12 October, 2022;
originally announced October 2022.
-
Emulating UAV Motion by Utilizing Robotic Arm for mmWave Wireless Channel Characterization
Authors:
Amit Kachroo,
Collin A. Thornton,
Md Arifur Rahman Sarker,
Wooyeol Choi,
He Bai,
Ickhyun Song,
John O'Hara,
Sabit Ekin
Abstract:
In this paper, millimeter wave (mmWave) wireless channel characteristics (Doppler spread and path loss modeling) for Unmanned Aerial Vehicles (UAVs) assisted communication is analyzed and studied by emulating the real UAV motion using a robotic arm. The motion considers the actual turbulence caused by the wind gusts to the UAV in the atmosphere, which is statistically modeled by the widely used Dr…
▽ More
In this paper, millimeter wave (mmWave) wireless channel characteristics (Doppler spread and path loss modeling) for Unmanned Aerial Vehicles (UAVs) assisted communication is analyzed and studied by emulating the real UAV motion using a robotic arm. The motion considers the actual turbulence caused by the wind gusts to the UAV in the atmosphere, which is statistically modeled by the widely used Dryden wind model. The frequency under consideration is 28 GHz in an anechoic chamber setting. A total of 11 distance points from 3.5 feet to 23.5 feet in increments of 2 feet were considered in this experiment. At each distance point, 3 samples of data were collected for better inference purposes. In this emulated environment, it was found out that the average Doppler spread at these different distances was around -20 Hz and +20 Hz at the noise floor of -60 dB. On the other hand, the path loss exponent was found to be 1.843. This study presents and lays out a novel framework of emulating UAV motion for mmWave communication systems, which will pave the way out for future design and implementation of next generation UAV-assisted wireless communication systems.
△ Less
Submitted 21 March, 2021; v1 submitted 20 June, 2020;
originally announced June 2020.
-
Statistical Modelling of Dynamic Interference Threshold and Its Effect on Network Capacity
Authors:
Amit Kachroo,
Sabit Ekin,
Ali Imran
Abstract:
In this paper, we present the case of utilizing interference temperature (IT) as a dynamic quantity rather than as a fixed quantity in an orthogonal frequency division multiple access (OFDMA) based spectrum sharing systems. The fundamental idea here is to reflect the changing capacity demand of primary user (PU) over time in setting the interference power threshold for secondary user (SU). This ty…
▽ More
In this paper, we present the case of utilizing interference temperature (IT) as a dynamic quantity rather than as a fixed quantity in an orthogonal frequency division multiple access (OFDMA) based spectrum sharing systems. The fundamental idea here is to reflect the changing capacity demand of primary user (PU) over time in setting the interference power threshold for secondary user (SU). This type of dynamic IT will allow the SU to opportunistically have higher transmit power during relaxed IT period, thereby resulting in higher network capacity. The cognitive radio network (CRN) considered in this paper has an underlay network configuration in which the available spectrum of the PU is accessed concurrently by SU provided that the interference power at the PU receiver from SU is under a certain power threshold. This power threshold is set to maintain and guarantee a certain level of quality of service (QoS) for PU network. Theoretical expressions for outage probability and mean capacity for SU network are derived, and validated with simulation results, and it is observed that utilizing dynamic IT results in high network performance gains as compared to utilizing a fixed IT in cognitive radio system.
△ Less
Submitted 4 March, 2020;
originally announced March 2020.
-
Impact of Secondary User Interference on Primary Network in Cognitive Radio Systems
Authors:
Amit Kachroo,
Sabit Ekin
Abstract:
Most of the research in cognitive radio field is primarily focused on finding and improving secondary user (SU) performance parameters such as bit error rate, outage probability and capacity etc. Less attention is being paid towards the other side of the network that is the primary network which is under interference from SU. Also, it is the primary user (PU) that decides upon the interference tem…
▽ More
Most of the research in cognitive radio field is primarily focused on finding and improving secondary user (SU) performance parameters such as bit error rate, outage probability and capacity etc. Less attention is being paid towards the other side of the network that is the primary network which is under interference from SU. Also, it is the primary user (PU) that decides upon the interference temperature constraint for power adaptation to maintain a certain level of quality of service while providing access to SUs. However, given the random nature of wireless communication, interference temperature can be regulated dynamically to overcome the bottlenecks in entire network performance. In order to do so, we need to analyze the primary network carefully. This study tries to fill this gap by analytically finding the closed form theoretical expressions for signal to interference and noise ratio (SINR), mean SINR, instantaneous capacity, mean capacity and outage probability of PU, while taking peak transmit power adaptation at SU into picture. Furthermore, the expressions generated are validated with the simulation results and it is found that our theoretical derivations are in perfect accord with the simulation outcomes
△ Less
Submitted 3 September, 2018;
originally announced September 2018.
-
Optimization of LTE Radio Resource Block Allocation for Maritime Channels
Authors:
Amit Kachroo,
Mehmet Kemal Ozdemir,
Hatice Tekiner-Mogulkoc
Abstract:
In this study, we describe the behavior of LTE over the sea and investigate the problem of radio resource block allocation in such SINR limited maritime channels. For simulations of such sea environment, we considered a network scenario of Bosphorus Strait in Istanbul, Turkey with different number of ships ferrying between two ports at a given time. After exploiting the network characteristics, we…
▽ More
In this study, we describe the behavior of LTE over the sea and investigate the problem of radio resource block allocation in such SINR limited maritime channels. For simulations of such sea environment, we considered a network scenario of Bosphorus Strait in Istanbul, Turkey with different number of ships ferrying between two ports at a given time. After exploiting the network characteristics, we formulated and solved the radio resource allocation problem by max-min integer linear programming method. The radio resource allocation fairness in terms of Jain's fairness index was computed and it was compared with round robin and opportunistic methods. Results show that the max-min optimization method performs better than the opportunistic and round robin methods. This result in turn reflects that the max-min optimization method gives us the high minimum best throughput as compared to other two methods considering different ship density scenarios in the sea. Also, it was observed that as the number of ships begin to increase in the sea, the max-min method performs significantly better with good fairness as compared to the other two methods.
△ Less
Submitted 17 August, 2018;
originally announced August 2018.
