-
Comparison of Impedance Matching Networks for Scanning Microwave Microscopy
Authors:
Johannes Hoffmann,
Sophie de Preville,
Bruno Eckmann,
Hung-Ju Lin,
Benedikt Herzog,
Kamel Haddadi,
Didier Theron,
Georg Gramse,
Damien Richert,
Jose Moran-Meza,
Francois Piquemal
Abstract:
In this paper, a definition of the gain and added noise of impedance matching networks for scanning microwave microscopy is given. This definition can be used to compare different impedance matching techniques independently of the instrument used to measure the S-parameter. As a demonstration, impedance matching devices consisting of a Beatty line, a tuner, and interferometric setups with and with…
▽ More
In this paper, a definition of the gain and added noise of impedance matching networks for scanning microwave microscopy is given. This definition can be used to compare different impedance matching techniques independently of the instrument used to measure the S-parameter. As a demonstration, impedance matching devices consisting of a Beatty line, a tuner, and interferometric setups with and without amplifiers have been investigated. Measurement frequencies up to 28 GHz are used, and the maximal resulting gain found was 9504.7 per Siemens.
△ Less
Submitted 17 September, 2024;
originally announced September 2024.
-
Facilitating Sim-to-real by Intrinsic Stochasticity of Real-Time Simulation in Reinforcement Learning for Robot Manipulation
Authors:
Ram Dershan,
Amir M. Soufi Enayati,
Zengjie Zhang,
Dean Richert,
Homayoun Najjaran
Abstract:
Simulation is essential to reinforcement learning (RL) before implementation in the real world, especially for safety-critical applications like robot manipulation. Conventionally, RL agents are sensitive to the discrepancies between the simulation and the real world, known as the sim-to-real gap. The application of domain randomization, a technique used to fill this gap, is limited to the imposit…
▽ More
Simulation is essential to reinforcement learning (RL) before implementation in the real world, especially for safety-critical applications like robot manipulation. Conventionally, RL agents are sensitive to the discrepancies between the simulation and the real world, known as the sim-to-real gap. The application of domain randomization, a technique used to fill this gap, is limited to the imposition of heuristic-randomized models. {We investigate the properties of intrinsic stochasticity of real-time simulation (RT-IS) of off-the-shelf simulation software and its potential to improve RL performance. This improvement includes a higher tolerance to noise and model imprecision and superiority to conventional domain randomization in terms of ease of use and automation. Firstly, we conduct analytical studies to measure the correlation of RT-IS with the utilization of computer hardware and validate its comparability with the natural stochasticity of a physical robot. Then, we exploit the RT-IS feature in the training of an RL agent. The simulation and physical experiment results verify the feasibility and applicability of RT-IS to robust agent training for robot manipulation tasks. The RT-IS-powered RL agent outperforms conventional agents on robots with modeling uncertainties. RT-IS requires less heuristic randomization, is not task-dependent, and achieves better generalizability than the conventional domain-randomization-powered agents. Our findings provide a new perspective on the sim-to-real problem in practical applications like robot manipulation tasks.
△ Less
Submitted 6 August, 2023; v1 submitted 12 April, 2023;
originally announced April 2023.
-
Robust distributed linear programming
Authors:
Dean Richert,
Jorge Cortes
Abstract:
This paper presents a robust, distributed algorithm to solve general linear programs. The algorithm design builds on the characterization of the solutions of the linear program as saddle points of a modified Lagrangian function. We show that the resulting continuous-time saddle-point algorithm is provably correct but, in general, not distributed because of a global parameter associated with the no…
▽ More
This paper presents a robust, distributed algorithm to solve general linear programs. The algorithm design builds on the characterization of the solutions of the linear program as saddle points of a modified Lagrangian function. We show that the resulting continuous-time saddle-point algorithm is provably correct but, in general, not distributed because of a global parameter associated with the nonsmooth exact penalty function employed to encode the inequality constraints of the linear program. This motivates the design of a discontinuous saddle-point dynamics that, while enjoying the same convergence guarantees, is fully distributed and scalable with the dimension of the solution vector. We also characterize the robustness against disturbances and link failures of the proposed dynamics. Specifically, we show that it is integral-input-to-state stable but not input-to-state stable. The latter fact is a consequence of a more general result, that we also establish, which states that no algorithmic solution for linear programming is input-to-state stable when uncertainty in the problem data affects the dynamics as a disturbance. Our results allow us to establish the resilience of the proposed distributed dynamics to disturbances of finite variation and recurrently disconnected communication among the agents. Simulations in an optimal control application illustrate the results.
△ Less
Submitted 24 September, 2014;
originally announced September 2014.
-
Distributed bargaining in dyadic-exchange networks
Authors:
Dean Richert,
Jorge Cortes
Abstract:
This paper considers dyadic-exchange networks in which individual agents autonomously form coalitions of size two and agree on how to split a transferable utility. Valid results for this game include stable (if agents have no unilateral incentive to deviate), balanced (if matched agents obtain similar benefits from collaborating), or Nash (both stable and balanced) outcomes. We design provably-cor…
▽ More
This paper considers dyadic-exchange networks in which individual agents autonomously form coalitions of size two and agree on how to split a transferable utility. Valid results for this game include stable (if agents have no unilateral incentive to deviate), balanced (if matched agents obtain similar benefits from collaborating), or Nash (both stable and balanced) outcomes. We design provably-correct continuous-time algorithms to find each of these classes of outcomes in a distributed way. Our algorithmic design to find Nash bargaining solutions builds on the other two algorithms by having the dynamics for finding stable outcomes feeding into the one for finding balanced ones. Our technical approach to establish convergence and robustness combines notions and tools from optimization, graph theory, nonsmooth analysis, and Lyapunov stability theory and provides a useful framework for further extensions. We illustrate our results in a wireless communication scenario where single-antenna devices have the possibility of working as 2-antenna virtual devices to improve channel capacity.
△ Less
Submitted 2 June, 2014;
originally announced June 2014.
-
Distributed linear programming with event-triggered communication
Authors:
Dean Richert,
Jorge Cortes
Abstract:
We consider a network of agents whose objective is for the aggregate of their states to converge to a solution of a linear program in standard form. Each agent has limited information about the problem data and can communicate with other agents at discrete time instants of their choosing. Our main contribution is the synthesis of a distributed dynamics and a set of state-based rules, termed trigge…
▽ More
We consider a network of agents whose objective is for the aggregate of their states to converge to a solution of a linear program in standard form. Each agent has limited information about the problem data and can communicate with other agents at discrete time instants of their choosing. Our main contribution is the synthesis of a distributed dynamics and a set of state-based rules, termed triggers, that individual agents use to determine when to opportunistically broadcast their state to neighboring agents to ensure asymptotic convergence to a solution of the linear program. Our technical approach to the algorithm design and analysis overcomes a number of challenges, including establishing convergence in the absence of a common smooth Lyapunov function, ensuring that the triggers are detectable by agents using only local information, accounting for asynchronism in the state broadcasts, and ruling out various causes of arbitrarily fast state broadcasting. Various simulations illustrate our results.
△ Less
Submitted 2 May, 2014;
originally announced May 2014.
