-
Can AI Agents Design and Implement Drug Discovery Pipelines?
Authors:
Khachik Smbatyan,
Tsolak Ghukasyan,
Tigran Aghajanyan,
Hovhannes Dabaghyan,
Sergey Adamyan,
Aram Bughdaryan,
Vahagn Altunyan,
Gagik Navasardyan,
Aram Davtyan,
Anush Hakobyan,
Aram Gharibyan,
Arman Fahradyan,
Artur Hakobyan,
Hasmik Mnatsakanyan,
Narek Ginoyan,
Garik Petrosyan
Abstract:
The rapid advancement of artificial intelligence, particularly autonomous agentic systems based on Large Language Models (LLMs), presents new opportunities to accelerate drug discovery by improving in-silico modeling and reducing dependence on costly experimental trials. Current AI agent-based systems demonstrate proficiency in solving programming challenges and conducting research, indicating an…
▽ More
The rapid advancement of artificial intelligence, particularly autonomous agentic systems based on Large Language Models (LLMs), presents new opportunities to accelerate drug discovery by improving in-silico modeling and reducing dependence on costly experimental trials. Current AI agent-based systems demonstrate proficiency in solving programming challenges and conducting research, indicating an emerging potential to develop software capable of addressing complex problems such as pharmaceutical design and drug discovery. This paper introduces DO Challenge, a benchmark designed to evaluate the decision-making abilities of AI agents in a single, complex problem resembling virtual screening scenarios. The benchmark challenges systems to independently develop, implement, and execute efficient strategies for identifying promising molecular structures from extensive datasets, while navigating chemical space, selecting models, and managing limited resources in a multi-objective context. We also discuss insights from the DO Challenge 2025, a competition based on the proposed benchmark, which showcased diverse strategies explored by human participants. Furthermore, we present the Deep Thought multi-agent system, which demonstrated strong performance on the benchmark, outperforming most human teams. Among the language models tested, Claude 3.7 Sonnet, Gemini 2.5 Pro and o3 performed best in primary agent roles, and GPT-4o, Gemini 2.0 Flash were effective in auxiliary roles. While promising, the system's performance still fell short of expert-designed solutions and showed high instability, highlighting both the potential and current limitations of AI-driven methodologies in transforming drug discovery and broader scientific research.
△ Less
Submitted 28 April, 2025;
originally announced April 2025.
-
Risk-Aware Wasserstein Distributionally Robust Control of Vessels in Natural Waterways
Authors:
Juan Moreno Nadales,
Astghik Hakobyan,
David Muñoz de la Peña,
Daniel Limon,
Insoon Yang
Abstract:
In the realm of maritime transportation, autonomous vessel navigation in natural inland waterways faces persistent challenges due to unpredictable natural factors. Existing scheduling algorithms fall short in handling these uncertainties, compromising both safety and efficiency. Moreover, these algorithms are primarily designed for non-autonomous vessels, leading to labor-intensive operations vuln…
▽ More
In the realm of maritime transportation, autonomous vessel navigation in natural inland waterways faces persistent challenges due to unpredictable natural factors. Existing scheduling algorithms fall short in handling these uncertainties, compromising both safety and efficiency. Moreover, these algorithms are primarily designed for non-autonomous vessels, leading to labor-intensive operations vulnerable to human error. To address these issues, this study proposes a risk-aware motion control approach for vessels that accounts for the dynamic and uncertain nature of tide islands in a distributionally robust manner. Specifically, a model predictive control method is employed to follow the reference trajectory in the time-space map while incorporating a risk constraint to prevent grounding accidents. To address uncertainties in tide islands, a novel modeling technique represents them as stochastic polytopes. Additionally, potential inaccuracies in waterway depth are addressed through a risk constraint that considers the worst-case uncertainty distribution within a Wasserstein ambiguity set around the empirical distribution. Using sensor data collected in the Guadalquivir River, we empirically demonstrate the performance of the proposed method through simulations on a vessel. As a result, the vessel successfully navigates the waterway while avoiding grounding accidents, even with a limited dataset of observations. This stands in contrast to existing non-robust controllers, highlighting the robustness and practical applicability of the proposed approach.
△ Less
Submitted 21 October, 2023;
originally announced October 2023.
-
Infusing model predictive control into meta-reinforcement learning for mobile robots in dynamic environments
Authors:
Jaeuk Shin,
Astghik Hakobyan,
Mingyu Park,
Yeoneung Kim,
Gihun Kim,
Insoon Yang
Abstract:
The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning (meta-RL) with model predictive control (MPC). Our method employs an off-policy meta-RL algorithm as a baseline to train a policy using transition samples generated by…
▽ More
The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning (meta-RL) with model predictive control (MPC). Our method employs an off-policy meta-RL algorithm as a baseline to train a policy using transition samples generated by MPC when the robot detects certain events that can be effectively handled by MPC, with its explicit use of robot dynamics. The key idea of our method is to switch between the meta-learned policy and the MPC controller in a randomized and event-triggered fashion to make up for suboptimal MPC actions caused by the limited prediction horizon. During meta-testing, the MPC module is deactivated to significantly reduce computation time in motion control. We further propose an online adaptation scheme that enables the robot to infer and adapt to a new task within a single trajectory. The performance of our method has been demonstrated through simulations using a nonlinear car-like vehicle model with (i) synthetic movements of obstacles, and (ii) real-world pedestrian motion data. The simulation results indicate that our method outperforms other algorithms in terms of learning efficiency and navigation quality.
△ Less
Submitted 7 July, 2022; v1 submitted 15 September, 2021;
originally announced September 2021.
-
Distributionally robust risk map for learning-based motion planning and control: A semidefinite programming approach
Authors:
Astghik Hakobyan,
Insoon Yang
Abstract:
This paper proposes a novel safety specification tool, called the distributionally robust risk map (DR-risk map), for a mobile robot operating in a learning-enabled environment. Given the robot's position, the map aims to reliably assess the conditional value-at-risk (CVaR) of collision with obstacles whose movements are inferred by Gaussian process regression (GPR). Unfortunately, the inferred di…
▽ More
This paper proposes a novel safety specification tool, called the distributionally robust risk map (DR-risk map), for a mobile robot operating in a learning-enabled environment. Given the robot's position, the map aims to reliably assess the conditional value-at-risk (CVaR) of collision with obstacles whose movements are inferred by Gaussian process regression (GPR). Unfortunately, the inferred distribution is subject to errors, making it difficult to accurately evaluate the CVaR of collision. To overcome this challenge, this tool measures the risk under the worst-case distribution in a so-called ambiguity set that characterizes allowable distribution errors. To resolve the infinite-dimensionality issue inherent in the construction of the DR-risk map, we derive a tractable semidefinite programming formulation that provides an upper bound of the risk, exploiting techniques from modern distributionally robust optimization. As a concrete application for motion planning, a distributionally robust RRT* algorithm is considered using the risk map that addresses distribution errors caused by GPR. Furthermore, a motion control method is devised using the DR-risk map in a learning-based model predictive control (MPC) formulation. In particular, a neural network approximation of the risk map is proposed to reduce the computational cost in solving the MPC problem. The performance and utility of the proposed risk map are demonstrated through simulation studies that show its ability to ensure the safety of mobile robots despite learning errors.
△ Less
Submitted 3 May, 2021;
originally announced May 2021.
-
Learning-based distributionally robust motion control with Gaussian processes
Authors:
Astghik Hakobyan,
Insoon Yang
Abstract:
Safety is a critical issue in learning-based robotic and autonomous systems as learned information about their environments is often unreliable and inaccurate. In this paper, we propose a risk-aware motion control tool that is robust against errors in learned distributional information about obstacles moving with unknown dynamics. The salient feature of our model predictive control (MPC) method is…
▽ More
Safety is a critical issue in learning-based robotic and autonomous systems as learned information about their environments is often unreliable and inaccurate. In this paper, we propose a risk-aware motion control tool that is robust against errors in learned distributional information about obstacles moving with unknown dynamics. The salient feature of our model predictive control (MPC) method is its capability of limiting the risk of unsafety even when the true distribution deviates from the distribution estimated by Gaussian process (GP) regression, within an ambiguity set. Unfortunately, the distributionally robust MPC problem with GP is intractable because the worst-case risk constraint involves an infinite-dimensional optimization problem over the ambiguity set. To remove the infinite-dimensionality issue, we develop a systematic reformulation approach exploiting modern distributionally robust optimization techniques. The performance and utility of our method are demonstrated through simulations using a nonlinear car-like vehicle model for autonomous driving.
△ Less
Submitted 5 March, 2020;
originally announced March 2020.
-
Wasserstein Distributionally Robust Motion Control for Collision Avoidance Using Conditional Value-at-Risk
Authors:
Astghik Hakobyan,
Insoon Yang
Abstract:
In this paper, a risk-aware motion control scheme is considered for mobile robots to avoid randomly moving obstacles when the true probability distribution of uncertainty is unknown. We propose a novel model predictive control (MPC) method for limiting the risk of unsafety even when the true distribution of the obstacles' movements deviates, within an ambiguity set, from the empirical distribution…
▽ More
In this paper, a risk-aware motion control scheme is considered for mobile robots to avoid randomly moving obstacles when the true probability distribution of uncertainty is unknown. We propose a novel model predictive control (MPC) method for limiting the risk of unsafety even when the true distribution of the obstacles' movements deviates, within an ambiguity set, from the empirical distribution obtained using a limited amount of sample data. By choosing the ambiguity set as a statistical ball with its radius measured by the Wasserstein metric, we achieve a probabilistic guarantee of the out-of-sample risk, evaluated using new sample data generated independently of the training data. To resolve the infinite-dimensionality issue inherent in the distributionally robust MPC problem, we reformulate it as a finite-dimensional nonlinear program using modern distributionally robust optimization techniques based on the Kantorovich duality principle. To find a globally optimal solution in the case of affine dynamics and output equations, a spatial branch-and-bound algorithm is designed using McCormick relaxation. The performance of the proposed method is demonstrated and analyzed through simulation studies using a nonlinear car-like vehicle model and a linearized quadrotor model.
△ Less
Submitted 14 January, 2020;
originally announced January 2020.
-
$S_{12}$ and $P_{12}$-colorings of cubic graphs
Authors:
Anush Hakobyan,
Vahan Mkrtchyan
Abstract:
If $G$ and $H$ are two cubic graphs, then an $H$-coloring of $G$ is a proper edge-coloring $f$ with edges of $H$, such that for each vertex $x$ of $G$, there is a vertex $y$ of $H$ with $f(\partial_G(x))=\partial_H(y)$. If $G$ admits an $H$-coloring, then we will write $H\prec G$. The Petersen coloring conjecture of Jaeger ($P_{10}$-conjecture) states that for any bridgeless cubic graph $G$, one h…
▽ More
If $G$ and $H$ are two cubic graphs, then an $H$-coloring of $G$ is a proper edge-coloring $f$ with edges of $H$, such that for each vertex $x$ of $G$, there is a vertex $y$ of $H$ with $f(\partial_G(x))=\partial_H(y)$. If $G$ admits an $H$-coloring, then we will write $H\prec G$. The Petersen coloring conjecture of Jaeger ($P_{10}$-conjecture) states that for any bridgeless cubic graph $G$, one has: $P_{10}\prec G$. The Sylvester coloring conjecture ($S_{10}$-conjecture) states that for any cubic graph $G$, $S_{10}\prec G$. In this paper, we introduce two new conjectures that are related to these conjectures. The first of them states that any cubic graph with a perfect matching admits an $S_{12}$-coloring. The second one states that any cubic graph $G$ whose edge-set can be covered with four perfect matchings, admits a $P_{12}$-coloring. We call these new conjectures $S_{12}$-conjecture and $P_{12}$-conjecture, respectively. Our first results justify the choice of graphs in $S_{12}$-conjecture and $P_{12}$-conjecture. Next, we characterize the edges of $P_{12}$ that may be fictive in a $P_{12}$-coloring of a cubic graph $G$. Finally, we relate the new conjectures to the already known conjectures by proving that $S_{12}$-conjecture implies $S_{10}$-conjecture, and $P_{12}$-conjecture and $(5,2)$-Cycle cover conjecture together imply $P_{10}$-conjecture. Our main tool for proving the latter statement is a new reformulation of $(5,2)$-Cycle cover conjecture, which states that the edge-set of any claw-free bridgeless cubic graph can be covered with four perfect matchings.
△ Less
Submitted 21 July, 2018;
originally announced July 2018.
-
On Sylvester Colorings of Cubic Graphs
Authors:
Anush Hakobyan,
Vahan Mkrtchyan
Abstract:
If $G$ and $H$ are two cubic graphs, then an $H$-coloring of $G$ is a proper edge-coloring $f$ with edges of $H$, such that for each vertex $x$ of $G$, there is a vertex $y$ of $H$ with $f(\partial_G(x))=\partial_H(y)$. If $G$ admits an $H$-coloring, then we will write $H\prec G$. The Petersen coloring conjecture of Jaeger states that for any bridgeless cubic graph $G$, one has: $P\prec G$. The se…
▽ More
If $G$ and $H$ are two cubic graphs, then an $H$-coloring of $G$ is a proper edge-coloring $f$ with edges of $H$, such that for each vertex $x$ of $G$, there is a vertex $y$ of $H$ with $f(\partial_G(x))=\partial_H(y)$. If $G$ admits an $H$-coloring, then we will write $H\prec G$. The Petersen coloring conjecture of Jaeger states that for any bridgeless cubic graph $G$, one has: $P\prec G$. The second author has recently introduced the Sylvester coloring conjecture, which states that for any cubic graph $G$ one has: $S\prec G$. Here $S$ is the Sylvester graph on $10$ vertices. In this paper, we prove the analogue of Sylvester coloring conjecture for cubic pseudo-graphs. Moreover, we show that if $G$ is any connected simple cubic graph $G$ with $G\prec P$, then $G = P$. This implies that the Petersen graph does not admit an $S_{16}$-coloring, where $S_{16}$ is the smallest connected simple cubic graph without a perfect matching. $S_{16}$ has $16$ vertices. %We conjecture that there are infinitely many connected cubic simple graphs which do not admit an %$S_{16}$-coloring. Finally, we obtain $2$ results towards the Sylvester coloring conjecture. The first result states that any cubic graph $G$ has a coloring with edges of Sylvester graph $S$ such that at least $\frac45$ of vertices of $G$ meet the conditions of Sylvester coloring conjecture. The second result states that any claw-free cubic graph graph admits an $S$-coloring. This results is an application of our result on cubic pseudo-graphs.
△ Less
Submitted 25 July, 2018; v1 submitted 8 November, 2015;
originally announced November 2015.
