-
MARCO: Multi-Agent Code Optimization with Real-Time Knowledge Integration for High-Performance Computing
Authors:
Asif Rahman,
Veljko Cvetkovic,
Kathleen Reece,
Aidan Walters,
Yasir Hassan,
Aneesh Tummeti,
Bryan Torres,
Denise Cooney,
Margaret Ellis,
Dimitrios S. Nikolopoulos
Abstract:
Large language models (LLMs) have transformed software development through code generation capabilities, yet their effectiveness for high-performance computing (HPC) remains limited. HPC code requires specialized optimizations for parallelism, memory efficiency, and architecture-specific considerations that general-purpose LLMs often overlook. We present MARCO (Multi-Agent Reactive Code Optimizer)…
▽ More
Large language models (LLMs) have transformed software development through code generation capabilities, yet their effectiveness for high-performance computing (HPC) remains limited. HPC code requires specialized optimizations for parallelism, memory efficiency, and architecture-specific considerations that general-purpose LLMs often overlook. We present MARCO (Multi-Agent Reactive Code Optimizer), a novel framework that enhances LLM-generated code for HPC through a specialized multi-agent architecture. MARCO employs separate agents for code generation and performance evaluation, connected by a feedback loop that progressively refines optimizations. A key innovation is MARCO's web-search component that retrieves real-time optimization techniques from recent conference proceedings and research publications, bridging the knowledge gap in pre-trained LLMs. Our extensive evaluation on the LeetCode 75 problem set demonstrates that MARCO achieves a 14.6\% average runtime reduction compared to Claude 3.5 Sonnet alone, while the integration of the web-search component yields a 30.9\% performance improvement over the base MARCO system. These results highlight the potential of multi-agent systems to address the specialized requirements of high-performance code generation, offering a cost-effective alternative to domain-specific model fine-tuning.
△ Less
Submitted 25 June, 2025; v1 submitted 6 May, 2025;
originally announced May 2025.
-
Why do Opinions and Actions Diverge? A Dynamic Framework to Explore the Impact of Subjective Norms
Authors:
Chen Song,
Vladimir Cvetkovic,
Rong Su
Abstract:
Socio-psychological studies have identified a common phenomenon where an individual's public actions do not necessarily coincide with their private opinions, yet most existing models fail to capture the dynamic interplay between these two aspects. To bridge this gap, we propose a novel agent-based modeling framework that integrates opinion dynamics with a decision-making mechanism. More precisely,…
▽ More
Socio-psychological studies have identified a common phenomenon where an individual's public actions do not necessarily coincide with their private opinions, yet most existing models fail to capture the dynamic interplay between these two aspects. To bridge this gap, we propose a novel agent-based modeling framework that integrates opinion dynamics with a decision-making mechanism. More precisely, our framework generalizes the classical Hegselmann-Krause model by combining it with a utility maximization problem. Preliminary results from our model demonstrate that the degree of opinion-action divergence within a population can be effectively controlled by adjusting two key parameters that reflect agents' personality traits, while the presence of social network amplifies the divergence. In addition, we study the social diffusion process by introducing a small number of committed agents into the model, and identify three key outcomes: adoption of innovation, rejection of innovation, and the enforcement of unpopular norms, consistent with findings in socio-psychological literature. The strong relevance of the results to real-world phenomena highlights our framework's potential for future applications in understanding and predicting complex social behaviors.
△ Less
Submitted 22 March, 2025;
originally announced March 2025.
-
On the modeling of neural cognition for social network applications
Authors:
Jieqiang Wei,
Junfeng Wu,
Marco Molinari,
Vladimir Cvetkovic,
Karl H. Johansson
Abstract:
In this paper, we study neural cognition in social network. A stochastic model is introduced and shown to incorporate two well-known models in Pavlovian conditioning and social networks as special case, namely Rescorla-Wagner model and Friedkin-Johnsen model. The interpretation and comparison of these model are discussed. We consider two cases when the disturbance is independent identical distribu…
▽ More
In this paper, we study neural cognition in social network. A stochastic model is introduced and shown to incorporate two well-known models in Pavlovian conditioning and social networks as special case, namely Rescorla-Wagner model and Friedkin-Johnsen model. The interpretation and comparison of these model are discussed. We consider two cases when the disturbance is independent identical distributed for all time and when the distribution of the random variable evolves according to a markov chain. We show that the systems for both cases are mean square stable and the expectation of the states converges to consensus.
△ Less
Submitted 11 April, 2017;
originally announced April 2017.
