-
Orbit Determination through Cosmic Microwave Background Radiation
Authors:
Pedro K de Albuquerque,
Andre R Kuroswiski,
Annie S. Wu,
Willer G. dos Santos,
Paulo Costa
Abstract:
This research explores the use of Cosmic Microwave Background (CMB) radiation as a reference signal for Initial Orbit Determination (IOD). By leveraging the unique properties of CMB, this study introduces a novel method for estimating spacecraft velocity and position with minimal reliance on pre-existing environmental data, offering significant advantages for space missions independent of Earth-sp…
▽ More
This research explores the use of Cosmic Microwave Background (CMB) radiation as a reference signal for Initial Orbit Determination (IOD). By leveraging the unique properties of CMB, this study introduces a novel method for estimating spacecraft velocity and position with minimal reliance on pre-existing environmental data, offering significant advantages for space missions independent of Earth-specific conditions. Using Machine Learning (ML) regression models, this approach demonstrates the capability to determine velocity from CMB signals and subsequently determine the satellite's position. The results indicate that CMB has the potential to enhance the autonomy and flexibility of spacecraft operations.
△ Less
Submitted 2 April, 2025;
originally announced April 2025.
-
Attention-Driven Multi-Agent Reinforcement Learning: Enhancing Decisions with Expertise-Informed Tasks
Authors:
Andre R Kuroswiski,
Annie S Wu,
Angelo Passaro
Abstract:
In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of domain-specific expertise into the learning process, which simplifies the development of collaborative behaviors. This approach aims to reduce the complexity and…
▽ More
In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of domain-specific expertise into the learning process, which simplifies the development of collaborative behaviors. This approach aims to reduce the complexity and learning overhead typically associated with MARL by enabling agents to concentrate on essential aspects of complex tasks, thus optimizing the learning curve. The utilization of attention mechanisms plays a key role in our model. It allows for the effective processing of dynamic context data and nuanced agent interactions, leading to more refined decision-making. Applied in standard MARL scenarios, such as the Stanford Intelligent Systems Laboratory (SISL) Pursuit and Multi-Particle Environments (MPE) Simple Spread, our method has been shown to improve both learning efficiency and the effectiveness of collaborative behaviors. The results indicate that our attention-based approach can be a viable approach for improving the efficiency of MARL training process, integrating domain-specific knowledge at the action level.
△ Less
Submitted 17 May, 2024; v1 submitted 8 April, 2024;
originally announced April 2024.
-
PID-inspired modifications in response threshold models in swarm intelligent systems
Authors:
Maryam Kebari,
Annie S. Wu,
H. David Mathias
Abstract:
In this study, we investigate the effectiveness of using the PID (Proportional - Integral - Derivative) control loop factors for modifying response thresholds in a decentralized, non-communicating, threshold-based swarm. Each agent in our swarm has a set of four thresholds, each corresponding to a task the agent is capable of performing. The agent will act on a particular task if the stimulus is h…
▽ More
In this study, we investigate the effectiveness of using the PID (Proportional - Integral - Derivative) control loop factors for modifying response thresholds in a decentralized, non-communicating, threshold-based swarm. Each agent in our swarm has a set of four thresholds, each corresponding to a task the agent is capable of performing. The agent will act on a particular task if the stimulus is higher than its corresponding threshold. The ability to modify their thresholds allows the agents to specialize dynamically in response to task demands. Current approaches to dynamic thresholds typically use a learning and forgetting process to adjust thresholds. These methods are able to effectively specialize once, but can have difficulty re-specializing if the task demands change. Our approach, inspired by the PID control loop, alters the threshold values based on the current task demand value, the change in task demand, and the cumulative sum of previous task demands. We show that our PID-inspired method is scalable and outperforms fixed and current learning and forgetting response thresholds with non-changing, constant, and abrupt changes in task demand. This superior performance is due to the ability of our method to re-specialize repeatedly in response to changing task demands.
△ Less
Submitted 24 April, 2023;
originally announced April 2023.
-
Analysis of Evolved Response Thresholds for Decentralized Dynamic Task Allocation
Authors:
H. David Mathias,
Annie S. Wu,
Daniel Dang
Abstract:
We investigate the application of a multi-objective genetic algorithm to the problem of task allocation in a self-organizing, decentralized, threshold-based swarm. Each agent in our system is capable of performing four tasks with a response threshold for each, and we seek to assign response threshold values to all of the agents a swarm such that the collective behavior of the swarm is optimized. R…
▽ More
We investigate the application of a multi-objective genetic algorithm to the problem of task allocation in a self-organizing, decentralized, threshold-based swarm. Each agent in our system is capable of performing four tasks with a response threshold for each, and we seek to assign response threshold values to all of the agents a swarm such that the collective behavior of the swarm is optimized. Random assignment of threshold values according to a uniform distribution is known to be effective; however, this method does not consider features of particular problem instances. Dynamic response thresholds have some flexibility to address problem specific features through real-time adaptivity, often improving swarm performance.
In this work, we use a multi-objective genetic algorithm to evolve response thresholds for a simulated swarm engaged in a dynamic task allocation problem: two-dimensional collective tracking. We show that evolved thresholds not only outperform uniformly distributed thresholds and dynamic thresholds but achieve nearly optimal performance on a variety of tracking problem instances (target paths). More importantly, we demonstrate that thresholds evolved for one of several problem instances generalize to all other problem instances eliminating the need to evolve new thresholds for each problem to be solved. We analyze the properties that allow these paths to serve as universal training instances and show that they are quite natural.
△ Less
Submitted 10 June, 2021;
originally announced June 2021.
-
Genetic Algorithms For Extractive Summarization
Authors:
William Chen,
Kensal Ramos,
Kalyan Naidu Mullaguri,
Annie S. Wu
Abstract:
Most current work in NLP utilizes deep learning, which requires a lot of training data and computational power. This paper investigates the strengths of Genetic Algorithms (GAs) for extractive summarization, as we hypothesized that GAs could construct more efficient solutions for the summarization task due to their relative customizability relative to deep learning models. This is done by building…
▽ More
Most current work in NLP utilizes deep learning, which requires a lot of training data and computational power. This paper investigates the strengths of Genetic Algorithms (GAs) for extractive summarization, as we hypothesized that GAs could construct more efficient solutions for the summarization task due to their relative customizability relative to deep learning models. This is done by building a vocabulary set, the words of which are represented as an array of weights, and optimizing those set of weights with the GA. These weights can be used to build an overall weighting of a sentence, which can then be passed to some threshold for extraction. Our results showed that the GA was able to learn a weight representation that could filter out excessive vocabulary and thus dictate sentence importance based on common English words.
△ Less
Submitted 9 January, 2022; v1 submitted 5 May, 2021;
originally announced May 2021.
-
Distributed Consensus Formation Through Unconstrained Gossiping
Authors:
Christopher D. Hollander,
Annie S. Wu
Abstract:
Gossip algorithms are widely used to solve the distributed consensus problem, but issues can arise when nodes receive multiple signals either at the same time or before they are able to finish processing their current work load. Specifically, a node may assume a new state that represents a linear combination of all received signals; even if such a state makes no sense in the problem domain. As a s…
▽ More
Gossip algorithms are widely used to solve the distributed consensus problem, but issues can arise when nodes receive multiple signals either at the same time or before they are able to finish processing their current work load. Specifically, a node may assume a new state that represents a linear combination of all received signals; even if such a state makes no sense in the problem domain. As a solution to this problem, we introduce the notion of conflict resolution for gossip algorithms and prove that their application leads to a valid consensus state when the underlying communication network possesses certain properties. We also introduce a methodology based on absorbing Markov chains for analyzing gossip algorithms that make use of these conflict resolution algorithms. This technique allows us to calculate both the probabilities of converging to a specific consensus state and the time that such convergence is expected to take. Finally, we make use of simulation to validate our methodology and explore the temporal behavior of gossip algorithms as the size of the network, the number of states per node, and the network density increase.
△ Less
Submitted 12 January, 2013;
originally announced January 2013.
-
Intermediate-mass Black Hole and stellar orbits in the Galactic Center
Authors:
Yuri Levin,
Alice S. P. Wu,
Edward W. Thommes
Abstract:
Many young stars reside within the central half-parsec from SgrA*, the supermassive black hole in the Galactic Center. The origin of these stars remains a puzzle. Recently, Hansen and Milosavljevic (2003, HM) have argued that an Intermediate-Mass Black Hole (IMBH) could have delivered the young stars to the immediate vicinity of SgrA*. Here we focus on the final stages of the HM scenario. Namely…
▽ More
Many young stars reside within the central half-parsec from SgrA*, the supermassive black hole in the Galactic Center. The origin of these stars remains a puzzle. Recently, Hansen and Milosavljevic (2003, HM) have argued that an Intermediate-Mass Black Hole (IMBH) could have delivered the young stars to the immediate vicinity of SgrA*. Here we focus on the final stages of the HM scenario. Namely, we integrate numerically the orbits of stars which are initially bound to the IMBH, but are stripped from it by the tidal field of SgrA*. Our numerical algorithm is a symplectic integrator designed specifically for the problem at hand; however, we have checked our results with SYMBA, a version of the widely available SWIFT code. We find that the distribution of the post-inspiral orbital parameters is sensitive to the eccentricity of the inspiraling IMBH. If the IMBH is on a circular orbit, then the inclinations of numerically computed orbits relative to the inspiral plane are almost always smaller than 10 degrees, and therefore (a) the simulations are in good agreement with the observed motions of stars in a clockwise-moving stellar disc, (b) the simulations never reproduce the orbits of stars outside this disc, which include those in the second thick ring of stars and the randomly oriented unrelaxed orbits of some of the S-stars. If the IMBH's orbital eccentricity is e=0.6, then approximately half of the stars end up with orbital inclinations below 10 degrees, and another half have inclinations anywhere between 0 and 180 degrees; this is somewhat closer to what's observed. We also show that if IRS13 cluster is bound by an IMBH, as has been argued by Maillard et. al. 2004, then the same IMBH could not have delivered all of the young stars to their present location.
△ Less
Submitted 7 February, 2005;
originally announced February 2005.
