-
DreamSat: Towards a General 3D Model for Novel View Synthesis of Space Objects
Authors:
Nidhi Mathihalli,
Audrey Wei,
Giovanni Lavezzi,
Peng Mun Siew,
Victor Rodriguez-Fernandez,
Hodei Urrutxua,
Richard Linares
Abstract:
Novel view synthesis (NVS) enables to generate new images of a scene or convert a set of 2D images into a comprehensive 3D model. In the context of Space Domain Awareness, since space is becoming increasingly congested, NVS can accurately map space objects and debris, improving the safety and efficiency of space operations. Similarly, in Rendezvous and Proximity Operations missions, 3D models can…
▽ More
Novel view synthesis (NVS) enables to generate new images of a scene or convert a set of 2D images into a comprehensive 3D model. In the context of Space Domain Awareness, since space is becoming increasingly congested, NVS can accurately map space objects and debris, improving the safety and efficiency of space operations. Similarly, in Rendezvous and Proximity Operations missions, 3D models can provide details about a target object's shape, size, and orientation, allowing for better planning and prediction of the target's behavior. In this work, we explore the generalization abilities of these reconstruction techniques, aiming to avoid the necessity of retraining for each new scene, by presenting a novel approach to 3D spacecraft reconstruction from single-view images, DreamSat, by fine-tuning the Zero123 XL, a state-of-the-art single-view reconstruction model, on a high-quality dataset of 190 high-quality spacecraft models and integrating it into the DreamGaussian framework. We demonstrate consistent improvements in reconstruction quality across multiple metrics, including Contrastive Language-Image Pretraining (CLIP) score (+0.33%), Peak Signal-to-Noise Ratio (PSNR) (+2.53%), Structural Similarity Index (SSIM) (+2.38%), and Learned Perceptual Image Patch Similarity (LPIPS) (+0.16%) on a test set of 30 previously unseen spacecraft images. Our method addresses the lack of domain-specific 3D reconstruction tools in the space industry by leveraging state-of-the-art diffusion models and 3D Gaussian splatting techniques. This approach maintains the efficiency of the DreamGaussian framework while enhancing the accuracy and detail of spacecraft reconstructions. The code for this work can be accessed on GitHub (https://github.com/ARCLab-MIT/space-nvs).
△ Less
Submitted 7 October, 2024;
originally announced October 2024.
-
Parameters Evolution in Source-Sink Space Population Evolutionary Models
Authors:
Erin Ashley,
Carla Simon Sanz,
Simone Servadio,
Giovanni Lavezzi
Abstract:
MOCAT-SSEM is a Source-Sink model that predicts the Low Earth Orbit (LEO) space population divided into families using a predefined set of interaction parameters. Thanks to data from the Monte Carlo version of the model (MOCAT-MC), which propagates singularly every object, it is possible to estimate such parameters, assumed as additional stochastic variables. Thus, this paper proposed a new set of…
▽ More
MOCAT-SSEM is a Source-Sink model that predicts the Low Earth Orbit (LEO) space population divided into families using a predefined set of interaction parameters. Thanks to data from the Monte Carlo version of the model (MOCAT-MC), which propagates singularly every object, it is possible to estimate such parameters, assumed as additional stochastic variables. Thus, this paper proposed a new set of parameters so that the new Source-Sink model prediction better fits the computationally expensive and accurate MOCAT-MC simulation. Estimation is performed by extracting stochastic quantities from the space population, which has been analyzed to fit common probability density functions.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Propagation of Uncertainty with the Koopman Operator
Authors:
Simone Servadio,
Giovanni Lavezzi,
Christian Hofmann,
Di Wu,
Richard Linares
Abstract:
This paper proposes a new method to propagate uncertainties undergoing nonlinear dynamics using the Koopman Operator (KO). Probability density functions are propagated directly using the Koopman approximation of the solution flow of the system, where the dynamics have been projected on a well-defined set of basis functions. The prediction technique is derived following both the analytical (Galerki…
▽ More
This paper proposes a new method to propagate uncertainties undergoing nonlinear dynamics using the Koopman Operator (KO). Probability density functions are propagated directly using the Koopman approximation of the solution flow of the system, where the dynamics have been projected on a well-defined set of basis functions. The prediction technique is derived following both the analytical (Galerkin) and numerical (EDMD) derivation of the KO, and a least square reduction algorithm assures the recursivity of the proposed methodology.
△ Less
Submitted 29 July, 2024;
originally announced July 2024.
-
Nonlinear Programming Solvers for Unconstrained and Constrained Optimization Problems: a Benchmark Analysis
Authors:
Giovanni Lavezzi,
Kidus Guye,
Marco Ciarcià
Abstract:
In this paper we propose a set of guidelines to select a solver for the solution of nonlinear programming problems. With this in mind, we present a comparison of the convergence performances of commonly used solvers for both unconstrained and constrained nonlinear programming problems. The comparison involves accuracy, convergence rate, and convergence speed. Because of its popularity among resear…
▽ More
In this paper we propose a set of guidelines to select a solver for the solution of nonlinear programming problems. With this in mind, we present a comparison of the convergence performances of commonly used solvers for both unconstrained and constrained nonlinear programming problems. The comparison involves accuracy, convergence rate, and convergence speed. Because of its popularity among research teams in academia and industry, MATLAB is used as common implementation platform for the solvers. Our study includes solvers which are either freely available, or require a license, or are fully described in literature. In addition, we differentiate solvers if they allow the selection of different optimal search methods. As result, we examine the performances of 23 algorithms to solve 60 benchmark problems. To enrich our analysis, we will describe how, and to what extent, convergence speed and accuracy can be improved by changing the inner settings of each solver.
△ Less
Submitted 11 April, 2022;
originally announced April 2022.
-
Bombus Species Image Classification
Authors:
Venkat Margapuri,
George Lavezzi,
Robert Stewart,
Dan Wagner
Abstract:
Entomologists, ecologists and others struggle to rapidly and accurately identify the species of bumble bees they encounter in their field work and research. The current process requires the bees to be mounted, then physically shipped to a taxonomic expert for proper categorization. We investigated whether an image classification system derived from transfer learning can do this task. We used Googl…
▽ More
Entomologists, ecologists and others struggle to rapidly and accurately identify the species of bumble bees they encounter in their field work and research. The current process requires the bees to be mounted, then physically shipped to a taxonomic expert for proper categorization. We investigated whether an image classification system derived from transfer learning can do this task. We used Google Inception, Oxford VGG16 and VGG19 and Microsoft ResNet 50. We found Inception and VGG classifiers were able to make some progress at identifying bumble bee species from the available data, whereas ResNet was not. Individual classifiers achieved accuracies of up to 23% for single species identification and 44% top-3 labels, where a composite model performed better, 27% and 50%. We feel the performance was most hampered by our limited data set of 5,000-plus labeled images of 29 species, with individual species represented by 59 -315 images.
△ Less
Submitted 9 June, 2020;
originally announced June 2020.
