Self-Parameterization Based Multi-Resolution Mesh Convolution Networks
Authors:
Shi Hezi,
Jiang Luo,
Zheng Jianmin,
Zeng Jun
Abstract:
This paper addresses the challenges of designing mesh convolution neural networks for 3D mesh dense prediction. While deep learning has achieved remarkable success in image dense prediction tasks, directly applying or extending these methods to irregular graph data, such as 3D surface meshes, is nontrivial due to the non-uniform element distribution and irregular connectivity in surface meshes whi…
▽ More
This paper addresses the challenges of designing mesh convolution neural networks for 3D mesh dense prediction. While deep learning has achieved remarkable success in image dense prediction tasks, directly applying or extending these methods to irregular graph data, such as 3D surface meshes, is nontrivial due to the non-uniform element distribution and irregular connectivity in surface meshes which make it difficult to adapt downsampling, upsampling, and convolution operations. In addition, commonly used multiresolution networks require repeated high-to-low and then low-to-high processes to boost the performance of recovering rich, high-resolution representations. To address these challenges, this paper proposes a self-parameterization-based multi-resolution convolution network that extends existing image dense prediction architectures to 3D meshes. The novelty of our approach lies in two key aspects. First, we construct a multi-resolution mesh pyramid directly from the high-resolution input data and propose area-aware mesh downsampling/upsampling operations that use sequential bijective inter-surface mappings between different mesh resolutions. The inter-surface mapping redefines the mesh, rather than reshaping it, which thus avoids introducing unnecessary errors. Second, we maintain the high-resolution representation in the multi-resolution convolution network, enabling multi-scale fusions to exchange information across parallel multi-resolution subnetworks, rather than through connections of high-to-low resolution subnetworks in series. These features differentiate our approach from most existing mesh convolution networks and enable more accurate mesh dense predictions, which is confirmed in experiments.
△ Less
Submitted 25 August, 2024;
originally announced August 2024.
Prospects for using drones to test formation-flying CubeSat concepts, and other astronomical applications
Authors:
John D. Monnier,
Prachet Jain,
Mayra Gutierrez,
Chi Han,
Sara Hezi,
Shashank Kalluri,
Hirsh Kabaria,
Brennan Kompas,
Vaishnavi Harikumar,
Julian Skifstad,
Janani Peri,
Emmanuel Hernandez,
Ramya Bhaskarapanthula,
James Cutler
Abstract:
Drones provide a versatile platform for remote sensing and atmospheric studies. However, strict payload mass limits and intense vibrations have proven obstacles to adoption for astronomy. We present a concept for system-level testing of a long-baseline CubeSat space interferometer using drones, taking advantage of their cm-level xyz station-keeping, 6-dof freedom of movement, large operational env…
▽ More
Drones provide a versatile platform for remote sensing and atmospheric studies. However, strict payload mass limits and intense vibrations have proven obstacles to adoption for astronomy. We present a concept for system-level testing of a long-baseline CubeSat space interferometer using drones, taking advantage of their cm-level xyz station-keeping, 6-dof freedom of movement, large operational environment, access to guide stars for end-to-end testing of optical train and control algorithms, and comparable mass and power requirements. We have purchased two different drone platforms (Aurelia X6 Pro, Freefly Alta X) and present characterization studies of vibrations, flight stability, gps positioning precision, and more. We also describe our progress in sub-system development, including inter-drone laser metrology, realtime gimbal control, and LED beacon tracking. Lastly, we explore whether custom-built drone-borne telescopes could be used for interferometry of bright objects over km-level baselines using vibration-isolation platforms and a small fast delay for fringe-tracking.
△ Less
Submitted 7 August, 2024;
originally announced August 2024.
