-
Seg2Reg: Differentiable 2D Segmentation to 1D Regression Rendering for 360 Room Layout Reconstruction
Authors:
Cheng Sun,
Wei-En Tai,
Yu-Lin Shih,
Kuan-Wei Chen,
Yong-Jing Syu,
Kent Selwyn The,
Yu-Chiang Frank Wang,
Hwann-Tzong Chen
Abstract:
State-of-the-art single-view 360-degree room layout reconstruction methods formulate the problem as a high-level 1D (per-column) regression task. On the other hand, traditional low-level 2D layout segmentation is simpler to learn and can represent occluded regions, but it requires complex post-processing for the targeting layout polygon and sacrifices accuracy. We present Seg2Reg to render 1D layo…
▽ More
State-of-the-art single-view 360-degree room layout reconstruction methods formulate the problem as a high-level 1D (per-column) regression task. On the other hand, traditional low-level 2D layout segmentation is simpler to learn and can represent occluded regions, but it requires complex post-processing for the targeting layout polygon and sacrifices accuracy. We present Seg2Reg to render 1D layout depth regression from the 2D segmentation map in a differentiable and occlusion-aware way, marrying the merits of both sides. Specifically, our model predicts floor-plan density for the input equirectangular 360-degree image. Formulating the 2D layout representation as a density field enables us to employ `flattened' volume rendering to form 1D layout depth regression. In addition, we propose a novel 3D warping augmentation on layout to improve generalization. Finally, we re-implement recent room layout reconstruction methods into our codebase for benchmarking and explore modern backbones and training techniques to serve as the strong baseline. Our model significantly outperforms previous arts. The code will be made available upon publication.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Beyond FRiM, ASAP: a family of sparse approximation for covariance matrices and preconditioners
Authors:
Éric Thiébaut,
Michel Tallon,
Samuel Thé,
Loïc Denis
Abstract:
The FRiM fractal operator belongs to a family of operators, called ASAP, defined by an ordered selection of nearest neighbors. This generalization provides means to improve upon the good properties of FRiM. We propose a fast algorithm to build an ASAP operator mimicking the fractal structure of FRiM for pupils of any size and geometry and to learn the sparse coefficients from empirical data. We em…
▽ More
The FRiM fractal operator belongs to a family of operators, called ASAP, defined by an ordered selection of nearest neighbors. This generalization provides means to improve upon the good properties of FRiM. We propose a fast algorithm to build an ASAP operator mimicking the fractal structure of FRiM for pupils of any size and geometry and to learn the sparse coefficients from empirical data. We empirically show the good approximation by ASAP of correlated statistics and the benefits of ASAP for solving phase restoration problems.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
Characterization of stellar companion from high-contrast long-slit spectroscopy data: The EXtraction Of SPEctrum of COmpanion (EXOSPECO) algorithm
Authors:
Samuel Thé,
Éric Thiébaut,
Loïc Denis,
Thibault Wanner,
Rémi Thiébaut,
Maud Langlois,
Ferréol Soulez
Abstract:
High-contrast long-slit spectrographs can be used to characterize exoplanets. High-contrast long-slit spectroscopic data are however corrupted by stellar leakages which largely dominate other signals and make the process of extracting the companion spectrum very challenging. This paper presents a complete method to calibrate the spectrograph and extract the signal of interest.
The proposed metho…
▽ More
High-contrast long-slit spectrographs can be used to characterize exoplanets. High-contrast long-slit spectroscopic data are however corrupted by stellar leakages which largely dominate other signals and make the process of extracting the companion spectrum very challenging. This paper presents a complete method to calibrate the spectrograph and extract the signal of interest.
The proposed method is based on a flexible direct model of the high-contrast long-slit spectroscopic data. This model explicitly accounts for the instrumental response and for the contributions of both the star and the companion. The contributions of these two components and the calibration parameters are jointly estimated by solving a regularized inverse problem. This problem having no closed-form solution, we propose an alternating minimization strategy to effectively find the solution.
We have tested our method on empirical long-slit spectroscopic data and by injecting synthetic companion signals in these data. The proposed initialization and the alternating strategy effectively avoid the self-subtraction bias, even for companions observed very close to the coronagraphic mask. Careful modeling and calibration of the angular and spectral dispersion laws of the instrument clearly reduce the contamination by the stellar leakages. In practice, the outputs of the method are mostly driven by a single hyper-parameter which tunes the level of regularization of the companion SED.
△ Less
Submitted 6 June, 2023;
originally announced June 2023.
-
REXPACO: an algorithm for high contrast reconstruction of the circumstellar environment by angular differential imaging
Authors:
Olivier Flasseur,
Samuel Thé,
Loïc Denis,
Éric Thiébaut,
Maud Langlois
Abstract:
Aims. The purpose of this paper is to describe a new post-processing algorithm dedicated to the reconstruction of the spatial distribution of light received from off-axis sources, in particular from circumstellar disks.
Methods. Built on the recent PACO algorithm dedicated to the detection of point-like sources, the proposed method is based on the local learning of patch covariances capturing th…
▽ More
Aims. The purpose of this paper is to describe a new post-processing algorithm dedicated to the reconstruction of the spatial distribution of light received from off-axis sources, in particular from circumstellar disks.
Methods. Built on the recent PACO algorithm dedicated to the detection of point-like sources, the proposed method is based on the local learning of patch covariances capturing the spatial fluctuations of the stellar leakages. From this statistical modeling, we develop a regularized image reconstruction algorithm (REXPACO) following an inverse problem approach based on a forward image formation model of the off-axis sources in the ADI sequences.
Results. Injections of fake circumstellar disks in ADI sequences from the VLT/SPHERE-IRDIS instrument show that both the morphology and the photometry of the disks are better preserved by REXPACO compared to standard postprocessing methods like cADI. In particular, the modeling of the spatial covariances proves usefull in reducing typical ADI artifacts and in better disentangling the signal of these sources from the residual stellar contamination. The application to stars hosting circumstellar disks with various morphologies confirms the ability of REXPACO to produce images of the light distribution with reduced artifacts. Finally, we show how REXPACO can be combined with PACO to disentangle the signal of circumstellar disks from the signal of candidate point-like sources.
Conclusions. REXPACO is a novel post-processing algorithm producing numerically deblurred images of the circumstellar environment. It exploits the spatial covariances of the stellar leakages and of the noise to efficiently eliminate this nuisance term.
△ Less
Submitted 13 May, 2021; v1 submitted 19 April, 2021;
originally announced April 2021.
-
A Photometric Catalogue of Southern Emission-Line Stars
Authors:
D. de Winter,
M. E. van den Ancker,
A. Maira,
P. S. Thé,
H. R. E. Tjin A Djie,
I. Redondo,
C. Eiroa,
F. J. Molster
Abstract:
We present a catalogue of previously unpublished optical and infrared photometry for a sample of 162 emission-line objects and shell stars visible from the southern hemisphere. The data were obtained between 1978 and 1997 in the Walraven (WULBV), Johnson/Cousins (UBV(RI)_c) and ESO and SAAO near-infrared (JHKLM) photometric systems. Most of the observed objects are Herbig Ae/Be (HAeBe) stars or…
▽ More
We present a catalogue of previously unpublished optical and infrared photometry for a sample of 162 emission-line objects and shell stars visible from the southern hemisphere. The data were obtained between 1978 and 1997 in the Walraven (WULBV), Johnson/Cousins (UBV(RI)_c) and ESO and SAAO near-infrared (JHKLM) photometric systems. Most of the observed objects are Herbig Ae/Be (HAeBe) stars or HAeBe candidates appearing in the list of HAeBe candidates of Thé et al. (1994), although several B[e] stars, LBVs and T Tauri are also included in our sample. For many of the stars the data presented here are the first photo-electric measurements in the literature. The resulting catalogue consists of 1809 photometric measurements. Optical variability was detected in 66 out of the 116 sources that were observed more than once. 15 out of the 50 stars observed multiple times in the infrared showed variability at 2.2 microns (K band).
△ Less
Submitted 22 October, 2001;
originally announced October 2001.
-
The central part of the young open cluster NGC 6383
Authors:
M. E. van den Ancker,
P. S. Thé,
D. de Winter
Abstract:
The spectral and extinction properties of 14 pre-main sequence candidates in the central part of the very young open cluster NGC 6383 were investigated. None of these stars shows evidence for anomalous circumstellar extinction. However, six out of 14 programme stars do show an infrared excess, indicative of the presence of circumstellar dust, heated up by the central star. One of these stars (nu…
▽ More
The spectral and extinction properties of 14 pre-main sequence candidates in the central part of the very young open cluster NGC 6383 were investigated. None of these stars shows evidence for anomalous circumstellar extinction. However, six out of 14 programme stars do show an infrared excess, indicative of the presence of circumstellar dust, heated up by the central star. One of these stars (number 4), also shows Halpha in emission and shows some indications for the presence of circumstellar gas in its spectrum, and might therefore be a newly identified Herbig Ae star.
△ Less
Submitted 20 June, 2000;
originally announced June 2000.
