-
On Soft Clustering For Correlation Estimators: Model Uncertainty, Differentiability, and Surrogates
Authors:
Edward Berman,
Sneh Pandya,
Jacqueline McCleary,
Marko Shuntov,
Caitlin Casey,
Nicole Drakos,
Andreas Faisst,
Steven Gillman,
Ghassem Gozaliasl,
Natalie Hogg,
Jeyhan Kartaltepe,
Anton Koekemoer,
Wilfried Mercier,
Diana Scognamiglio,
COSMOS-Web,
:,
The JWST Cosmic Origins Survey
Abstract:
Properly estimating correlations between objects at different spatial scales necessitates $\mathcal{O}(n^2)$ distance calculations. For this reason, most widely adopted packages for estimating correlations use clustering algorithms to approximate local trends. However, methods for quantifying the error introduced by this clustering have been understudied. In response, we present an algorithm for e…
▽ More
Properly estimating correlations between objects at different spatial scales necessitates $\mathcal{O}(n^2)$ distance calculations. For this reason, most widely adopted packages for estimating correlations use clustering algorithms to approximate local trends. However, methods for quantifying the error introduced by this clustering have been understudied. In response, we present an algorithm for estimating correlations that is probabilistic in the way that it clusters objects, enabling us to quantify the uncertainty caused by clustering simply through model inference. These soft clustering assignments enable correlation estimators that are theoretically differentiable with respect to their input catalogs. Thus, we also build a theoretical framework for differentiable correlation functions and describe their utility in comparison to existing surrogate models. Notably, we find that repeated normalization and distance function calls slow gradient calculations and that sparse Jacobians destabilize precision, pointing towards either approximate or surrogate methods as a necessary solution to exact gradients from correlation functions. To that end, we close with a discussion of surrogate models as proxies for correlation functions. We provide an example that demonstrates the efficacy of surrogate models to enable gradient-based optimization of astrophysical model parameters, successfully minimizing a correlation function output. Our numerical experiments cover science cases across cosmology, from point spread function (PSF) modeling efforts to gravitational simulations to galaxy intrinsic alignment (IA).
△ Less
Submitted 8 April, 2025;
originally announced April 2025.
-
The COSMOS-Web Lens Survey (COWLS) III: forecasts versus data
Authors:
Natalie B. Hogg,
James W. Nightingale,
Quihan He,
Jacqueline McCleary,
Guillaume Mahler,
Aristeidis Amvrosiadis,
Ghassem Gozaliasl,
Edward Berman,
Richard J. Massey,
Diana Scognamiglio,
Maximilien Franco,
Daizhong Liu,
Marko Shuntov,
Louise Paquereau,
Olivier Ilbert,
Natalie Allen,
Sune Toft,
Hollis B. Akins,
Caitlin M. Casey,
Jeyhan S. Kartaltepe,
Anton M. Koekemoer,
Henry Joy McCracken,
Jason D. Rhodes,
Brant E. Robertson,
Nicole E. Drakos
, et al. (3 additional authors not shown)
Abstract:
We compare forecasts for the abundance and properties of strong gravitational lenses in the COSMOS-Web survey, a $0.54$ deg$^2$ survey of the COSMOS field using the NIRCam and MIRI instruments aboard JWST, with the first catalogue of strong lens candidates identified in the observed NIRCam data, COWLS. We modify the lenspop package to produce a forecast for strong lensing in COSMOS-Web. We add a n…
▽ More
We compare forecasts for the abundance and properties of strong gravitational lenses in the COSMOS-Web survey, a $0.54$ deg$^2$ survey of the COSMOS field using the NIRCam and MIRI instruments aboard JWST, with the first catalogue of strong lens candidates identified in the observed NIRCam data, COWLS. We modify the lenspop package to produce a forecast for strong lensing in COSMOS-Web. We add a new mock galaxy catalogue to use as the source population, as well as the COSMOS-Web survey specifications, including the transmission data for the four NIRCam filters used. We forecast 107 strong lenses can be detected in COSMOS-Web across all bands, assuming complete subtraction of the lens galaxy light. The majority of the lenses are forecast to have small Einstein radii ($θ_{\rm E} < 1$ arcsecond) and lie at redshifts between $0 < z <2$, whilst the source redshift distribution peaks at $z\sim 3$ and has a long tail extending up to $z \sim 11$, unambiguously showing that strong lensing in JWST can probe the entirety of the epoch of reionisation. We compare our forecast with the distributions of Einstein radii, lens photometric redshifts, and lens and source magnitudes in the observed lenses, finding that whilst the forecast and observed Einstein radii distributions match, the redshifts and magnitudes do not. The observed lens redshift distribution peaks at a slightly lower redshift than the forecast one, whilst the lens magnitudes are systematically brighter in the observed data than in the forecast. Assuming the validity of the lenspop forecast, this finding motivates further inspection of the COWLS data to search for the as-yet undiscovered population of faint, high-redshift lenses.
△ Less
Submitted 11 March, 2025;
originally announced March 2025.
-
The COSMOS-Web Lens Survey (COWLS) II: depth, resolution, and NIR coverage from JWST reveal 17 spectacular lenses
Authors:
Guillaume Mahler,
James W. Nightingale,
Natalie B. Hogg,
Ghassem Gozaliasl,
Jacqueline McCleary,
Qiuhan He,
Edward Berman,
Maximilien Franco,
Daizhong Liu,
Richard J. Massey,
Wilfried Mercier,
Diana Scognamiglio,
Marko Shuntov,
Maximilian von Wietersheim-Kramsta,
Louise Paquereau,
Olivier Ilbert,
Natalie Allen,
Sune Toft,
Hollis B. Akins,
Caitlin M. Casey,
Jeyhan S. Kartaltepe,
Anton M. Koekemoer,
Henry Joy McCracken,
Jason D. Rhodes,
Brant E. Robertson
, et al. (5 additional authors not shown)
Abstract:
The COSMOS-Web Lens Survey (COWLS) presents the first systematic search for strong gravitational lenses in the COSMOS-Web field using data from the \textit{James Webb} Space Telescope (\textit{JWST}). Using high-resolution NIRCam imaging, we visually inspected over 42\,660 galaxies and identified over 400 lensing candidates. From this sample and based on \textit{JWST}/NIRCam imaging only, we repor…
▽ More
The COSMOS-Web Lens Survey (COWLS) presents the first systematic search for strong gravitational lenses in the COSMOS-Web field using data from the \textit{James Webb} Space Telescope (\textit{JWST}). Using high-resolution NIRCam imaging, we visually inspected over 42\,660 galaxies and identified over 400 lensing candidates. From this sample and based on \textit{JWST}/NIRCam imaging only, we report here the 17 most obvious and spectacular strong lensing systems. These lenses, characterised by large Einstein rings and arcs and their distinct lens and source colours, were found through only the visual inspection of the lens-light-subtracted image data and were immediately visible due to their spectacular appearance. We showcase how spectacular strong lenses are at the extremes of lens parameter space. Their exceptionally high signal-to-noise, multi-wavelength imaging enables unprecedented lensing analysis, including `\textit{HST}-dark' source galaxies that are also invisible in the deeper bluer \textit{JWST} wavebands, enabling clean deblending between the lens and the source. Sources may exhibit dramatic morphological changes across wavelengths, and dust absorption within lenses may be detectable by eye. No other instrument, including the \textit{Hubble} Space Telescope, can discover or image such lenses with comparable detail. We estimate that \textit{JWST} uncovers a new spectacular lens approximately every 10 to 12 NIRCam pointings, suggesting that over 40 such lenses remain undetected within its first three years of observations. All COWLS data is publicly available on GitHub.
△ Less
Submitted 11 March, 2025;
originally announced March 2025.
-
The COSMOS-Web Lens Survey (COWLS) I: Discovery of >100 high redshift strong lenses in contiguous JWST imaging
Authors:
James Nightingale,
Guillaume Mahler,
Jacqueline McCleary,
Qiuhan He,
Natalie B. Hogg,
Aristeidis Amvrosiadis,
Ghassem Gozaliasl,
Wilfried Mercier,
Diana Scognamiglio,
Edward Berman,
Gavin Leroy,
Daizhong Liu,
Richard J. Massey,
Marko Shuntov,
Maximilian von Wietersheim-Kramsta,
Maximilien Franco,
Louise Paquereau,
Olivier Ilbert,
Natalie Allen,
Sune Toft,
Hollis B. Akins,
Caitlin M. Casey,
Jeyhan S. Kartaltepe,
Anton M. Koekemoer,
Henry Joy McCracken
, et al. (5 additional authors not shown)
Abstract:
We present the COSMOS-Web Lens Survey (COWLS), a sample of over 100 strong lens candidates from the $0.54$\,deg$^2$ COSMOS-Web survey, discovered using exquisite James Webb Space Telescope (JWST) imaging across four wavebands. Following two rounds of visual inspection, over 100 candidates were ranked as `high confidence' or `likely' by at least $50\%$ of inspectors. The COWLS sample has several no…
▽ More
We present the COSMOS-Web Lens Survey (COWLS), a sample of over 100 strong lens candidates from the $0.54$\,deg$^2$ COSMOS-Web survey, discovered using exquisite James Webb Space Telescope (JWST) imaging across four wavebands. Following two rounds of visual inspection, over 100 candidates were ranked as `high confidence' or `likely' by at least $50\%$ of inspectors. The COWLS sample has several notable properties: (i) magnified source galaxies spanning redshifts $z \sim 0.1$ to $z \sim 9$, which therefore extend into the epoch of reionisation; (ii) the highest-redshift lens galaxies known, pushing galaxy density profile evolution studies beyond $z \sim 2$; (iii) all lenses are distributed within a contiguous $0.54$\,deg$^2$ region, allowing for joint strong and weak lensing analyses; and (iv) a subset exhibits lensed source emission ray-traced near the lens galaxy centers, enabling studies of supermassive black holes and dust absorption. A key innovation of our approach is the use of lens modelling to aid in identifying lenses that may otherwise be missed. This paper is accompanied by the first COWLS public release, providing JWST NIRCam imaging in four bands, lens models, pixelized source reconstructions and lens redshift estimates : https://github.com/Jammy2211/COWLS_COSMOS_Web_Lens_Survey
△ Less
Submitted 11 March, 2025;
originally announced March 2025.
-
Tracing the galaxy-halo connection with galaxy clustering in COSMOS-Web from z = 0.1 to z ~ 12
Authors:
Louise Paquereau,
Clotilde Laigle,
Henry Joy McCracken,
Marko Shuntov,
Olivier Ilbert,
Hollis B. Akins,
Natalie Allen,
Rafael Arango- Togo,
Eddie M. Berman,
Matthieu Bethermin,
Caitlin M. Casey,
Jacqueline McCleary,
Yohan Dubois,
Nicole E. Drakos,
Andreas L. Faisst,
Maximilien Franco,
Santosh Harish,
Christian K. Jespersen,
Jeyhan S. Kartaltepe,
Anton M. Koekemoer,
Vasily Kokorev,
Erini Lambrides,
Rebecca Larson,
Daizhong Liu,
Damien Le Borgne
, et al. (9 additional authors not shown)
Abstract:
We explore the evolving relationship between galaxies and their dark matter halos from $z \sim 0.1$ to $z \sim 12$ using mass-limited angular clustering measurements in the 0.54 deg$^2$ of the COSMOS-Web survey. This study provides the first measurements of the mass-limited two-point correlation function at $z \ge 10$ and a consistent analysis spanning 13.4 Gyr of cosmic history, setting new bench…
▽ More
We explore the evolving relationship between galaxies and their dark matter halos from $z \sim 0.1$ to $z \sim 12$ using mass-limited angular clustering measurements in the 0.54 deg$^2$ of the COSMOS-Web survey. This study provides the first measurements of the mass-limited two-point correlation function at $z \ge 10$ and a consistent analysis spanning 13.4 Gyr of cosmic history, setting new benchmarks for future simulations and models. Using a halo occupation distribution (HOD) framework, we derive characteristic halo masses and the stellar-to-halo mass relationship (SHMR) across redshifts and stellar mass bins. Our results first indicate that HOD models fit data at $z \ge 2.5$ best when incorporating a non-linear scale-dependent halo bias, boosting clustering at non-linear scales (r = 10-100 kpc). We find that galaxies at z > 10.5 with $\log(M_\star / M_\odot) \ge 8.85$ are hosted by halos with $M_{\rm h} \sim 10^{10.5}\,M_\odot$, achieving a star formation efficiency (SFE) $M_\star / (f_b M_{\rm h}) $ up to 1 dex higher than at $z \le 1$. The high galaxy bias at $z \ge 8$ suggests that these galaxies reside in massive halos with intrinsic high SFE. Our SHMR evolves significantly with redshift, starting high at $z \ge 10.5$, decreasing until $z \sim 2 - 3$, then increasing again until the present. Current simulations fail to reproduce both massive high-$z$ galaxies and this evolution, while semi-empirical models linking SFE to halo mass, accretion rates, and redshift align with our findings. We propose that $z > 8$ galaxies experience bursty star formation without significant feedback altering their growth, driving the rapid growth of massive galaxies observed by JWST. Over time, increasing feedback efficiency and exponential halo growth suppress star formation. At $z \sim 2 - 3$ and after, halo growth slows down while star formation continues, supported by gas reservoirs in halos.
△ Less
Submitted 16 May, 2025; v1 submitted 20 January, 2025;
originally announced January 2025.
-
Not-so-little Red Dots: Two massive and dusty starbursts at z~5-7 pushing the limits of star formation discovered by JWST in the COSMOS-Web survey
Authors:
Fabrizio Gentile,
Caitlin M. Casey,
Hollis B. Akins,
Maximilien Franco,
Jed McKinney,
Edward Berman,
Olivia R. Cooper,
Nicole E. Drakos,
Michaela Hirschmann,
Arianna S. Long,
Georgios Magdis,
Anton M. Koekemoer,
Vasily Kokorev,
Marko Shuntov,
Margherita Talia,
Natalie Allen,
Santosh Harish,
Olivier Ilbert,
Henry J. McCracken,
Jeyhan S. Kartaltepe,
Daizhong Liu,
Louise Paquereau,
Jason Rhodes,
Michael R. Rich,
Brant Robertson
, et al. (2 additional authors not shown)
Abstract:
We present the properties of two candidate massive ($M_\star\sim10^{11}M_\odot$) and dusty ($A_{\rm v}>2.5$ mag) galaxies at $z=5-7$ in the first 0.28 deg$^2$ of the COSMOS-Web survey. One object is spectroscopically confirmed at $z_{\rm spec}=5.051$, while the other has a robust $z_{\rm phot}=6.7\pm0.3$. Thanks to their extremely red colors ($F277W-F444W\sim1.7$ mag), these galaxies satisfy the n…
▽ More
We present the properties of two candidate massive ($M_\star\sim10^{11}M_\odot$) and dusty ($A_{\rm v}>2.5$ mag) galaxies at $z=5-7$ in the first 0.28 deg$^2$ of the COSMOS-Web survey. One object is spectroscopically confirmed at $z_{\rm spec}=5.051$, while the other has a robust $z_{\rm phot}=6.7\pm0.3$. Thanks to their extremely red colors ($F277W-F444W\sim1.7$ mag), these galaxies satisfy the nominal color-selection for the widely-studied ``little red dot" (LRD) population with the exception of their spatially-resolved morphologies. The morphology of our targets allows us to conclude that their red continuum is dominated by highly obscured stellar emission and not by reddened nuclear activity. Using a variety of SED-fitting tools and star formation histories, we estimate the stellar masses to be $\log(M_\star)=11.32^{+0.07}_{-0.15}$ $M_\odot$ and $\log(M_\star)=11.2^{+0.1}_{-0.2}$ $M_\odot$, respectively, with a red continuum emission dominated by a recent episode of star formation. We then compare their number density to the halo mass function to infer stellar baryon fractions of $ε_\star\sim0.25$ and $ε_\star\sim0.5$. Both are significantly higher than what is commonly observed in lower-z galaxies or more dust-obscured galaxies at similar redshifts. With very bright ultra-high-z Lyman-Break Galaxies and some non-AGN dominated LRDs, such ``extended" LRDs represent another population that may require very efficient star formation at early times.
△ Less
Submitted 4 September, 2024; v1 submitted 19 August, 2024;
originally announced August 2024.
-
Efficient PSF Modeling with ShOpt.jl: A PSF Benchmarking Study with JWST NIRCam Imaging
Authors:
Edward Berman,
Jacqueline McCleary,
Anton M. Koekemoer,
Maximilien Franco,
Nicole E. Drakos,
Daizhong Liu,
James W. Nightingale,
Marko Shuntov,
Diana Scognamiglio,
Richard Massey,
Guillaume Mahler,
Henry Joy McCracken,
Brant E. Robertson,
Andreas L. Faisst,
Caitlin M. Casey,
Jeyhan S. Kartaltepe
Abstract:
With their high angular resolutions of 30--100 mas, large fields of view, and complex optical systems, imagers on next-generation optical/near-infrared space observatories, such as the Near-Infrared Camera (NIRCam) on the James Webb Space Telescope (JWST), present both new opportunities for science and also new challenges for empirical point spread function (PSF) characterization. In this context,…
▽ More
With their high angular resolutions of 30--100 mas, large fields of view, and complex optical systems, imagers on next-generation optical/near-infrared space observatories, such as the Near-Infrared Camera (NIRCam) on the James Webb Space Telescope (JWST), present both new opportunities for science and also new challenges for empirical point spread function (PSF) characterization. In this context, we introduce ShOpt, a new PSF fitting tool developed in Julia and designed to bridge the advanced features of PIFF (PSFs in the Full Field of View) with the computational efficiency of PSFEx (PSF Extractor). Along with ShOpt, we propose a suite of non-parametric statistics suitable for evaluating PSF fit quality in space-based imaging. Our study benchmarks ShOpt against the established PSF fitters PSFEx and PIFF using real and simulated COSMOS-Web Survey imaging. We assess their respective PSF model fidelity with our proposed diagnostic statistics and investigate their computational efficiencies, focusing on their processing speed relative to the complexity and size of the PSF models. We find that ShOpt can already achieve PSF model fidelity comparable to PSFEx and PIFF while maintaining competitive processing speeds, constructing PSF models for large NIRCam mosaics within minutes.
△ Less
Submitted 18 June, 2024; v1 submitted 21 January, 2024;
originally announced January 2024.
-
ShOpt.jl: A Julia Package for Empirical Point Spread Function Characterization of JWST NIRCam Data
Authors:
Edward Berman,
Jacqueline McCleary
Abstract:
As astronomical data grows in volume and complexity, the scalability of analysis software becomes increasingly important. At the same time, astrophysics analysis software relies heavily on open-source contributions, so languages and tools that prioritize both performance and readability are especially valuable. Julia, with its just-in-time compiler and high level syntax, offers a compelling altern…
▽ More
As astronomical data grows in volume and complexity, the scalability of analysis software becomes increasingly important. At the same time, astrophysics analysis software relies heavily on open-source contributions, so languages and tools that prioritize both performance and readability are especially valuable. Julia, with its just-in-time compiler and high level syntax, offers a compelling alternative to traditional languages like Python or C.
In this paper, we outline ShOpt.jl, a new software package for point spread function (PSF) characterization written in Julia. ShOpt.jl features a number of performance optimizations, such as multithreading, the use of preconditioners, and the implementation of the memory-limited Broyden-Fletcher-Goldfarb-Shanno algorithm, as well as the flexibility to choose between principal component analysis, an autoencoder, and analytic profiles for PSF characterization. As observatories like the James Webb Space Telescope bring astrophysics into a new era of wide-field, high-resolution imaging, the challenges of PSF modeling become more pronounced. Tools like ShOpt.jl provide the community with a scalable, efficient, and accurate solution to these challenges, while also demonstrating the potential of Julia as a language that meets the demands of modern astrophysical research.
△ Less
Submitted 31 January, 2024; v1 submitted 29 September, 2023;
originally announced October 2023.
