-
First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
Authors:
E. Ceccotti,
A. R. Offringa,
F. G. Mertens,
L. V. E. Koopmans,
S. Munshi,
J. K. Chege,
A. Acharya,
S. A. Brackenhoff,
E. Chapman,
B. Ciardi,
R. Ghara,
S. Ghosh,
S. K. Giri,
C. Höfer,
I. Hothi,
G. Mellema,
M. Mevius,
V. N. Pandey,
S. Zaroubi
Abstract:
The redshifted 21-cm signal of neutral hydrogen from the Epoch of Reionization (EoR) can potentially be detected using low-frequency radio instruments such as the Low-Frequency Array (LOFAR). So far, LOFAR upper limits on the 21-cm signal power spectrum have been published using a single target field: the North Celestial Pole (NCP). In this work, we analyse and provide upper limits for the 3C196 f…
▽ More
The redshifted 21-cm signal of neutral hydrogen from the Epoch of Reionization (EoR) can potentially be detected using low-frequency radio instruments such as the Low-Frequency Array (LOFAR). So far, LOFAR upper limits on the 21-cm signal power spectrum have been published using a single target field: the North Celestial Pole (NCP). In this work, we analyse and provide upper limits for the 3C196 field, observed by LOFAR, with a strong ${\approx}80\,$Jy source in the centre. This field offers advantages such as higher sensitivity due to zenith-crossing observations and reduced geostationary radio-frequency interference, but also poses challenges due to the presence of the bright central source. After constructing a wide-field sky model, we process a single 6-hour night of 3C196 observations using direction-independent and direction-dependent calibration, followed by a residual foreground subtraction with a machine learned Gaussian process regression (ML-GPR). A bias correction is necessary to account for signal suppression in the GPR step. Still, even after this correction, the upper limits are a factor of two lower than previous single-night NCP results, with a lowest $2σ$ upper limit of $(146.61\,\text{mK})^2$ at $z = 9.16$ and $k=0.078\,h\,\text{cMpc}^{-1}$ (with $\text{d}k/k\approx 0.3$). The results also reveal an excess power, different in behaviour from that observed in the NCP field, suggesting a potential residual foreground origin. In future work, the use of multiple nights of 3C196 observations combined with improvements to sky modelling and ML-GPR to avoid the need for bias correction should provide tighter constraints per unit observing time than the NCP.
△ Less
Submitted 25 April, 2025;
originally announced April 2025.
-
Robust direction-dependent gain-calibration of beam-modelling errors far from the target field
Authors:
S. A. Brackenhoff,
A. R. Offringa,
M. Mevius,
L. V. E. Koopmans,
J. K. Chege,
E. Ceccotti,
C. Höfer,
L. Gao,
S. Ghosh,
F. G. Mertens,
S. Munshi
Abstract:
Many astronomical questions require deep, wide-field observations at low radio frequencies. Phased arrays like LOFAR and SKA-low are designed for this, but have inherently unstable element gains, leading to time, frequency and direction-dependent gain errors. Precise direction-dependent calibration of observations is therefore key to reaching the highest possible dynamic range. Many tools for dire…
▽ More
Many astronomical questions require deep, wide-field observations at low radio frequencies. Phased arrays like LOFAR and SKA-low are designed for this, but have inherently unstable element gains, leading to time, frequency and direction-dependent gain errors. Precise direction-dependent calibration of observations is therefore key to reaching the highest possible dynamic range. Many tools for direction-dependent calibration utilise sky and beam models to infer gains. However, these calibration tools struggle with precision calibration for relatively bright (e.g. A-team) sources far from the beam centre. Therefore, the point-spread-function of these sources can potentially obscure a faint signal of interest. We show that, and why, the assumption of a smooth gain solution per station fails for realistic radio interferometers, and how this affects gain-calibration results. Subsequently, we introduce an improvement for smooth spectral gain constraints for direction-dependent gain-calibration algorithms, in which the level of regularisation is weighted by the expected station response to the sky model. We test this method using direction-dependent calibration method DDECal and physically-motivated beam modelling errors for LOFAR-HBA stations. The new method outperforms the standard method for various calibration settings near nulls in the beam, and matches the standard inverse-variance-weighted method's performance for the remainder of the data. The proposed method is especially effective for short baselines, both in visibility and image space. Improved direction-dependent gain-calibration is critical for future high-precision SKA-low observations, where higher sensitivity, increased antenna beam complexity, and mutual coupling call for better off-axis source subtraction, which may not be achieved through improved beam models alone.
△ Less
Submitted 3 April, 2025;
originally announced April 2025.
-
Near-field imaging of local interference in radio interferometric data: Impact on the redshifted 21 cm power spectrum
Authors:
S. Munshi,
F. G. Mertens,
L. V. E. Koopmans,
M. Mevius,
A. R. Offringa,
B. Semelin,
C. Viou,
A. Bracco,
S. A. Brackenhoff,
E. Ceccotti,
J. K. Chege,
A. Fialkov,
L. Y. Gao,
R. Ghara,
S. Ghosh,
A. K. Shaw,
P. Zarka,
S. Zaroubi,
B. Cecconi,
S. Corbel,
J. N. Girard,
J. M. Griessmeier,
O. Konovalenko,
A. Loh,
P. Tokarsky
, et al. (2 additional authors not shown)
Abstract:
Radio-frequency interference (RFI) is a major systematic limitation in radio astronomy, particularly for science cases requiring high sensitivity, such as 21 cm cosmology. Traditionally, RFI is dealt with by identifying its signature in the dynamic spectra of visibility data and flagging strongly affected regions. However, for RFI sources that do not occupy narrow regions in the time-frequency spa…
▽ More
Radio-frequency interference (RFI) is a major systematic limitation in radio astronomy, particularly for science cases requiring high sensitivity, such as 21 cm cosmology. Traditionally, RFI is dealt with by identifying its signature in the dynamic spectra of visibility data and flagging strongly affected regions. However, for RFI sources that do not occupy narrow regions in the time-frequency space, such as persistent local RFI, modeling these sources could be essential to mitigating their impact. This paper introduces two methods for detecting and characterizing local RFI sources from radio interferometric visibilities: matched filtering and maximum a posteriori (MAP) imaging. These algorithms use the spherical wave equation to construct three-dimensional near-field image cubes of RFI intensity from the visibilities. The matched filter algorithm can generate normalized maps by cross-correlating the expected contributions from RFI sources with the observed visibilities, while the MAP method performs a regularized inversion of the visibility equation in the near field. We developed a full polarization simulation framework for RFI and demonstrated the methods on simulated observations of local RFI sources. The stability, speed, and errors introduced by these algorithms were investigated, and, as a demonstration, the algorithms were applied to a subset of NenuFAR observations to perform spatial, spectral, and temporal characterization of two local RFI sources. We used simulations to assess the impact of local RFI on images, the uv plane, and cylindrical power spectra, and to quantify the level of bias introduced by the algorithms in order to understand their implications for the estimated 21 cm power spectrum with radio interferometers. The near-field imaging and simulation codes are publicly available in the Python library nfis.
△ Less
Submitted 11 April, 2025; v1 submitted 27 March, 2025;
originally announced March 2025.
-
Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
Authors:
E. Ceccotti,
A. R. Offringa,
L. V. E. Koopmans,
F. G. Mertens,
M. Mevius,
A. Acharya,
S. A. Brackenhoff,
B. Ciardi,
B. K. Gehlot,
R. Ghara,
J. K. Chege,
S. Ghosh,
C. Höfer,
I. Hothi,
I. T. Iliev,
J. P. McKean,
S. Munshi,
S. Zaroubi
Abstract:
Studying the redshifted 21-cm signal from the the neutral hydrogen during the Epoch of Reionization and Cosmic Dawn is fundamental for understanding the physics of the early universe. One of the challenges that 21-cm experiments face is the contamination by bright foreground sources, such as Cygnus A, for which accurate spatial and spectral models are needed to minimise the residual contamination…
▽ More
Studying the redshifted 21-cm signal from the the neutral hydrogen during the Epoch of Reionization and Cosmic Dawn is fundamental for understanding the physics of the early universe. One of the challenges that 21-cm experiments face is the contamination by bright foreground sources, such as Cygnus A, for which accurate spatial and spectral models are needed to minimise the residual contamination after their removal. In this work, we develop a new, high-resolution model of Cygnus A using Low Frequency Array (LOFAR) observations in the $110{-}250$ MHz range, improving upon previous models by incorporating physical spectral information through the forced-spectrum method during multi-frequency deconvolution. This approach addresses the limitations of earlier models by providing a more accurate representation of the complex structure and spectral behaviour of Cygnus A, including the spectral turnover in its brightest hotspots. The impact of this new model on the LOFAR 21-cm signal power spectrum is assessed by comparing it with both simulated and observed North Celestial Pole data sets. Significant improvements are observed in the cylindrical power spectrum along the Cygnus A direction, highlighting the importance of having spectrally accurate models of the brightest foreground sources. However, this improvement is washed out in the spherical power spectrum, where we measure differences of a few hundred mK at $k<0.63\,h\,\text{cMpc}^{-1}$, but not statistically significant. The results suggest that other systematic effects must be mitigated before a substantial impact on 21-cm power spectrum can be achieved.
△ Less
Submitted 25 February, 2025;
originally announced February 2025.
-
Application of 3D U-Net Neural Networks in Extracting the Epoch of Reionization Signal from SKA-Low Observations Based on Real Observations of NCP Field from LOFAR
Authors:
Li-Yang Gao,
Léon V. E. Koopmans,
Florent G. Mertens,
Satyapan Munshi,
Yichao Li,
Stefanie A. Brackenhoff,
Emilio Ceccotti,
J. Kariuki Chege,
Anshuman Acharya,
Raghunath Ghara,
Sambit K. Giri,
Ilian T. Iliev,
Garrelt Mellema,
Xin Zhang
Abstract:
Neutral hydrogen serves as a crucial probe for the Cosmic Dawn and the Epoch of Reionization (EoR). Actual observations of the 21-cm signal often encounter challenges such as thermal noise and various systematic effects. To overcome these challenges, we simulate SKA-Low-depth images and process them with a deep learning method. We utilized foreground residuals acquired by LOFAR during actual North…
▽ More
Neutral hydrogen serves as a crucial probe for the Cosmic Dawn and the Epoch of Reionization (EoR). Actual observations of the 21-cm signal often encounter challenges such as thermal noise and various systematic effects. To overcome these challenges, we simulate SKA-Low-depth images and process them with a deep learning method. We utilized foreground residuals acquired by LOFAR during actual North Celestial Pole field observations, thermal and excess variances calculated via Gaussian process regression, and 21-cm signals generated with 21cmFAST for signal extraction tests. Our approach to overcome these foreground, thermal noise, and excess variance components employs a 3D U-Net neural network architecture for image analysis. When considering thermal noise corresponding to 1400 hours of integration, U-Net provides reliable 2D power spectrum predictions, and robustness tests ensure that we get realistic EoR signals. Adding foreground residuals, however, causes inconsistencies below the horizon delay-line. Lastly, evaluating both thermal and excess variance with observations up to 3700 and 14000 hours ensures reliable power spectrum estimations within the EoR window and across nearly all scales, respectively.
△ Less
Submitted 21 December, 2024;
originally announced December 2024.
-
Ionospheric contributions to the excess power in high-redshift 21-cm power-spectrum observations with LOFAR
Authors:
S. A. Brackenhoff,
M. Mevius,
L. V. E. Koopmans,
A. Offringa,
E. Ceccotti,
J. K. Chege,
B. K. Gehlot,
S. Ghosh,
C. Höfer,
F. G. Mertens,
S. Munshi,
S. Zaroubi
Abstract:
The turbulent ionosphere causes phase shifts to incoming radio waves on a broad range of temporal and spatial scales. When an interferometer is not sufficiently calibrated for the direction-dependent ionospheric effects, the time-varying phase shifts can cause the signal to decorrelate. The ionosphere's influence over various spatiotemporal scales introduces a baseline-dependent effect on the inte…
▽ More
The turbulent ionosphere causes phase shifts to incoming radio waves on a broad range of temporal and spatial scales. When an interferometer is not sufficiently calibrated for the direction-dependent ionospheric effects, the time-varying phase shifts can cause the signal to decorrelate. The ionosphere's influence over various spatiotemporal scales introduces a baseline-dependent effect on the interferometric array. We study the impact of baseline-dependent decorrelation on high-redshift observations with the Low Frequency Array (LOFAR). Datasets with a range of ionospheric corruptions are simulated using a thin-screen ionosphere model, and calibrated using the state-of-the-art LOFAR Epoch of Reionisation pipeline. For the first time ever, we show the ionospheric impact on various stages of the calibration process including an analysis of the transfer of gain errors from longer to shorter baselines using realistic end-to-end simulations. We find that direction-dependent calibration for source subtraction leaves excess power of up to two orders of magnitude above the thermal noise at the largest spectral scales in the cylindrically averaged auto-power spectrum under normal ionospheric conditions. However, we demonstrate that this excess power can be removed through Gaussian process regression, leaving no excess power above the ten per cent level for a $5~$km diffractive scale. We conclude that ionospheric errors, in the absence of interactions with other aggravating effects, do not constitute a dominant component in the excess power observed in LOFAR Epoch of Reionisation observations of the North Celestial Pole. Future work should therefore focus on less spectrally smooth effects, such as beam modelling errors.
△ Less
Submitted 29 July, 2024;
originally announced July 2024.
-
The impact of lossy data compression on the power spectrum of the high redshift 21-cm signal with LOFAR
Authors:
J. K. Chege,
L. V. E. Koopmans,
A. R. Offringa,
B. K. Gehlot,
S. A. Brackenhoff,
E. Ceccotti,
S. Ghosh,
C. Höfer,
F. G. Mertens,
M. Mevius,
S. Munshi
Abstract:
Current radio interferometers output multi-petabyte-scale volumes of data per year making the storage, transfer, and processing of this data a sizeable challenge. This challenge is expected to grow with the next-generation telescopes such as the Square Kilometre Array. Lossy compression of interferometric data post-correlation can abate this challenge. However, since high-redshift 21-cm studies im…
▽ More
Current radio interferometers output multi-petabyte-scale volumes of data per year making the storage, transfer, and processing of this data a sizeable challenge. This challenge is expected to grow with the next-generation telescopes such as the Square Kilometre Array. Lossy compression of interferometric data post-correlation can abate this challenge. However, since high-redshift 21-cm studies impose strict precision requirements, the impact of such lossy data compression on the 21-cm signal power spectrum statistic should be understood. We apply Dysco visibility compression, a technique to normalize and quantize specifically designed for radio interferometric data. We establish the level of the compression noise in the power spectrum in comparison to the thermal noise as well as its coherency behavior. Finally, for optimal compression results, we compare the compression noise obtained from different compression settings to a nominal 21-cm signal power. From a single night of observation, we find that the noise introduced due to the compression is more than five orders of magnitude lower than the thermal noise level in the power spectrum. The noise does not affect calibration. The compression noise shows no correlation with the sky signal and has no measurable coherent component. The level of compression error in the power spectrum ultimately depends on the compression settings. Dysco visibility compression is found to be of insignificant concern for 21-cm power spectrum studies. Hence, data volumes can be safely reduced by factors of $\sim 4$ and with insignificant bias to the final power spectrum. Data from SKA-low will likely be compressible by the same factor as LOFAR, owing to the similarities of the two instruments. The same technique can be used to compress data from other telescopes, but a small adjustment of the compression parameters might be required.
△ Less
Submitted 16 July, 2024;
originally announced July 2024.
-
Beyond the horizon: Quantifying the full sky foreground wedge in the cylindrical power spectrum
Authors:
S. Munshi,
F. G. Mertens,
L. V. E. Koopmans,
A. R. Offringa,
E. Ceccotti,
S. A. Brackenhoff,
J. K. Chege,
B. K. Gehlot,
S. Ghosh,
C. Höfer,
M. Mevius
Abstract:
One of the main obstacles preventing the detection of the redshifted 21-cm signal from neutral hydrogen in the early Universe is the astrophysical foreground emission, which is several orders of magnitude brighter than the signal. The foregrounds, due to their smooth spectra, are expected to predominantly occupy a region in the cylindrical power spectrum known as the foreground wedge. However, the…
▽ More
One of the main obstacles preventing the detection of the redshifted 21-cm signal from neutral hydrogen in the early Universe is the astrophysical foreground emission, which is several orders of magnitude brighter than the signal. The foregrounds, due to their smooth spectra, are expected to predominantly occupy a region in the cylindrical power spectrum known as the foreground wedge. However, the conventional equations describing the extent of the foreground wedge are derived under a flat-sky approximation. This assumption breaks down for tracking wide-field instruments, thus rendering these equations inapplicable in these situations. In this paper, we derive equations for the full sky foreground wedge and show that the foregrounds can potentially extend far beyond what the conventional equations suggest. We also derive the equations that describe a specific bright source in the cylindrical power spectrum space. The validity of both sets of equations is tested against numerical simulations. Many current and upcoming interferometers (e.g., LOFAR, NenuFAR, MWA, SKA) are wide-field phase-tracking instruments. These equations give us new insights into the nature of foreground contamination in the cylindrical power spectra estimated using wide-field instruments. Additionally, they allow us to accurately associate features in the power spectrum to foregrounds or instrumental effects. The equations are also important for correctly selecting the "EoR window" for foreground avoidance analyses, and for planning 21-cm observations. In future analyses, it is recommended to use these updated horizon lines to indicate the foreground wedge in the cylindrical power spectrum accurately. The new equations for generating the updated wedge lines are made available in a Python library, pslines.
△ Less
Submitted 10 December, 2024; v1 submitted 15 July, 2024;
originally announced July 2024.
-
Optimising MWA EoR data processing for improved 21 cm power spectrum measurements -- fine-tuning ionospheric corrections
Authors:
J. Kariuki Chege,
C. H. Jordan,
C. Lynch,
C. M. Trott,
J. L. B. Line,
B. Pindor,
S. Yoshiura
Abstract:
The redshifted cosmological 21 cm signal emitted by neutral hydrogen during the first billion years of the universe is much fainter relative to other galactic and extragalactic radio emissions, posing a great challenge towards detection of the signal. Therefore, precise instrumental calibration is a vital prerequisite for the success of radio interferometers such as the Murchison Widefield Array (…
▽ More
The redshifted cosmological 21 cm signal emitted by neutral hydrogen during the first billion years of the universe is much fainter relative to other galactic and extragalactic radio emissions, posing a great challenge towards detection of the signal. Therefore, precise instrumental calibration is a vital prerequisite for the success of radio interferometers such as the Murchison Widefield Array (MWA), which aim for a 21 cm detection. Over the previous years, novel calibration techniques targeting the power spectrum paradigm of EoR science have been actively researched and where possible implemented. Using recently acquired computation resources for the MWA, we test the full capabilities of the state-of-the-art calibration techniques available for the MWA EoR project, with a focus on both direction dependent and direction independent calibration. Specifically, we investigate improvements that can be made in the vital calibration stages of sky modelling, ionospheric correction, and compact source foreground subtraction as applied in the hybrid foreground mitigation approach (one that combines both foreground subtraction and avoidance). Additionally, we investigate a method of ionospheric correction using interpolated ionospheric phase screens and assess its performance in the power spectrum space. Overall, we identify a refined RTS calibration configuration that leads to an at least 2 factor reduction of the EoR window power contamination at the $0.1 \; \text{hMpc}^{-1}$ scale. The improvement marks a step further towards detecting the 21 cm signal using the MWA and the forthcoming SKA low telescope.
△ Less
Submitted 25 July, 2022;
originally announced July 2022.
-
The MWA Long Baseline Epoch of Reionisation Survey: I. Improved Source Catalogue for the EoR 0 field
Authors:
C. R. Lynch,
T. J. Galvin,
J. L. B. Line,
C. H. Jordan,
C. M. Trott,
J. K. Chege,
B. McKinley,
M. Johnston-Hollitt,
S. J. Tingay
Abstract:
One of the principal systematic constraints on the Epoch of Reionisation (EoR) experiment is the accuracy of the foreground calibration model. Recent results have shown that highly accurate models of extended foreground sources, and including models for sources in both the primary beam and its sidelobes, are necessary for reducing foreground power. To improve the accuracy of the source models for…
▽ More
One of the principal systematic constraints on the Epoch of Reionisation (EoR) experiment is the accuracy of the foreground calibration model. Recent results have shown that highly accurate models of extended foreground sources, and including models for sources in both the primary beam and its sidelobes, are necessary for reducing foreground power. To improve the accuracy of the source models for the EoR fields observed by the Murchison Widefield Array (MWA), we conducted the MWA Long Baseline Epoch of Reionisation Survey (LoBES). This survey consists of multi-frequency observations of the main MWA EoR fields and their eight neighbouring fields using the MWA Phase II extended array. We present the results of the first half of this survey centred on the MWA EoR0 observing field (centred at RA(J2000) 0 h, Dec(J2000) -27 deg). This half of the survey covers an area of 3069 degrees$^2$, with an average rms of 2.1 mJy beam$^{-1}$. The resulting catalogue contains a total of 80824 sources, with 16 separate spectral measurements between 100 and 230 MHz, and spectral modelling for 78$\%$ of these sources. Over this region we estimate that the catalogue is 90$\%$ complete at 32 mJy, and 70$\%$ complete at 10.5~mJy. The overall normalised source counts are found to be in good agreement with previous low-frequency surveys at similar sensitivities. Testing the performance of the new source models we measure lower residual rms values for peeled sources, particularly for extended sources, in a set of MWA Phase I data. The 2-dimensional power spectrum of these data residuals also show improvement on small angular scales -- consistent with the better angular resolution of the LoBES catalogue. It is clear that the LoBES sky models improve upon the current sky model used by the Australian MWA EoR group for the EoR0 field.
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
Simulations of ionospheric refraction on radio interferometric data
Authors:
J. Kariuki Chege,
C. H. Jordan,
C. Lynch,
J. L. B. Line,
C. M. Trott
Abstract:
The Epoch of Reionisation (EoR) is the period within which the neutral universe transitioned to an ionised one. This period remains unobserved using low-frequency radio interferometers which target the 21 cm signal of neutral hydrogen emitted in this era. The Murchison Widefield Array (MWA) radio telescope was built with the detection of this signal as one of its major science goals. One of the mo…
▽ More
The Epoch of Reionisation (EoR) is the period within which the neutral universe transitioned to an ionised one. This period remains unobserved using low-frequency radio interferometers which target the 21 cm signal of neutral hydrogen emitted in this era. The Murchison Widefield Array (MWA) radio telescope was built with the detection of this signal as one of its major science goals. One of the most significant challenges towards a successful detection is that of calibration, especially in the presence of the Earth's ionosphere. By introducing refractive source shifts, distorting source shapes and scintillating flux densities, the ionosphere is a major nuisance in low-frequency radio astronomy. We introduce SIVIO, a software tool developed for simulating observations of the MWA through different ionospheric conditions estimated using thin screen approximation models and propagated into the visibilities. This enables us to directly assess the impact of the ionosphere on observed EoR data and the resulting power spectra. We show that the simulated data captures the dispersive behaviour of ionospheric effects. We show that the spatial structure of the simulated ionospheric media is accurately reconstructed either from the resultant source positional offsets or from parameters evaluated during the data calibration procedure. In turn, this will inform on the best strategies of identifying and efficiently eliminating ionospheric contamination in EoR data moving into the Square Kilometre Array era.
△ Less
Submitted 10 May, 2021;
originally announced May 2021.
