Showing 1–50 of 208 results for author: Nair, G

ROC Curves for Spatial Point Patterns and Presence-Absence Data

Authors: Adrian Baddeley, Ege Rubak, Suman Rakshit, Gopalan Nair

Abstract: Receiver Operating Characteristic (ROC) curves have recently been used to evaluate the performance of models for spatial presence-absence or presence-only data. Applications include species distribution modelling and mineral prospectivity analysis. We clarify the interpretation of the ROC curve in this context. Contrary to statements in the literature, ROC does not measure goodness-of-fit of a spa… ▽ More Receiver Operating Characteristic (ROC) curves have recently been used to evaluate the performance of models for spatial presence-absence or presence-only data. Applications include species distribution modelling and mineral prospectivity analysis. We clarify the interpretation of the ROC curve in this context. Contrary to statements in the literature, ROC does not measure goodness-of-fit of a spatial model, and its interpretation as a measure of predictive ability is weak; it is a measure of ranking ability, insensitive to the precise form of the model. To gain insight we draw connections between ROC and existing statistical techniques for spatial point pattern data. The area under the ROC curve (AUC) is related to hypothesis tests of the null hypothesis that the explanatory variables have no effect. The shape of the ROC curve has a diagnostic interpretation. This suggests several new techniques, which extend the scope of application of ROC curves for spatial data, to support variable selection and model selection, analysis of segregation between different types of points, adjustment for a baseline, and analysis of spatial case-control data. The new techniques are illustrated with several real example datasets. Open source R code implementing the techniques is available in the development version of our package spatstat [Baddeley and Turner, 2005, Baddeley et al., 2015] and will be included in the next public release. △ Less

Submitted 3 June, 2025; originally announced June 2025.

Phase-based analysis and control of low Reynolds number aeroelastic flows

Authors: Chathura R. Sumanasiri, Tulsi Ram Sahu, Aditya G. Nair

Abstract: Flutter in lightweight airfoils under unsteady flows presents a critical challenge in aeroelastic stability and control. This study uncovers phase-localized mechanisms that drive the onset and suppression of flutter in a freely pitching airfoil at low Reynolds number. By introducing targeted impulsive stiffness perturbations, we identify critical phases that trigger instability. Using phase-sensit… ▽ More Flutter in lightweight airfoils under unsteady flows presents a critical challenge in aeroelastic stability and control. This study uncovers phase-localized mechanisms that drive the onset and suppression of flutter in a freely pitching airfoil at low Reynolds number. By introducing targeted impulsive stiffness perturbations, we identify critical phases that trigger instability. Using phase-sensitivity functions, energy-transfer metrics, and dynamic mode decomposition, we show that flutter arises from phase lock-on between structural and fluid modes. Leveraging this insight, we design an energy-optimal, phase-based control strategy that applies transient heaving motions to disrupt synchronization and arrest unstable growth. This minimal, time-localized control suppresses subharmonic amplification and restores stable periodic motion. △ Less

Submitted 30 May, 2025; originally announced June 2025.

Comments: 11 pages, 5 figures

Origin of the ring ellipticity in the black hole images of M87*

Authors: Rohan Dahale, Ilje Cho, Kotaro Moriyama, Kaj Wiik, Paul Tiede, José L. Gómez, Chi-kwan Chan, Roman Gold, Vadim Y. Bernshteyn, Marianna Foschi, Britton Jeter, Hung-Yi Pu, Boris Georgiev, Abhishek V. Joshi, Alejandro Cruz-Osorio, Iniyan Natarajan, Avery E. Broderick, León D. S. Salas, Koushik Chatterjee, Kazunori Akiyama, Ezequiel Albentosa-Ruíz, Antxon Alberdi, Walter Alef, Juan Carlos Algaba, Richard Anantua , et al. (251 additional authors not shown)

Abstract: We investigate the origin of the elliptical ring structure observed in the images of the supermassive black hole M87*, aiming to disentangle contributions from gravitational, astrophysical, and imaging effects. Leveraging the enhanced capabilities of the Event Horizon Telescope (EHT) 2018 array, including improved $(u,v)$-coverage from the Greenland Telescope, we measure the ring's ellipticity usi… ▽ More We investigate the origin of the elliptical ring structure observed in the images of the supermassive black hole M87*, aiming to disentangle contributions from gravitational, astrophysical, and imaging effects. Leveraging the enhanced capabilities of the Event Horizon Telescope (EHT) 2018 array, including improved $(u,v)$-coverage from the Greenland Telescope, we measure the ring's ellipticity using five independent imaging methods, obtaining a consistent average value of $τ= 0.08_{-0.02}^{+0.03}$ with a position angle $ξ= 50.1_{-7.6}^{+6.2}$ degrees. To interpret this measurement, we compare against General Relativistic Magnetohydrodynamic (GRMHD) simulations spanning a wide range of physical parameters including thermal or non-thermal electron distribution function, spins, and ion-to-electron temperature ratios in both low and high-density regions. We find no statistically significant correlation between spin and ellipticity in GRMHD images. Instead, we identify a correlation between ellipticity and the fraction of non-ring emission, particularly in non-thermal models and models with higher jet emission. These results indicate that the ellipticity measured from the \m87 emission structure is consistent with that expected from simulations of turbulent accretion flows around black holes, where it is dominated by astrophysical effects rather than gravitational ones. Future high-resolution imaging, including space very long baseline interferometry and long-term monitoring, will be essential to isolate gravitational signatures from astrophysical effects. △ Less

Submitted 15 May, 2025; originally announced May 2025.

Comments: 18 pages, 13 figures

Single-shot prediction of parametric partial differential equations

Authors: Khalid Rafiq, Wenjing Liao, Aditya G. Nair

Abstract: We introduce Flexi-VAE, a data-driven framework for efficient single-shot forecasting of nonlinear parametric partial differential equations (PDEs), eliminating the need for iterative time-stepping while maintaining high accuracy and stability. Flexi-VAE incorporates a neural propagator that advances latent representations forward in time, aligning latent evolution with physical state reconstructi… ▽ More We introduce Flexi-VAE, a data-driven framework for efficient single-shot forecasting of nonlinear parametric partial differential equations (PDEs), eliminating the need for iterative time-stepping while maintaining high accuracy and stability. Flexi-VAE incorporates a neural propagator that advances latent representations forward in time, aligning latent evolution with physical state reconstruction in a variational autoencoder setting. We evaluate two propagation strategies, the Direct Concatenation Propagator (DCP) and the Positional Encoding Propagator (PEP), and demonstrate, through representation-theoretic analysis, that DCP offers superior long-term generalization by fostering disentangled and physically meaningful latent spaces. Geometric diagnostics, including Jacobian spectral analysis, reveal that propagated latent states reside in regions of lower decoder sensitivity and more stable local geometry than those derived via direct encoding, enhancing robustness for long-horizon predictions. We validate Flexi-VAE on canonical PDE benchmarks, the 1D viscous Burgers equation and the 2D advection-diffusion equation, achieving accurate forecasts across wide parametric ranges. The model delivers over 50x CPU and 90x GPU speedups compared to autoencoder-LSTM baselines for large temporal shifts. These results position Flexi-VAE as a scalable and interpretable surrogate modeling tool for accelerating high-fidelity simulations in computational fluid dynamics (CFD) and other parametric PDE-driven applications, with extensibility to higher-dimensional and more complex systems. △ Less

Submitted 13 May, 2025; originally announced May 2025.

Comments: 35 pages, 17 figures

MSC Class: 68T07

Unmasking the Canvas: A Dynamic Benchmark for Image Generation Jailbreaking and LLM Content Safety

Authors: Variath Madhupal Gautham Nair, Vishal Varma Dantuluri

Abstract: Existing large language models (LLMs) are advancing rapidly and produce outstanding results in image generation tasks, yet their content safety checks remain vulnerable to prompt-based jailbreaks. Through preliminary testing on platforms such as ChatGPT, MetaAI, and Grok, we observed that even short, natural prompts could lead to the generation of compromising images ranging from realistic depicti… ▽ More Existing large language models (LLMs) are advancing rapidly and produce outstanding results in image generation tasks, yet their content safety checks remain vulnerable to prompt-based jailbreaks. Through preliminary testing on platforms such as ChatGPT, MetaAI, and Grok, we observed that even short, natural prompts could lead to the generation of compromising images ranging from realistic depictions of forged documents to manipulated images of public figures. We introduce Unmasking the Canvas (UTC Benchmark; UTCB), a dynamic and scalable benchmark dataset to evaluate LLM vulnerability in image generation. Our methodology combines structured prompt engineering, multilingual obfuscation (e.g., Zulu, Gaelic, Base64), and evaluation using Groq-hosted LLaMA-3. The pipeline supports both zero-shot and fallback prompting strategies, risk scoring, and automated tagging. All generations are stored with rich metadata and curated into Bronze (non-verified), Silver (LLM-aided verification), and Gold (manually verified) tiers. UTCB is designed to evolve over time with new data sources, prompt templates, and model behaviors. Warning: This paper includes visual examples of adversarial inputs designed to test model safety. All outputs have been redacted to ensure responsible disclosure. △ Less

Submitted 7 May, 2025; originally announced May 2025.

Monitoring morphometric drift in lifelong learning segmentation of the spinal cord

Authors: Enamundram Naga Karthik, Sandrine Bédard, Jan Valošek, Christoph S. Aigner, Elise Bannier, Josef Bednařík, Virginie Callot, Anna Combes, Armin Curt, Gergely David, Falk Eippert, Lynn Farner, Michael G Fehlings, Patrick Freund, Tobias Granberg, Cristina Granziera, RHSCIR Network Imaging Group, Ulrike Horn, Tomáš Horák, Suzanne Humphreys, Markus Hupp, Anne Kerbrat, Nawal Kinany, Shannon Kolind, Petr Kudlička , et al. (31 additional authors not shown)

Abstract: Morphometric measures derived from spinal cord segmentations can serve as diagnostic and prognostic biomarkers in neurological diseases and injuries affecting the spinal cord. While robust, automatic segmentation methods to a wide variety of contrasts and pathologies have been developed over the past few years, whether their predictions are stable as the model is updated using new datasets has not… ▽ More Morphometric measures derived from spinal cord segmentations can serve as diagnostic and prognostic biomarkers in neurological diseases and injuries affecting the spinal cord. While robust, automatic segmentation methods to a wide variety of contrasts and pathologies have been developed over the past few years, whether their predictions are stable as the model is updated using new datasets has not been assessed. This is particularly important for deriving normative values from healthy participants. In this study, we present a spinal cord segmentation model trained on a multisite $(n=75)$ dataset, including 9 different MRI contrasts and several spinal cord pathologies. We also introduce a lifelong learning framework to automatically monitor the morphometric drift as the model is updated using additional datasets. The framework is triggered by an automatic GitHub Actions workflow every time a new model is created, recording the morphometric values derived from the model's predictions over time. As a real-world application of the proposed framework, we employed the spinal cord segmentation model to update a recently-introduced normative database of healthy participants containing commonly used measures of spinal cord morphometry. Results showed that: (i) our model outperforms previous versions and pathology-specific models on challenging lumbar spinal cord cases, achieving an average Dice score of $0.95 \pm 0.03$; (ii) the automatic workflow for monitoring morphometric drift provides a quick feedback loop for developing future segmentation models; and (iii) the scaling factor required to update the database of morphometric measures is nearly constant among slices across the given vertebral levels, showing minimum drift between the current and previous versions of the model monitored by the framework. The model is freely available in Spinal Cord Toolbox v7.0. △ Less

Submitted 2 May, 2025; originally announced May 2025.

MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research

Authors: James Burgess, Jeffrey J Nirschl, Laura Bravo-Sánchez, Alejandro Lozano, Sanket Rajan Gupte, Jesus G. Galaz-Montoya, Yuhui Zhang, Yuchang Su, Disha Bhowmik, Zachary Coman, Sarina M. Hasan, Alexandra Johannesson, William D. Leineweber, Malvika G Nair, Ridhi Yarlagadda, Connor Zuraski, Wah Chiu, Sarah Cohen, Jan N. Hansen, Manuel D Leonetti, Chad Liu, Emma Lundberg, Serena Yeung-Levy

Abstract: Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal reasoning benchmarks only target up to college-level difficulty, while research-level benchmarks emphasize lower-level perception, falling short of the complex multimo… ▽ More Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal reasoning benchmarks only target up to college-level difficulty, while research-level benchmarks emphasize lower-level perception, falling short of the complex multimodal reasoning needed for scientific discovery. To bridge this gap, we introduce MicroVQA, a visual-question answering (VQA) benchmark designed to assess three reasoning capabilities vital in research workflows: expert image understanding, hypothesis generation, and experiment proposal. MicroVQA consists of 1,042 multiple-choice questions (MCQs) curated by biology experts across diverse microscopy modalities, ensuring VQA samples represent real scientific practice. In constructing the benchmark, we find that standard MCQ generation methods induce language shortcuts, motivating a new two-stage pipeline: an optimized LLM prompt structures question-answer pairs into MCQs; then, an agent-based `RefineBot' updates them to remove shortcuts. Benchmarking on state-of-the-art MLLMs reveal a peak performance of 53\%; models with smaller LLMs only slightly underperform top models, suggesting that language-based reasoning is less challenging than multimodal reasoning; and tuning with scientific articles enhances performance. Expert analysis of chain-of-thought responses shows that perception errors are the most frequent, followed by knowledge errors and then overgeneralization errors. These insights highlight the challenges in multimodal scientific reasoning, showing MicroVQA is a valuable resource advancing AI-driven biomedical research. MicroVQA is available at https://huggingface.co/datasets/jmhb/microvqa, and project page at https://jmhb0.github.io/microvqa. △ Less

Submitted 17 March, 2025; originally announced March 2025.

Comments: CVPR 2025 (Conference on Computer Vision and Pattern Recognition) Project page at https://jmhb0.github.io/microvqa Benchmark at https://huggingface.co/datasets/jmhb/microvqa

Tracking X-ray Variability in Next Generation EHT LLAGN Targets

Authors: Nicole M. Ford, Michael Nowak, Venkatessh Ramakrishnan, Daryl Haggard, Kristen Dage, Dhanya G. Nair, Chi-kwan Chan

Abstract: We present a 5 month NICER X-ray monitoring campaign for two low luminosity active galactic nuclei (LLAGNs) -- NGC 4594 and IC 1459 -- with complementary Swift and NuSTAR observations. Utilizing an absorbed power law and thermal source model combined with NICER's SCORPEON background model, we demonstrate the effectiveness of joint source/background modeling for constraining emission from faint, ba… ▽ More We present a 5 month NICER X-ray monitoring campaign for two low luminosity active galactic nuclei (LLAGNs) -- NGC 4594 and IC 1459 -- with complementary Swift and NuSTAR observations. Utilizing an absorbed power law and thermal source model combined with NICER's SCORPEON background model, we demonstrate the effectiveness of joint source/background modeling for constraining emission from faint, background-dominated targets. Both sources are dominated by nuclear power law emission with photon indices $Γ\sim 1.5 - 2$, with NGC 4594 being slightly harder than IC 1459. The thermal contribution in both sources is fainter, but constant, with $kT \sim 0.5$ keV ($\sim 5 \times 10^6$ K). The power law flux and $Γ$ are strongly anti-correlated in both sources, as has been seen for other LLAGNs with radiatively inefficient accretion flows. NGC 4594 is the brighter source and exhibits significant aperiodic variability. Its variability timescale with an upper limit of $5 - 7$ days indicates emission originating from $< 100 R_{g}$, at the scale of the inner accretion flow. A spectral break found at $\sim 6$ keV, while tentative, could arise from synchrotron/inverse compton emission. This high-cadence LLAGN X-ray monitoring campaign underlines the importance of multi-wavelength variability studies for a sample of LLAGNs to truly understand their accretion and outflow physics. △ Less

Submitted 13 March, 2025; v1 submitted 24 January, 2025; originally announced January 2025.

Comments: 14 pages, 5 figures, 5 tables. Updated to match version published in ApJ

Journal ref: ApJ 981 126 (2025)

Investigating launching of black hole jets with the combined power of the EVN and the EHT

Authors: G. F. Paraschos, L. C. Debbrecht, J. A. Kramer, E. Traianou, I. Liodakis, T. Krichbaum, J. -Y. Kim, M. Janssen, D. G. Nair, T. Savolainen, E. Ros, U Bach, J. A. Hodgson, M. Lisakov, N. R. MacDonald, J. A. Zensus

Abstract: AGN-launched jets are a crucial element in the study of supermassive black holes (SMBH) and their closest surroundings. The formation of such jets, whether they are launched by magnetic field lines anchored to the accretion disc or directly connected to the black hole's (BH) ergosphere, is the subject of ongoing, extensive research. 3C84, the compact radio source in the central galaxy NGC1275 of t… ▽ More AGN-launched jets are a crucial element in the study of supermassive black holes (SMBH) and their closest surroundings. The formation of such jets, whether they are launched by magnetic field lines anchored to the accretion disc or directly connected to the black hole's (BH) ergosphere, is the subject of ongoing, extensive research. 3C84, the compact radio source in the central galaxy NGC1275 of the Perseus super-cluster, is a prime laboratory for testing such jet launching scenarios, as well as studying the innermost, sub-parsec AGN structure and jet origin. Very long baseline interferometry (VLBI) offers a unique view into the physical processes in action, in the immediate vicinity of BHs, unparalleled by other observational techniques. With VLBI at short wavelengths particular high angular resolutions are obtained. Utilising such cm and mm-VLBI observations of 3C84 with the European VLBI Network and the Event Horizon Telescope, we study the magnetic field strength and associated accretion flow around its central SMBH. This is possible, as higher frequency VLBI measurements are capable of peering through the accretion flow surrounding the central engine of 3C84, which is known to block the line of sight to the sub-parsec counter-jet via free-free absorption. Furthermore, we study the magnetic field's signature in the core region, as manifested in polarised light. As part of this analysis we compare our observations to relativistic magneto-hydrodynamic simulations. Finally, we investigate the effect of instabilities on the shape of the jet's parsec-scale funnel and try to connect them to its historical evolution. △ Less

Submitted 21 January, 2025; originally announced January 2025.

Comments: 4 pages, 4 figures, Proceedings of the 16th European VLBI Network Symposium

The putative center in NGC 1052

Authors: Anne-Kathrin Baczko, Matthias Kadler, Eduardo Ros, Christian M. Fromm, Maciek Wielgus, Manel Perucho, Thomas P. Krichbaum, Mislav Baloković, Lindy Blackburn, Chi-kwan Chan, Sara Issaoun, Michael Janssen, Luca Ricci, Kazunori Akiyama, Ezequiel Albentosa-Ruíz, Antxon Alberdi, Walter Alef, Juan Carlos Algaba, Richard Anantua, Keiichi Asada, Rebecca Azulay, Uwe Bach, David Ball, Bidisha Bandyopadhyay, John Barrett , et al. (262 additional authors not shown)

Abstract: Many active galaxies harbor powerful relativistic jets, however, the detailed mechanisms of their formation and acceleration remain poorly understood. To investigate the area of jet acceleration and collimation with the highest available angular resolution, we study the innermost region of the bipolar jet in the nearby low-ionization nuclear emission-line region (LINER) galaxy NGC 1052. We combine… ▽ More Many active galaxies harbor powerful relativistic jets, however, the detailed mechanisms of their formation and acceleration remain poorly understood. To investigate the area of jet acceleration and collimation with the highest available angular resolution, we study the innermost region of the bipolar jet in the nearby low-ionization nuclear emission-line region (LINER) galaxy NGC 1052. We combined observations of NGC 1052 taken with VLBA, GMVA, and EHT over one week in the spring of 2017. For the first time, NGC 1052 was detected with the EHT, providing a size of the central region in-between both jet bases of 250 RS (Schwarzschild radii) perpendicular to the jet axes. This size estimate supports previous studies of the jets expansion profile which suggest two breaks of the profile at around 300 RS and 10000 RS distances to the core. Furthermore, we estimated the magnetic field to be 1.25 Gauss at a distance of 22 μas from the central engine by fitting a synchrotron-self absorption spectrum to the innermost emission feature, which shows a spectral turn-over at about 130 GHz. Assuming a purely poloidal magnetic field, this implies an upper limit on the magnetic field strength at the event horizon of 26000 Gauss, which is consistent with previous measurements. The complex, low-brightness, double-sided jet structure in NGC 1052 makes it a challenge to detect the source at millimeter (mm) wavelengths. However, our first EHT observations have demonstrated that detection is possible up to at least 230 GHz. This study offers a glimpse through the dense surrounding torus and into the innermost central region, where the jets are formed. This has enabled us to finally resolve this region and provide improved constraints on its expansion and magnetic field strength. △ Less

Submitted 15 January, 2025; originally announced January 2025.

Comments: 22 pages, 10 figures, published in A&A

Journal ref: A&A, 692, A205 (2024)

A multi-frequency study of sub-parsec jets with the Event Horizon Telescope

Authors: Jan Röder, Maciek Wielgus, Andrei P. Lobanov, Thomas P. Krichbaum, Dhanya G. Nair, Sang-Sung Lee, Eduardo Ros, Vincent L. Fish, Lindy Blackburn, Chi-kwan Chan, Sara Issaoun, Michael Janssen, Michael D. Johnson, Sheperd S. Doeleman, Geoffrey C. Bower, Geoffrey B. Crew, Remo P. J. Tilanus, Tuomas Savolainen, C. M. Violette Impellizzeri, Antxon Alberdi, Anne-Kathrin Baczko, José L. Gómez, Ru-Sen Lu, Georgios F. Paraschos, Efthalia Traianou , et al. (265 additional authors not shown)

Abstract: The 2017 observing campaign of the Event Horizon Telescope (EHT) delivered the first very long baseline interferometry (VLBI) images at the observing frequency of 230 GHz, leading to a number of unique studies on black holes and relativistic jets from active galactic nuclei (AGN). In total, eighteen sources were observed: the main science targets, Sgr A* and M87 along with various calibrators. We… ▽ More The 2017 observing campaign of the Event Horizon Telescope (EHT) delivered the first very long baseline interferometry (VLBI) images at the observing frequency of 230 GHz, leading to a number of unique studies on black holes and relativistic jets from active galactic nuclei (AGN). In total, eighteen sources were observed: the main science targets, Sgr A* and M87 along with various calibrators. We investigated the morphology of the sixteen AGN in the EHT 2017 data set, focusing on the properties of the VLBI cores: size, flux density, and brightness temperature. We studied their dependence on the observing frequency in order to compare it with the Blandford-Königl (BK) jet model. We modeled the source structure of seven AGN in the EHT 2017 data set using linearly polarized circular Gaussian components and collected results for the other nine AGN from dedicated EHT publications, complemented by lower frequency data in the 2-86 GHz range. Then, we studied the dependences of the VLBI core flux density, size, and brightness temperature on the frequency measured in the AGN host frame. We compared the observations with the BK jet model and estimated the magnetic field strength dependence on the distance from the central black hole. Our results indicate a deviation from the standard BK model, particularly in the decrease of the brightness temperature with the observing frequency. Either bulk acceleration of the jet material, energy transfer from the magnetic field to the particles, or both are required to explain the observations. △ Less

Submitted 9 January, 2025; originally announced January 2025.

Journal ref: A&A 695, A233 (2025)

The LOFAR Two-metre Sky Survey: Deep Fields Data Release 2. I. The ELAIS-N1 field

Authors: T. W. Shimwell, C. L. Hale, P. N. Best, A. Botteon, A. Drabent, M. J. Hardcastle, V. Jelić, J. M. G. H. J. de Jong, R. Kondapally, H. J. A. Röttgering, C. Tasse, R. J. van Weeren, W. L. Williams, A. Bonafede, M. Bondi, M. Brüggen, G. Brunetti, J. R. Callingham, F. De Gasperin, K. J. Duncan, C. Horellou, S. Iyer, I. de Ruiter, K. Małek, D. G. Nair , et al. (7 additional authors not shown)

Abstract: We present the final 6'' resolution data release of the ELAIS-N1 field from the LOw-Frequency ARray (LOFAR) Two-metre Sky Survey Deep Fields project (LoTSS Deep). The 144MHz images are the most sensitive achieved to date at this frequency and were created from 290 TB of data obtained from 505 hrs on-source observations taken over 7.5 years. The data were processed following the strategies develope… ▽ More We present the final 6'' resolution data release of the ELAIS-N1 field from the LOw-Frequency ARray (LOFAR) Two-metre Sky Survey Deep Fields project (LoTSS Deep). The 144MHz images are the most sensitive achieved to date at this frequency and were created from 290 TB of data obtained from 505 hrs on-source observations taken over 7.5 years. The data were processed following the strategies developed for previous LoTSS and LoTSS Deep data releases. The resulting images span 24.53 square degrees and, using a refined source detection approach, we identified 154,952 radio sources formed from 182,184 Gaussian components within this area. The maps reach a noise level of 10.7 $μ$Jy/beam at 6'' resolution where approximately half of the noise is due to source confusion. In about 7.4% of the image our limited dynamic range around bright sources results in a further > 5% increase in the noise. The images have a flux density scale accuracy of about 9% and the standard deviation of offsets between our source positions and those from Pan-STARRS is 0.2'' in RA and Dec for high significance detections. We searched individual epoch images for variable sources, identifying 39 objects with considerable variation. We also searched for circularly polarised sources achieving three detections of previously known emitters (two stars and one pulsar) whilst constraining the typical polarisation fraction plus leakage to be less than 0.045%. △ Less

Submitted 7 January, 2025; originally announced January 2025.

Comments: Accepted for publication in A&A. 16 figures, 1 table and 20 pages. The catalogues and images associated with this data release are publicly available via https://lofar-surveys.org/

Journal ref: A&A 695, A80 (2025)

Demographics of black holes at $<$100 R$_{\rm g}$ scales: accretion flows, jets, and shadows

Authors: Dhanya G. Nair, Neil M. Nagar, Venkatessh Ramakrishnan, Maciek Wielgus, Vicente Arratia, Thomas P. Krichbaum, Xinyue A. Zhang, Angelo Ricarte, Silpa S., Joaquín Hernández-Yévenes, Nicole M. Ford, Bidisha Bandyopadhyay, Mark Gurwell, Roman Burridge, Dominic W. Pesce, Sheperd S. Doeleman, Jae-Young Kim, Daewon Kim, Michael Janssen, Sebastiano D. von Fellenberg, Christian M. Fromm, Deokhyeong Lee, Heino Falcke, Jan Wagner, Geoffrey C. Bower , et al. (65 additional authors not shown)

Abstract: Using the Event Horizon Telescope (EHT), the gravitationally lensed rings around the supermassive black holes (SMBHs) in Messier 87 (M87) and Sagittarius A* (Sgr A*) have now been successfully imaged at a resolution under 10 gravitational radii (R$_{\rm g}$ $ = \rm{GM/c^2}$). To expand studies beyond M87 and Sgr A*, we have constructed the Event Horizon and Environs (ETHER) sample, a comprehensive… ▽ More Using the Event Horizon Telescope (EHT), the gravitationally lensed rings around the supermassive black holes (SMBHs) in Messier 87 (M87) and Sagittarius A* (Sgr A*) have now been successfully imaged at a resolution under 10 gravitational radii (R$_{\rm g}$ $ = \rm{GM/c^2}$). To expand studies beyond M87 and Sgr A*, we have constructed the Event Horizon and Environs (ETHER) sample, a comprehensive database encompassing approximately 3.15 million SMBH mass estimates, $\sim$ 20,000 Very-Long Baseline Interferometry (VLBI) radio flux densities, and $\sim$ 36,000 hard X-ray flux densities. This database is designed to identify and optimize target selection for the EHT and its upgrades on the ground and in space. We have identified a Gold Sample (GS) of nearby low-luminosity Active Galactic Nuclei (AGNs) within it that are ideal for studying jet bases and potentially imaging black hole shadows. We observed 27 of these AGNs using the EHT from 2022 to 2024, providing an opportunity to resolve and image accretion flows and jets at resolutions of $\leq$ 100 R$_{\rm g}$. Only a few SMBHs have sufficiently high enough flux density to be imaged at scales of $\leq$ 50 R$_{\rm g}$ with the present EHT. Among these are M87, Sgr A*, NGC4594 (Sombrero/M104), NGC4261, and NGC4374 (Messier 84/M84). Of these, NGC4261, Sombrero, and M84 have been observed and/or are scheduled for deep imaging with EHT+ALMA from 2023 to 2025. Sombrero, NGC4261, M84, NGC4278, and NGC5232 are clearly detected in our EHT+ALMA observations in 2022, indicating that the 230 GHz flux density from the accretion flows is significantly high. Ongoing imaging of the ETHER GS will enable measurements of black hole mass and spin, help constrain General Relativity, and enrich our understanding of jet launching and accretion inflows across a broad multi-parameter space, including black hole mass, spin, accretion rate, and orientation. △ Less

Submitted 28 December, 2024; originally announced December 2024.

Comments: 9 pages, 6 figures, 1 table, published in Proceedings of the 16th EVN Symposium, Ed. E. Ros, P. Benke, S.A. Dzib, I. Rottmann, & J.A. Zensus, Bonn: Max-Planck-Institut für Radioastronomie, 2024, pages 75-84, https://cloud.mpifr-bonn.mpg.de/index.php/s/BkX2CC2Xjn2aKR4

PETALface: Parameter Efficient Transfer Learning for Low-resolution Face Recognition

Authors: Kartik Narayan, Nithin Gopalakrishnan Nair, Jennifer Xu, Rama Chellappa, Vishal M. Patel

Abstract: Pre-training on large-scale datasets and utilizing margin-based loss functions have been highly successful in training models for high-resolution face recognition. However, these models struggle with low-resolution face datasets, in which the faces lack the facial attributes necessary for distinguishing different faces. Full fine-tuning on low-resolution datasets, a naive method for adapting the m… ▽ More Pre-training on large-scale datasets and utilizing margin-based loss functions have been highly successful in training models for high-resolution face recognition. However, these models struggle with low-resolution face datasets, in which the faces lack the facial attributes necessary for distinguishing different faces. Full fine-tuning on low-resolution datasets, a naive method for adapting the model, yields inferior performance due to catastrophic forgetting of pre-trained knowledge. Additionally the domain difference between high-resolution (HR) gallery images and low-resolution (LR) probe images in low resolution datasets leads to poor convergence for a single model to adapt to both gallery and probe after fine-tuning. To this end, we propose PETALface, a Parameter-Efficient Transfer Learning approach for low-resolution face recognition. Through PETALface, we attempt to solve both the aforementioned problems. (1) We solve catastrophic forgetting by leveraging the power of parameter efficient fine-tuning(PEFT). (2) We introduce two low-rank adaptation modules to the backbone, with weights adjusted based on the input image quality to account for the difference in quality for the gallery and probe images. To the best of our knowledge, PETALface is the first work leveraging the powers of PEFT for low resolution face recognition. Extensive experiments demonstrate that the proposed method outperforms full fine-tuning on low-resolution datasets while preserving performance on high-resolution and mixed-quality datasets, all while using only 0.48% of the parameters. Code: https://kartik-3004.github.io/PETALface/ △ Less

Submitted 10 December, 2024; originally announced December 2024.

Comments: Accepted to WACV 2025. Project Page: https://kartik-3004.github.io/PETALface/

GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration

Authors: Sudarshan Rajagopalan, Nithin Gopalakrishnan Nair, Jay N. Paranjape, Vishal M. Patel

Abstract: Deep learning-based models for All-In-One Image Restoration (AIOR) have achieved significant advancements in recent years. However, their practical applicability is limited by poor generalization to samples outside the training distribution. This limitation arises primarily from insufficient diversity in degradation variations and scenes within existing datasets, resulting in inadequate representa… ▽ More Deep learning-based models for All-In-One Image Restoration (AIOR) have achieved significant advancements in recent years. However, their practical applicability is limited by poor generalization to samples outside the training distribution. This limitation arises primarily from insufficient diversity in degradation variations and scenes within existing datasets, resulting in inadequate representations of real-world scenarios. Additionally, capturing large-scale real-world paired data for degradations such as haze, low-light, and raindrops is often cumbersome and sometimes infeasible. In this paper, we leverage the generative capabilities of latent diffusion models to synthesize high-quality degraded images from their clean counterparts. Specifically, we introduce GenDeg, a degradation and intensity-aware conditional diffusion model capable of producing diverse degradation patterns on clean images. Using GenDeg, we synthesize over 550k samples across six degradation types: haze, rain, snow, motion blur, low-light, and raindrops. These generated samples are integrated with existing datasets to form the GenDS dataset, comprising over 750k samples. Our experiments reveal that image restoration models trained on the GenDS dataset exhibit significant improvements in out-of-distribution performance compared to those trained solely on existing datasets. Furthermore, we provide comprehensive analyses on implications of diffusion model-based synthetic degradations for AIOR. △ Less

Submitted 22 March, 2025; v1 submitted 26 November, 2024; originally announced November 2024.

Comments: Accepted to CVPR 2025. Project Page: https://sudraj2002.github.io/gendegpage/

Dominant balance-based adaptive mesh refinement for incompressible fluid flows

Authors: Gaurav Kumar, Aditya G. Nair

Abstract: This work introduces a novel adaptive mesh refinement (AMR) method that utilizes dominant balance analysis (DBA) for efficient and accurate grid adaptation in computational fluid dynamics (CFD) simulations. The proposed method leverages a Gaussian mixture model (GMM) to classify grid cells into active and passive regions based on the dominant physical interactions in the equation space. Unlike tra… ▽ More This work introduces a novel adaptive mesh refinement (AMR) method that utilizes dominant balance analysis (DBA) for efficient and accurate grid adaptation in computational fluid dynamics (CFD) simulations. The proposed method leverages a Gaussian mixture model (GMM) to classify grid cells into active and passive regions based on the dominant physical interactions in the equation space. Unlike traditional AMR strategies, this approach does not rely on heuristic-based sensors or user-defined parameters, providing a fully automated and problem-independent framework for AMR. Applied to the incompressible Navier-Stokes equations for unsteady flow past a cylinder, the DBA-based AMR method achieves comparable accuracy to high-resolution grids while reducing computational costs by up to 70%. The validation highlights the method's effectiveness in capturing complex flow features while minimizing grid cells, directing computational resources toward regions with the most critical dynamics. This modular and scalable strategy is adaptable to a range of applications, presenting a promising tool for efficient high-fidelity simulations in CFD and other multiphysics domains. △ Less

Submitted 4 November, 2024; originally announced November 2024.

Comments: 22 pages, 12 figures

Mid-Range Science Objectives for the Event Horizon Telescope

Authors: The Event Horizon Telescope Collaboration

Abstract: The first images of the black holes in Sagittarius A* and M87* have created a wide range of new scientific opportunities in gravitational physics, compact objects, and relativistic astrophysics. We discuss here the scientific opportunities that arise from the rich data sets that have already been obtained and the new data sets that will be obtained, exploiting a wide range of technical advances, i… ▽ More The first images of the black holes in Sagittarius A* and M87* have created a wide range of new scientific opportunities in gravitational physics, compact objects, and relativistic astrophysics. We discuss here the scientific opportunities that arise from the rich data sets that have already been obtained and the new data sets that will be obtained, exploiting a wide range of technical advances, including observational agility, receiver upgrades, and the addition of new stations. This document provides a 5-year framework for Event Horizon Telescope (EHT) science structured around four fundamental questions that are used to prioritize the analysis of existing data, guide technical upgrades, and determine the optimal use of future observational opportunities with EHT, ALMA, and multi-wavelength facilities. Through enhancements over this period, the EHT will create the first movie of M87* connecting black hole and jet physics, provide detailed studies of the structure and dynamics of Sgr A*, characterize the magnetospheres of both systems through polarimetric imaging, and explore the spacetime properties of black holes with greater precision and range. △ Less

Submitted 3 October, 2024; originally announced October 2024.

Comments: 22 pages, 4 figures

Core prominence as a signature of restarted jet activity in the LOFAR radio-galaxy population

Authors: Dhanya G. Nair, Raffaella Morganti, Marisa Brienza, Beatriz Mingo, Judith H. Croston, Nika Jurlin, Timothy W. Shimwell, Joseph R. Callingham, Martin J. Hardcastle

Abstract: (abridged) Characterizing duty cycles of recurrent phases of dormancy and activity in supermassive black holes in active galactic nuclei is crucial in understanding impact of energy released on host galaxies and their evolution. However, identifying sources in quiescent and restarted phases is challenging. Our goal is to identify and characterize a substantial sample of radio galaxies in restarted… ▽ More (abridged) Characterizing duty cycles of recurrent phases of dormancy and activity in supermassive black holes in active galactic nuclei is crucial in understanding impact of energy released on host galaxies and their evolution. However, identifying sources in quiescent and restarted phases is challenging. Our goal is to identify and characterize a substantial sample of radio galaxies in restarted phase and explore core prominence as a signature of this activity. We expand our prior study from a $30\,\mathrm{deg^2}$ area in Lockman Hole to a larger $424\,\mathrm{deg^2}$ region in Hobby-Eberly Telescope Dark Energy Experiment (HETDEX) field using visually selected core-dominated radio galaxies. We used 144 MHz LOFAR survey images to identify galaxies with restarting jets. By applying selection criteria, including radio core dominance, low surface brightness extended emission, spectral index properties, and morphology, we found 69 candidate restarted radio galaxies. These candidates show diverse intrinsic morphology, spanning FRI, FRII, core-with-halo, and asymmetric forms, suggesting different progenitors. Among these, nine galaxies exhibit ultra-steep spectrum extended emission combined with high radio core prominence, representing previous and current epochs of jet activity. This subset supports a model where the switch-on and switch-off mechanism occurs with fast duty cycle. The restarted candidates span radio luminosities from log$_{10}$(L$_\mathrm{144 MHz}$/$\mathrm{WHz^{-1}}$) = 23.24 to 26.80, with sizes between 88 and 1659 kpc, including 16 giant radio galaxies. Their total stellar content aligns with massive elliptical galaxies. Our findings at $z<0.4$ suggest that many restarting galaxies are not found in rich cluster environments, consistent with broader radio-galaxy population. This study confirms core prominence as an effective parameter for selecting restarted radio sources. △ Less

Submitted 23 September, 2024; originally announced September 2024.

Comments: 28 pages, 18 figures, 7 tables, accepted for publication in A&A

Journal ref: A&A 691, A287 (2024)

Optimal Linear Filtering for Discrete-Time Systems with Infinite-Dimensional Measurements

Authors: Maxwell Varley, Timothy L. Molloy, Girish N. Nair

Abstract: Systems equipped with modern sensing modalities such as vision and lidar gain access to increasingly high-dimensional measurements with which to enact estimation and control schemes. In this article, we examine the continuum limit of high-dimensional measurements and analyze state estimation in linear time-invariant systems with infinite-dimensional measurements but finite-dimensional states, both… ▽ More Systems equipped with modern sensing modalities such as vision and lidar gain access to increasingly high-dimensional measurements with which to enact estimation and control schemes. In this article, we examine the continuum limit of high-dimensional measurements and analyze state estimation in linear time-invariant systems with infinite-dimensional measurements but finite-dimensional states, both corrupted by additive noise. We propose a linear filter and derive the corresponding optimal gain functional in the sense of the minimum mean square error, analogous to the classic Kalman filter. By modeling the measurement noise as a wide-sense stationary random field, we are able to derive the optimal linear filter explicitly, in contrast to previous derivations of Kalman filters in distributed-parameter settings. Interestingly, we find that we need only impose conditions that are finite-dimensional in nature to ensure that the filter is asymptotically stable. The proposed filter is verified via simulation of a linearized system with a pinhole camera sensor. △ Less

Submitted 18 September, 2024; originally announced September 2024.

Comments: 15 pages, 3 Figures. This paper will appear in the IEEE Transactions on Automatic Control

Daytime turbulence strength profile measurement at Kodaikanal Observatory

Authors: Saraswathi Kalyani Subramanian, Sridharan Rengaswamy, Prasanna Gajanan Deshmukh, Binukumar G. Nair, Mahesh Babu S

Abstract: The Indian Institute of Astrophysics (IIA) is developing a Multi-Conjugate Adaptive Optics (MCAO) system for the Kodaikanal Tower Telescope (KTT). In this context, we have measured the daytime turbulence strength profile at the Kodaikanal Observatory. The first method based on wavefront sensor (WFS) images, called S-DIMM+ (Solar-Differential Image Motion Monitor+), was used to estimate the higher… ▽ More The Indian Institute of Astrophysics (IIA) is developing a Multi-Conjugate Adaptive Optics (MCAO) system for the Kodaikanal Tower Telescope (KTT). In this context, we have measured the daytime turbulence strength profile at the Kodaikanal Observatory. The first method based on wavefront sensor (WFS) images, called S-DIMM+ (Solar-Differential Image Motion Monitor+), was used to estimate the higher altitude turbulence up to a height of 5 - 6 km. The second method used balloon-borne temperature sensors to measure the near-Earth turbulence up to 350 m. We also carried out simulations to validate the performance of our system. We report the first-ever daytime turbulence strength profile measurements at the observatory. We have identified the presence of a strong turbulence layer about 3 km above the observatory. The measured near-Earth turbulence matches the trend that is expected from the model for daytime component of turbulence and gives an integrated $r_0$ of about 4 cm at 500 nm. This is consistent with earlier seeing measurements. This shows that a low-cost setup with a small telescope and a simple array of temperature sensors can be used for estimating the turbulence strength profile at the site. △ Less

Submitted 19 July, 2024; originally announced July 2024.

Comments: Accepted for publication in JATIS

Simulations of distributed-phase-reference quantum key distribution protocols

Authors: Venkat Abhignan, Abhishek Jamunkar, Gokul Nair, Mohit Mittal, Megha Shrivastava

Abstract: Quantum technology can enable secure communication for cryptography purposes using quantum key distribution. Quantum key distribution protocols provide a secret key between two users with security guaranteed by the laws of quantum mechanics. To define the proper implementation of a quantum key distribution system using a particular cryptography protocol, it is crucial to critically and meticulousl… ▽ More Quantum technology can enable secure communication for cryptography purposes using quantum key distribution. Quantum key distribution protocols provide a secret key between two users with security guaranteed by the laws of quantum mechanics. To define the proper implementation of a quantum key distribution system using a particular cryptography protocol, it is crucial to critically and meticulously assess the device's performance due to technological limitations in the components used. We perform simulations on the ANSYS Interconnect platform to characterise the practical implementation of these devices using distributed-phase-reference protocols differential-phase-shift and coherent-one-way quantum key distribution. Further, we briefly describe and simulate some possible eavesdropping attempts, backflash attack, trojan-horse attack and detector-blinding attack exploiting the device imperfections. △ Less

Submitted 13 June, 2024; originally announced June 2024.

Journal ref: Physica Scripta 99 105131, 2024

Dreamguider: Improved Training free Diffusion-based Conditional Generation

Authors: Nithin Gopalakrishnan Nair, Vishal M Patel

Abstract: Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for estimating the guidance direction. Moreover, these techniques often require handcrafted parameter tuning on a case-by-case basis. Although some recent works have introd… ▽ More Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for estimating the guidance direction. Moreover, these techniques often require handcrafted parameter tuning on a case-by-case basis. Although some recent works have introduced minimal compute methods for linear inverse problems, a generic lightweight guidance solution to both linear and non-linear guidance problems is still missing. To this end, we propose Dreamguider, a method that enables inference-time guidance without compute-heavy backpropagation through the diffusion network. The key idea is to regulate the gradient flow through a time-varying factor. Moreover, we propose an empirical guidance scale that works for a wide variety of tasks, hence removing the need for handcrafted parameter tuning. We further introduce an effective lightweight augmentation strategy that significantly boosts the performance during inference-time guidance. We present experiments using Dreamguider on multiple tasks across multiple datasets and models to show the effectiveness of the proposed modules. To facilitate further research, we will make the code public after the review process. △ Less

Submitted 4 June, 2024; originally announced June 2024.

Evidence for a toroidal magnetic field in the core of 3C 84

Authors: G. F. Paraschos, L. C. Debbrecht, J. A. Kramer, E. Traianou, I. Liodakis, T. P. Krichbaum, J. -Y. Kim, M. Janssen, D. G. Nair, T. Savolainen, E. Ros, U. Bach, J. A. Hodgson, M. Lisakov, N. R. MacDonald, J. A. Zensus

Abstract: The spatial scales of relativistic radio jets, probed by relativistic magneto-hydrodynamic jet launching simulations (RMHDs) and by most very-long-baseline interferometry (VLBI) observations differ by an order of magnitude. Bridging the gap between these RMHD simulations and VLBI observations requires selecting nearby active galactic nuclei (AGN), the parsec-scale region of which can be resolved.… ▽ More The spatial scales of relativistic radio jets, probed by relativistic magneto-hydrodynamic jet launching simulations (RMHDs) and by most very-long-baseline interferometry (VLBI) observations differ by an order of magnitude. Bridging the gap between these RMHD simulations and VLBI observations requires selecting nearby active galactic nuclei (AGN), the parsec-scale region of which can be resolved. 3C 84 is a nearby bright AGN fulfilling the necessary requirements: it is launching a powerful, relativistic jet powered by a central supermassive black hole, while also being very bright. Using 22 GHz global VLBI measurements of 3C 84 we aim to study its sub-parsec region in both total intensity and linear polarisation, to explore the properties of this jet, with a linear resolution of $\sim0.1$ parsec. We test different simulation setups by altering the bulk Lorentz factor $Γ$ of the jet, as well as the magnetic field configuration (toroidal, poloidal, helical). We confirm the persistence of a limb brightened structure, which reaches deep into the sub-parsec region. The corresponding electric vector position angles (EVPAs) follow the bulk jet flow inside but tend to be orthogonal to it near the edges. Our state-of-the-art RMHD simulations show that this geometry is consistent with a spine-sheath model, associated with a mildly relativistic flow and a toroidal magnetic field configuration. △ Less

Submitted 15 May, 2024; v1 submitted 30 April, 2024; originally announced May 2024.

Comments: 10 pages, 8 figures, accepted for publication in Astronomy and Astrophysics

Journal ref: A&A 686, L5 (2024)

Spectroscopic Investigation of Nebular Gas (SING): Instrument Design, Assembly and Calibration

Authors: Bharat Chandra P, Binukumar G. Nair, Shubham Jankiram Ghatul, Shubhangi Jain, S. Sriram, Mahesh Babu S., Rekhesh Mohan, Margarita Safonova, Jayant Murthy, Mikhail Sachkov

Abstract: The Spectroscopic Investigation of Nebular Gas (SING) is a near-ultraviolet (NUV) low-resolution spectrograph payload designed to operate in the NUV range, 1400 $\unicode{x212B}$ -- 2700 $\unicode{x212B}$, from a stable space platform. SING telescope has a primary aperture of 298 mm, feeding the light to the long-slit UV spectrograph. SING has a field of view (FOV) of 1$^{\circ}$, achieving a spat… ▽ More The Spectroscopic Investigation of Nebular Gas (SING) is a near-ultraviolet (NUV) low-resolution spectrograph payload designed to operate in the NUV range, 1400 $\unicode{x212B}$ -- 2700 $\unicode{x212B}$, from a stable space platform. SING telescope has a primary aperture of 298 mm, feeding the light to the long-slit UV spectrograph. SING has a field of view (FOV) of 1$^{\circ}$, achieving a spatial resolution of 1.33 arc minute and spectral resolution of 3.7 $\unicode{x212B}$ ($R\sim600$) at the central wavelength. SING employs a micro-channel plate (MCP) with a CMOS readout-based photon-counting detector. The instrument is designed to observe diffuse sources such as nebulae, supernova remnants, and the interstellar medium (ISM) to understand their chemistry. SING was selected by the United Nations Office for Outer Space Affairs to be hosted on the Chinese Space Station. The instrument will undergo qualification tests as per the launch requirements. In this paper, we describe the hardware design, optomechanical assembly, and calibration of the instrument. △ Less

Submitted 26 April, 2024; originally announced April 2024.

Journal ref: Exp Astron 57, 18 (2024)

Broadband Multi-wavelength Properties of M87 during the 2018 EHT Campaign including a Very High Energy Flaring Episode

Authors: J. C. Algaba, M. Balokovic, S. Chandra, W. Y. Cheong, Y. Z. Cui, F. D'Ammando, A. D. Falcone, N. M. Ford, M. Giroletti, C. Goddi, M. A. Gurwell, K. Hada, D. Haggard, S. Jorstad, A. Kaur, T. Kawashima, S. Kerby, J. Y. Kim, M. Kino, E. V. Kravchenko, S. S. Lee, R. S. Lu, S. Markoff, J. Michail, J. Neilsen , et al. (721 additional authors not shown)

Abstract: The nearby elliptical galaxy M87 contains one of the only two supermassive black holes whose emission surrounding the event horizon has been imaged by the Event Horizon Telescope (EHT). In 2018, more than two dozen multi-wavelength (MWL) facilities (from radio to gamma-ray energies) took part in the second M87 EHT campaign. The goal of this extensive MWL campaign was to better understand the physi… ▽ More The nearby elliptical galaxy M87 contains one of the only two supermassive black holes whose emission surrounding the event horizon has been imaged by the Event Horizon Telescope (EHT). In 2018, more than two dozen multi-wavelength (MWL) facilities (from radio to gamma-ray energies) took part in the second M87 EHT campaign. The goal of this extensive MWL campaign was to better understand the physics of the accreting black hole M87*, the relationship between the inflow and inner jets, and the high-energy particle acceleration. Understanding the complex astrophysics is also a necessary first step towards performing further tests of general relativity. The MWL campaign took place in April 2018, overlapping with the EHT M87* observations. We present a new, contemporaneous spectral energy distribution (SED) ranging from radio to very high energy (VHE) gamma-rays, as well as details of the individual observations and light curves. We also conduct phenomenological modelling to investigate the basic source properties. We present the first VHE gamma-ray flare from M87 detected since 2010. The flux above 350 GeV has more than doubled within a period of about 36 hours. We find that the X-ray flux is enhanced by about a factor of two compared to 2017, while the radio and millimetre core fluxes are consistent between 2017 and 2018. We detect evidence for a monotonically increasing jet position angle that corresponds to variations in the bright spot of the EHT image. Our results show the value of continued MWL monitoring together with precision imaging for addressing the origins of high-energy particle acceleration. While we cannot currently pinpoint the precise location where such acceleration takes place, the new VHE gamma-ray flare already presents a challenge to simple one-zone leptonic emission model approaches, and emphasises the need for combined image and spectral modelling. △ Less

Submitted 5 December, 2024; v1 submitted 24 April, 2024; originally announced April 2024.

Comments: 46 pages, 23 figures, accepted by Astronomy & Astrophysics on August. 29, 2024

Journal ref: A&A 692, A140 (2024)

MaxFusion: Plug&Play Multi-Modal Generation in Text-to-Image Diffusion Models

Authors: Nithin Gopalakrishnan Nair, Jeya Maria Jose Valanarasu, Vishal M Patel

Abstract: Large diffusion-based Text-to-Image (T2I) models have shown impressive generative powers for text-to-image generation as well as spatially conditioned image generation. For most applications, we can train the model end-toend with paired data to obtain photorealistic generation quality. However, to add an additional task, one often needs to retrain the model from scratch using paired data across al… ▽ More Large diffusion-based Text-to-Image (T2I) models have shown impressive generative powers for text-to-image generation as well as spatially conditioned image generation. For most applications, we can train the model end-toend with paired data to obtain photorealistic generation quality. However, to add an additional task, one often needs to retrain the model from scratch using paired data across all modalities to retain good generation performance. In this paper, we tackle this issue and propose a novel strategy to scale a generative model across new tasks with minimal compute. During our experiments, we discovered that the variance maps of intermediate feature maps of diffusion models capture the intensity of conditioning. Utilizing this prior information, we propose MaxFusion, an efficient strategy to scale up text-to-image generation models to accommodate new modality conditions. Specifically, we combine aligned features of multiple models, hence bringing a compositional effect. Our fusion strategy can be integrated into off-the-shelf models to enhance their generative prowess. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Diffscaler: Enhancing the Generative Prowess of Diffusion Transformers

Authors: Nithin Gopalakrishnan Nair, Jeya Maria Jose Valanarasu, Vishal M. Patel

Abstract: Recently, diffusion transformers have gained wide attention with its excellent performance in text-to-image and text-to-vidoe models, emphasizing the need for transformers as backbone for diffusion models. Transformer-based models have shown better generalization capability compared to CNN-based models for general vision tasks. However, much less has been explored in the existing literature regard… ▽ More Recently, diffusion transformers have gained wide attention with its excellent performance in text-to-image and text-to-vidoe models, emphasizing the need for transformers as backbone for diffusion models. Transformer-based models have shown better generalization capability compared to CNN-based models for general vision tasks. However, much less has been explored in the existing literature regarding the capabilities of transformer-based diffusion backbones and expanding their generative prowess to other datasets. This paper focuses on enabling a single pre-trained diffusion transformer model to scale across multiple datasets swiftly, allowing for the completion of diverse generative tasks using just one model. To this end, we propose DiffScaler, an efficient scaling strategy for diffusion models where we train a minimal amount of parameters to adapt to different tasks. In particular, we learn task-specific transformations at each layer by incorporating the ability to utilize the learned subspaces of the pre-trained model, as well as the ability to learn additional task-specific subspaces, which may be absent in the pre-training dataset. As these parameters are independent, a single diffusion model with these task-specific parameters can be used to perform multiple tasks simultaneously. Moreover, we find that transformer-based diffusion models significantly outperform CNN-based diffusion models methods while performing fine-tuning over smaller datasets. We perform experiments on four unconditional image generation datasets. We show that using our proposed method, a single pre-trained model can scale up to perform these conditional and unconditional tasks, respectively, with minimal parameter tuning while performing as close as fine-tuning an entire diffusion model for that particular task. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Enhancing Visual Place Recognition via Fast and Slow Adaptive Biasing in Event Cameras

Authors: Gokul B. Nair, Michael Milford, Tobias Fischer

Abstract: Event cameras are increasingly popular in robotics due to beneficial features such as low latency, energy efficiency, and high dynamic range. Nevertheless, their downstream task performance is greatly influenced by the optimization of bias parameters. These parameters, for instance, regulate the necessary change in light intensity to trigger an event, which in turn depends on factors such as the e… ▽ More Event cameras are increasingly popular in robotics due to beneficial features such as low latency, energy efficiency, and high dynamic range. Nevertheless, their downstream task performance is greatly influenced by the optimization of bias parameters. These parameters, for instance, regulate the necessary change in light intensity to trigger an event, which in turn depends on factors such as the environment lighting and camera motion. This paper introduces feedback control algorithms that automatically tune the bias parameters through two interacting methods: 1) An immediate, on-the-fly \textit{fast} adaptation of the refractory period, which sets the minimum interval between consecutive events, and 2) if the event rate exceeds the specified bounds even after changing the refractory period repeatedly, the controller adapts the pixel bandwidth and event thresholds, which stabilizes after a short period of noise events across all pixels (\textit{slow} adaptation). Our evaluation focuses on the visual place recognition task, where incoming query images are compared to a given reference database. We conducted comprehensive evaluations of our algorithms' adaptive feedback control in real-time. To do so, we collected the QCR-Fast-and-Slow dataset that contains DAVIS346 event camera streams from 366 repeated traversals of a Scout Mini robot navigating through a 100 meter long indoor lab setting (totaling over 35km distance traveled) in varying brightness conditions with ground truth location information. Our proposed feedback controllers result in superior performance when compared to the standard bias settings and prior feedback control methods. Our findings also detail the impact of bias adjustments on task performance and feature ablation studies on the fast and slow adaptation mechanisms. △ Less

Submitted 13 August, 2024; v1 submitted 25 March, 2024; originally announced March 2024.

Comments: 8 pages, 9 figures, paper accepted to the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)

Synchronization in random networks of identical phase oscillators: A graphon approach

Authors: Shriya V. Nagpal, Gokul G. Nair, Steven H. Strogatz, Francesca Parise

Abstract: Networks of coupled nonlinear oscillators have been used to model circadian rhythms, flashing fireflies, Josephson junction arrays, high-voltage electric grids, and many other kinds of self-organizing systems. Recently, several authors have sought to understand how coupled oscillators behave when they interact according to a random graph. Here we consider interaction networks generated by a grapho… ▽ More Networks of coupled nonlinear oscillators have been used to model circadian rhythms, flashing fireflies, Josephson junction arrays, high-voltage electric grids, and many other kinds of self-organizing systems. Recently, several authors have sought to understand how coupled oscillators behave when they interact according to a random graph. Here we consider interaction networks generated by a graphon model known as a $W$-random network, and examine the dynamics of an infinite number of identical phase oscillators, following an approach pioneered by Medvedev. We show that with sufficient regularity on $W$, the solution to the dynamical system over a $W$-random network of size $n$ converges in the $L^{\infty}$ norm to the solution of the continuous graphon system, with high probability as $n\rightarrow\infty$. This result suggests a framework for studying synchronization properties in large but finite random networks. In this paper, we leverage our convergence result in the $L^{\infty}$ norm to prove synchronization results for two classes of identical phase oscillators on Erdős-Rényi random graphs. First, we show that the Kuramoto model on the Erdős-Rényi graph $G(n, α_n)$ achieves phase synchronization with high probability as $n$ goes to infinity, if the edge probability $α_n$ exceeds $(\log n)/n$, the connectivity threshold of an Erdős-Rényi random graph. Then we show that the Sakaguchi-Kuramoto model on the Erdős-Rényi graph $G(n, p)$ achieves frequency synchronization with high probability as $n$ goes to infinity, assuming a fixed edge probability $p\in(0,1]$ and a certain regime for the model's phase shift parameter. A notable feature of the latter result is that it holds for an oscillator model whose dynamics are not simply given by a gradient flow. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: 29 pages, 3 figures

Cluster regression model for control of nonlinear dynamics

Authors: Nitish Arya, Aditya G. Nair

Abstract: In the realm of big data, discerning patterns in nonlinear systems affected by external control inputs is increasingly challenging. Our approach blends the coarse-graining strengths of centroid-based unsupervised clustering with the clarity of sparse regression in a unique way to enhance the closed-loop feedback control of nonlinear dynamical systems. A key innovation in our methodology is the emp… ▽ More In the realm of big data, discerning patterns in nonlinear systems affected by external control inputs is increasingly challenging. Our approach blends the coarse-graining strengths of centroid-based unsupervised clustering with the clarity of sparse regression in a unique way to enhance the closed-loop feedback control of nonlinear dynamical systems. A key innovation in our methodology is the employment of cluster coefficients via a cluster decomposition of time-series measurement data. This approach transcends the conventional emphasis on the proximity of time series measurements to cluster centroids, offering a more nuanced representation of the dynamics within phase space. Capturing the evolving dynamics of these coefficients enable the construction of a robust, deterministic model for the observed states of the system. This model excels in capturing a wide range of dynamics, including periodic and chaotic behaviors, under the influence of external control inputs. Demonstrated in both the low-dimensional Lorenz system and the high-dimensional scenario of a flexible plate immersed in fluid flow, our model showcases its ability to pinpoint critical system features and its adaptability in reaching any observed state. A distinctive feature of our control strategy is the novel hopping technique between cluster states, which successfully averts lobe switching in the Lorenz system and accelerates vortex shedding in fluid-structure interaction systems while maintaining the mean aerodynamic characteristics. △ Less

Submitted 19 December, 2023; originally announced December 2023.

Comments: 35 pages, 12 figures

MSC Class: 76D55

Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis

Authors: Nithin Gopalakrishnan Nair, Anoop Cherian, Suhas Lohit, Ye Wang, Toshiaki Koike-Akino, Vishal M. Patel, Tim K. Marks

Abstract: Conditional generative models typically demand large annotated training sets to achieve high-quality synthesis. As a result, there has been significant interest in designing models that perform plug-and-play generation, i.e., to use a predefined or pretrained model, which is not explicitly trained on the generative task, to guide the generative process (e.g., using language). However, such guidanc… ▽ More Conditional generative models typically demand large annotated training sets to achieve high-quality synthesis. As a result, there has been significant interest in designing models that perform plug-and-play generation, i.e., to use a predefined or pretrained model, which is not explicitly trained on the generative task, to guide the generative process (e.g., using language). However, such guidance is typically useful only towards synthesizing high-level semantics rather than editing fine-grained details as in image-to-image translation tasks. To this end, and capitalizing on the powerful fine-grained generative control offered by the recent diffusion-based generative models, we introduce Steered Diffusion, a generalized framework for photorealistic zero-shot conditional image generation using a diffusion model trained for unconditional generation. The key idea is to steer the image generation of the diffusion model at inference time via designing a loss using a pre-trained inverse model that characterizes the conditional task. This loss modulates the sampling trajectory of the diffusion process. Our framework allows for easy incorporation of multiple conditions during inference. We present experiments using steered diffusion on several tasks including inpainting, colorization, text-guided semantic editing, and image super-resolution. Our results demonstrate clear qualitative and quantitative improvements over state-of-the-art diffusion-based plug-and-play models while adding negligible additional computational cost. △ Less

Submitted 29 September, 2023; originally announced October 2023.

Comments: Accepted at ICCV 2023

Control of Vortex Dynamics using Invariants

Authors: Kartik Krishna, Aditya G. Nair, Anand Krishnan, Steven L. Brunton, Eurika Kaiser

Abstract: Vortex-dominated flows are ubiquitous in engineering, and the ability to efficiently manipulate the dynamics of these vortices has broad applications, from wake shaping to mixing enhancement. However, the strongly nonlinear behavior of the vortex dynamics makes this a challenging task. In this work, we investigate the control of vortex dynamics by using a change of coordinates from the Biot-Savart… ▽ More Vortex-dominated flows are ubiquitous in engineering, and the ability to efficiently manipulate the dynamics of these vortices has broad applications, from wake shaping to mixing enhancement. However, the strongly nonlinear behavior of the vortex dynamics makes this a challenging task. In this work, we investigate the control of vortex dynamics by using a change of coordinates from the Biot-Savart equations into well-known invariants, such as the Hamiltonian, linear, and angular impulses, which are Koopman eigenfunctions. We then combine the resulting model with model predictive control to generate control laws that force the vortex system using "virtual cylinders". The invariant model is beneficial as it provides a linear, global description of the vortex dynamics through a recently developed Koopman control scheme for conserved quantities and invariants. The use of this model has not been well studied in the literature in the context of control. In this paper, we seek to understand the effect of changing each invariant individually or multiple invariants simultaneously. We use the 4-vortex system as our primary test bed, as it is the simplest configuration that exhibits chaotic behavior. We show that by controlling to specific invariant quantities, we can modify the transition from chaotic to quasiperiodic states. Finally, we computationally demonstrate the effectiveness of invariant control on a toy example of tracer mixing in the 4-vortex system. △ Less

Submitted 7 November, 2023; v1 submitted 7 August, 2023; originally announced August 2023.

MSC Class: 76B57; 76B47; 34H10

AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentation

Authors: Jay N. Paranjape, Nithin Gopalakrishnan Nair, Shameema Sikder, S. Swaroop Vedula, Vishal M. Patel

Abstract: Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle this issue, current research employs pretrained models and finetunes them on the given data. Even so, these require training deep networks with millions of parame… ▽ More Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle this issue, current research employs pretrained models and finetunes them on the given data. Even so, these require training deep networks with millions of parameters every time new data becomes available. A recently published foundation model, Segment-Anything (SAM), generalizes well to a large variety of natural images, hence tackling this challenge to a reasonable extent. However, SAM does not generalize well to the medical domain as is without utilizing a large amount of compute resources for fine-tuning and using task-specific prompts. Moreover, these prompts are in the form of bounding-boxes or foreground/background points that need to be annotated explicitly for every image, making this solution increasingly tedious with higher data size. In this work, we propose AdaptiveSAM - an adaptive modification of SAM that can adjust to new datasets quickly and efficiently, while enabling text-prompted segmentation. For finetuning AdaptiveSAM, we propose an approach called bias-tuning that requires a significantly smaller number of trainable parameters than SAM (less than 2\%). At the same time, AdaptiveSAM requires negligible expert intervention since it uses free-form text as prompt and can segment the object of interest with just the label name as prompt. Our experiments show that AdaptiveSAM outperforms current state-of-the-art methods on various medical imaging datasets including surgery, ultrasound and X-ray. Code is available at https://github.com/JayParanjape/biastuning △ Less

Submitted 7 August, 2023; originally announced August 2023.

Comments: 10 pages, 6 figures, 5 tables

Nonlinearly Elastic Maps: Energy Minimizing Configurations of Membranes on Prescribed Surfaces

Authors: Timothy J. Healey, Gokul G. Nair

Abstract: We propose a model for nonlinearly elastic membranes undergoing finite deformations while confined to a regular frictionless surface in $\mathbb{R}^3$. This is a physically correct model of the analogy sometimes given to motivate harmonic maps between manifolds. The proposed energy density function is convex in the strain pair comprising the deformation gradient and the local area ratio. If the ta… ▽ More We propose a model for nonlinearly elastic membranes undergoing finite deformations while confined to a regular frictionless surface in $\mathbb{R}^3$. This is a physically correct model of the analogy sometimes given to motivate harmonic maps between manifolds. The proposed energy density function is convex in the strain pair comprising the deformation gradient and the local area ratio. If the target surface is a plane, the problem reduces to 2-dimensional, polyconvex nonlinear elasticity addressed by J.M. Ball. On the other hand, the energy density is not rank-one convex for unconstrained deformations into $\mathbb{R}^3$. We show that the problem admits an energy-minimizing configuration when constrained to lie on the given surface. For a class of Dirichlet problems, we demonstrate that the minimizing deformation is a homeomorphism onto its image on the given surface and establish the weak Eulerian form of the equilibrium equations. △ Less

Submitted 30 May, 2024; v1 submitted 3 August, 2023; originally announced August 2023.

Comments: 13 pages

MSC Class: 74B20; 74G65; 35D30; 74K15

A ring-like accretion structure in M87 connecting its black hole and jet

Authors: Ru-Sen Lu, Keiichi Asada, Thomas P. Krichbaum, Jongho Park, Fumie Tazaki, Hung-Yi Pu, Masanori Nakamura, Andrei Lobanov, Kazuhiro Hada, Kazunori Akiyama, Jae-Young Kim, Ivan Marti-Vidal, José L. Gómez, Tomohisa Kawashima, Feng Yuan, Eduardo Ros, Walter Alef, Silke Britzen, Michael Bremer, Avery E. Broderick, Akihiro Doi, Gabriele Giovannini, Marcello Giroletti, Paul T. P. Ho, Mareki Honma , et al. (96 additional authors not shown)

Abstract: The nearby radio galaxy M87 is a prime target for studying black hole accretion and jet formation^{1,2}. Event Horizon Telescope observations of M87 in 2017, at a wavelength of 1.3 mm, revealed a ring-like structure, which was interpreted as gravitationally lensed emission around a central black hole^3. Here we report images of M87 obtained in 2018, at a wavelength of 3.5 mm, showing that the comp… ▽ More The nearby radio galaxy M87 is a prime target for studying black hole accretion and jet formation^{1,2}. Event Horizon Telescope observations of M87 in 2017, at a wavelength of 1.3 mm, revealed a ring-like structure, which was interpreted as gravitationally lensed emission around a central black hole^3. Here we report images of M87 obtained in 2018, at a wavelength of 3.5 mm, showing that the compact radio core is spatially resolved. High-resolution imaging shows a ring-like structure of 8.4_{-1.1}^{+0.5} Schwarzschild radii in diameter, approximately 50% larger than that seen at 1.3 mm. The outer edge at 3.5 mm is also larger than that at 1.3 mm. This larger and thicker ring indicates a substantial contribution from the accretion flow with absorption effects in addition to the gravitationally lensed ring-like emission. The images show that the edge-brightened jet connects to the accretion flow of the black hole. Close to the black hole, the emission profile of the jet-launching region is wider than the expected profile of a black-hole-driven jet, suggesting the possible presence of a wind associated with the accretion flow. △ Less

Submitted 25 April, 2023; originally announced April 2023.

Comments: 50 pages, 18 figures, 3 tables, author's version of the paper published in Nature

Knowledge Distillation for Feature Extraction in Underwater VSLAM

Authors: Jinghe Yang, Mingming Gong, Girish Nair, Jung Hoon Lee, Jason Monty, Ye Pu

Abstract: In recent years, learning-based feature detection and matching have outperformed manually-designed methods in in-air cases. However, it is challenging to learn the features in the underwater scenario due to the absence of annotated underwater datasets. This paper proposes a cross-modal knowledge distillation framework for training an underwater feature detection and matching network (UFEN). In par… ▽ More In recent years, learning-based feature detection and matching have outperformed manually-designed methods in in-air cases. However, it is challenging to learn the features in the underwater scenario due to the absence of annotated underwater datasets. This paper proposes a cross-modal knowledge distillation framework for training an underwater feature detection and matching network (UFEN). In particular, we use in-air RGBD data to generate synthetic underwater images based on a physical underwater imaging formation model and employ these as the medium to distil knowledge from a teacher model SuperPoint pretrained on in-air images. We embed UFEN into the ORB-SLAM3 framework to replace the ORB feature by introducing an additional binarization layer. To test the effectiveness of our method, we built a new underwater dataset with groundtruth measurements named EASI (https://github.com/Jinghe-mel/UFEN-SLAM), recorded in an indoor water tank for different turbidity levels. The experimental results on the existing dataset and our new dataset demonstrate the effectiveness of our method. △ Less

Submitted 31 March, 2023; originally announced March 2023.

Comments: Accepted by IEEE International Conference on Robotics and Automation (ICRA 2023),6 pages

Nonlinear Dual control based on Fast Moving Horizon estimation and Model Predictive Control with an observability constraint

Authors: Emilien Flayac, Girish Nair, Iman Shames

Abstract: This paper proposes an algorithm that combines Fast Moving Horizon Parameter Estimation and Model Predictive Control subject to an observability constraint designed to ensure a lower bound on the performance of the parameter estimator. Output-feedback stability is proved through input-to-state stability of the state/error system under a small noise and initial error assumption. Numerical experimen… ▽ More This paper proposes an algorithm that combines Fast Moving Horizon Parameter Estimation and Model Predictive Control subject to an observability constraint designed to ensure a lower bound on the performance of the parameter estimator. Output-feedback stability is proved through input-to-state stability of the state/error system under a small noise and initial error assumption. Numerical experiments have been carried out in the case of Active Simultaneous Localisation and Mapping (SLAM). △ Less

Submitted 24 March, 2023; originally announced March 2023.

$CrowdDiff$: Multi-hypothesis Crowd Density Estimation using Diffusion Models

Authors: Yasiru Ranasinghe, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel

Abstract: Crowd counting is a fundamental problem in crowd analysis which is typically accomplished by estimating a crowd density map and summing over the density values. However, this approach suffers from background noise accumulation and loss of density due to the use of broad Gaussian kernels to create the ground truth density maps. This issue can be overcome by narrowing the Gaussian kernel. However, e… ▽ More Crowd counting is a fundamental problem in crowd analysis which is typically accomplished by estimating a crowd density map and summing over the density values. However, this approach suffers from background noise accumulation and loss of density due to the use of broad Gaussian kernels to create the ground truth density maps. This issue can be overcome by narrowing the Gaussian kernel. However, existing approaches perform poorly when trained with ground truth density maps with broad kernels. To deal with this limitation, we propose using conditional diffusion models to predict density maps, as diffusion models show high fidelity to training data during generation. With that, we present $CrowdDiff$ that generates the crowd density map as a reverse diffusion process. Furthermore, as the intermediate time steps of the diffusion process are noisy, we incorporate a regression branch for direct crowd estimation only during training to improve the feature learning. In addition, owing to the stochastic nature of the diffusion model, we introduce producing multiple density maps to improve the counting performance contrary to the existing crowd counting pipelines. We conduct extensive experiments on publicly available datasets to validate the effectiveness of our method. $CrowdDiff$ outperforms existing state-of-the-art crowd counting methods on several public crowd analysis benchmarks with significant improvements. △ Less

Submitted 4 April, 2024; v1 submitted 22 March, 2023; originally announced March 2023.

Comments: Accepted at CVPR'24. The project is available at https://dylran.github.io/crowddiff.github.io

Network-theoretic modeling of fluid-structure interactions

Authors: Aditya G. Nair, Samuel B. Douglass, Nitish Arya

Abstract: The coupling interactions between deformable structures and unsteady fluid flows occur across a wide range of spatial and temporal scales in many engineering applications. These fluid-structure interactions (FSI) pose significant challenges in accurately predicting flow physics. In the present work, two multi-layer network approaches are proposed that characterize the interactions between the flui… ▽ More The coupling interactions between deformable structures and unsteady fluid flows occur across a wide range of spatial and temporal scales in many engineering applications. These fluid-structure interactions (FSI) pose significant challenges in accurately predicting flow physics. In the present work, two multi-layer network approaches are proposed that characterize the interactions between the fluid and structural layers for an incompressible laminar flow over a two-dimensional compliant flat plate at a 35-degrees angle of attack. In the first approach, the network nodes are formed by wake vortices and bound vortexlets, and the edges of the network are defined by the induced velocity between these elements. In the second approach, coherent structures (fluid modes), contributing to the kinetic energy of the flow and structural modes, contributing to the kinetic energy of the compliant structure constitute the network nodes. The energy transfers between the modes are extracted using a perturbation approach. Furthermore, the network structure of the FSI system is simplified using the community detection algorithm in the vortical approach and by selecting dominant modes in the modal approach. Network measures are used to reveal the temporal behavior of the individual nodes within the simplified FSI system. Predictive models are then built using both data-driven and physics-based methods. Overall, this work sets the foundation for network-theoretic reduced-order modeling of fluid-structure interactions, generalizable to other multi-physics systems. △ Less

Submitted 30 November, 2023; v1 submitted 3 January, 2023; originally announced January 2023.

Comments: 20 pages, 10 figures

MSC Class: 76D17

Contrasting Analog and Digital Resistive Switching Memory Characteristics in Solution-Processed Copper (I) Thiocyanate and Its Polymer Electrolyte Based Memristive Devices

Authors: Rajesh Deb, Saumya R. Mohapatra, Manjula G. Nair, Ujjal Das

Abstract: Usually, resistive switching (RS) devices show digital RS memory (sharp SET and RESET process), which is most suitable for digital data storage applications. Some RS devices also manifest ideal memristive behavior or analog memory characteristics (gradual change in resistance states). The analog RS properties of memristive devices widen their application domain to a much broader field of neuromorp… ▽ More Usually, resistive switching (RS) devices show digital RS memory (sharp SET and RESET process), which is most suitable for digital data storage applications. Some RS devices also manifest ideal memristive behavior or analog memory characteristics (gradual change in resistance states). The analog RS properties of memristive devices widen their application domain to a much broader field of neuromorphic computing. The tunability of memristive devices to digital or analog memory applications greatly depends upon the switching medium. In this work, we report a comparative study on RS properties of two kinds of memristive devices based upon copper (I) thiocyanate (CuSCN) and a solid polymer electrolyte (SPE) made up of CuSCN as ionic moieties in polyethylene oxide (PEO). The device (ITO/CuSCN/Cu), prepared by spin-coating CuSCN layer between ITO and copper electrode, shows simultaneous analog and digital RS characteristics. The RS property of the device is tunable by varying the thickness of the CuSCN layer. The current-voltage characteristics reveal that devices prepared at 3000 rpm (thicker) during the spin-coating show only digital bipolar RS memory. In comparison, the devices deposited at 4000 rpm (thinner) show both analog and digital RS memory. The conduction mechanism responsible for RS behavior in CuSCN-based devices is Schottky emission mediated charge trapping and de-trapping at the interfacial states. Contrastingly, when the same CuSCN is used as the electrolyte in SPE film, the device only shows bipolar digital non-volatile memory characteristics. The RS behavior is due to the electrochemical metallization (ECM) mechanism. The ON and OFF states are achieved by the formation and rupture of copper filaments due to the redox reactions at the interface. △ Less

Submitted 31 December, 2022; originally announced January 2023.

Stabilizing two-dimensional turbulent Kolmogorov flow via selective modification of inviscid invariants

Authors: Gaurav Kumar, Aditya G. Nair

Abstract: We stabilize two-dimensional turbulent Kolmogorov flow by selectively altering the time rate of change of inviscid invariants (energy and enstrophy) of the flow. This method has earlier been demonstrated to modify the two-dimensional unforced decaying turbulent flow to reach steady states. However, Kolmogorov flow exhibits flow unsteadiness over a range of spatial and temporal scales which are dri… ▽ More We stabilize two-dimensional turbulent Kolmogorov flow by selectively altering the time rate of change of inviscid invariants (energy and enstrophy) of the flow. This method has earlier been demonstrated to modify the two-dimensional unforced decaying turbulent flow to reach steady states. However, Kolmogorov flow exhibits flow unsteadiness over a range of spatial and temporal scales which are driven by constant external forcing at wave number $k_f$. The energy injected at scale ($k \approx k_f$) is distributed to large ($k > k_f$) and small ($k < k_f$) wave numbers through interactions of different scales called direct and inverse energy cascading, respectively. The selective modification strategy autonomously identifies additional forcing inputs into the governing equations which results in the transformation of Kolmogorov flow into a non-trivial steady state. We demonstrate that this method is highly effective in altering the inverse energy cascading, a particularly intricate challenge in fluid dynamics. Intriguingly, we have also found that the steady states achieved through this approach resemble an invariant solution of the original Kolmogorov flow, highlighting the potential significance of our method. △ Less

Submitted 4 December, 2023; v1 submitted 23 December, 2022; originally announced December 2022.

Comments: 20 pages, 8 figures

MSC Class: 76F20

V-LoTSS: The Circularly-Polarised LOFAR Two-metre Sky Survey

Authors: J. R. Callingham, T. W. Shimwell, H. K. Vedantham, C. G. Bassa, S. P. O'Sullivan, T. W. H. Yiu, S. Bloot, P. N. Best, M. J. Hardcastle, M. Haverkorn, R. D. Kavanagh, L. Lamy, B. J. S. Pope, H. J. A. Röttgering, D. J. Schwarz, C. Tasse, R. J. van Weeren, G. J. White, P. Zarka, D. J. Bomans, A. Bonafede, M. Bonato, A. Botteon, M. Bruggen, K. T. Chyży , et al. (22 additional authors not shown)

Abstract: We present the detection of 68 sources from the most sensitive radio survey in circular polarisation conducted to date. We use the second data release of the 144 MHz LOFAR Two-metre Sky Survey to produce circularly-polarised maps with median 140 $μ$Jy beam$^{-1}$ noise and resolution of 20$''$ for $\approx$27% of the northern sky (5634 deg$^{2}$). The leakage of total intensity into circular polar… ▽ More We present the detection of 68 sources from the most sensitive radio survey in circular polarisation conducted to date. We use the second data release of the 144 MHz LOFAR Two-metre Sky Survey to produce circularly-polarised maps with median 140 $μ$Jy beam$^{-1}$ noise and resolution of 20$''$ for $\approx$27% of the northern sky (5634 deg$^{2}$). The leakage of total intensity into circular polarisation is measured to be $\approx$0.06%, and our survey is complete at flux densities $\geq1$ mJy. A detection is considered reliable when the circularly-polarised fraction exceeds 1%. We find the population of circularly-polarised sources is composed of four distinct classes: stellar systems, pulsars, active galactic nuclei, and sources unidentified in the literature. The stellar systems can be further separated into chromospherically-active stars, M dwarfs, and brown dwarfs. Based on the circularly-polarised fraction and lack of an optical counterpart, we show it is possible to infer whether the unidentified sources are likely unknown pulsars or brown dwarfs. By the completion of this survey of the northern sky, we expect to detect 300$\pm$100 circularly-polarised sources. △ Less

Submitted 19 December, 2022; originally announced December 2022.

Comments: Accepted for publication in A&A, 15 pages, 8 figures, 1 table. The catalogue will be publicly available at http://lofar-surveys.org/ and via Vizier shortly

Journal ref: A&A 670, A124 (2023)

Bi-Noising Diffusion: Towards Conditional Diffusion Models with Generative Restoration Priors

Authors: Kangfu Mei, Nithin Gopalakrishnan Nair, Vishal M. Patel

Abstract: Conditional diffusion probabilistic models can model the distribution of natural images and can generate diverse and realistic samples based on given conditions. However, oftentimes their results can be unrealistic with observable color shifts and textures. We believe that this issue results from the divergence between the probabilistic distribution learned by the model and the distribution of nat… ▽ More Conditional diffusion probabilistic models can model the distribution of natural images and can generate diverse and realistic samples based on given conditions. However, oftentimes their results can be unrealistic with observable color shifts and textures. We believe that this issue results from the divergence between the probabilistic distribution learned by the model and the distribution of natural images. The delicate conditions gradually enlarge the divergence during each sampling timestep. To address this issue, we introduce a new method that brings the predicted samples to the training data manifold using a pretrained unconditional diffusion model. The unconditional model acts as a regularizer and reduces the divergence introduced by the conditional model at each sampling step. We perform comprehensive experiments to demonstrate the effectiveness of our approach on super-resolution, colorization, turbulence removal, and image-deraining tasks. The improvements obtained by our method suggest that the priors can be incorporated as a general plugin for improving conditional diffusion models. △ Less

Submitted 14 December, 2022; originally announced December 2022.

Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models

Authors: Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel

Abstract: Generating photos satisfying multiple constraints find broad utility in the content creation industry. A key hurdle to accomplishing this task is the need for paired data consisting of all modalities (i.e., constraints) and their corresponding output. Moreover, existing methods need retraining using paired data across all modalities to introduce a new condition. This paper proposes a solution to t… ▽ More Generating photos satisfying multiple constraints find broad utility in the content creation industry. A key hurdle to accomplishing this task is the need for paired data consisting of all modalities (i.e., constraints) and their corresponding output. Moreover, existing methods need retraining using paired data across all modalities to introduce a new condition. This paper proposes a solution to this problem based on denoising diffusion probabilistic models (DDPMs). Our motivation for choosing diffusion models over other generative models comes from the flexible internal structure of diffusion models. Since each sampling step in the DDPM follows a Gaussian distribution, we show that there exists a closed-form solution for generating an image given various constraints. Our method can unite multiple diffusion models trained on multiple sub-tasks and conquer the combined task through our proposed sampling strategy. We also introduce a novel reliability parameter that allows using different off-the-shelf diffusion models trained across various datasets during sampling time alone to guide it to the desired outcome satisfying multiple constraints. We perform experiments on various standard multimodal tasks to demonstrate the effectiveness of our approach. More details can be found in https://nithin-gk.github.io/projectpages/Multidiff/index.html △ Less

Submitted 20 April, 2023; v1 submitted 1 December, 2022; originally announced December 2022.

Comments: Accepted at CVPR 2023

NBD-GAP: Non-Blind Image Deblurring Without Clean Target Images

Authors: Nithin Gopalakrishnan Nair, Rajeev Yasarla, Vishal M. Patel

Abstract: In recent years, deep neural network-based restoration methods have achieved state-of-the-art results in various image deblurring tasks. However, one major drawback of deep learning-based deblurring networks is that large amounts of blurry-clean image pairs are required for training to achieve good performance. Moreover, deep networks often fail to perform well when the blurry images and the blur… ▽ More In recent years, deep neural network-based restoration methods have achieved state-of-the-art results in various image deblurring tasks. However, one major drawback of deep learning-based deblurring networks is that large amounts of blurry-clean image pairs are required for training to achieve good performance. Moreover, deep networks often fail to perform well when the blurry images and the blur kernels during testing are very different from the ones used during training. This happens mainly because of the overfitting of the network parameters on the training data. In this work, we present a method that addresses these issues. We view the non-blind image deblurring problem as a denoising problem. To do so, we perform Wiener filtering on a pair of blurry images with the corresponding blur kernels. This results in a pair of images with colored noise. Hence, the deblurring problem is translated into a denoising problem. We then solve the denoising problem without using explicit clean target images. Extensive experiments are conducted to show that our method achieves results that are on par to the state-of-the-art non-blind deblurring works. △ Less

Submitted 20 September, 2022; originally announced September 2022.

Comments: Accepted at ICIP 2022

T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models

Authors: Nithin Gopalakrishnan Nair, Vishal M. Patel

Abstract: Modern-day surveillance systems perform person recognition using deep learning-based face verification networks. Most state-of-the-art facial verification systems are trained using visible spectrum images. But, acquiring images in the visible spectrum is impractical in scenarios of low-light and nighttime conditions, and often images are captured in an alternate domain such as the thermal infrared… ▽ More Modern-day surveillance systems perform person recognition using deep learning-based face verification networks. Most state-of-the-art facial verification systems are trained using visible spectrum images. But, acquiring images in the visible spectrum is impractical in scenarios of low-light and nighttime conditions, and often images are captured in an alternate domain such as the thermal infrared domain. Facial verification in thermal images is often performed after retrieving the corresponding visible domain images. This is a well-established problem often known as the Thermal-to-Visible (T2V) image translation. In this paper, we propose a Denoising Diffusion Probabilistic Model (DDPM) based solution for T2V translation specifically for facial images. During training, the model learns the conditional distribution of visible facial images given their corresponding thermal image through the diffusion process. During inference, the visible domain image is obtained by starting from Gaussian noise and performing denoising repeatedly. The existing inference process for DDPMs is stochastic and time-consuming. Hence, we propose a novel inference strategy for speeding up the inference time of DDPMs, specifically for the problem of T2V image translation. We achieve the state-of-the-art results on multiple datasets. The code and pretrained models are publically available at http://github.com/Nithin-GK/T2V-DDPM △ Less

Submitted 19 September, 2022; originally announced September 2022.

Comments: Accepted at The IEEE conference series on Automatic Face and Gesture Recognition 2023

Stationary curves under the Möbius-Plateau energy

Authors: Max Lipton, Gokul Nair

Abstract: Plateau problems with elastic boundary energies have been of recent theoretical and applied interest. However, strong assumptions have to be made to avoid self-intersections of the boundary curve during energy minimization. We introduce a class of Plateau problems for boundaries with self-repulsive energies that obviates self-contact in energy minimization problems. For the self-repulsive energy,… ▽ More Plateau problems with elastic boundary energies have been of recent theoretical and applied interest. However, strong assumptions have to be made to avoid self-intersections of the boundary curve during energy minimization. We introduce a class of Plateau problems for boundaries with self-repulsive energies that obviates self-contact in energy minimization problems. For the self-repulsive energy, we choose the Möbius Energy introduced by O'Hara due to its myriad regularity properties shown by Freedman et al. We first prove an existence theorem for this Möbius-Plateau problem in the class of closed Lipschitz curves of a given irreducible knot-type spanned by immersed discs. We then turn our attention to Möbius-Plateau variations of helicoidal strips, which are classified as "screw-like" or "ribbon-like" based on the signs of the radii of the boundary helices. By analyzing the Euler-Lagrange equations, we show that screw-like solutions are plentiful, whilst ribbon-like solutions impose strong constraints on their parameters: they must have high frequency (equivalently, low pitch), thin width in comparison to the frequency, and remain close to the axis. △ Less

Submitted 9 March, 2025; v1 submitted 26 August, 2022; originally announced August 2022.

Comments: 14 pages, 3 figures

AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models

Authors: Nithin Gopalakrishnan Nair, Kangfu Mei, Vishal M. Patel

Abstract: Although many long-range imaging systems are designed to support extended vision applications, a natural obstacle to their operation is degradation due to atmospheric turbulence. Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion. In recent years, various deep learning-based single image atmospheric turbulence mitigation methods, inc… ▽ More Although many long-range imaging systems are designed to support extended vision applications, a natural obstacle to their operation is degradation due to atmospheric turbulence. Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion. In recent years, various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed in the literature which attempt to remove the distortion in the image. However, some of these methods are difficult to train and often fail to reconstruct facial features and produce unrealistic results especially in the case of high turbulence. Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images. In this paper, we propose the first DDPM-based solution for the problem of atmospheric turbulence mitigation. We also propose a fast sampling technique for reducing the inference times for conditional DDPMs. Extensive experiments are conducted on synthetic and real-world data to show the significance of our model. To facilitate further research, all codes and pretrained models are publically available at http://github.com/Nithin-GK/AT-DDPM △ Less

Submitted 20 September, 2022; v1 submitted 23 August, 2022; originally announced August 2022.

Comments: Accepted to IEEE WACV 2023

Energy Minimizing Configurations for Single-Director Cosserat Shells

Authors: Timothy J. Healey, Gokul G. Nair

Abstract: We consider a class of single-director Cosserat shell models accounting for both curvature and finite mid-plane strains. We assume a polyconvexity condition for the stored-energy function that reduces to a physically correct membrane model in the absence of bending. With appropriate growth conditions, we establish the existence of energy minimizers. The local orientation of a minimizing configurat… ▽ More We consider a class of single-director Cosserat shell models accounting for both curvature and finite mid-plane strains. We assume a polyconvexity condition for the stored-energy function that reduces to a physically correct membrane model in the absence of bending. With appropriate growth conditions, we establish the existence of energy minimizers. The local orientation of a minimizing configuration is maintained via the blowup of the stored energy as a version of the local volume ratio approaches zero. Finally, we specialize our results to three constrained versions of the theory commonly employed in the subject. △ Less

Submitted 8 December, 2022; v1 submitted 18 August, 2022; originally announced August 2022.

Comments: 10 pages

MSC Class: 74B20; 35D99; 49K20

Low-Cost Raspberry Pi Star Sensor for Small Satellites

Authors: Bharat Chandra P, Mayuresh Sarpotdar, Binukumar G. Nair, Richa Rai, Rekhesh Mohan, Joice Mathew, Margarita Safonova, Jayant Murthy

Abstract: We present here a low-cost Raspberry Pi (RPi)-based star sensor StarberrySense using commercial-off-the-shelf (COTS) components, developed and built for applications in small satellites and CubeSat-based missions. A star sensor is one of the essential instruments onboard a satellite for attitude determination. However, most commercially available star sensors are expensive and bulky to be used in… ▽ More We present here a low-cost Raspberry Pi (RPi)-based star sensor StarberrySense using commercial-off-the-shelf (COTS) components, developed and built for applications in small satellites and CubeSat-based missions. A star sensor is one of the essential instruments onboard a satellite for attitude determination. However, most commercially available star sensors are expensive and bulky to be used in small satellite missions. StarberrySense is a configurable system -- it can operate as an imaging camera, a centroiding camera, or as a star sensor. We describe the algorithms implemented in the sensor, its assembly and calibration. This payload was selected by a recent Announcement of Opportunity call for payloads to fly on the PS4-Orbital Platform by the Indian Space Research Organization (ISRO). △ Less

Submitted 13 July, 2022; v1 submitted 7 July, 2022; originally announced July 2022.

Comments: J. Astron. Telesc. Instrum. Syst (Accepted)

Journal ref: J. of Astronomical Telescopes, Instruments, and Systems, 8(3), 036002 (2022)