-
CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads
Authors:
Radostin Stoyanov,
Viktória Spišaková,
Jesus Ramos,
Steven Gurfinkel,
Andrei Vagin,
Adrian Reber,
Wesley Armour,
Rodrigo Bruno
Abstract:
Deep learning training at scale is resource-intensive and time-consuming, often running across hundreds or thousands of GPUs for weeks or months. Efficient checkpointing is crucial for running these workloads, especially in multi-tenant environments where compute resources are shared, and job preemptions or interruptions are common. However, transparent and unified GPU snapshots are particularly c…
▽ More
Deep learning training at scale is resource-intensive and time-consuming, often running across hundreds or thousands of GPUs for weeks or months. Efficient checkpointing is crucial for running these workloads, especially in multi-tenant environments where compute resources are shared, and job preemptions or interruptions are common. However, transparent and unified GPU snapshots are particularly challenging because of the hardware architecture differences between CPU and GPU, including memory subsystems, dynamic parallelism, and thread synchronization. State-of-the-art GPU checkpointing techniques typically leverage mechanisms that intercept, log, and replay device API calls. However, this approach adds performance overhead and requires hardware-specific implementation that is difficult to test, maintain, and integrate with existing container platforms. In this paper, we present CRIUgpu - a novel approach for transparent checkpointing of GPU-accelerated workloads that builds on recently introduced driver capabilities, enabling support for CUDA and ROCm applications. Our evaluation results show that CRIUgpu works with a variety of deep learning and high-performance computing workloads running across multiple GPUs, completely eliminating steady-state performance overheads, and significantly reducing recovery times compared to state-of-the-art transparent GPU checkpointing mechanisms.
△ Less
Submitted 23 February, 2025;
originally announced February 2025.
-
Electro-Optic Comb Generation Via Cascaded Harmonic Modulation
Authors:
Todd Eliason,
Payton A. Parker,
Melanie A. R. Reber
Abstract:
Electro-optical modulation of a continuous wave laser is a highly stable way to generate frequency combs, gaining popularity in telecommunication and spectroscopic applications. These combs are generated by modulating non-linear electro-optic crystals with radio frequencies, creating equally spaced side-bands centered around the single-frequency seed laser. Electro-optic frequency comb architectur…
▽ More
Electro-optical modulation of a continuous wave laser is a highly stable way to generate frequency combs, gaining popularity in telecommunication and spectroscopic applications. These combs are generated by modulating non-linear electro-optic crystals with radio frequencies, creating equally spaced side-bands centered around the single-frequency seed laser. Electro-optic frequency comb architectures often choose between optical bandwidth (cascaded GHz combs) or higher mode density (chirped RF generation). This work demonstrates an electro-optic frequency comb with > 120 GHz of bandwidth and a 75 MHz repetition rate. The comb has three cascaded electro-optic modulators driven at sequentially lower harmonics, the last megahertz modulation dictating the repetition rate. This architecture can modulate at any individual harmonic and repetition rate without changes to the components. This comb can be used in any applications where a stable and tunable repetition rate is needed.
△ Less
Submitted 28 July, 2024;
originally announced July 2024.
-
Ultrafast Structured Light through Nonlinear Frequency Generation in an Optical Enhancement Cavity
Authors:
Walker M Jones,
Melanie A R Reber
Abstract:
The generation of shaped laser beams, or structured light, is of interest in a wide range of fields, from microscopy to fundamental physics. There are several ways to make shaped beams, most commonly using spatial light modulators comprised of pixels of liquid crystals. These methods have limitations on the wavelength, pulse duration, and average power that can be used. Here we present a method to…
▽ More
The generation of shaped laser beams, or structured light, is of interest in a wide range of fields, from microscopy to fundamental physics. There are several ways to make shaped beams, most commonly using spatial light modulators comprised of pixels of liquid crystals. These methods have limitations on the wavelength, pulse duration, and average power that can be used. Here we present a method to generate shaped light that can be used at any wavelength from the UV to IR, on ultrafast pulses, and a large range of optical powers. By exploiting the frequency difference between higher order modes, a result of the Gouy phase, and cavity mode matching, we can selectively couple into a variety of pure and composite higher order modes. Optical cavities are used as a spatial filter and then combined with sum frequency generation in a nonlinear crystal as the output coupler to the cavity to create ultrafast, frequency comb structured light.
△ Less
Submitted 20 May, 2024;
originally announced May 2024.
-
Three-Wave Mixing between Continuous-Wave and Ultrafast Lasers
Authors:
Jie Zhan,
Nicholas D. Cooper,
Melanie A. R. Reber
Abstract:
Ultrafast optical frequency combs allow for both high spectral and temporal resolution in molecular spectroscopy and have become a powerful tool in many areas of chemistry and physics. Ultrafast lasers and frequency combs generated from ultrafast mode-locked lasers often need to be converted to other wavelengths. Commonly used wavelength conversions are optical parametric oscillators, which requir…
▽ More
Ultrafast optical frequency combs allow for both high spectral and temporal resolution in molecular spectroscopy and have become a powerful tool in many areas of chemistry and physics. Ultrafast lasers and frequency combs generated from ultrafast mode-locked lasers often need to be converted to other wavelengths. Commonly used wavelength conversions are optical parametric oscillators, which require an external optical cavity, and supercontinuum generation combined with optical parametric amplifiers. Whether commercial or home-built, these systems are complex and costly. Here we propose an alternative, simple, and easy-to-implement approach to tunable frequency comb ultrafast lasers enabled by new continuous-wave laser technology. Sum-frequency generation between a Nd:YAG continuous-wave laser and a Yb:fiber femtosecond frequency comb in a beta-barium borate (BBO) crystal is explored. The resulting sum-frequency beam is a pulsed frequency comb with the same repetition rate as the Yb:fiber source. SNLO simulation software was used to simulate the results and provide benchmarks for designing future system to achieve wavelength conversion and tunability in difficult spectral regions.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
Spectral shaping of an ultrafast modelocked Ytterbium fiber laser output through a passive intracavity optical filter; a simple and reliable route to sub-45 fs pulses
Authors:
Nicholas D. Cooper,
Uyen M. Ta,
Melanie A. R. Reber
Abstract:
Here we investigate the use of passive intracavity optical filters for controlling the laser output spectrum of a polarization-mode-locked, ultrafast Ytterbium fiber laser. With strategic placement of the filter cutoff frequency, the overall lasing bandwidth can be increased or extended. Overall laser performance, including pulse compression and intensity noise, is investigated for both shortpass…
▽ More
Here we investigate the use of passive intracavity optical filters for controlling the laser output spectrum of a polarization-mode-locked, ultrafast Ytterbium fiber laser. With strategic placement of the filter cutoff frequency, the overall lasing bandwidth can be increased or extended. Overall laser performance, including pulse compression and intensity noise, is investigated for both shortpass and longpass filters with a range of cutoff frequencies, tuned by rotating the filters. We demonstrate the use of an intracavity filter not only shapes the output spectra, it provides a route for overall broader bandwidths and shorter pulses in Yb:fiber lasers. These results demonstrate that spectral shaping is a useful tool to routinely achieve sub-45 fs pulse durations in Yb:fiber lasers.
△ Less
Submitted 30 September, 2022;
originally announced October 2022.
-
High-power ultrafast Yb:fiber laser frequency combs using commercially available components and basic fiber tools
Authors:
X. L. Li,
M. A. R. Reber,
C. Corder,
Y. Chen,
P. Zhao,
T. K. Allison
Abstract:
We present a detailed description of the design, construction, and performance of high-power ultrafast Yb:fiber laser frequency combs in operation in our laboratory. We discuss two such laser systems: an 87 MHz, 9 W, 85 fs laser operating at 1060 nm and an 87 MHz, 80 W, 155 fs laser operating at 1035 nm. Both are constructed using low-cost, commercially available components, and can be assembled u…
▽ More
We present a detailed description of the design, construction, and performance of high-power ultrafast Yb:fiber laser frequency combs in operation in our laboratory. We discuss two such laser systems: an 87 MHz, 9 W, 85 fs laser operating at 1060 nm and an 87 MHz, 80 W, 155 fs laser operating at 1035 nm. Both are constructed using low-cost, commercially available components, and can be assembled using only basic tools for cleaving and splicing single-mode fibers. We describe practical methods for achieving and characterizing low-noise single-pulse operation and long-term stability from Yb:fiber oscillators based on nonlinear polarization evolution. Stabilization of the combs using a variety of transducers, including a new method for tuning the carrier-envelope offset frequency, is discussed. High average power is achieved through chirped-pulse amplification in simple fiber amplifiers based on double-clad photonic crystal fibers. We describe the use of these combs in several applications, including ultrasensitive femtosecond time-resolved spectroscopy and cavity-enhanced high-order harmonic generation.
△ Less
Submitted 16 June, 2016;
originally announced June 2016.
-
Cavity-Enhanced Ultrafast Transient Absorption Spectroscopy
Authors:
Melanie A. R. Reber,
Yuning Chen,
Thomas K. Allison
Abstract:
We present a new technique using a frequency comb laser and optical cavities for performing ultrafast transient absorption spectroscopy with improved sensitivity. Resonantly enhancing the probe pulses, we demonstrate a sensitivity of $Δ$OD $ = 1 \times 10^{-9}/\sqrt{\mbox{Hz}}$ for averaging times as long as 30 s per delay point ($Δ$OD$_{min} = 2 \times 10^{-10}$). Resonantly enhancing the pump pu…
▽ More
We present a new technique using a frequency comb laser and optical cavities for performing ultrafast transient absorption spectroscopy with improved sensitivity. Resonantly enhancing the probe pulses, we demonstrate a sensitivity of $Δ$OD $ = 1 \times 10^{-9}/\sqrt{\mbox{Hz}}$ for averaging times as long as 30 s per delay point ($Δ$OD$_{min} = 2 \times 10^{-10}$). Resonantly enhancing the pump pulses allows us to produce a high excitation fraction at high repetition-rate, so that signals can be recorded from samples with optical densities as low as OD $\approx 10^{-8}$, or column densities $< 10^{10}$ molecules/cm$^2$. This high sensitivity enables new directions for ultrafast spectroscopy.
△ Less
Submitted 9 November, 2015;
originally announced November 2015.