-
Performance of Confidential Computing GPUs
Authors:
Antonio Martínez Ibarra,
Julian James Stephen,
Aurora González Vidal,
K. R. Jayaram,
Antonio Fernando Skarmeta Gómez
Abstract:
This work examines latency, throughput, and other metrics when performing inference on confidential GPUs. We explore different traffic patterns and scheduling strategies using a single Virtual Machine with one NVIDIA H100 GPU, to perform relaxed batch inferences on multiple Large Language Models (LLMs), operating under the constraint of swapping models in and out of memory, which necessitates effi…
▽ More
This work examines latency, throughput, and other metrics when performing inference on confidential GPUs. We explore different traffic patterns and scheduling strategies using a single Virtual Machine with one NVIDIA H100 GPU, to perform relaxed batch inferences on multiple Large Language Models (LLMs), operating under the constraint of swapping models in and out of memory, which necessitates efficient control. The experiments simulate diverse real-world scenarios by varying parameters such as traffic load, traffic distribution patterns, scheduling strategies, and Service Level Agreement (SLA) requirements. The findings provide insights into the differences between confidential and non-confidential settings when performing inference in scenarios requiring active model swapping. Results indicate that in No-CC mode, relaxed batch inference with model swapping latency is 20-30% lower than in confidential mode. Additionally, SLA attainment is 15-20% higher in No-CC settings. Throughput in No-CC scenarios surpasses that of confidential mode by 45-70%, and GPU utilization is approximately 50% higher in No-CC environments. Overall, performance in the confidential setting is inferior to that in the No-CC scenario, primarily due to the additional encryption and decryption overhead required for loading models onto the GPU in confidential environments.
△ Less
Submitted 22 May, 2025;
originally announced May 2025.
-
Transition to turbulence in viscoelastic channel flow of dilute polymer solutions
Authors:
Alexia Martinez Ibarra,
Jae Sung Park
Abstract:
The transition to turbulence in a plane Poiseuille flow of dilute polymer solutions is studied by direct numerical simulations of a FENE-P fluid. A range of Reynolds number ($Re$) in $2000 \le Re \le 5000$ is studied but with the same level of elasticity in viscoelastic flows. The evolution of a finite-amplitude perturbation and its effects on transition dynamics are investigated. A viscoelastic f…
▽ More
The transition to turbulence in a plane Poiseuille flow of dilute polymer solutions is studied by direct numerical simulations of a FENE-P fluid. A range of Reynolds number ($Re$) in $2000 \le Re \le 5000$ is studied but with the same level of elasticity in viscoelastic flows. The evolution of a finite-amplitude perturbation and its effects on transition dynamics are investigated. A viscoelastic flow begins transition at an earlier time than its Newtonian counterparts, but the transition time appears to be insensitive to polymer concentration at dilute or semi-dilute regimes studied. Increasing polymer concentration, however, decreases the maximum attainable energy growth during the transition process. The critical or minimum perturbation amplitude required to trigger transition is computed. Interestingly, both Newtonian and viscoelastic flows follow almost the same power-law scaling of $Re^γ$ with the critical exponent $γ\approx -1.25$, which is in close agreement with previous studies. However, a shift downward is observed for viscoelastic flow, suggesting that smaller perturbation amplitudes are required for the transition. A mechanism of the early transition is investigated by the evolution of wall-normal and spanwise velocity fluctuations and flow structure. The early growth of these fluctuations and formation of quasi-streamwise vortices around low-speed streaks are promoted by polymers, hence causing an early transition. These vortical structures are found to support the critical exponent $γ\approx -1.25$. Once the transition process is completed, polymers play a role in dampening the wall-normal and spanwise velocity fluctuations and vortices to attain a drag-reduced state in viscoelastic turbulent flows.
△ Less
Submitted 6 November, 2023;
originally announced November 2023.
-
Spatiotemporal clustering, climate periodicity, and social-ecological risk factors for dengue during an outbreak in Machala, Ecuador, in 2010
Authors:
Anna M. Stewart Ibarra,
Angel G. Munoz,
Sadie J. Ryan,
Mercy J. Borbor,
Efrain Beltran Ayala,
Julia L. Finkelstein,
Raul Mejia,
Tania Ordonez,
G. Cristina Recalde Coronel,
Keytia Rivero
Abstract:
The objective of this study was to characterize the spatiotemporal dynamics and climatic and social-ecological risk factors associated with the largest dengue epidemic to date in Machala, Ecuador, to inform the development of a dengue EWS. The following data were included in analyses: neighborhood-level georeferenced dengue cases, national census data, and entomological surveillance data from 2010…
▽ More
The objective of this study was to characterize the spatiotemporal dynamics and climatic and social-ecological risk factors associated with the largest dengue epidemic to date in Machala, Ecuador, to inform the development of a dengue EWS. The following data were included in analyses: neighborhood-level georeferenced dengue cases, national census data, and entomological surveillance data from 2010; time series of weekly dengue cases (aggregated to the city-level) and meteorological data from 2003 to 2012. We applied LISA and Morans I to analyze the spatial distribution of the 2010 dengue cases, and developed multivariate logistic regression models through a multi-model selection process to identify census variables and entomological covariates associated with the presence of dengue at the neighborhood level. Using data aggregated at the city-level, we conducted a time-series (wavelet) analysis of weekly climate and dengue incidence (2003-2012) to identify significant time periods (e.g., annual, biannual) when climate co-varied with dengue, and to describe the climate conditions associated with the 2010 outbreak. We found significant hotspots of dengue transmission near the center of Machala. The best-fit model to predict the presence of dengue included older age and female gender of the head of the household, greater access to piped water in the home, poor housing condition, and less distance to the central hospital. Wavelet analyses revealed that dengue transmission co-varied with rainfall and minimum temperature at annual and biannual cycles, and we found that anomalously high rainfall and temperatures were associated with the 2010 outbreak. Our findings highlight the importance of geospatial information in dengue surveillance and the potential to develop a climate-driven spatiotemporal prediction models to inform disease prevention and control interventions.
△ Less
Submitted 13 January, 2015; v1 submitted 29 July, 2014;
originally announced July 2014.
