-
A flexible smoother adapted to censored data with outliers and its application to SARS-CoV-2 monitoring in wastewater
Authors:
Marie Courbariaux,
Nicolas Cluzel,
Siyun Wang,
Vincent Maréchal,
Laurent Moulin,
Sébastien Wurtzer,
Obépine consortium,
Jean-Marie Mouchel,
Yvon Maday,
Grégory Nuel
Abstract:
A sentinel network, Obépine, has been designed to monitor SARS-CoV-2 viral load in wastewaters arriving at wastewater treatment plants (WWTPs) in France as an indirect macro-epidemiological parameter. The sources of uncertainty in such monitoring system are numerous and the concentration measurements it provides are left-censored and contain outliers, which biases the results of usual smoothing me…
▽ More
A sentinel network, Obépine, has been designed to monitor SARS-CoV-2 viral load in wastewaters arriving at wastewater treatment plants (WWTPs) in France as an indirect macro-epidemiological parameter. The sources of uncertainty in such monitoring system are numerous and the concentration measurements it provides are left-censored and contain outliers, which biases the results of usual smoothing methods. Hence the need for an adapted pre-processing in order to evaluate the real daily amount of virus arriving to each WWTP. We propose a method based on an auto-regressive model adapted to censored data with outliers. Inference and prediction are produced via a discretised smoother which makes it a very flexible tool. This method is both validated on simulations and on real data from Obépine. The resulting smoothed signal shows a good correlation with other epidemiological indicators and is currently used by Obépine to provide an estimate of virus circulation over the watersheds corresponding to about 200 WWTPs.
△ Less
Submitted 4 January, 2022; v1 submitted 4 August, 2021;
originally announced August 2021.
-
BitPruning: Learning Bitlengths for Aggressive and Accurate Quantization
Authors:
Miloš Nikolić,
Ghouthi Boukli Hacene,
Ciaran Bannon,
Alberto Delmas Lascorz,
Matthieu Courbariaux,
Yoshua Bengio,
Vincent Gripon,
Andreas Moshovos
Abstract:
Neural networks have demonstrably achieved state-of-the art accuracy using low-bitlength integer quantization, yielding both execution time and energy benefits on existing hardware designs that support short bitlengths. However, the question of finding the minimum bitlength for a desired accuracy remains open. We introduce a training method for minimizing inference bitlength at any granularity whi…
▽ More
Neural networks have demonstrably achieved state-of-the art accuracy using low-bitlength integer quantization, yielding both execution time and energy benefits on existing hardware designs that support short bitlengths. However, the question of finding the minimum bitlength for a desired accuracy remains open. We introduce a training method for minimizing inference bitlength at any granularity while maintaining accuracy. Namely, we propose a regularizer that penalizes large bitlength representations throughout the architecture and show how it can be modified to minimize other quantifiable criteria, such as number of operations or memory footprint. We demonstrate that our method learns thrifty representations while maintaining accuracy. With ImageNet, the method produces an average per layer bitlength of 4.13, 3.76 and 4.36 bits on AlexNet, ResNet18 and MobileNet V2 respectively, remaining within 2.0%, 0.5% and 0.5% of the base TOP-1 accuracy.
△ Less
Submitted 11 August, 2020; v1 submitted 7 February, 2020;
originally announced February 2020.
-
Post-processing multi-ensemble temperature and precipitation forecasts through an Exchangeable Gamma Normal model and its Tobit extension
Authors:
Marie Courbariaux,
Pierre Barbillon,
Luc Perreault,
Éric Parent
Abstract:
Meteorological ensembles are a collection of scenarios for future weather delivered by a meteorological center. Such ensembles form the main source of valuable information for probabilistic forecasting which aims at producing a predictive probability distribution of the quantity of interest instead of a single best guess estimate. Unfortunately, ensembles cannot generally be considered as a sample…
▽ More
Meteorological ensembles are a collection of scenarios for future weather delivered by a meteorological center. Such ensembles form the main source of valuable information for probabilistic forecasting which aims at producing a predictive probability distribution of the quantity of interest instead of a single best guess estimate. Unfortunately, ensembles cannot generally be considered as a sample from such a predictive probability distribution without a preliminary post-processing treatment to calibrate the ensemble. Two main families of post-processing methods, either competing such as BMA or collaborative such as EMOS, can be found in the literature. This paper proposes a mixed effect model belonging to the collaborative family. The structure of the model is based on the hypothesis of invariance under the relabelling of the ensemble members. Its interesting specificities are as follows: 1) exchangeability, which contributes to parsimony, with a latent pivot variable synthesizing the essential meteorological features of the ensembles, 2) a multi-ensemble implementation, allowing to take advantage of various information so as to increase the sharpness of the forecasting procedure. Focus is cast onto Normal statistical structures, first with a direct application for temperatures, then with its Tobit extension for precipitation. Inference is performed by EM algorithms with recourse made to stochastic conditional simulations in the precipitation case. After checking its good behavior on artificial data, the proposed post-processing technique is applied to temperature and precipitation ensemble forecasts produced over five river basins managed by Hydro-Qu$é$bec. These ensemble forecasts were extracted from the THORPEX Interactive Grand Global Ensemble (TIGGE) database. The results indicate that post-processed ensemble are calibrated and generally sharper than the raw ensembles.
△ Less
Submitted 5 March, 2019; v1 submitted 24 April, 2018;
originally announced April 2018.
