Skip to main content

Showing 1–18 of 18 results for author: Aïvodji, U

.
  1. arXiv:2505.09503  [pdf, other

    cs.LG

    Towards Fair In-Context Learning with Tabular Foundation Models

    Authors: Patrik Kenfack, Samira Ebrahimi Kahou, Ulrich Aïvodji

    Abstract: Tabular foundational models have exhibited strong in-context learning (ICL) capabilities on structured data, allowing them to make accurate predictions on test sets without parameter updates, using training examples as context. This emerging approach positions itself as a competitive alternative to traditional gradient-boosted tree methods. However, while biases in conventional machine learning mo… ▽ More

    Submitted 14 May, 2025; v1 submitted 14 May, 2025; originally announced May 2025.

    Comments: 24 pages, 10 figures, 4 tables

  2. arXiv:2505.05707  [pdf, other

    cs.LG cs.CR

    Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacy

    Authors: Rushabh Solanki, Meghana Bhange, Ulrich Aïvodji, Elliot Creager

    Abstract: The integration of AI into daily life has generated considerable attention and excitement, while also raising concerns about automating algorithmic harms and re-entrenching existing social inequities. While the responsible deployment of trustworthy AI systems is a worthy goal, there are many possible ways to realize it, from policy and regulation to improved algorithm design and evaluation. In fac… ▽ More

    Submitted 8 May, 2025; originally announced May 2025.

  3. arXiv:2411.14984  [pdf, other

    cs.LG

    Adaptive Group Robust Ensemble Knowledge Distillation

    Authors: Patrik Kenfack, Ulrich Aïvodji, Samira Ebrahimi Kahou

    Abstract: Neural networks can learn spurious correlations in the data, often leading to performance disparity for underrepresented subgroups. Studies have demonstrated that the disparity is amplified when knowledge is distilled from a complex teacher model to a relatively "simple" student model. Prior work has shown that ensemble deep learning methods can improve the performance of the worst-case subgroups;… ▽ More

    Submitted 22 November, 2024; originally announced November 2024.

    Comments: Workshop Algorithmic Fairness through the Lens of Metrics and Evaluation at NeurIPS 2024

  4. arXiv:2403.13848  [pdf, other

    cs.LG cs.AI cs.CR

    Smooth Sensitivity for Learning Differentially-Private yet Accurate Rule Lists

    Authors: Timothée Ly, Julien Ferry, Marie-José Huguet, Sébastien Gambs, Ulrich Aivodji

    Abstract: Differentially-private (DP) mechanisms can be embedded into the design of a machine learning algorithm to protect the resulting model against privacy leakage. However, this often comes with a significant loss of accuracy due to the noise added to enforce DP. In this paper, we aim at improving this trade-off for a popular class of machine learning algorithms leveraging the Gini impurity as an infor… ▽ More

    Submitted 12 November, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

    Report number: Rapport LAAS n{\textdegree} 24050

  5. arXiv:2312.16191  [pdf, ps, other

    cs.LG cs.AI

    SoK: Taming the Triangle -- On the Interplays between Fairness, Interpretability and Privacy in Machine Learning

    Authors: Julien Ferry, Ulrich Aïvodji, Sébastien Gambs, Marie-José Huguet, Mohamed Siala

    Abstract: Machine learning techniques are increasingly used for high-stakes decision-making, such as college admissions, loan attribution or recidivism prediction. Thus, it is crucial to ensure that the models learnt can be audited or understood by human users, do not create or reproduce discrimination or bias, and do not leak sensitive information regarding their training data. Indeed, interpretability, fa… ▽ More

    Submitted 22 December, 2023; originally announced December 2023.

  6. arXiv:2308.15099  [pdf, other

    cs.AI cs.IT

    Probabilistic Dataset Reconstruction from Interpretable Models

    Authors: Julien Ferry, Ulrich Aïvodji, Sébastien Gambs, Marie-José Huguet, Mohamed Siala

    Abstract: Interpretability is often pointed out as a key requirement for trustworthy machine learning. However, learning and releasing models that are inherently interpretable leaks information regarding the underlying training data. As such disclosure may directly conflict with privacy, a precise quantification of the privacy impact of such breach is a fundamental problem. For instance, previous work have… ▽ More

    Submitted 3 April, 2024; v1 submitted 29 August, 2023; originally announced August 2023.

    Report number: Rapport LAAS n{\textdegree} 23244

    Journal ref: 2nd IEEE Conference on Secure and Trustworthy Machine Learning, Apr 2024, Toronto, Canada

  7. arXiv:2307.13081  [pdf, other

    cs.LG cs.AI

    Fairness Under Demographic Scarce Regime

    Authors: Patrik Joslin Kenfack, Samira Ebrahimi Kahou, Ulrich Aïvodji

    Abstract: Most existing works on fairness assume the model has full access to demographic information. However, there exist scenarios where demographic information is partially available because a record was not maintained throughout data collection or for privacy reasons. This setting is known as demographic scarce regime. Prior research has shown that training an attribute classifier to replace the missin… ▽ More

    Submitted 17 September, 2024; v1 submitted 24 July, 2023; originally announced July 2023.

    Comments: Published in Transactions on Machine Learning Research (TMLR), 2024

  8. arXiv:2303.04437  [pdf, other

    cs.LG stat.ML

    Learning Hybrid Interpretable Models: Theory, Taxonomy, and Methods

    Authors: Julien Ferry, Gabriel Laberge, Ulrich Aïvodji

    Abstract: A hybrid model involves the cooperation of an interpretable model and a complex black box. At inference, any input of the hybrid model is assigned to either its interpretable or complex component based on a gating mechanism. The advantages of such models over classical ones are two-fold: 1) They grant users precise control over the level of transparency of the system and 2) They can potentially pe… ▽ More

    Submitted 8 March, 2023; originally announced March 2023.

  9. arXiv:2209.01215  [pdf, other

    cs.LG cs.AI cs.CR

    Exploiting Fairness to Enhance Sensitive Attributes Reconstruction

    Authors: Julien Ferry, Ulrich Aïvodji, Sébastien Gambs, Marie-José Huguet, Mohamed Siala

    Abstract: In recent years, a growing body of work has emerged on how to learn machine learning models under fairness constraints, often expressed with respect to some sensitive attributes. In this work, we consider the setting in which an adversary has black-box access to a target model and show that information about this model's fairness can be exploited by the adversary to enhance his reconstruction of t… ▽ More

    Submitted 2 September, 2022; originally announced September 2022.

  10. arXiv:2205.15419  [pdf, other

    cs.LG

    Fool SHAP with Stealthily Biased Sampling

    Authors: Gabriel Laberge, Ulrich Aïvodji, Satoshi Hara, Mario Marchand., Foutse Khomh

    Abstract: SHAP explanations aim at identifying which features contribute the most to the difference in model prediction at a specific input versus a background distribution. Recent studies have shown that they can be manipulated by malicious adversaries to produce arbitrary desired explanations. However, existing attacks focus solely on altering the black-box model itself. In this paper, we propose a comple… ▽ More

    Submitted 3 March, 2023; v1 submitted 30 May, 2022; originally announced May 2022.

  11. Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanations

    Authors: Jessica Dai, Sohini Upadhyay, Ulrich Aivodji, Stephen H. Bach, Himabindu Lakkaraju

    Abstract: As post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to ensure that the quality of the resulting explanations is consistently high across various population subgroups including the minority groups. For instance, it should not be the case that explanations associated with instances belonging to a particular gender su… ▽ More

    Submitted 1 July, 2022; v1 submitted 15 May, 2022; originally announced May 2022.

    Comments: As presented at AIES 2022

  12. arXiv:2106.07504  [pdf, other

    cs.LG cs.CY

    Characterizing the risk of fairwashing

    Authors: Ulrich Aïvodji, Hiromi Arai, Sébastien Gambs, Satoshi Hara

    Abstract: Fairwashing refers to the risk that an unfair black-box model can be explained by a fairer model through post-hoc explanation manipulation. In this paper, we investigate the capability of fairwashing attacks by analyzing their fidelity-unfairness trade-offs. In particular, we show that fairwashed explanation models can generalize beyond the suing group (i.e., data points that are being explained),… ▽ More

    Submitted 2 November, 2021; v1 submitted 14 June, 2021; originally announced June 2021.

    Comments: Accepted to NeurIPS 2021

  13. arXiv:2009.01884  [pdf, other

    cs.LG cs.CR stat.ML

    Model extraction from counterfactual explanations

    Authors: Ulrich Aïvodji, Alexandre Bolot, Sébastien Gambs

    Abstract: Post-hoc explanation techniques refer to a posteriori methods that can be used to explain how black-box machine learning models produce their outcomes. Among post-hoc explanation techniques, counterfactual explanations are becoming one of the most popular methods to achieve this objective. In particular, in addition to highlighting the most important features used by the black-box model, they prov… ▽ More

    Submitted 3 September, 2020; originally announced September 2020.

  14. arXiv:1909.11835  [pdf, other

    cs.LG stat.ML

    GAMIN: An Adversarial Approach to Black-Box Model Inversion

    Authors: Ulrich Aïvodji, Sébastien Gambs, Timon Ther

    Abstract: Recent works have demonstrated that machine learning models are vulnerable to model inversion attacks, which lead to the exposure of sensitive information contained in their training dataset. While some model inversion attacks have been developed in the past in the black-box attack setting, in which the adversary does not have direct access to the structure of the model, few of these have been con… ▽ More

    Submitted 25 September, 2019; originally announced September 2019.

  15. arXiv:1909.03977  [pdf, other

    cs.LG stat.ML

    Learning Fair Rule Lists

    Authors: Ulrich Aïvodji, Julien Ferry, Sébastien Gambs, Marie-José Huguet, Mohamed Siala

    Abstract: As the use of black-box models becomes ubiquitous in high stake decision-making systems, demands for fair and interpretable models are increasing. While it has been shown that interpretable models can be as accurate as black-box models in several critical domains, existing fair classification techniques that are interpretable by design often display poor accuracy/fairness tradeoffs in comparison w… ▽ More

    Submitted 17 February, 2020; v1 submitted 9 September, 2019; originally announced September 2019.

  16. arXiv:1906.07858  [pdf, other

    cs.LG cs.CR stat.ML

    Adversarial training approach for local data debiasing

    Authors: Ulrich Aïvodji, François Bidet, Sébastien Gambs, Rosin Claude Ngueveu, Alain Tapp

    Abstract: The widespread use of automated decision processes in many areas of our society raises serious ethical issues concerning the fairness of the process and the possible resulting discriminations. In this work, we propose a novel approach called GANsan whose objective is to prevent the possibility of any discrimination i.e., direct and indirect) based on a sensitive attribute by removing the attribute… ▽ More

    Submitted 3 September, 2020; v1 submitted 18 June, 2019; originally announced June 2019.

  17. arXiv:1903.12211  [pdf, other

    cs.CR

    Privacy in trajectory micro-data publishing : a survey

    Authors: Marco Fiore, Panagiota Katsikouli, Elli Zavou, Mathieu Cunche, Françoise Fessant, Dominique Le Hello, Ulrich Matchi Aivodji, Baptiste Olivier, Tony Quertier, Razvan Stanica

    Abstract: We survey the literature on the privacy of trajectory micro-data, i.e., spatiotemporal information about the mobility of individuals, whose collection is becoming increasingly simple and frequent thanks to emerging information and communication technologies. The focus of our review is on privacy-preserving data publishing (PPDP), i.e., the publication of databases of trajectory micro-data that pre… ▽ More

    Submitted 13 May, 2020; v1 submitted 26 March, 2019; originally announced March 2019.

    Comments: Accepted for publication at Transactions for Data Privacy

  18. arXiv:1901.09749  [pdf, other

    cs.LG stat.ML

    Fairwashing: the risk of rationalization

    Authors: Ulrich Aïvodji, Hiromi Arai, Olivier Fortineau, Sébastien Gambs, Satoshi Hara, Alain Tapp

    Abstract: Black-box explanation is the problem of explaining how a machine learning model -- whose internal logic is hidden to the auditor and generally complex -- produces its outcomes. Current approaches for solving this problem include model explanation, outcome explanation as well as model inspection. While these techniques can be beneficial by providing interpretability, they can be used in a negative… ▽ More

    Submitted 15 May, 2019; v1 submitted 28 January, 2019; originally announced January 2019.

    Comments: Accepted to ICML 2019