FairPOT: Balancing AUC Performance and Fairness with Proportional Optimal Transport.

Abstract

Fairness metrics utilizing the area under the receiver operator characteristic curve (AUC) have gained increasing attention in high-stakes domains such as healthcare, finance, and criminal justice. In these domains, fairness is often evaluated over risk scores rather than binary outcomes, and a common challenge is that enforcing strict fairness can significantly degrade AUC performance. To address this challenge, we propose Fair Proportional Optimal Transport (FairPOT), a novel, model-agnostic post-processing framework that strategically aligns risk score distributions across different groups using optimal transport, but does so selectively by transforming a controllable proportion, i.e., the top- λ quantile, of scores within the disadvantaged group. By varying λ , our method allows for a tunable trade-off between reducing AUC disparities and maintaining overall AUC performance. Furthermore, we extend FairPOT to the partial AUC setting, enabling fairness interventions to concentrate on the highest-risk regions. Extensive experiments on synthetic, public, and clinical datasets show that FairPOT consistently outperforms existing post-processing techniques in both global and partial AUC scenarios, often achieving improved fairness with slight AUC degradation or even positive gains in utility. The computational efficiency and practical adaptability of FairPOT make it a promising solution for real-world deployment.

Department

Description

Provenance

Subjects

Citation

Published Version (Please cite this version)

10.1609/aies.v8i2.36660

Publication Info

Liu, Pengxi, Yi Shen, Matthew M Engelhard, Benjamin A Goldstein, Michael J Pencina, Nicoleta J Economou-Zavlanos and Michael M Zavlanos (2025). FairPOT: Balancing AUC Performance and Fairness with Proportional Optimal Transport. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, 8(2). pp. 1611–1622. 10.1609/aies.v8i2.36660 Retrieved from https://hdl.handle.net/10161/33830.

This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.

Scholars@Duke

Engelhard

Matthew M. Engelhard

Assistant Professor of Biostatistics & Bioinformatics

Developing new machine learning methods for multi-modal longitudinal clinical data to support clinical decision-making.

Goldstein

Benjamin Alan Goldstein

Professor of Biostatistics & Bioinformatics

I study the meaningful use of Electronic Health Records data. My research interests sit at the intersection of biostatistics, biomedical informatics, machine learning and epidemiology. I collaborate with researchers both locally at Duke as well as nationally. I am interested in speaking with any students, methodologists or collaborators interested in EHR data.

Please find more information at: https://biostat.duke.edu/goldstein-lab

Economou-Zavlanos

Nicoleta Economou-Zavlanos

Assistant Professor of Biostatistics & Bioinformatics

Director of Duke Health AI Evaluation and Governance  
Founding Director of Algorithm-Based Clinical Decision Support (ABCDS) Oversight 

Nicoleta Economou-Zavlanos, PhD, is the Director of the Duke Health AI Evaluation & Governance Program and the founding director of the Algorithm-Based Clinical Decision Support (ABCDS) Oversight initiative. In this capacity, she leads Duke Health’s efforts to evaluate and govern health AI technologies. Dr. Economou also serves on the Executive Committee of the NIH Common Fund’s Bridge to Artificial Intelligence (Bridge2AI) Program. Additionally, she served as Scientific Advisor for the Coalition for Health AI (CHAI), driving the development of guidelines for AI assurance in healthcare, from 2024 to 2025. 

A nationally recognized expert in health AI governance, Dr. Economou has been instrumental in creating frameworks and methodologies for the registration, review, and assurance of health AI systems. Her research, published in leading journals such as NPJ Digital MedicineJAMAJAMA Health Forum, and JAMIA, reflects her commitment to advancing the responsible development and use of AI in healthcare.


Unless otherwise indicated, scholarly articles published by Duke faculty members are made available here with a CC-BY-NC (Creative Commons Attribution Non-Commercial) license, as enabled by the Duke Open Access Policy. If you wish to use the materials in ways not already permitted under CC-BY-NC, please consult the copyright owner. Other materials are made available here through the author’s grant of a non-exclusive license to make their work openly accessible.