Algorithms for abstention, calibration and domain adaptation to label shift.

A decision-safety lab for loan approval: trains a baseline classifier, calibrates probabilities (ECE/Brier), sweeps confidence thresholds to build a coverage, quality frontier and outputs a defensible abstention policy (auto-decide vs review). Includes a Streamlit dashboard for report cards, triage UI, and data quality checks.

A practical framework for turning data analysis into decision policies you can defend. Covers risk modeling, thresholding, exception handling, policy cards, monitoring, and update triggers, using real patterns like abstention rules, reorder points, and fairness-aware benchmarking. Built for “ship it” data science.

Decision-safe evaluation + Streamlit dashboard for AI vs Human vs Post-Edited AI text detection. Generates a reliability report card (Accuracy, Macro F1, ECE, Brier), calibration plots, confidence histograms, and a coverage-vs-performance abstention curve. Recommends an operating threshold for human-review routing.

Longform article reframing abstention (reject option / selective prediction) as product design, not model weakness. Covers coverage as a KPI, calibration as a prerequisite, threshold selection under review capacity and risk, queue/UX design for human-in-the-loop workflows, and anti-patterns that break safety in production.

We show that a model owner can artificially introduce uncertainty into their model and provide a corresponding detection mechanism.

Data visualization site on abstention from legislative elections in France

Transform enrichment outputs into verifiable pathway claims via stability distillation, evidence modules, and mechanical PASS/ABSTAIN/FAIL audits.

Code for our paper analyzing the looseness of the upper bound on selective classification performance.