Falaah Arif Khan

PhD Candidate – fa2161 (at) nyu.edu – Personal Website

ian

Falaah is a Data Science PhD student working with Prof Julia Stoyanovich on the ‘fairness’ and ’stability’ of algorithmic systems. An engineer by training and an artist by nature, Falaah also creates scientific comic books to bridge together scholarship from different disciplines, and to disseminate the nuances of her research in a way that is more accessible to the general public. Falaah holds an undergraduate degree in Electronics and Communication Engineering, with a minor in Mathematics from Shiv Nadar University, India, and has industry experience in building machine learning models for access management and security at Dell EMC.

Selected publications

Still More Shades of Null: A Benchmark for Responsible Missing Value Imputation

Falaah Arif Khan, Denys Herasymuk, Nazar Protsiv, and Julia Stoyanovich

CoRR 2024

Cite PDF Github

@article{khan2024shadesnullbenchmarkresponsible,
  title = {Still More Shades of Null: A Benchmark for Responsible Missing Value Imputation},
  author = {Khan, Falaah Arif and Herasymuk, Denys and Protsiv, Nazar and Stoyanovich, Julia},
  year = {2024},
  journal = {CoRR},
  volume = {abs/2409.07510},
  archiveprefix = {arXiv},
  primaryclass = {cs.AI},
  doi = {10.48550/arXiv.2409.07510},
  eprinttype = {arXiv},
  eprint = {2409.07510},
  keywords = {working,RAIforUkraine,data}
}

Responsible Model Selection with Virny and VirnyView

Denys Herasymuk, Falaah Arif Khan, and Julia Stoyanovich

In Companion of the International Conference on Management of Data, SIGMOD/PODS, Santiago, Chile 2024

Cite PDF Github

@inproceedings{DBLP:conf/sigmod/HerasymukKS24,
  author = {Herasymuk, Denys and Khan, Falaah Arif and Stoyanovich, Julia},
  editor = {Barcel{\'{o}}, Pablo and Pi, Nayat S{\'{a}}nchez and Meliou, Alexandra and Sudarshan, S.},
  title = {Responsible Model Selection with Virny and VirnyView},
  booktitle = {Companion of the International Conference on Management of Data,
                    {SIGMOD/PODS}, Santiago, Chile},
  pages = {488--491},
  publisher = {{ACM}},
  year = {2024},
  url = {https://doi.org/10.1145/3626246.3654738},
  doi = {10.1145/3626246.3654738},
  keywords = {conference,demo,RAIforUkraine,data},
  author+an = {1=self;2=self;3=self}
}

Subset Modelling: A Domain Partitioning Strategy for Data-efficient Machine-Learning

Vı́tor Ribeiro, Eduardo H. M. Pena, Raphael Freitas Saldanha, Reza Akbarinia, Patrick Valduriez, Falaah Arif Khan, Julia Stoyanovich, and Fábio Porto

In Proceedings of the 38th Brazilian Symposium on Databases, SBBD 2023, Belo Horizonte, MG, Brazil, September 25-29, 2023 2023

@inproceedings{DBLP:conf/sbbd/RibeiroPSAVKS023,
  author = {Ribeiro, V{\'{\i}}tor and Pena, Eduardo H. M. and de Freitas Saldanha, Raphael and Akbarinia, Reza and Valduriez, Patrick and {Arif Khan}, Falaah and Stoyanovich, Julia and Porto, F{\'{a}}bio},
  title = {Subset Modelling: {A} Domain Partitioning Strategy for Data-efficient
                    Machine-Learning},
  booktitle = {Proceedings of the 38th Brazilian Symposium on Databases, {SBBD} 2023,
                    Belo Horizonte, MG, Brazil, September 25-29, 2023},
  pages = {318--323},
  publisher = {{SBC}},
  year = {2023},
  timestamp = {Wed, 25 Oct 2023 16:14:33 +0200},
  biburl = {https://dblp.org/rec/conf/sbbd/RibeiroPSAVKS023.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  keywords = {conference,data},
}

Automated Data Cleaning Can Hurt Fairness in Machine Learning-based Decision Making

Shubha Guha, Falaah Arif Khan, Julia Stoyanovich, and Sebastian Schelter

In Proceedings of the 39th International Conference on Data Engineering, ICDE 2023

@inproceedings{guha_23,
  author = {Guha, Shubha and Khan, Falaah Arif and Stoyanovich, Julia and Schelter, Sebastian},
  year = {2023},
  title = {Automated Data Cleaning Can Hurt Fairness in Machine Learning-based Decision Making},
  keywords = {conference,data,fair},
  booktitle = {Proceedings of the 39th International Conference on Data Engineering, {ICDE}},
}

The Unbearable Weight of Massive Privilege: Revisiting Bias-Variance Trade-Offs in the Context of Fair Prediction

Falaah Arif Khan, and Julia Stoyanovich

CoRR 2023

@article{DBLP:journals/corr/abs-2302-08704,
  author = {Khan, Falaah Arif and Stoyanovich, Julia},
  title = {The Unbearable Weight of Massive Privilege: Revisiting Bias-Variance
                    Trade-Offs in the Context of Fair Prediction},
  journal = {CoRR},
  volume = {abs/2302.08704},
  year = {2023},
  doi = {10.48550/arXiv.2302.08704},
  eprinttype = {arXiv},
  eprint = {2302.08704},
  keywords = {working,fairness,stability},
}

An Interactive Introduction to Causal Inference

Lucius E.J. Bynum, Falaah Arif Khan, Oleksandra Konopatska, Joshua R. Loftus, and Julia Stoyanovich

VISxAI: Workshop on Visualization for AI Explainability 2022

Cite online resource

@article{bynum2022interactive,
  author = {Bynum, Lucius E.J. and Khan, Falaah Arif and Konopatska, Oleksandra and Loftus, Joshua R. and Stoyanovich, Julia},
  title = {An Interactive Introduction to Causal Inference},
  journal = {VISxAI: Workshop on Visualization for AI Explainability},
  year = {2022},
  site = {https://r-ai.co/ci-playground},
  publisher = {IEEE},
  keywords = {workshop,education,playground,RAIforUkraine},
}

Translational Tutorial: Fairness and Friends

Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich

In 4th Annual Conference on Fairness, Accountability, and Transparency, ACM FAccT 2021

All Aboard! Making AI Education Accessible

Falaah Arif Khan, Lucius Bynum, Amy Hurst, Lucas Rosenblatt, Meghana Shanbhogue, Mona Sloane, and Julia Stoyanovich

Center for Responsible AI, New York University 2023

@article{AllAboard,
  author = {{Arif Khan}, Falaah and Bynum, Lucius and Hurst, Amy and Rosenblatt, Lucas and Shanbhogue, Meghana and Sloane, Mona and Stoyanovich, Julia},
  title = {{All Aboard! Making AI Education Accessible}},
  journal = {Center for Responsible AI, New York University},
  keywords = {panel,education,weareai},
  year = {2023},
}

What is AI?

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol1,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {What is AI?},
  journal = {We are AI Comic Series},
  volume = {1},
  year = {2021},
  keywords = {public,education,comics,english},
}

What is AI? (Spanish Edition)

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol1_sp,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {What is AI? (Spanish Edition)},
  journal = {We are AI Comic Series},
  volume = {1},
  year = {2021},
  keywords = {public,education,comics,spanish},
}

What is AI? (Ukrainian Edition)

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol1_uk,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {What is AI? (Ukrainian Edition)},
  journal = {We are AI Comic Series},
  volume = {1},
  year = {2021},
  keywords = {public,education,comics,other},
}

Learning from Data (Ukrainian Edition)

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol2_uk,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {Learning from Data (Ukrainian Edition)},
  journal = {We are AI Comic Series},
  volume = {2},
  year = {2021},
  keywords = {public,education,comics,other},
}

What is AI? (Greek Edition)

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol1_gr,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {What is AI? (Greek Edition)},
  journal = {We are AI Comic Series},
  volume = {1},
  year = {2021},
  keywords = {public,education,comics,other},
}

Learning from data

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol2,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {Learning from data},
  journal = {We are AI Comic Series},
  volume = {2},
  year = {2021},
  keywords = {public,education,comics,english},
}

Learning from data (Spanish Edition)

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol2_sp,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {Learning from data (Spanish Edition)},
  journal = {We are AI Comic Series},
  volume = {2},
  year = {2021},
  keywords = {public,education,comics,spanish},
}

Who lives, who dies, who decides?

Julia Stoyanovich, Mona Sloane, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol3,
  author = {Stoyanovich, Julia and Sloane, Mona and Khan, Falaah Arif},
  title = {Who lives, who dies, who decides?},
  journal = {We are AI Comic Series},
  volume = {3},
  year = {2021},
  keywords = {public,education,comics,english},
}

Who lives, who dies, who decides? (Spanish Edition)

Julia Stoyanovich, Mona Sloane, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol3_sp,
  author = {Stoyanovich, Julia and Sloane, Mona and Khan, Falaah Arif},
  title = {Who lives, who dies, who decides? (Spanish Edition)},
  journal = {We are AI Comic Series},
  volume = {3},
  year = {2021},
  keywords = {public,education,comics,spanish},
}

All about that bias

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol4,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {All about that bias},
  journal = {We are AI Comic Series},
  volume = {4},
  year = {2021},
  keywords = {public,education,comics,english}
}

All about that bias (Spanish Edition

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol4_sp,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {All about that bias (Spanish Edition},
  journal = {We are AI Comic Series},
  volume = {4},
  year = {2021},
  keywords = {public,education,comics,spanish}
}

We are AI

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol5,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {We are AI},
  journal = {We are AI Comic Series},
  volume = {5},
  year = {2021},
  keywords = {public,education,comics,english},
}

We are AI

Julia Stoyanovich, and Falaah Arif Khan

We are AI Comic Series 2021

@article{weareaicomic_vol5_sp,
  author = {Stoyanovich, Julia and Khan, Falaah Arif},
  title = {We are AI},
  journal = {We are AI Comic Series},
  volume = {5},
  year = {2021},
  keywords = {public,education,comics,english},
}

Mirror, Mirror

Falaah Arif Khan, and Julia Stoyanovich

Data, Responsibly Comic Series 2020

@article{rdscomic_vol1,
  author = {Khan, Falaah Arif and Stoyanovich, Julia},
  title = {Mirror, Mirror},
  journal = {Data, Responsibly Comic Series},
  volume = {1},
  year = {2020},
  keywords = {public,edu,comics,english},
}

Mirror, Mirror (French Edition)

Falaah Arif Khan, and Julia Stoyanovich

Data, Responsibly Comic Series 2020

@article{rdscomic_vol1_fr,
  author = {Khan, Falaah Arif and Stoyanovich, Julia},
  title = {Mirror, Mirror (French Edition)},
  journal = {Data, Responsibly Comic Series},
  volume = {1},
  year = {2020},
  keywords = {public,edu,comics,other},
}

Mirror, Mirror (Spanish Edition)

Falaah Arif Khan, and Julia Stoyanovich

Data, Responsibly Comic Series 2020

@article{rdscomic_vol1_sp,
  author = {Khan, Falaah Arif and Stoyanovich, Julia},
  title = {Mirror, Mirror (Spanish Edition)},
  journal = {Data, Responsibly Comic Series},
  volume = {1},
  year = {2020},
  keywords = {public,edu,comics,spanish},
}

Mirror, Mirror (Portugueze Edition)

Falaah Arif Khan, and Julia Stoyanovich

Data, Responsibly Comic Series 2020

@article{rdscomic_vol1_br,
  author = {Khan, Falaah Arif and Stoyanovich, Julia},
  title = {Mirror, Mirror (Portugueze Edition)},
  journal = {Data, Responsibly Comic Series},
  volume = {1},
  year = {2020},
  keywords = {public,edu,comics,other},
}

Fairness and Friends

Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich

Data, Responsibly Comic Series 2021

@article{rdscomic_Vol2,
  author = {Khan, Falaah Arif and Manis, Eleni and Stoyanovich, Julia},
  title = {Fairness and Friends},
  journal = {Data, Responsibly Comic Series},
  volume = {2},
  year = {2021},
  keywords = {public,edu,comics,english},
}

Towards Substantive Conceptions of Algorithmic Fairness: Normative Guidance from Equal Opportunity Doctrines

Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich

In Equity and Access in Algorithms, Mechanisms, and Optimization, EAAMO 2022, Arlington, VA, USA, October 6-9, 2022 2022

PDF

An External Stability Audit Framework to Test the Validity of Personality Prediction in AI Hiring

Alene K. Rhea, Kelsey Markey, Lauren D’Arinzo, Hilke Schellmann, Mona Sloane, Paul Squires, Falaah Arif Khan, and Julia Stoyanovich

Data Mining and Knowledge Discovery, Special Issue on Bias and Fairness in AI 2022

@article{hiringaudit_journal,
  author = {Rhea, Alene K. and Markey, Kelsey and D'Arinzo, Lauren and Schellmann, Hilke and Sloane, Mona and Squires, Paul and {Arif Khan}, Falaah and Stoyanovich, Julia},
  title = {An External Stability Audit Framework to Test the Validity of Personality Prediction in AI Hiring},
  year = {2022},
  journal = {Data Mining and Knowledge Discovery, Special Issue on Bias and Fairness in AI},
  keywords = {journal,stab,audit,hiring},
}

Towards Substantive Conceptions of Algorithmic Fairness: Normative Guidance from Equal Opportunity Doctrines

Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich

In Equity and Access in Algorithms, Mechanisms, and Optimization, EAAMO 2022, Arlington, VA, USA, October 6-9, 2022 2022

@inproceedings{DBLP:conf/eaamo/ArifKhanMS22,
  author = {{Arif Khan}, Falaah and Manis, Eleni and Stoyanovich, Julia},
  title = {Towards Substantive Conceptions of Algorithmic Fairness: Normative
                    Guidance from Equal Opportunity Doctrines},
  booktitle = {Equity and Access in Algorithms, Mechanisms, and Optimization, {EAAMO}
                    2022, Arlington, VA, USA, October 6-9, 2022},
  pages = {18:1--18:10},
  publisher = {{ACM}},
  year = {2022},
  url = {https://doi.org/10.1145/3551624.3555303},
  doi = {10.1145/3551624.3555303},
  keywords = {conference, fairness},
}

On Fairness and Stability: Is Estimator Variance a Friend or a Foe?

Falaah Arif Khan, Denys Herasymuk, and Julia Stoyanovich

CoRR 2023

@article{DBLP:journals/corr/abs-2302-04525,
  author = {Khan, Falaah Arif and Herasymuk, Denys and Stoyanovich, Julia},
  title = {On Fairness and Stability: Is Estimator Variance a Friend or a Foe?},
  journal = {CoRR},
  volume = {abs/2302.04525},
  year = {2023},
  doi = {10.48550/arXiv.2302.04525},
  eprinttype = {arXiv},
  eprint = {2302.04525},
  keywords = {working,fairness,stability,RAIforUkraine},
}