About

I study the social structure of science from both normative and descriptive perspectives.

On the normative side, I have contributed new conceptual tools and norms for science. My conceptual work on peer review bias has motivated changes to peer review processes at AI conferences, including the development of a new algorithm to measure and detect commensuration bias (see Shah 2022, Noothigattu, Shah, and Procaccia 2021). Most recently, I have proposed an epistemology for AI tools used to evaluate science (Lee 2026).

On the empirical side, I have worked with funding institutions to study equity in grant review and funding, including Black-white disparities in National Institutes of Health R01 grants and gender disparities in Doris Duke Charitable Foundation Clinical Scientist Development Awards. I have also studied gender homophily in co-authorship across the JSTOR corpus.

My research has been published in venues across fields (e.g., Science, The Lancet, Philosophy of Science) and funded by the National Science Foundation, the National Institutes of Health, and a Career Enhancement Fellowship (funded by the Mellon Foundation and administered by the Institute for Citizens & Scholars).

I'm honored to have received the Philosophy of Science Association's Prize in Philosophy of Science & Race as well as (with Elena Erosheva) First Prize for most creative submission to NIH's Peer Review Challenge.

I'm a Director at Rapid Science and previously served as an Advisory Board member for the Transparency and Openness Promotion (TOP) Guidelines and ASAPbio.

At the University of Washington, I'm a member of the AI Governance Committee and served on the Steering Committee for the UW Faculty 2050 Report. I'm Affiliate Faculty with the Center for an Informed Public, eScience Institute, Society + Technology Program, Center for Statistics and the Social Sciences, and Center for Studies in Demography and Ecology.

Recent

  • Invited workshop participant, “AI for Science Evaluation,” Princeton University, Princeton, NJ (November 5–6).
  • “Critically Engaged Pragmatism” on AI science evaluation tools is out in Social Epistemology. Read
    An abridged version has been accepted to the NeurIPS 2026 Workshop on AI & Science: Evolution or Extinction.
  • TOP 2025, the update to the Transparency and Openness Promotion Guidelines, published in Research Integrity and Peer Review. Read
  • “Causal Decomposition of Black-White Disparities in NIH Proposal Discussion Selection,” with S. Prakash and E. A. Erosheva, accepted at PLOS ONE.

Research

Areas of Research

AI & the evaluation of science

A social, pragmatist epistemology for AI tools used to evaluate scientific research.

Key: Critically Engaged Pragmatism (Lee 2026)

New conceptual tools & norms for science

New concepts, norms, and taxonomies for understanding and/or improving scientific evaluation.

Key: Critically Engaged Pragmatism (Lee 2026) · Certified amplification (Lee 2022) · Reference class problem for credit valuation (Lee 2020) · Commensuration bias (Lee 2015) · Bias in peer review (Lee et al. 2013)

Peer review scoring

How to interpret and restructure peer review scoring.

Key: Score, then rank (Gallo et al. 2023) · Refinement (Grant et al. 2022) · When zero may not be zero (Erosheva et al. 2021) · Alternative grant models (Lee et al. 2020) · Commensuration bias (Lee 2015) · A Kuhnian critique (Lee 2012)

Equity in peer review

Racial and gender disparities in grant review and funding, bias in journal peer review, gender homophily in co-authorship choices.

Key: Gender homophily (Wang et al. 2023) · What is metascience? Part 2 (Lee 2021) · NIH criterion scores (Erosheva et al. 2020) · Alternative grant models (Lee et al. 2020) · Promoting gender equity in grant making (Escobar-Alvarez et al. 2019) · Bias in peer review (Lee et al. 2013) · Philosophy journal practices (Lee and Schunn 2010)

Open Science

Policies that make research more open and accountable, including reporting guidelines and opening up journal peer review data.

Key: TOP 2025 (Grant et al. 2026) · TOP statement (Aalbersberg et al. 2018) · Peer review data for scientific integrity (Lee and Moher 2017) · Limited effectiveness of prestige (Lee 2013)

Publications

Selected writing

    Teaching

    Courses

    Undergraduate

    • PHIL 115Practical Reasoning
    • PHIL 462The Social Structure of Science
    • PHIL 464Philosophy of Cognitive Science

    Graduate

    • PHIL 550Epistemology
    • PHIL 560Philosophy of Science
    • PHIL 562Social Structure of Science
    • PHIL 564Philosophy of Cognitive Science
    • PHIL 566Philosophy of Social Science

    Dissertation advising (chair)

    • Darcy McCusker, The Mismeasure of Woman: The Epistemic and Social Impacts of Gendered Citation PracticesPh.D., Philosophy, University of Washington, 2021
    • D. Stone Addington, Tower to Agora: Insularity and Philosophical MethodologyPh.D., Philosophy, University of Washington, 2021
    • Sam Sumpter, Constructing and Being Constructed: Relational Trans Identity and Responsibility for MicroaggressionsPh.D., Philosophy, University of Washington, 2020

    CV

    Curriculum Vitae

    View my CV (PDF)