Computational · Paper · 2026

Sortition Upstream of NTQR

Daniel Ari Friedman

Zenodo

Catalog Row180
Citation KeyFriedman2026SortitionUpstreamNTQR180
Paper FolderAvailable

Overview

Extracted from the local paper documentation when available.

How should you choose the judges, jurors, or reviewers who form a panel — and does that upstream choice change how well you can evaluate them without an answer key? A panel can be selected many ways — by competence, by a representative lottery (sortition), by ideological bloc, or at random — and, separately, its noisy judgments can be evaluated blind: given the agreement/disagreement pattern...

sortitionNTQRunlabeled evaluationexpert panelspeer reviewerror independencestatistical powerpanel formationsynthetic evaluationLLM reviewers

Use Notes

Concise findings and methods pulled from README/SKILL documentation.

Findings / Concepts
  • How should you choose the judges, jurors, or reviewers who form a panel — and does that upstream choice change how well you can evaluate them without an answer key?
  • A panel can be selected many ways — by competence, by a representative lottery (sortition), by ideological bloc, or at random — and, separately, its noisy judgments can be evaluated blind: given the a
Methods / Techniques
  • Software pipeline design
  • Data-driven analysis

Citation

Plain-text citation for quick reuse.

Friedman, Daniel Ari. 2026. Sortition Upstream of NTQR. Zenodo. DOI: 10.5281/zenodo.21083779. URL: https://doi.org/10.5281/zenodo.21083779.

Primary source Documentation Full Text Image Gallery Source repository BibTeX

Related in Computational

Other catalogued works in the same domain.

View all Computational works, software & media →