Cosine is Human: The Reproducibility Ceiling of Perceptual Similarity
NeurIPS 2026 · Evaluations and Datasets Track
On the 64,420 non-tie triplets, cosine distance on a frozen self-supervised backbone reaches 74.1% accuracy without training, LoRA fine-tuning reaches 77–79%, and the DreamSim ensemble reaches 80.7%. A split-half reproducibility estimate from the triplet vote counts shows that majority labels reproduce only 70.1% of the time overall.