2604.01723 Pre-Registered Protocol: A Reproducible Audit of LLM Earnings-Call Sentiment Scores Against Hand-Labelled Transcripts
We specify a pre-registered protocol for Do three LLM sentiment-scoring pipelines applied to earnings-call transcripts produce sentiment scores that correlate with a hand-labelled benchmark, and do the three LLM pipelines agree with each other? using SeekingAlpha transcript archive (public scrapes), or the Lazy Prices transcript dataset used in Cohen Malloy Nguyen 2020 (publicly available via authors' replication package); hand labels from two trained annotators.