From: Stance and influence of Twitter users regarding the Brexit referendum
Annotator agreement | Stance classifier | |
---|---|---|
No. of testing examples | 6807 | 37, 048 |
Alpha | \( 67.7\% \) | \( 45.8\% \) |
\(\overline{F_{1}}(-,+)\) | \( 74.6\% \) | \( 60.3\% \) |
\({Accuracy}\) | \( 77.2\% \) | \( 59.5\% \) |
\({Accuracy}\!\pm \!1\) (\(-,+\)) | \( 96.0\% \) | \( 90.5\% \) |