The effect of threshold tuning on F1

At threshold 0.50 After threshold tuning
F1 before and after threshold tuning
ModelAt threshold 0.50After tuning (held-out)

* A few F1 scores fell slightly after tuning. We chose thresholds on a set of examples held out for tuning and measured performance on the remainder, so tuning doesn't guarantee improvement.