For further evaluation, we chose to annotate a smaller subset of the corpus <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">LB </hi>by hand. We selected 50 snippets from texts of low brow literature. This dataset, referred to as <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">ALB</hi>, is relatively skewed towards text outside direct speech, with only about 18% of tokens in a direct speech.