urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:	edition	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1	body	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.1	div1	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.1.1	p	creative signs can be observed in literary and non-literary genres. computational linguistics and dh, however, often expect a poetic function of linguistic creativity. they tend to equate it with figurative language (gervás 2010) or “foregrounding”, a deviation from the linguistic norm or an aspect of the text brought to the fore through repetition or parallelism (see (simpson 2014: 50; peer et al. 2021). this conflation limits the concept of creativity to artistic genres. following runco and jaeger (2012), in the presented project we therefore conceptualize the creativity of a sign as its originality and effectiveness across genres.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.1.2	p	using data-driven metrics and models, we operationalize linguistic creativity by disentangling originality at the level of the sign from literariness, defined as “density of specific textual features that create linguistic foregrounding” by appel et al. (2021: 177) and from success at the level of usage, i.e. perception and evaluation by the actors in the discourse domain. this approach considers how readers’ perceptions of creativity depend on genres and their internal conventions and usage patterns (steen et al. 2010).
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.2	div1	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.2.1	p	the overall goal of the project is to explore to what extent linguistic creativity can be measured across textual genres with quantitative methods. previous studies on creativity assessment have shown that this seemingly subjective concept can be measured by objective, text-inherent linguistic features (distefano, patterson, and beaty 2024; jacobs and kinder. 2022; weinstein et al. 2022; zedelius, mills, and schooler 2019). building on lay readers’ creativity assessments of a collection of spatial descriptions obtained from both literary and non-literary texts, we approach creativity from the following perspectives:
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.3	div1	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.3.1	p	at the time of the poster presentation, we will be able to report a first set of findings about linguistic creativity at the sentence-level. we are currently running a set of experts’ annotations of rhetorical devices to determine the degree of potential creativity within our data set (see amabile 1982). in parallel, our piloting of rating studies has provided first methodological insights into how to capture lay readers’ perceptions of creativity, and is currently being expanded to our data set.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.3.2	p	our methodological work tests how conceptions of conventional language use shape assessment of originality (veale 2012: 59). when a text is perceived as literary, linguistic signs appear systematically judged as less original, even though they may have a high level of literariness. this may be a function of exposure to genres, involving predictions from holistic schemas as well as the level of specific forms. consider the following examples from robert walser’s <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic" xml:space="preserve">geschwister tanner </hi>[1907]:
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.3.3	p	(1) <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">unten lag die stadt, weit und wollüstig über die ebene gebreitet, wie ein flimmernder, glitzernder teppich [...]. </hi>
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.3.4	p	(2) <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">stelle dir vor, die luft wird ganz blau und warmfeucht in die straßen hinuntersinken, der himmel geht dann in paris spazieren und mischt sich unter die entzückten menschen.</hi>
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.3.5	p	example (1) constitutes no strong deviation from predicted literariness in literary texts from around 1900. it might be perceived as literary, but not particularly creative—this is very likely to be different in a non-literary context. example (2), however, is more unpredictable even in the literary domain, yet meaningful, and can thus be perceived as creative. to operationalize creativity, we therefore need to disentangle literary style from originality across genres at points in time.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.3.6	p	in the current phase of the project, we finetune measures to compare lay and expert readers’ creativity judgment and correlate them to stylometric features and the surprisal measures of a language model.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.4	div1	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.4.1	p	in this four-year project, next steps will be determined by the correlated measures across genres. creativity assessment will be extended to the full text level, using feature frequencies from distinct style combined with surprisal measures to assess the degree to which a text as a holistic unit is creative and literary.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.4.2	p	presenting our multi-methodological and interdisciplinary approach to measuring linguistic creativity in texts and readers, we hope to engender a fruitful discussion with interested and knowledgeable colleagues.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.5	div1	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:1.5.1	p	this research has been funded by the deutsche forschungsgemeinschaft (dfg, german research foundation) – crc-1646, project number 512393437, project a05.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2	back	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1	bibliogr	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1	listBibl	
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.1	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">amabile, teresa m.</hi> 1982. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>social psychology of creativity: a consensual assessment technique <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">journal of personality and social psychology</hi> 43 (5): 997–1013. https://doi.org/10.1037/0022-3514.43.5.997.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.2	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">anderegg, johannes.</hi> 1995. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>stil und stilbegriff in der neueren literaturwissenschaft <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. in <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">stilfragen</hi>, edited by gerhard stickel, 115–27. de gruyter. https://doi.org/10.1515/9783110622515-007.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.3	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">appel, markus, david hanauer, hans hoeken, kobie van krieken, tobias richter, and josé sanders.</hi> 2021. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>the psychological and social effects of literariness: formal features and paratextual information <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. in <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">handbook of empirical literary studies</hi>, edited by don kuiken and arthur m. jacobs, 177–202. berlin/boston: de gruyter.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.4	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">distefano, paul v., john d. patterson, and roger e. beaty.</hi> 2024. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>automatic scoring of metaphor creativity with large language models <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">creativity research journal</hi>, march. https://doi.org/10.1080/10400419.2024.2326343.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.5	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">gervas, pablo.</hi> 2010. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>engineering linguistic creativity: bird flight and jet planes <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. in <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic" xml:space="preserve">proceedings of the naacl hlt 2010 </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">second workshop on computational approaches to linguistic creativity</hi>, 23–30. los angeles. https://aclanthology.org/w10-0304.pdf.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.6	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">herrmann, berenike, karina van dalen-oskam, and christof schöch.</hi> 2015. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>revisiting style, a key concept in literary studies <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">journal of literary theory</hi> 9 (1): 25–52.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.7	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">humpston, clara s., and matthew r. broome.</hi> 2016. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>perplexity <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. in <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">an experiential approach to psychopathology: what is it like to suffer from mental disorders?</hi>, edited by giovanni stanghellini and massimiliano aragona, 245–64. cham: springer international publishing. https://doi.org/10.1007/978-3-319-29945-7_13.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.8	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">jacobs, arthur m. and annette kinder.</hi> 2022. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>computational analyses of the topics, sentiments, literariness, creativity and beauty of texts in a large corpus of english literature <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”.</hi> arxiv. https://doi.org/10.48550/arxiv.2201.04356.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.9	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">kullback, s., and r. a. leibler.</hi> 1951. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>on information and sufficiency <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">the annals of mathematical statistics</hi> 22 (1): 79–86.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.10	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">martindale, colin, and anne e. martindale.</hi> 1988. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>historical evolution of content of style in nineteenth- and twentieth-century american short stories <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">poetics</hi> 17: 333–55.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.11	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">oh, byung-doh, and william schuler.</hi> 2022. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>entropy- and distance-based predictors from gpt-2 attention patterns predict reading times over and above gpt-2 surprisal <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. arxiv. https://doi.org/10.48550/arxiv.2212.11185.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.12	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">peer, willie van, paul sopčák, davide castiglione, olivia fialho, arthur m. jacobs, and frank hakemulder.</hi> 2021. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>foregrounding <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. in <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">handbook of empirical literary studies</hi>, 145–76. de gruyter. https://doi.org/10.1515/9783110645958-007.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.13	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">runco, mark a., and garret j. jaeger.</hi> 2012. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>the standard definition of creativity <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">creativity research journal</hi> 24 (1): 92–96. https://doi.org/10.1080/10400419.2012.650092.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.14	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">simpson, paul.</hi> 2014. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">stylistics: a resource book for students</hi>. 2nd ed. routledge. https://www.routledge.com/stylistics-a-resource-book-for-students/simpson/p/book/9780415644976.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.15	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">steen, gerard, aletta g. dorst, berenike herrmann, anna a. kaal, tina krennmayr, and trijntje pasma.</hi> 2010. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">a method for linguistic metaphor identification. from mip to mipvu</hi>. vol. 14. converging evidence in language and communication research (celcr). amsterdam/philadelphia: john benjamins publishing company.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.16	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">veale, tony.</hi> 2012. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">exploding the creativity myth: the computational foundations of linguistic creativity</hi>. london: bloomsbury academic.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.17	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">weinstein, theresa j., simon majed ceh, christoph meinel, and mathias benedek.</hi> 2022. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>what’s creative about sentences? a computational approach to assessing creativity in a sentence generation task <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">creativity research journal</hi> 34 (4): 419–30. https://doi.org/10.1080/10400419.2022.2124777.
urn:cts:dhd:2025.sitter_emilie_towards_measuring_linguistic_creativity_in_lit:2.1.1.18	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">zedelius, claire m., caitlin mills, and jonathan w. schooler.</hi> 2019. <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">“</hi>beyond subjective judgments: predicting evaluations of creative writing from computational linguistic features <hi xmlns="http://www.tei-c.org/ns/1.0" style="font-size:10pt">”</hi>. <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">behavior research methods</hi> 51 (2): 879–94. https://doi.org/10.3758/s13428-018-1137-1.