urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:	edition	
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1	body	
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.1	p	<anchor xmlns="http://www.tei-c.org/ns/1.0" xml:id="id_docs-internal-guid-9f56acc5-7fff-4a6e-05a0-07ec80c9d8ca" />this poster reports on the groundwork for the computational study of evaluative practices in german language book reviews. we trained classifiers for evaluation and sentiment at sentence level on the lobo corpus, comprising ~1.3 million book reviews downloaded from the social reading platform lovelybooks.
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.2	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="">for the two classification tasks, we compared performance of dictionary-based and transfer-learning (tl) based sentiment analysis (sa). to use dictionary-based sa systematically, a repository of twelve open-source german-language sa lexicons was created (see table 1). lexicon formats were uniformed to automatically annotate reviews for sentiment in a processing pipeline. for the tl approaches, we chose bert and fasttext, both of which based on distributional representations of natural language (see devlin et al., 2019; mikolov et al., 2017</hi>) <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">.</hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.3	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> <figure> <head>tab. 1: overview of german-language sentiment dictionaries</head> <graphic url="pictures/b21ba19a61b2c71b0d07415a2b4311aa.png" /> </figure> </hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.4	p	the dictionary-based and tl approaches were evaluated on two manually annotated datasets, working with two annotators: in the first dataset (~21,000 sentences), the annotation task was that of identifying evaluative language (vs. descriptive language); in the second dataset (~13,500 sentences), the task focused on the distinction between positive and negative sentiment. these two classification tasks form the basis for a large-scale analysis of the lobo corpus, which segments reviews into evaluative and descriptive passages, to describe differences in evaluation practices across genres (e.g., romance, science fiction) and ratings (1-5 stars).
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.5	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="">for the creation of the gold standard of task 1 (evaluation classification), manual annotation reliability was evaluated on a subset of 250 reviews (~4,000 sentences). cohen’s </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">kappa</hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">(0.76) indicated a strong agreement between annotators. overall, 66% of the total sentences were annotated as “evaluation”. training an svm classifier on the features generated by the 12 sentiment dictionaries rendered a macro </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">f1</hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">score of 0.75 (see table 2 for details).</hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.6	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> <figure> <head>tab. 2: efficiency of dictionary-based svm on task 1</head> <graphic url="pictures/aacbbb91c514a9932afe8765dbc51672.png" /> </figure> </hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.7	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="">to compare the efficiency of the dictionaries, the same classifier was trained separately with the single dictionaries. fig. 1 shows the results, with affectivenorms as the best-performing dictionary (macro </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">f1 </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">score of 0.67).</hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.8	p	<figure xmlns="http://www.tei-c.org/ns/1.0"> <graphic url="pictures/fdceb3361a5be5c10f1024ce25cb6d0f.png" /> <head>fig. 1: efficiency of single german-language sa dictionaries (task 1)</head> </figure>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.9	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="">yet, by contrast, tl-methods proved substantially more efficient, with macro</hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">f1</hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">scores of 0.83 for fasttext and of 0.89 for bert (results obtained via a 5-fold cross validation, repeated five times to average variance, see table 3 for details on bert).</hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.10	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> <figure> <head>tab. 3: efficiency of bert on task 1</head> <graphic url="pictures/a5e4fb31030e74dadf2fcbf9fd0a9242.png" /> </figure> </hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.11	p	the evaluation procedure was repeated on task 2 (positive vs. negative sentiment). again, inter-annotator agreement was strong for manual annotation of the gold standard (cohen’s kappa = 0.79). annotation percentages are shown by fig. 2 (where the “other” category indicates both mixed feelings and the absence of evaluation).
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.12	p	<figure xmlns="http://www.tei-c.org/ns/1.0"> <graphic url="pictures/d950d46427f136c87d8c87085dbaa50e.png" /> <head>fig. 2: percentages of annotations for task 2</head> </figure>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.13	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="">the dictionary-based svm classifier reached a macro </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">f1</hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">score of 0.64, while the best performance was obtained by sentiart (see fig. 3). efficiency was again higher for fasttext (macro </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">f1 </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">score = 0.72) and best for bert (macro </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">f1</hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> </hi> <hi xmlns="http://www.tei-c.org/ns/1.0" rend="">score = 0.83). however, the learning curve for bert shows how there is still room for improvement, with efficiency not fully reaching a plateau (see fig. 4).</hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.14	p	<figure xmlns="http://www.tei-c.org/ns/1.0"> <graphic url="pictures/33e14784be3beec00ab9fe90a8523774.png" /> <head>fig. 3: efficiency of single german-language sa dictionaries on task 2</head> </figure>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.15	p	<figure xmlns="http://www.tei-c.org/ns/1.0"> <graphic url="pictures/eff835afec5d34aac5e649535a0fcd49.png" /> <head>fig. 4: learning curve (with increasing amount of training material) of bert for task 2</head> </figure>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.16	p	<hi xmlns="http://www.tei-c.org/ns/1.0" rend=""> <figure> <head>tab. 4: overview of results for lexicon-based and tl-based approache</head> <graphic url="pictures/636ae6971af2f159725288924fc664fc.png" /> </figure> </hi>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:1.17	p	our results highlight the higher efficiency of tl-methods (see table 4) and of dictionaries based on vector space models (like sentiart and affectivenorms). they show that computational methods can reliably identify sentiment of book reviews in german. in order to fruitfully use similar methodology to identify types of engagement by reviewers with literature beyond the descriptive/evaluative and positive/negative dichotomies, a useful next step will be to attempt the design of tl-tasks for the identification of more fine-grained evaluative practices. these include the construction of and orientation to particular evaluative scales (e.g. reading pleasure, literary quality) and particular subjects of evaluation (e.g. novels, authors, characters).
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2	back	
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1	bibliogr	
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1	listBibl	
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.1	bibl	<anchor xmlns="http://www.tei-c.org/ns/1.0" xml:id="id_docs-internal-guid-29983a88-7fff-e13a-4495-4ee6266fd339" /> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">clematide, s. and klenner, m.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2010). evaluation and extension of a polarity lexicon for german. s.n. doi:10.5167/uzh-45506. https://www.zora.uzh.ch/id/eprint/45506 (accessed 12 july 2021).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.2	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">devlin, j., chang, m.-w., lee, k. and toutanova, k.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2019). bert: pre-training of deep bidirectional transformers for language understanding. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">arxiv:1810.04805 [cs] </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">http://arxiv.org/abs/1810.04805 (accessed 13 july 2021).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.3	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">hölzer, m., scheytt, n. and kächele, h.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(1992). das „affektive diktionär ulm“ als eine methode der quantitativen vokabularbestimmung. in züll, c. and mohler, p. ph. (eds), </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">textanalyse: anwendungen der computerunterstützten inhaltsanalyse. beiträge zur 1. textpack-anwenderkonferenz</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">. (zuma-publikationen). wiesbaden: vs verlag für sozialwissenschaften, pp. 131–54 doi:10.1007/978-3-322-94229-6_7. https://doi.org/10.1007/978-3-322-94229-6_7 (accessed 12 july 2021).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.4	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">jacobs, a. m.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2019). sentiment analysis for words and fiction characters from the perspective of computational (neuro-)poetics. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">frontiers in robotics and ai</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">, </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">6</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">doi:10.3389/frobt.2019.00053. https://www.frontiersin.org/article/10.3389/frobt.2019.00053/full (accessed 8 september 2019).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.5	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">kanske, p. and kotz, s. a.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2010). leipzig affective norms for german: a reliability study. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">behavior research methods</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">, </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">42</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(4): 987–91 doi:10.3758/brm.42.4.987.</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.6	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">klinger, r., suliya, s. s. and reiter, n.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2016). automatic emotion detection for quantitative literary studies: a case study based on franz kafka’s ‘das schloss’ und ‘amerika’. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">dh2016 book of abstracts</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">. kraków: adho https://dh2016.adho.org/abstracts/318.</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.7	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">köper, m. and schulte im walde, s.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2016). automatically generated affective norms of abstractness, arousal, imageability and valence for 350 000 german lemmas. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">proceedings of the tenth international conference on language resources and evaluation (lrec’16)</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">. portorož, slovenia: european language resources association (elra), pp. 2595–98 https://aclanthology.org/l16-1413 (accessed 12 july 2021).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.8	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">mikolov, t., grave, e., bojanowski, p., puhrsch, c. and joulin, a.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2017). advances in pre-training distributed word representations. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">arxiv:1712.09405 [cs] </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">http://arxiv.org/abs/1712.09405 (accessed 13 july 2021).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.9	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">mohammad, s. m. and turney, p. d.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2013). crowdsourcing a word-emotion association lexicon. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">computational intelligence</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">, </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">29</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(3): 436–65 doi:10.1111/j.1467-8640.2012.00460.x.</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.10	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">remus, r., quasthoff, u. and heyer, g.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2010). sentiws - a publicly available german-language resource for sentiment analysis. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">proceedings of the seventh international conference on language resources and evaluation (lrec’10)</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">. valletta, malta: european language resources association (elra) http://www.lrec-conf.org/proceedings/lrec2010/pdf/490_paper.pdf (accessed 12 july 2021).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.11	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">ruppenhofer, j., steiner, p. and wiegand, m.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2017). evaluating the morphological compositionality of polarity. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">ranlp 2017 - recent advances in natural language processing meet deep learning</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">. incoma ltd. shoumen, bulgaria, pp. 625–33 doi:10.26615/978-954-452-049-6_081. http://www.acl-bg.org/proceedings/2017/ranlp%202017/pdf/ranlp081.pdf (accessed 12 july 2021).</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.12	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">stamm, n.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2014). klassifikation und analyse von emotionswörtern in tweets für die sentimentanalyse.</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.13	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">võ, m. l. h., conrad, m., kuchinke, l., urton, k., hofmann, m. j. and jacobs, a. m.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2009). the berlin affective word list reloaded (bawl-r). </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">behavior research methods</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">, </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">41</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2): 534–38 doi:10.3758/brm.41.2.534.</hi> </ref>
urn:cts:dhd:2022.rebora_simone_towards_a_computational_study_of_german_book_r:2.1.1.14	bibl	<ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="bold">waltinger, u.</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend=""> </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">(2010). germanpolarityclues: a lexical resource for german sentiment analysis. </hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="italic">proceedings of the seventh international conference on language resources and evaluation (lrec’10)</hi> </ref> <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://www.zotero.org/google-docs/?hrnxlp"> <hi rend="">. valletta, malta: european language resources association (elra) http://www.lrec-conf.org/proceedings/lrec2010/pdf/91_paper.pdf (accessed 12 july 2021).</hi> </ref>