urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:	edition	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1	body	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.1	div1	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.1.1	p	Comparative endeavors in Computational Literary Studies typically require corpora which are both diverse, i.e., including texts in different languages and from different sources, and homogenized, i.e., formal and structural consistent. One way to tackle this issue is to establish upstream internal guidelines, such as the ones developed within the ELTeC initiative (Schöch et al. 2021). <ref xmlns="http://www.tei-c.org/ns/1.0" n="1" target="ftn1" /> In the following, we report on our approach to homogenizing corpora for DraCor. <ref xmlns="http://www.tei-c.org/ns/1.0" n="2" target="ftn2" />
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.1.2	p	DraCor, based on the concept of Programmable Corpora (Fischer et al. 2019), is an open platform as well as a growing network for hosting, accessing, and analyzing theater plays. DraCor relies on the general TEI model for dramatic texts, with minimal enhancements, and thus facilitates contributions by external scholars who want to onboard their corpora onto its ecosystem. Once integrated, corpora can benefit from the platform’s APIs and services, ranging from the computation of network metrics via various extraction functions to SPARQL queries.
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.1.3	p	Typically, corpora for DraCor are not built from scratch, but are created either by aggregating formally heterogeneous texts from different sources or by transforming existing corpora. Unlike in ELTeC, the homogenization of texts for DraCor usually does not stand at the beginning of the corpus creation process, but is rather an intervention in existing corpora which are sometimes subject to amendment and growth, hence ›living‹. This approach poses a number of challenges, for which we are currently prototyping several workflows. Here, we present the pipelines for mounting to DraCor two new corpora: the English-language <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">EarlyPrint Drama Corpus</hi> (EPDraCor) and the <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">Ukrainian Drama Corpus</hi> (UDraCor). <ref xmlns="http://www.tei-c.org/ns/1.0" n="3" target="ftn3" />
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.2	div1	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.2.1	p	From a technical point of view, onboarding corpora onto DraCor is a series of automated and manual transformations of the source data, which depend crucially on the format and markup of the files. Texts from a single, homogeneous collection with pre-existing markup and metadata will require different workflows and pipelines than those coming, for example, from a variety of raw text sources.
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.2.2	p	This heterogeneous point of departure is what shapes our onboarding approach. Consequently, we are developing a modular workflow made up of a set of demand-dependent components. In addition to guideline-based manual revisions (e.g. pre-structuring texts with Markdown), we use XSLT scripts for automated transformations. Edits specific to theater plays, such as the task of speaker identification, are supported by an Oxygen framework; <ref xmlns="http://www.tei-c.org/ns/1.0" n="4" target="ftn4" /> we are furthermore experimenting with task-specific GUI applications based on react.js. <ref xmlns="http://www.tei-c.org/ns/1.0" n="5" target="ftn5" /> The correction and enrichment of metadata, such as the addition of Wikidata ID, is organized semi-automatically via OpenRefine.
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.2.3	p	A particular challenge is posed by living corpora. Here, the manual transformations performed during onboarding should be reapplicable in case of edits to the source data. Accordingly, we implemented routines for a ›backward compatibility‹ of the markup: the changes made by us during onboarding can later be applied again to a newer version of the source files. <ref xmlns="http://www.tei-c.org/ns/1.0" n="6" target="ftn6" />
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.3	div1	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.3.1	p	To develop our workflows and pipelines, two corpora with very different requirements are currently in the process of onboarding. While UDraCor originates from a growing collection of heterogeneous sources, EPDraCor is based on semantically rich TEI files from the Early Print project. <ref xmlns="http://www.tei-c.org/ns/1.0" n="7" target="ftn7" /> The onboarding of EPDraCor starts with enhancing and correcting the original markup in our copy of the source corpus, accompanied by collecting LOD metadata from additional sources. Then, we combine the enhanced sources with their metadata and use XSLT to transform them, so that the TEI fulfills the requirements of the DraCor platform.
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:1.3.2	p	Due to the heterogeneity of the sources, a more case-specific solution must be found for UDraCor in this initial step. Here, the conversion is a semi-automatic procedure with heavy use of string patterns and regex. At the same time, UDraCor takes a community-based corpus-building approach by inviting scholars specializing in Ukrainian studies to work on both technical and content-related tasks. This work on UDraCor once again shows how the technical task of corpus building and community activities are crucially intertwined.
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:2	back	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:2.1	notes	<note xmlns="http://www.tei-c.org/ns/1.0" rend="footnote text" xml:id="ftn1" n="1"> See <ref target="https://distantreading.github.io/ELTeC">https://distantreading.github.io/ELTeC</ref> and <ref target="https://distantreading.github.io/Schema/eltec-1.html">https://distantreading.github.io/Schema/eltec-1.html</ref>. </note><note xmlns="http://www.tei-c.org/ns/1.0" rend="footnote text" xml:id="ftn2" n="2"> <ref target="https://dracor.org">https://dracor.org</ref>. In the context of CLS INFRA ( <ref target="https://clsinfra.io">https://clsinfra.io</ref>), DraCor has received funding from the European Union's Horizon 2020 program (grant agreement No. 101004984). </note><note xmlns="http://www.tei-c.org/ns/1.0" rend="footnote text" xml:id="ftn3" n="3"> Both corpora are still a work in progress. For review, the two corpora can (as public alpha) be accessed in the corresponding GitHub repositories <ref target="https://github.com/dracor-org/epdracor">https://github.com/dracor-org/epdracor</ref> and <ref target="https://github.com/dracor-org/udracor">https://github.com/dracor-org/udracor</ref>. Both corpora will be published as public beta in the context of DHd2023. </note><note xmlns="http://www.tei-c.org/ns/1.0" rend="footnote text" xml:id="ftn4" n="4"> <ref target="https://github.com/dracor-org/dracor-oxygen-framework">https://github.com/dracor-org/dracor-oxygen-framework</ref>. </note><note xmlns="http://www.tei-c.org/ns/1.0" rend="footnote text" xml:id="ftn5" n="5"> See e.g. our prototype of a Who-Is-Identification-Tool <ref target="https://github.com/dracor-org/epdracor-whois">https://github.com/dracor-org/epdracor-whois</ref> and its interface <ref target="https://dracor-org.github.io/epdracor-whois">https://dracor-org.github.io/epdracor-whois</ref>. </note><note xmlns="http://www.tei-c.org/ns/1.0" rend="footnote text" xml:id="ftn6" n="6"> For this, see our prototype script in the EPDraCor repository: <ref target="https://github.com/dracor-org/epdracor">https://github.com/dracor-org/epdracor</ref>. </note><note xmlns="http://www.tei-c.org/ns/1.0" rend="footnote text" xml:id="ftn7" n="7"> <ref target="https://earlyprint.org">https://earlyprint.org</ref>. </note>
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:2.2	bibliogr	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:2.2.1	listBibl	
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:2.2.1.1	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">Fischer, Frank, Ingo Börner, Mathias Göbel, Angelika Hechtl, Christopher Kittel, Carsten Milling, and Peer Trilcke</hi>. 2019. “Programmable Corpora: Introducing DraCor, an Infrastructure for the Research on European Drama”. In <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">Proceedings of DH2019: "Complexities"</hi>. Utrecht: Utrecht University. <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://doi.org/10.5281/zenodo.4284002">https://doi.org/10.5281/zenodo.4284002</ref>.
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:2.2.1.2	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">Mueller, Martin, and Joseph Loewenstein</hi> (eds.). n.d. “Early Print Library”. Accessed August 3, 2022. <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://earlyprint.org">https://earlyprint.org</ref>.
urn:cts:dhd:2023.giovannini_luca_onboard_onto_dracor:2.2.1.3	bibl	<hi xmlns="http://www.tei-c.org/ns/1.0" rend="bold">Schöch, Christof, Roxana Patraș, Diana Santos, and Tomaž Erjavec</hi>. 2021. "Creating the European Literary Text Collection (ELTeC): Challenges and Perspectives". <hi xmlns="http://www.tei-c.org/ns/1.0" rend="italic">Modern Languages Open</hi> 1: 25. <ref xmlns="http://www.tei-c.org/ns/1.0" target="https://doi.org/10.3828/mlo.v0i0.364">https://doi.org/10.3828/mlo.v0i0.364</ref>.