The Unicode cookbook for linguists Managing writing systems using orthography profiles

This text is a practical guide for linguists, and programmers, who work with data in multilingual computational environments. We introduce the basic concepts needed to understand how writing systems and character encodings function, and how they work together at the intersection between the Unicode...

Volledige beschrijving

Bewaard in:
Bibliografische gegevens
Hoofdauteur: Moran, Steven (auth)
Andere auteurs: Cysouw, Michael (auth)
Formaat: Elektronisch Hoofdstuk
Taal:Engels
Gepubliceerd in: Berlin Language Science Press 2018
Reeks:Translation and Multilingual Natural Language Processing
Onderwerpen:
Online toegang:DOAB: download the publication
DOAB: description of the publication
Tags: Voeg label toe
Geen labels, Wees de eerste die dit record labelt!

MARC

LEADER 00000naaaa2200000uu 4500
001 doab_20_500_12854_34976
005 20210210
003 oapen
006 m o d
007 cr|mn|---annan
008 20210210s2018 xx |||||o ||| 0|eng d
020 |a zenodo.1296780 
020 |a 9783961100903 
040 |a oapen  |c oapen 
024 7 |a 10.5281/zenodo.1296780  |c doi 
041 0 |a eng 
042 |a dc 
100 1 |a Moran, Steven  |4 auth 
700 1 |a Cysouw, Michael  |4 auth 
245 1 0 |a The Unicode cookbook for linguists  |b Managing writing systems using orthography profiles 
260 |a Berlin  |b Language Science Press  |c 2018 
336 |a text  |b txt  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
490 1 |a Translation and Multilingual Natural Language Processing 
506 0 |a Open Access  |2 star  |f Unrestricted online access 
520 |a This text is a practical guide for linguists, and programmers, who work with data in multilingual computational environments. We introduce the basic concepts needed to understand how writing systems and character encodings function, and how they work together at the intersection between the Unicode Standard and the International Phonetic Alphabet. Although these standards are often met with frustration by users, they nevertheless provide language researchers and programmers with a consistent computational architecture needed to process, publish and analyze lexical data from the world's languages. Thus we bring to light common, but not always transparent, pitfalls which researchers face when working with Unicode and IPA. Having identified and overcome these pitfalls involved in making writing systems and character encodings syntactically and semantically interoperable (to the extent that they can be), we created a suite of open-source Python and R tools to work with languages using orthography profiles that describe author- or document-specific orthographic conventions. In this cookbook we describe a formal specification of orthography profiles and provide recipes using open source tools to show how users can segment text, analyze it, identify errors, and to transform it into different written forms for comparative linguistics research. 
536 |a Knowledge Unlatched 
540 |a Creative Commons  |f https://creativecommons.org/licenses/by/4.0/legalcode  |2 cc  |4 https://creativecommons.org/licenses/by/4.0/legalcode 
546 |a English 
653 |a Linguistics 
856 4 0 |a www.oapen.org  |u https://library.oapen.org/bitstream/20.500.12657/28277/1/1001685.pdf  |7 0  |z DOAB: download the publication 
856 4 0 |a www.oapen.org  |u https://library.oapen.org/bitstream/20.500.12657/28277/1/1001685.pdf  |7 0  |z DOAB: download the publication 
856 4 0 |a www.oapen.org  |u https://library.oapen.org/bitstream/20.500.12657/28277/1/1001685.pdf  |7 0  |z DOAB: download the publication 
856 4 0 |a www.oapen.org  |u https://directory.doabooks.org/handle/20.500.12854/34976  |7 0  |z DOAB: description of the publication