This volume grew out of the workshop Writing Language, held at the Max Planck Institute, Nijmegen. The papers represent several lines of research into the intricate relation between writing and spoken language: Theoretical and computational linguists discuss the models that explain why orthographies are the way they are and the constraints that hold between writing and speaking a language; researchers in special education deal with the question of how certain aspects of orthography can be learned; and psycholinguists discuss aspects of language processing affected by variation in orthographies.

For millennia humans have used visible marks to communicate information. Modern examples of conventional graphical symbols include written language, and non-linguistic symbol systems such as mathematical symbology or traffic signs. The latter kinds of symbols convey information without reference to language.  This book presents the first systematic study of graphical symbol systems, including a history of graphical symbols from the Paleolithic onwards, a taxonomy of non-linguistic systems – systems that are not tied to spoken language – and a survey of more than 25 such systems. One important feature of many non-linguistic systems is that, as in written language, symbols may be combined into complex “messages� if the information the system represents is itself complex. To illustrate, the author presents an in-depth comparison of two systems that had very similar functions, but very different structure: European heraldry and Japanese kamon.  Writing first appeared in Mesopotamia about 5,000 years ago and is believed to have evolved from a previous non-linguistic accounting system. The exact mechanism is unknown, but crucial was the discovery that symbols can represent the sounds of words, not just the meanings. The book presents a novel neurologically-inspired hypothesis that writing evolved in an institutional context in which symbols were “dictated�, thus driving an association between symbol and sound, and provides a computational simulation to support this hypothesis. The author further discusses some common fallacies about writing and non-linguistic systems, and how these relate to widely cited claims about statistical “evidence� for one or another system being writing. The book ends with some thoughts about the future of graphical symbol systems.  The intended audience includes students, researchers, lecturers, professionals and scientists from fields like Natural Language Processing, Machine Learning, Archaeology and Semiotics, as well as general readers interested in language and/or writing systems and symbol systems.

Multilingual Text-to-Speech Synthesis: The Bell Labs Approach is the first monograph-length description of the Bell Labs work on multilingual text-to-speech synthesis. Every important aspect of the system is described, including text analysis, segmental timing, intonation and synthesis. There is also a discussion of evaluation methodologies, as well as a chapter outlining some future areas of research. While the book focuses on the Bell Labs approach to the various problems of converting from text into speech, other approaches are discussed and compared. Thus, this book serves both the function of providing a single reference to an important strand of research in multilingual synthesis, while at the same time providing a source of information on current trends in the field. Chapters in this work were contributed by Richard Sproat, Jan van Santen, Bernd Mobius, Chilin Shih, Joseph Olive, Evelyne Tzoukermann, all of Bell Labs, and Kazuaki Maeda of the University of Pennsylvania.

This innovative book develops a formal computational theory of writing systems and relates it to psycholinguistic results. Drawing on case studies of writing systems around the world, it offers specific proposals about the linguistic objects that are represented by orthographic elements and the formal constraints that hold of the mapping relation between them. Based on the insights gained, it posits a new taxonomy of writing systems. The book will be of interest to students and researchers in theoretical and computational linguistics, the psycholinguistics of reading and writing, and speech technology.

For a machine to convert text into sounds that humans can understand as speech requires an enormous range of components, from abstract analysis of discourse structure to synthesis and modulation of the acoustic output. Work in the field is thus inherently interdisciplinary, involving linguistics, computer science, acoustics, and psychology. This collection of articles by leading researchers in each of the fields involved in text-to-speech synthesis provides a picture of recent work in laboratories throughout the world and of the problems and challenges that remain. By providing samples of synthesized speech as well as video demonstrations for several of the synthesizers discussed, the book will also allow the reader to judge what all the work adds up to -- that is, how good is the synthetic speech we can now produce? Topics covered include: Signal processing and source modeling Linguistic analysis Articulatory synthesis and visual speech Concatenative synthesis and automated segmentation Prosodic analysis of natural speech Synthesis of prosody Evaluation and perception Systems and applications.

The book will appeal to scholars and advanced students of morphology, syntax, computational linguistics and natural language processing (NLP). It provides a critical and practical guide to computational techniques for handling morphological and syntactic phenomena, showing how these techniques have been used and modified in practice.
The authors discuss the nature and uses of syntactic parsers and examine the problems and opportunities of parsing algorithms for finite-state, context-free and various context-sensitive grammars. They relate approaches for describing syntax and morphology to formal mechanisms and algorithms, and present well-motivated approaches for augmenting grammars with weights or probabilities.

This book develops a formal computational theory of writing systems. It offers specific proposals about the linguistic objects that are represented by orthographic elements; what levels of linguistic representation are involved and how they may differ across writing systems; and what formal constraints hold of the mapping relation between linguistic and orthographic elements. Based on the insights gained, Sproat then proposes a taxonomy of writing systems. The treatment of theoretical linguistic issues and their computational implementation is complemented with discussion of empirical psycholinguistic work on reading and its relevance for the computational model developed here. Throughout, the model is illustrated with a number of detailed case studies of writing systems around the world. This book will be of interest to students and researchers in a variety of fields, including theoretical and computational linguistics, the psycholinguistics of reading and writing, and speech technology.

This book constitutes the thoroughly refereed proceedings of the 21st International Conference on Computer Processing of Oriental Languages, ICCPOL 2006, held in Singapore in December 2006, colocated with ISCSLP 2006, the 5th International Symposium on Chinese Spoken Language Processing.

The 36 revised full papers and 20 revised short papers presented were carefully reviewed and selected from 169 submissions. The papers are organized in topical sections on information retrieval, document classification, questions and answers, summarization, machine translation, word segmentation, chunking, abbreviation expansion, writing-system issues, parsing, semantics, and lexical resources.

This book traces the history of language technology from writing - the first technology specifically designed for language - to digital speech and other contemporary language systems. The book describes the social impact of technological developments over five millennia, and addresses topics such as the ways in which literacy has influenced cognitive and scientific development; the social impact of modern speech technology; the influence of various printing technologies; the uses and limitations of machine translation; how far mass information access is a means for exploitation or enlightenment; the deciphering of ancient scripts; and technical aids for people with language disabilities.
Richard Sproat writes in a clear, readable style, introducing linguistic and other scientific concepts as they are needed. His book offers fascinating reading for everyone interested in how language and technology have shaped and continue to shape our day-to-day lives.

Weighted finite-state transducers (WFSTs) are commonly used by engineers and computational linguists for processing and generating speech and text. This book first provides a detailed introduction to this formalism. It then introduces Pynini, a Python library for compiling finite-state grammars and for combining, optimizing, applying, and searching finite-state transducers. This book illustrates this library's conventions and use with a series of case studies. These include the compilation and application of context-dependent rewrite rules, the construction of morphological analyzers and generators, and text generation and processing applications.

The book will appeal to scholars and advanced students of morphology, syntax, computational linguistics and natural language processing (NLP). It provides a critical and practical guide to computational techniques for handling morphological and syntactic phenomena, showing how these techniques have been used and modified in practice.
The authors discuss the nature and uses of syntactic parsers and examine the problems and opportunities of parsing algorithms for finite-state, context-free and various context-sensitive grammars. They relate approaches for describing syntax and morphology to formal mechanisms and algorithms, and present well-motivated approaches for augmenting grammars with weights or probabilities.