An Introduction To Language Processing With Perl and Prolog

An Introduction to Language Processing with Perl and Prolog
Chapter 1: An Overview of Language Processing
Pierre Nugues
Lund University Pierre.Nugues@cs.lth.se http://www.cs.lth.se/home/Pierre_Nugues/
Pierre Nugues
1 / 19
Applications of Language Processing
Spelling and grammatical checkers: MS Word Text indexing and information retrieval on the Internet: Google, Microsoft Bing, Yahoo Telephone information that understands some spoken questions: SJ (trains in Sweden) or Tellme.com in the United States Speech dictation of letters or reports: IBM ViaVoice, Windows Vista Translation: Google Translate, SYSTRAN
Pierre Nugues
2 / 19
Applications of Language Processing (ctnd)
Direct translation from spoken English to spoken Swedish in a restricted domain: SRI and SICS Voice control of domestic devices such as tape recorders: Philips or disc changers: MS Persona Conversational agents able to dialogue and to plan: TRAINS Spoken navigation in virtual worlds: Ulysse, Higgins Generation of 3D scenes from text: Carsim
Pierre Nugues
3 / 19
Linguistics Layers
Sounds Phonemes Words and morphology Syntax and functions Semantics Dialogue
Pierre Nugues
4 / 19
Sounds and Phonemes
Serious
Cest par l` a It is that way
Pierre Nugues
5 / 19
Lexicon and Parts of Speech
The big cat ate the gray mouse The /article big /adjective cat /noun ate /verb the /article gray /adjective mouse /noun Le /article gros /adjectif chat /nom mange /verbe la/article souris /nom grise /adjectif Die /Artikel groe /Adjektiv Katze /Substantiv it /Verb die /Artikel graue /Adjektiv Maus /Substantiv
Pierre Nugues
6 / 19
Morphology
Word worked travaill e gearbeitet
Root form to work + verb + preterit travailler + verb + past participle arbeiten + verb + past participle
Pierre Nugues
7 / 19
Syntactic Tree
sentence
noun phrase
verb phrase
article
noun
verb
noun phrase
article
noun
The

boy
hit
the
ball
Pierre Nugues
8 / 19
Syntax: A Classical View
A graph of dependencies and functions
Verb Subject The boy

Object hit the ball
Pierre Nugues
9 / 19
Semantics
As opposed to syntax:
1 2
Colorless green ideas sleep furiously. *Furiously sleep ideas green colorless.
Determining the logical form: Sentence Frank is writing notes Fran cois ecrit des notes Franz schreibt Notizen Logical representation writing(Frank, notes). ecrit(Fran cois, notes). schreibt(Franz, Notizen).
Pierre Nugues
10 / 19
Lexical Semantics
Word senses:
1 2 3 4 5
note (noun) short piece of writing; note (noun) a single sound at a particular level; note (noun) a piece of paper money; note (verb ) to take notice of; note (noun) of note: of importance.
Pierre Nugues
11 / 19
Reference
1. sentence Pierre wrote notes
2. logical representation wrote(pierre, notes)
3. real world
referencing
referencing
Louis Pierre Charlotte

operating systems computational linguistics Prolog programming
Pierre Nugues
12 / 19
Ambiguity
Many analyses are ambiguous. It makes language processing dicult. Ambiguity occurs in any layer: speech recognition, part-of-speech tagging, parsing, etc. Example of an ambiguous phonetic transcription: The boys eat the sandwiches That may correspond to: The boy seat the sandwiches ; the boy seat this and which is ; the buoys eat the sand which is
Pierre Nugues
13 / 19
Models and Tools
Linguistics has produced an impressive set of theories and models Language processing requires signicant resources Models and tools have matured. Resources are available. Tools involve notably nite-state automata, regular expressions, rewriting rules, logic, statistics and machine learning.
Pierre Nugues
14 / 19
The Carsim System: A Text-to-Scene Converter

Texts V ehicule B venant de ma gauche, je me trouve dans le carrefour, ` a faible vitesse environ 40 km/h, quand le v ehicule B, percute mon v ehicule, et me refuse la priorit e ` a droite. Le premier choc atteint mon aile arri` ere gauche, XML Templates // Static Objects STATIC [ ROAD TREE ] // Dynamic Objects DYNAMIC [ VEHICLE [ ID = vehicule b; INITDIRECTION = east; 3D Animation
= NLP engine
Pierre Nugues
= Java 3D animation program

15 / 19
Dialogue: The Persona Project from Microsoft Research

A conversation with Peedy Turn User: Peedy: User: Peedy: User: Utterance [Peedy is asleep on his perch] Good morning, Peedy. [Peedy rouses] Good morning. Lets do a demo. [Peedy stands up, smiles] Your wish is my command, what would you like to hear? What have you got by Bonnie Raitt? [Peedy waves in a stream of notes, and grabs one as they rush by.] I have The Bonnie Raitt Collection from 1990. Pick something from that How about Angel from Montgomery?

Peedy: User: Peedy:
Pierre Nugues
16 / 19
Dialogue: The Persona Project from Microsoft Research

User: Peedy: User: Peedy: User: Peedy: User: Peedy: User: Sounds good. [Peedy drops note on pile] OK. Play some rock after that. [Peedy scans the notes again, selects one] How about Fools in love? Who wrote that? [Peedy cups one wing to his ear] Huh? Who wrote that? [Peedy looks up, scrunches his brow] Joe Jackson Fine. [Drops note on pile]

Pierre Nugues
17 / 19
Persona System Architecture
Source: http: //research.microsoft.com/research/pubs/view.aspx?pubid=439

Pierre Nugues
18 / 19
Research Relevance
Large companies like Microsoft, Google, Yahoo, IBM, or Xerox have a research activity in natural language processing. The 7th European framework program (2007-2013) names six technology pillars in information technologies. Two of them are related to language processing: Knowledge, cognitive and learning systems: semantic systems; capturing and exploiting knowledge embedded in web and multimedia content; bio-inspired articial systems that perceive, understand, learn and evolve, and act autonomously; learning by convivial machines and humans based on a better understanding of human cognition. Simulation, visualization, interaction and mixed realities: tools for innovative design and creativity in products, services and digital media, and for natural, language-enabled and context-rich interaction and communication.

Pierre Nugues
19 / 19

An Introduction To Language Processing With Perl and Prolog

Uploaded by

Copyright:

Available Formats

An Introduction To Language Processing With Perl and Prolog

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

An Introduction To Language Processing With Perl and Prolog

Uploaded by

Copyright:

Available Formats

An Introduction to Language Processing with Perl and Prolog

Chapter 1: An Overview of Language Processing