Natural Language Processing The saara...
Transcript of Natural Language Processing The saara...
![Page 1: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/1.jpg)
July 2014 Kavi Narayana Murthy - UoH
Natural Language ProcessingThe saara Approach
Kavi Narayana Murthy
School of Computer and Information SciencesUniversity of Hyderabad
![Page 2: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/2.jpg)
July 2014 Kavi Narayana Murthy - UoH
NLP
NLP Today: a data driven empirical science. NLP systems are built by training language independent and generic machine learning algorithms on large scale language data.
Original goals of NLP: NL understanding, NL generation and NL learning
Meaning has gradually lost focus, almost forgotten?
![Page 3: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/3.jpg)
July 2014 Kavi Narayana Murthy - UoH
The saara Approach
Given a sentence, how to compute its meaning. Given a word, how to compute its meaning.
Problem: Computers do not understand meanings. Solution: Structure indicates meaning. Use
appropriate structures and manipulations. Grammar: Mapping Structure to Meaning Main Focus: Development of Computational
Grammars Philosophy: Do it right, no short cuts!
![Page 4: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/4.jpg)
July 2014 Kavi Narayana Murthy - UoH
Grammar
Morphology: Relating word internal structure to word meaning
Syntax: Relating sentence structure to sentence meaning
What exactly does a sentence mean? Can be computed. Provided
Speaker knows what exactly to say Speaker knows how exactly to say
Universal / language-independent
![Page 5: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/5.jpg)
July 2014 Kavi Narayana Murthy - UoH
Grammar and Usage
People are not always very careful. They may also not know what to say or how to express it. Thus, actual usage may not indicate the intended meaning directly, precisely and unambiguously.
Layered Approach: Grammar should be designed for carefully usage only. This forms the core. We can then build layers or wrappers to handle all the variations we find in actual usage. This way, we can get a simple, neat, elegant, efficient grammar and cater to practical needs at the same time.
![Page 6: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/6.jpg)
July 2014 Kavi Narayana Murthy - UoH
The saara System
Computational Models for Analysis Generation Translation and other Applications
kannaDa-saara Alpha Ver 3 telugu-saaramu Alpha Ver 3 Lexical Resources and Tools The saara Translator System
![Page 7: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/7.jpg)
July 2014 Kavi Narayana Murthy - UoH
The saara Approach
Correct Analysis of Source Language Can be translated into any other language
Only bilingual dictionary and transfer grammar required Correct Generation
Can take the analysis produced by any other system for any other language and translate to our language
How to guarantee correctness? Machine Learning cannot!
NLP is a technology. Q: What is the scientific foundation? A: The saara Approach!
![Page 8: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/8.jpg)
July 2014 Kavi Narayana Murthy - UoH
Natural Language Engineering at SCIS, UoH
Foundations: Word, Word Classes, Sentence, Syntactic Relations, Parsing, ...
− Universal and Precise Definitions
− Lexical Resources and Tools Core Research and Development:
− Telugu, Kannada, Indian Languages, English Applications
− Text Categorization, Text Summarization, NERC
− Language ID, WSD, Spell Checking, Anaphora Reso.
− ASR, TTS, OCR, Machine Translation, IR, IE
![Page 9: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/9.jpg)
July 2014 Kavi Narayana Murthy - UoH
![Page 10: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/10.jpg)
July 2014 Kavi Narayana Murthy - UoH
If You are Interested
• Yoga, Ayurveda, Holistic Healing
• Vedanta
• Classical Music
• Books:– Brahmacharya– Ahimsa– Freedom
![Page 11: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/11.jpg)
July 2014 Kavi Narayana Murthy - UoH
Just Released!
![Page 12: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/12.jpg)
July 2014 Kavi Narayana Murthy - UoH
Freedom
See what the previewers have said:
"Here is one book which covers all aspects of life, simple, clear, written with a scientific bent of mind, a great book, very much unlike many other books I have seen on similar topics"
"The book is a masterpiece - no doubt"
" The book is simply awesome and I feel it is a 'must read' for all human beings"
"This is a book I love to read again and again"
![Page 14: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/14.jpg)
July 2014 Kavi Narayana Murthy - UoH
Words
What Exactly is a Word? Universal Word Classes Sub-Categorization Tag-Set
Hierarchical, Extensible, Fine-Grained More Than POS
Languages are NOT as ambiguous as they seem to be!
![Page 15: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/15.jpg)
July 2014 Kavi Narayana Murthy - UoH
Words
Lexicon Morphological Analysis and Generation Stemming and Lemmatization Spelling Error Detection and Correction Lexical Resource Toolkit, Glossing Tagging
No ML, No Training Data, No Manual Work High Performance
![Page 16: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/16.jpg)
July 2014 Kavi Narayana Murthy - UoH
Sentence
What exactly is a Sentence? What exactly is Syntax? Universal Syntactic Relations How to identify them?
![Page 17: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/17.jpg)
July 2014 Kavi Narayana Murthy - UoH
The saara Architecture
Purely Linguistic, no ML Simple Pipe-Line Architecture
Phonemes, Words, Sentences, Discourse No tagging, chunking, local-word-grouping, ...
Perl and Java – Platform Independent Synchronization Stand Alone, No other dependencies
![Page 18: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/18.jpg)
July 2014 Kavi Narayana Murthy - UoH
Status, Plans
Word Level: Alpha Versions Released, Beta soon > 90% Analyzed, Mostly Correct First Complete Morph for Kannada/Telugu
Sentence Level: Going On To be Ready in about an Year
Workshop Series No Funding taken from any source so far.
TDIL/DeitY has now sanctioned a project.
![Page 19: Natural Language Processing The saara Approachltrc.iiit.ac.in/iasnlp2014/slides/lecture/knm_saara.pdf · July 2014 Kavi Narayana Murthy - UoH The saara Approach Given a sentence,](https://reader033.fdocuments.us/reader033/viewer/2022051511/60106daabd7cb07a067526b6/html5/thumbnails/19.jpg)
July 2014 Kavi Narayana Murthy - UoH
References
Pl. visit our website!