Uploaded byEdureka!
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka
The document outlines a certification course on Natural Language Processing (NLP) with Python, covering topics such as text mining, NLP applications, and components like natural language understanding and generation. It discusses the importance of tokenization, stemming, lemmatization, parts of speech, and named entity recognition. The course aims to provide skills for deriving meaningful information from text and understanding human language through NLP techniques.
In this document
Powered by AI
Introduction to Natural Language Processing (NLP) and Text Mining, focusing on course overview and training topics.
Exploration of human language, alphabets across cultures, and the formation of sentences.
Discussion on the prevalence of structured (21%) vs unstructured data in modern data environments.
Explanation of Text Mining as a process to extract meaningful information from natural language text using NLP.
Definition of Natural Language Processing as part of AI and computer science, detailing the basic structure of NLP applications.
Various applications of NLP including sentiment analysis, speech recognition, and text mining applications.
Key components of NLP including Natural Language Understanding (NLU) and Natural Language Generation (NLG), and their processes.
Types of ambiguities in NLU: lexical, syntactic, and referential, with examples illustrating each type.
Introduction to the Natural Language Toolkit (NLTK) and its usage in NLP tasks.
Description of tokenization, breaking sentences into words and understanding their significance.
Overview of stemming, the process of normalizing words to their base or root form.
Explanation of lemmatization, grouping inflected forms of words into a common root.
Discussion on the relevance of stop words in NLP and their role in text processing.
Introduction to parts of speech tagging, with examples to illustrate their grammatical roles.
Definition and examples of Named Entity Recognition, identifying entities within text.
Overview of syntax, including phase structure rules and the representation of sentence structure through syntax trees.
Definition of chunking as a method for grouping pieces of information into larger structures.
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka
- 1. Natural Language Processingwith Python Certification Course www.edureka.co
- 2. Natural Language Processingwith Python Certification Course www.edureka.co Text Mining & NLP
- 3. Natural Language Processingwith Python Certification Course www.edureka.co Today’s Training Topics ❖ Evolution of Human Language ❖ What is Text Mining? ❖ Text Mining and Natural Language Processing? ❖ Applications of NLP ❖ NLP Components and Demo
- 4. Natural Language Processingwith Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS األبجدية எழுத்துக்கள்
- 5. Natural Language Processingwith Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS األبجدية எழுத்துக்கள் Words form Sentences
- 6. Natural Language Processingwith Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS األبجدية எழுத்துக்கள் Words form Sentences
- 7. Natural Language Processingwith Python Certification Course www.edureka.co The 21st Century 21 % STRUCTURED DATA
- 8. Natural Language Processingwith Python Certification Course www.edureka.co The 21st Century STRUCTURED DATA21 % Unstructured
- 9. Natural Language Processingwith Python Certification Course www.edureka.co What is Text Mining ? Text Mining / Text Analytics is the process of deriving meaningful information from natural language text
- 10. Natural Language Processingwith Python Certification Course www.edureka.co Text Mining and NLP As, Text Mining refers to the process of deriving high quality information from the text . The overall goal is, essentially to turn text into data for analysis, via application of Natural Language Processing (NLP)
- 11. Natural Language Processingwith Python Certification Course www.edureka.co What is NLP? NLP: Natural Language Processing is a part of computer science and artificial intelligence which deals with human languages.
- 12. Natural Language Processingwith Python Certification Course www.edureka.co Basic Structure of a NLP Application
- 13. Natural Language Processingwith Python Certification Course www.edureka.co Applications of NLP Sentimental Analysis Speech Recognition Chatbot Machine Translation
- 14. Natural Language Processingwith Python Certification Course www.edureka.co Applications of NLP and Text Mining Spell Checking Keyword Search Information Extraction Advertisement Matching
- 15. Natural Language Processingwith Python Certification Course www.edureka.co
- 16. Natural Language Processingwith Python Certification Course www.edureka.co NLP : Components
- 17. Natural Language Processingwith Python Certification Course www.edureka.co NLP : Components Natural Language Understanding Natural Language Generation
- 18. Natural Language Processingwith Python Certification Course www.edureka.co NLP : Components Natural Language Understanding Natural Language Generation • Mapping input to useful representations • Analyzing different aspects of the language • Text Planning • Sentence Planning • Text Realization
- 19. Natural Language Processingwith Python Certification Course www.edureka.co NLP : Ambiguity Natural Language Understanding Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity
- 20. Natural Language Processingwith Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank.
- 21. Natural Language Processingwith Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank. The chicken is ready to eat. Visiting relatives can be boring. I saw the man with the binoculars.
- 22. Natural Language Processingwith Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank. The chicken is ready to eat. Visiting relatives can be boring. I saw the man with the binoculars. The boy told his father the theft. He was very upset
- 23. Natural Language Processingwith Python Certification Course www.edureka.co NLTK
- 24. Natural Language Processingwith Python Certification Course www.edureka.co NLTK NLTK
- 25. Natural Language Processingwith Python Certification Course www.edureka.co NLTK NLTK
- 26. Natural Language Processingwith Python Certification Course www.edureka.co Tokenization 01 Break a complex sentence into words 02 Understand the importance of each of the words with respect to the sentence 03 Produce a structural description on an input sentence Tokenization is the first step in NLP
- 27. Natural Language Processingwith Python Certification Course www.edureka.co Tokenization 01 Break a complex sentence into words 02 Understand the importance of each of the words with respect to the sentence 03 Produce a structural description on an input sentence Tokenization is the first step in NLP
- 28. Natural Language Processingwith Python Certification Course www.edureka.co Tokenization
- 29. Natural Language Processingwith Python Certification Course www.edureka.co Stemming Affectation Affected Affection AffectingAffectionsAffects Normalize words into its base form or root form
- 30. Natural Language Processingwith Python Certification Course www.edureka.co Stemming Affect Normalize words into its base form or root form
- 31. Natural Language Processingwith Python Certification Course www.edureka.co • Groups together different inflected forms of a word, called Lemma • Somehow similar to Stemming, as it maps several words into one common root • Output of Lemmatisation is a proper word • For example, a Lemmatiser should map gone, going and went into go Lemmatization
- 32. Natural Language Processingwith Python Certification Course www.edureka.co Stop Words Are they Helpful or Not
- 33. Natural Language Processingwith Python Certification Course www.edureka.co POS : Parts of Speech
- 34. Natural Language Processingwith Python Certification Course www.edureka.co POS : Tags and Descriptions
- 35. Natural Language Processingwith Python Certification Course www.edureka.co POS : Examples The Dog killed the bat DT NN VBD DT NN SENTENCE
- 36. Natural Language Processingwith Python Certification Course www.edureka.co What are Named Entity Recognition ? MOVIE LOCATION MONETARY VALUE QUANTITIES ORGANIZATION PERSON
- 37. Natural Language Processingwith Python Certification Course www.edureka.co NER : Named Entity Recognition Google’s CEO Sundar Pichai introduced the new Pixel at Minnesota Roi Centre Event Organization Person Location Organization
- 38. Natural Language Processingwith Python Certification Course www.edureka.co Syntax
- 39. Natural Language Processingwith Python Certification Course www.edureka.co Phase Structure Rules
- 40. Natural Language Processingwith Python Certification Course www.edureka.co Syntax Tree Syntax Tree is a tree representation of syntactic structure of sentences or strings
- 41. Natural Language Processingwith Python Certification Course www.edureka.co Chunking Picking up Individual pieces of Information and Grouping them into bigger Pieces CHUNK
- 42. Natural Language Processingwith Python Certification Course www.edureka.co Chunking CHUNKs PRP VBD DT JJ NN NP NP We Caught the Black Panther