Study of Various Methods for Tokenization
Abigail Rai, Samarjeet Borah
Topics & Concepts
Lexical analysisMorphemeComputer scienceWord (group theory)Natural language processingArtificial intelligenceSecurity tokenPart-of-speech taggingPart of speechSpeech recognitionLinguisticsComputer securityPhilosophyNatural Language Processing Techniquessemigroups and automata theoryTopic Modeling