allNotes.txt

There are different preprocesses before we extract features


What are lexical categories and how are they used in natural language processing?
By the end of article you should be able to answer the question above..

text.similar('word')--> will output the context of word..
Example:

>>> text.similar('woman')
Building word-context index...
man day time year car moment world family house boy child country job

Tag	Meaning	English Examples
ADJ	adjective	new, good, high, special, big, local
ADP	adposition	on, of, at, with, by, into, under
ADV	adverb	really, already, still, early, now
CONJ	conjunction	and, or, but, if, while, although
DET	determiner, article	the, a, some, most, every, no, which
NOUN	noun	year, home, costs, time, Africa
NUM	numeral	twenty-four, fourth, 1991, 14:24
PRT	particle	at, on, out, over per, that, up, with
PRON	pronoun	he, their, her, its, my, I, us
VERB	verb	is, say, told, given, playing, would
.	punctuation marks	. , ; !
X	other	ersatz, esprit, dunno, gr8, univeristy


The simplified noun tags are N for common nouns like book, and NP for proper nouns like Scotland.


Whether you achieve something or not depends on one and only one factor - how badly you want it. But that is completely wrong. The truth is - Whether you achieve something or not depends on one, and only one factor - what you are willing to ‘settle for’ instead.”