Natural language processing (NLP) is a subfield of linguistics, computer science, and artificial intelligence concerned with the interactions between computers and human language, in particular how to program computers to process and analyze large amounts of natural language data (Source: Wikipedia).

Install

pip install git+ssh://[email protected]/mikelakoju/preprocess_nlp_mikelakoju.git

Uninstall

pip uninstall preprocess_nlp_mikelakoju

• Word counts get_wordcounts(x)
• Characters count get_charcounts(x)
• Average characters per word get_avg_wordlength(x)
• Stop words count get_stopwords_counts(x)
• Count #HashTags and @Mentions get_hashtag_counts(x) & get_mentions_counts(x)
• If numeric digits are present in twitts get_digit_counts(x)
• Upper case word counts get_uppercase_counts(x)

• Contraction to Expansion cont_exp(x)
• Emails removal and counts get_emails(x) & remove_emails(x)
• URLs removal and counts get_urls(x) & remove_urls(x)
• Removal of RT remove_rt(x)
• Removal of Special Characters remove_special_chars(x)
• Removal of multiple spaces
• Removal of HTML tags remove_html_tags(x)
• Removal of accented characters remove_accented_chars(x)
• Removal of Stop Words remove_stopwords(x)
• Conversion into base form of words make_base(x)
• Common Occuring words Removal remove_common_words(x, freq, n=20)
• Rare Occuring words Removal remove_rarewords(x, freq, n=20)
• Spelling Correction spelling_correction(x)