Skip to content

Latest commit

 

History

History
23 lines (16 loc) · 971 Bytes

README.md

File metadata and controls

23 lines (16 loc) · 971 Bytes
Raw

Word Frequency Toytools

Code to generate/annotate/handle lists of frequency from corpora.

Normalize Word Frequency v0.1.5

R code to normalize raw frequency counts into fpmw, fpbw, zipf, zipf per billion and other popular measures to indicate word frequency. To use Normalize Word Frequency :

Prepare your input file:

  • make sure your txt or csv input files have a header: the column with raw frequency you want to normalize must be called "Frequency"

Set input specifications in the code:

  • set the paths for input and output files (line 28-30)
  • set the file extension (36)
  • set the file separators (48)
  • set size of corpus (70) - this version reports the size of Itwac.

Set output specifications in the code:

  • choose what transformations to apply by commenting/ uncommenting (56-65)

Normalize Word Frequency v0.1.4

This version has been deprecated.