mdrobulis / naming Goto Github PK

Allow meta info that would provide meanings to the names.

Main issues

• file format
• extensibility
• refactor current files
• adapt the analysis script

Make a script that

• Checks name uniqueness
• Counts the words in each list
• Counts average, min, max word lenght in a list
• Checks if all names in a list are one word.
• Checks for special chars
• Checks for NonAscii chars
• Checks file naming convention
• Provides a nice report

These are ideas, feel free to contribute

• Scientists
  • Physics
  • Astronomy
  • Chemistry
• Peoples names
• Language words by category
• Military code names
• List of military operations
• Ship names
• Airplane codenames
• ...

quick way to aproximate UTF8 chars to ASCII chars

https://stackoverflow.com/questions/10207354/how-to-remove-all-of-the-diacritics-from-a-file

iconv -f utf8 -t ascii//TRANSLIT input.txt >output.txt

Script should

• trim
• dedupe
• Sort / randomize
• turn to single words / skip double words
• option Turn to ASCII
• write to "normalized" dir