Used Scrapy , python framework to crawl all names used in https://www.ssa.gov/oact/babynames/
Worte different spiders to handle different webpages
merged all output json files and removed duplicates and save the final results into final.text
refered the official document of Scrapy: https://doc.scrapy.org/en/latest/intro/tutorial.html