- Assignment1: Word Count
- Assignment2: Word Search
- Assignment3: Stop Word Removal
- Assignment4: Weather Data Mining
- Assignment5: Store Data Mining
- Install Java 1.8
- Install Hadoop 3.1.4
- Create a project eg. WSProgram
- In the project (WSProgram) create a package (WSPackage)
- Create (at least) 3 files for Driver, Mapper and Reducer
- If needed create more class
- Now you need to Add some external libraries, for that add the jar files in the JAR Files folder
- Now it's time to export your project as jar file.
- Note: while create the jar files you can mention the class that contains the main method if you
don't mention it then it's compulsory to mention the class name in the command life but if you do
mention it then you can skip writing the name of the java file in the command line.
- Note: while create the jar files you can mention the class that contains the main method if you
- Assignment 1
- Create a folder named
Outputin the folder where you'll be having the script. - Run the script using,
pig -x local script_name.pig - If the script run successfully then a folder will be generate in the
Output
- Assignment 2
- Need to rename the text files, make it Map Reduce compatiple and keep them the text files in a folder named
txtand keeptxtin the folder where your pig scripts are. - Create a folder
Outputwithin the folder where you'll be having the scripts - First run the script.pig
pig -x local script.pig - You can see inside
Outputthere will be new 3 folders. - To run search.pig, use
pig -x local search.pig
- Weather Data Mining
- Store Data Mining
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent