This practical work consisted in the implementation and experimental evaluation of data storage and processing tasks, through the development of methods and classes that extend the Map Reduce and Avro + Parquet interfaces existing in the Apache Hadoop framework, allowing to answer the questions raised. In order to answer these questions, the public IMDB dataset was used.

This practical work consisted in the implementation and experimental evaluation of data storage and processing tasks, using the Spark library and the Hive Metastore service. In order to answer these questions, the public IMDB dataset was used.

University of Minho, Software Engineering (4th Year).