The PDF Compressor project is a system for compressing PDF files and managing them using a combination of MongoDB Kafka and a Golang-based web service. This README provides an overview of the project its components and how to set it up.

• Description: Handles file uploads, compression, and file downloads.
• Dependencies: Gin (HTTP framework), MongoDB Go driver, Confluent Kafka Go library.

• Description: Manages asynchronous communication between the web service and the consumer service.
• Dependencies: Confluent Kafka.

• Description: Stores compressed PDF files and associated metadata.
• Dependencies: MongoDB, GridFS.

• Description: Consumes messages from Kafka, indicating successful compression.
• Dependencies: Confluent Kafka.

• Description: Scheduled job for deleting old files from MongoDB GridFS.
• Dependencies: MongoDB, GridFS

Here're some of the project's best features:

• Upload PDF files for compression.
• Compress PDF files using PyMuPDF
• Store compressed PDF files in MongoDB using GridFS.
• Asynchronous processing of compression tasks with Kafka.
• Download compressed PDF files.

1. Fork The Repository

2. Clone the repository:

git clone https://github.com/your-username/pdf-compressor.git

3. Navigate to the project directory:

cd pdf-compressor

4. Add the helm bitnami repo:

helm repo add bitnami https://charts.bitnami.com/bitnami

5. Install the Confluentic Kafka service using below command:

helm upgrade --install kafka-release bitnami/kafka --set persistence.size=8GilogPersistence.size=8GivolumePermissions.enabled=truepersistence.enabled=truelogPersistence.enabled=trueserviceAccount.create=truerbac.create=true --version 23.0.7 -f Helm_charts/Kafka/values.yaml

6. Install MongoDB service using command:

helm install mongo Helm_charts/MongoDB -f Helm_chart/MongoDB/values.yaml

7. Run frontend service using command

kubectl apply -f frontend-service/manifests/

8. Run producer service using command

kubectl apply -f producer-service/manifests/

9. Run compressor service using command

kubectl apply -f compressor-service/manifests/

10. Run DB Cleaner Service using command

kubectl apply -f DBClean-service/manifests/

Technologies used in the project:

• Golang
• Kafka
• Helm Charts
• MongoDB
• Python
• Html
• Bootstrap
• Javascript

This project is licensed under the MIT