This project involves creating a custom Amazon Support Bot using the GPT-3 language model by OpenAI. The goal is to build a conversational AI that can provide accurate and helpful responses to customer queries based on the Amazon Question Answering dataset. We will fine tune a GPT-3 model on custom Amazon question answering dataset for this purpose.

• The project starts with a dataset named amazon_qna.csv, which contains Amazon-related questions and answers.
• To train the GPT-3 model, a smaller sample of training and validation data is created from the original dataset.

• The training and validation datasets (training_amazon_qna.csv and validation_amazon_qna.csv) are converted from CSV format to JSONL format (training_amazon_qna.jsonl and validation_amazon_qna.jsonl)
• JSONL (JSON Lines) format is required for fine-tuning the GPT-3 model.
• Each row in the JSONL file would contain a valid JSON having 2 keys, prompt and completion. This format is compulsory to fine tune a GPT-3 model.

{"prompt": "Non-Ducted range Hood, does this mean there is no need to vent up thru the roof or out thru the wall? ->", "completion": "That's correct. The air flows through the filter on the underside and out through the three columns of vent slats you see on the front of the range hood. There is no connection to other vents or ducts in a wall or through the roof.\n"}

• The converted training and validation datasets in JSONL format are uploaded to the OpenAI platform.
• This data will be used to fine-tune the GPT-3 model to generate responses specific to Amazon customer support queries.

• The GPT-3 model used for fine-tuning is davinci.
• The hyperparameters for fine-tuning are set as follows:
  • Number of Epochs: 15
  • Batch Size: 3
  • Learning Rate Multiplier: 0.3

• The fine-tuning training process is monitored to ensure the model is learning effectively.
• The progress of all fine-tuning jobs is tracked on the OpenAI platform.

• Once fine-tuning is complete, the fine-tuned model name is extracted from the training process.
• This model will be used for generating responses in the Amazon Support Bot.

• The fine-tuned GPT-3 model is used for inference in the Amazon Support Bot.

prompt = "Is this louder/quiter than the HWM450? Does it need to be cleaned more often? ->"

• Above prompt will result in following response

"I think they are about the same, and it does not need to be cleaned\n"

This project demonstrates the process of creating a custom Amazon Support Bot using a fine-tuned GPT-3 model. By training the model on Amazon-specific question and answer data, the bot can provide helpful responses to customer inquiries. The README provides an overview of the project steps, data preparation, fine-tuning, inference, and the ultimate goal of building an efficient customer support chatbot for Amazon-related queries.

If you have any questions, suggestions, or would like to discuss this project further, feel free to get in touch with me:

• Email
• LinkedIn

I'm open to collaboration and would be happy to connect!

Mir Abdullah Yaser