ibnaleem / mistral-discord Goto Github PK

The open source repository for Mistral AI Discord chatbot.

https://discord.com/api/oauth2/authorize?client_id=1202215160954228766&permissions=0&scope=bot

Mistral Discord facilitates user interaction with the Large Language Model (LLM) through Discord chat functionality. Users can invite Mistral AI to their Discord server and engage in conversations immediately, equivalent to ChatGPT. Currently, Mistral's 7.3B parameter LLM can:

• Outperform Llama 2 13B on all benchmarks
• Outperform Llama 1 34B on many benchmarks
• Approach CodeLlama 7B performance on code, while remaining good at English tasks
• Use Grouped-query attention (GQA) for faster inference
• Use Sliding Window Attention (SWA) to handle longer sequences at smaller cost

(Mistral AI, 2024)

Mistral Discord does not have any commands, though could in the future. Therefore, Mistral Discord does not require any permissions to function properly. It is recommended for admins to create a separate (no-permission) role for Mistral AI Discord and place it near the top of the server so server members can easily message the bot.

This project does not collect or store your chats with Mistral AI; all chats are stored in random access memory (RAM) temporarily. See lines 9, 39, and 43 in main.py

• Mistral AI
• ollama/ollama-python

https://discord.gg/JX4XgrQSeV