Giter Club home page Giter Club logo

maxmlang / lightningfast-ai-chat Goto Github PK

View Code? Open in Web Editor NEW
3.0 2.0 0.0 612 KB

Lightning is an ultra-fast AI chatbot powered by Groq LPUs (Language Processing Units), offering one of the fastest inference speeds on the market as of April 2024. With its advanced natural language processing capabilities and lightning-fast response times, Lightning provides an unparalleled conversational experience.

Home Page: https://lightning-ai.streamlit.app/

License: MIT License

Python 100.00%
chat-application chatgpt chatgpt-app chatgpt-clone groq groqapi langchain lpu python llama3 llama3-prompts

lightningfast-ai-chat's Introduction

Lightning Chatbot

Supports Meta AI's new Llama 3 Model!

Lightning Chatbot Logo

GitHub Stars GitHub Issues GitHub Pull Requests License

Lightning is an ultra-fast AI chatbot powered by Groq LPUs (Language Processing Units), offering one of the fastest inference speeds on the market as of April 2024. With its advanced natural language processing capabilities and lightning-fast response times, Lightning provides an unparalleled conversational experience.

Features

  • โšก Ultra-fast inference powered by Groq LPUs
  • ๐ŸŽจ Customizable model selection and conversational memory length
  • ๐Ÿ’ฌ Seamless conversation history tracking
  • ๐ŸŒ Easy deployment using Streamlit web framework

Available Models

  • ๐Ÿฆ™ Llama3-70B-8192: Experience high-end performance with this large-scale model, ideal for complex language tasks and deep learning insights.
  • ๐Ÿฆ™ Llama3-8B-8192: Harness robust capabilities with this more accessible version of Llama3, perfect for a wide range of AI applications.
  • ๐ŸŒŸ Mixtral-8x7B-32768: Leverage the power of ensemble modeling with Mixtral's extensive capacity for nuanced understanding and response generation.
  • ๐Ÿฆ™ Llama2-70B-4096: Utilize the proven effectiveness of Llama2 for comprehensive language processing and application development.
  • ๐Ÿ’Ž Gemma-7B-IT: Explore specialized interactions and tech-focused solutions with Gemma, tailored for IT and technical content.

Installation

  1. Clone the repository:git clone https://github.com/MaxMLang/lightningfast-ai-chat.git
  2. Navigate to the project directory:
cd lightningfast-ai-chat
  1. Install the required dependencies:
pip install -r requirements.txt
  1. Set up the Groq API key:
  • Create a .env file in the project directory.

  • Add the following line to the .env file, replacing your_api_key with your actual Groq API key:

    GROQ_API_KEY=your_api_key
    
  1. Run the chatbot:
streamlit run app.py
  1. Open the provided URL in your web browser to access the Lightning Chatbot interface.

Usage

  1. Choose a language model from the sidebar.
  2. Adjust the conversational memory length using the slider in the sidebar.
  3. Type your question or message in the input field and press Enter.
  4. Lightning will generate a response using the selected model and display it in the chat interface.
  5. Continue the conversation by entering more questions or messages.

License

This project is licensed under the MIT License.

Acknowledgements

  • Groq for providing the lightning-fast LPUs.
  • Langchain for the powerful language modeling capabilities.
  • Streamlit for the intuitive web framework.

lightningfast-ai-chat's People

Contributors

maxmlang avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.