Giter Club home page Giter Club logo

superduper-community-apps's Introduction

Bring AI to your favorite database!

License - Apache 2.0 CI Coverage Package version Supported Python versions


๐Ÿ”ฎ SuperDuperDB is open-source: Please leave a star โญ๏ธ to support the project!


SuperDuperDB Examples & Use-Cases

Welcome to the SuperDuperDB Examples repository! Here, you'll find a collection of diverse use-cases showcasing the capabilities of SuperDuperDB, from notebook demos to full-fledged applications.

Community Use-Cases

This Semantic Search Engine was developed with the following objectives:

  • Utilizing Superduperdb to create a practical business use case of a vector database using MongoDB as the backend.
  • Comparing the differences between a basic Semantic search engine and a simple Full-Text Search Engine.

Basic Components Used:

  • Backend: MongoDB
  • Embedding: OpenAI
  • Vector Search Functionality: SuperduperDB
  • Frontend: Streamlit

This Customer Deduplication Architecture was developed with the following objectives:

  • Leveraging Superduperdb to create a vector search functionality to narrow down potential customer detail matches
  • Using Recordlinkage to reduce the false positive matches from the search

Basic Components Used:

  • Backend: MongoDB
  • Embedding: HuggingFace
  • Vector Search Functionality: SuperduperDB
  • Entity Resolution: RecordLinkage
  • Frontend: Streamlit

Let's find specific text within documents using vector-search. In this example, we show how to do vector-search. But here, we want to go one step further. Let's search for smaller pieces of text within larger documents. For instance, a developer may store entire documents but wants to find specific parts or references inside those documents.

Here we will show you an example with Wikipedia dataset. Implementing this kind of search is usually more complex, but with superduperdb, it's just one extra command.

Real-life use cases for the described problem of searching for specific text within documents using vector-search with smaller text units.

In each of these scenarios, the ability to efficiently search for and retrieve smaller text units within larger documents can significantly enhance data analysis and retrieval capabilities.

Building an Image Feature Database in torchvision

In this example, we show how to utilize a pre-trained network from torchvision to produce image features. The images are automatically fetched and stored in MongoDB. We use a subset of the CoCo dataset (https://cocodataset.org/#home) to illustrate the process.

Real-life use cases for creating a database of image features using a pre-trained network in torchvision:

Use Case: Enhance image search capabilities in e-commerce platforms. How: Generate image features for products using a pre-trained network. Store these features in a database for efficient image retrieval, making it easier for users to find similar products. Content-Based Recommendation Systems:

Use Case: Improve content recommendations in media streaming services. How: Extract image features from movie or show frames. Store these features in a database to recommend content with similar visual characteristics to users based on their preferences. Facial Recognition in Security Systems:

Use Case: Strengthen facial recognition systems in security applications. How: Utilize a pre-trained neural network to extract facial features from images. Store these features in a database for quick and accurate identification in security and surveillance scenarios. Medical Image Analysis:

Use Case: Streamline image organization in photo libraries or social media platforms. How: Extract features from uploaded images using a pre-trained model. Use these features to automatically generate relevant tags, making it easier for users to search and categorize their photos. These use cases demonstrate how creating a database of image features using torchvision can be applied across various domains to enhance functionality and improve user experiences.

Sentiment analysis with transformers and SuperDuperDB

In this document, we're doing sentiment analysis using Hugging Face's transformers library. We demonstrate that you can perform this task seamlessly in SuperDuperDB, using MongoDB to store the data.

Sentiment analysis has some real-life use cases:

Customer Feedback & Review Analysis: Analyzing customer

reviews and feedback to understand overall satisfaction, identify areas for improvement, and respond to customer concerns. It is used in the E-commerce industry frequently.

Brand Monitoring: Monitoring social media, blogs, news articles, and online forums to gauge public sentiment towards a brand, product, or service. Addressing negative sentiment and capitalizing on positive feedback.

Sentiment analysis plays a crucial role in understanding and responding to opinions and emotions expressed across various domains, contributing to better decision-making and enhanced user experiences.

All of these can be done with your existing database and SuperDuperDB. You can integrate similar code into your ETL infrastructure as well. Let's see an example.


๐Ÿš€ Submit Your Community App and Get Featured!

Have you built an exciting app using SuperDuperDB that you want to showcase to the community? We'd love to feature it here!

How to Submit:

  1. Create a Pull Request: Fork this repository, add details about your app to the README.md, and create a pull request.

  2. Include Information: Make sure to include details such as the purpose of your app, components used, a brief description, and any unique features.

  3. Add Contact Information: Provide a way for the community to reach out to you, whether it's through GitHub, email, or any preferred communication channel.

  4. Highlight Your Contributions: If your app uses specific features of SuperDuperDB or integrates with other technologies, highlight those contributions.

Benefits of Submission:

  • Community Recognition: Your app will be showcased in the SuperDuperDB community, giving you visibility and recognition.

  • Connect with Others: Connect with fellow developers, share insights, and collaborate on potential improvements or extensions to your app.

  • Contribute to the Ecosystem: Contribute to the growth of the SuperDuperDB ecosystem by sharing your innovative applications with the community.

Let's build an inspiring collection of community apps together! ๐Ÿ”ฅ

Contributing

There many ways to contribute, and they are not limited to creating community apps for us. We welcome all contributions. Read our contributing guideline.

Code of Conduct

This repository is part of the SuperDuperDB, thus the SuperDuperDB Code of Conduct applies.

License

SuperDuperDB is open-source and intended to be a community effort, and it wouldn't be possible without your support and enthusiasm. It is distributed under the terms of the Apache 2.0 license. Any contribution made to this project will be subject to the same provisions.

More Information

For more details about the SuperDuperDB framework and its impressive functionality, visit the main open-source repository here.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.