Giter Club home page Giter Club logo

surfer-data's Introduction

Surfer: The World's First Digital Footprint Exporter

Contributors Forks Stargazers Issues MIT License

Table of Contents
  1. How it works
  2. Getting Started
  3. Roadmap
  4. License
  5. Contact
  6. Acknowledgements

Demo (click to view)

YouTube

Surfer is the world's first digital footprint exporter, designed to centralize all your personal data from various online platforms into a single folder.

Currently, your personal data is scattered across hundreds of platforms and the companies operating these platforms have no incentive to give this data back to you. Surfer solves this problem by navigating to websites and scraping data from these websites.

We believe that personal data centralization is the key to enabling truly useful, universal personal assistants.

How it works

Surfer Diagram

  1. Click on "Export" to initiate the data extraction process.
  2. The app waits for the target page to load completely.
  3. The system checks if the user is signed in to the platform being scraped.
  4. If not signed in, the user is prompted to sign in.
  5. If signed in, the process continues.
  6. Once signed in, the app interacts with the platform's user interface.
  7. The app then scrapes the user's data from the platform.
  8. Finally, the extracted data is exported and saved to your local storage.

Getting Started

To download the app, head over to https://surfsup.web.app. Or you can go to the releases page.

For instructions on setting up the app locally and contributing to the project, please refer to the Contributing Guidelines, Helper Functions Documentation, and Guide to Adding New Platforms.

See the open issues for a full list of proposed features (and known issues).

Roadmap

Short-Term

  • Obtain a code signing certificate for Windows
  • Replace setTimeout with await for script execution to ensure elements exist before scraping
  • Implement robust error handling for the scraping process
  • Add support for more online platforms
  • Add verbosity to runs

Medium to Long-Term

  • Implement concurrent scraping to allow for multiple scraping jobs to run simultaneously
  • Adding sub-tasks within platforms (i.e. Twitter Bookmarks, LinkedIn Connections Data, etc)
  • Integrate with other agentic frameworks like LangChain for advanced personal AI assistants
  • Explore integration with wearable devices for enhanced personal data tracking and acknowledgment

License

Distributed under the MIT License. See LICENSE for more information.

Built With

  • Electron
  • React
  • Tailwind
  • Shadcn UI

Contact

Surfer Discord Server - @SahilLalani0 - @JackBlair87 - @T0M_3D

Project Link: https://github.com/CEREBRUS-MAXIMUS/Surfer-Data

Acknowledgements

surfer-data's People

Contributors

jackblair87 avatar sahil-lalani avatar t0mcs avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.