Giter Club home page Giter Club logo

personal-analytics-visualizer's Introduction

Splash Image

Self Stats - Google Takeout Data Insights Visualizer ๐Ÿ“Š

Welcome to Self Stats Google Takeout Data Insights Visualizer! This Python package revolutionizes how you interact with your personal Google Analytics data extracted via Google Takeout. By offering eye-catching, interactive visualizations, this tool helps you gain deep insights into your digital footprint with Google services. Whether you're a data enthusiast or simply curious about your online habits, this tool provides valuable perspectives into your personal analytics data.

Features ๐ŸŒŸ

  • Automated Data Processing: Import and analyze your personal Google Analytics data from Google Takeout.
  • Interactive Visualizations: Engage with your data through beautifully designed graphs and interactive charts.
  • Insight Discovery: Discover trends, patterns, and more from your personal usage data.
  • User-Friendly Interface: Easy setup and intuitive controls make your data exploration enjoyable and straightforward.

Getting Started ๐Ÿš€

Prerequisites

To use the Google Takeout Data Insights Visualizer, you will need:

  • Python 3.6 or higher
  • Pip for Python package management

Installation

Install this package using pip:

pip install self_stats

You will then need to install a word model from spacy for keyword analysis.

python3 -m spacy download en_core_web_sm

Data Preparation

Downloading Your Data from Google Takeout

  • Open your web browser and go to Google Takeout.
  • Google Takeout allows you to export data from your Google account products.
  • Choose the Google products you want data from. Ensure you have selected "MyActivity" and "YouTube and YouTube Music"
  • Change the file format to JSON. The default is HTML and will be incompatible with this pipeline.
  • Once your archive is ready, Google will notify you via email.
  • Download the archive and extract it.

Google Takeout Demo

Setting Up the Visualizer

  1. Prepare Your Data:

    • After extracting your data, place the relevant Google Analytics JOSN file(s) in a chosen directory.
    • The package will detect specific filenames automatically so ensure they are correctly named:
      • "watch-history.html": initiates YouTube watch history processing.
      • "MyActivity": initiates search history processing.

Usage

Run the data processing tool with:

python -m self_stats
  • The package will ask you to specify the directory with the data.
  • Processed files will be populated in the chosen directory.

Example Visualizations ๐Ÿ“ˆ

Example Dashboard

  • Time Series Analysis: Analyze activity trends over time.
  • Keyword Analysis: Analyze popular topics that you query.

Visualizing your data with Looker Studio

  1. Upload your data sources to Google Drive:
  • "SEARCH_collated.xlsx"
  • "WATCH_collated.xlsx"
  1. Once the files are uploaded, open them in Google Sheets and select "File" > "Save as Google Sheets". This will allow the files to be discoverable by Looker Studio.
  2. Navigate to the Looker Studio Personal Analytics Demo Dashboard.
  3. Select "more options" (three vertical dots) and then select "make a copy".
  4. Select "Copy Report" in the following prompt.
  5. Click "Add Data", select Google Sheets as a data source and then select each file individually
  6. Once all data is added, right-click on any of the plots and click "Select" then click "charts with this data source on page".
  7. In the right sidebar, select your new data source for their respective dashboard pages.
  8. For the "Date range dimension" select "Date".
  9. The page should auto-update with your personal analytic data.
  10. Remember not to share your dashboard once it has been modified with your data.

Contributing ๐Ÿค

We encourage contributions from the community! Please read our CONTRIBUTING.md for guidelines on how to participate in developing this tool further.

Data Privacy Disclaimer

While the Self Stats Google Takeout Data Insights Visualizer offers powerful insights into your personal Google Analytics data, it's important to handle your data with care. Here are some precautions we strongly advise:

  • Sensitive Information: Your Google Takeout archive may contain sensitive personal information. Ensure you securely handle and store this data to prevent unauthorized access.
  • Data Security: Only use this tool on devices you trust, within secure environments. Avoid using public or shared computers where data might be compromised.
  • Privacy Settings: Regularly review your privacy settings on Google and other online platforms to manage what data is collected about you.
  • Data Sharing: Be cautious about sharing your insights and visualizations. They could inadvertently reveal personal information about you or your habits.
  • Legal Compliance: Ensure your use of data complies with local data protection laws and regulations, including GDPR, if applicable.

By using this tool, you agree to do so at your own risk. The developers of the Self Stats Google Takeout Data Insights Visualizer are not responsible for any data breaches or privacy violations that may occur from improper handling of your data. Always prioritize your data privacy and use this tool responsibly.

License

This project is released under the MIT License - see the LICENSE file for details.

Support and Feedback ๐Ÿ“

For support, feature requests, or to report bugs, please use the repository's issue tracker.

personal-analytics-visualizer's People

Contributors

coltonrobbins73 avatar ivanpedroza avatar

Watchers

 avatar

personal-analytics-visualizer's Issues

TODO

  • Plot ideas for visualizing web traffic data
    • Look for pre-existing libraries
    • Draw on existing web traffic analytics frameworks
    • Current ideas
      • Day of the week activity profile
      • Long term activity profile
      • Keyword graph display of common search categories
      • Heat map of where you submit queries using lat and long coords
  • Plot ideas for visualizing youtube watch history
    • Common video themes over time
  • Plot ideas for visualizing calendar events
  • Plot ideas for visualizing other data flights, notifications, podcasts, maps
  • Plot ideas for visualizing phone calls, voicemail, chats
    • Overall activity over time
  • Write better documentation
    • Currently using automated generation with sphinx
  • Package application with pip

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.