Python scripts to convert chat logs from Facebook Messenger and Google Hangouts into Panda DataFrames. Can also generate ggplot histograms and word clouds from chat logs.

Use Google Takeout: https://takeout.google.com/settings/takeout

Request an archive containing your Hangouts chat logs. Extract the file called Hangouts.json and put it in the raw folder of ChatShape.

Google switched from "Google Talk" to "Google Hangouts" mid-2013. Sadly you will only get your Hangouts logs using Takeout.

1. Go to the "Settings" page: https://www.facebook.com/settings
2. Click on "Download a copy of your Facebook data" at the bottom of the General section.
3. Click on "Start My Archive". It will take Facebook a while to generate it.
4. Once it is done download and extract the archive, then move the messages folder in the raw folder of ChatShape.

Install the required Python packages:

virtualenv Chatistics
source Chatistics/bin/activate
pip install -r requirements.txt

You will need to specify your own name to the parsers. Use the exact same format as you have on Messenger or Hangouts.

• Google Hangouts: python parse_hangouts.py -ownName "John Doe"
• Facebook Messenger: python parse_messenger.py -ownName "John Doe"

The pickle files will now be ready for analysis in the data folder!

For more options use the -h argument on the parsers.

Chatistics can plot the chat logs as histograms, showing how many messages each interlocutor sent. It can also generate word clouds based on word density and a base image.

Plot all messages with:

python analyse.py -data data/*

You can filter messages as needed:

  -filterConversation FILTERCONVERSATION
                        only keep messages sent in a conversation with this sender
  -filterSender FILTERSENDER
                        only keep messages sent by this sender
  -removeSender REMOVESENDER
                        remove messages sent by this sender

Eg to see all the messages sent between you and Jane Doe:

python analyse.py -data data/* -filterConversation "Jane Doe"

To see the messages sent to you by the top 10 people with whom you talk the most:

python analyse.py -data data/* -removeSender "Your Name" -n 10

You can also plot the conversation densities using the -plotDensity flag.

You will need a mask file to render the word cloud. The white bits of the image will be left empty, the rest will be filled with words using the color of the image. See the WordCloud library documentation for more information.

python cloud.py -data data/* -m img/mask_image.jpg

You can filter which messages to use using the same flags as with histograms.

• Parsers for more chat platforms: WhatsApp? Pidgin? ...
• Figure out OWN_NAME automatically.
• Handle group chats.
• See TODO file for more.

Pull requests are welcome!

Fix with:

export LC_ALL=en_US.UTF-8
export LANG=en_US.UTF-8

ImportError: dlopen(/Users/flaurent/Sites/Chatistics/Chatistics/lib/python2.7/site-packages/lxml/etree.so, 2): Library not loaded: @rpath/libxml2.2.dylib
  Referenced from: /Users/flaurent/Sites/Chatistics/Chatistics/lib/python2.7/site-packages/lxml/etree.so
  Reason: Incompatible library version: etree.so requires version 12.0.0 or later, but libxml2.2.dylib provides version 10.0.0

This will fix it: https://stackoverflow.com/a/31607751/318557

• Word cloud generated using https://github.com/amueller/word_cloud
• Stopwords from https://github.com/6/stopwords-json
• Code under MIT license