Giter Club home page Giter Club logo

empathytalk's Introduction

The EmpathyTalk Project ๐Ÿ’– ๐Ÿ’ฌ

Introduction

How does priming interlocutors to think and behave empathically toward others influence the quality of naturalistic conversation?

During the pandemic, ~50 speaker dyads engaged in ~20-minute long conversations and were provided the option of relying on various prewritten prompts to guide the direction of their chat. Both cameras and microphones were on for the duration of each video call over Zoom allowing for recording of both video and audio data. The speech extracted from the latter was manually transcribed by professional transcriptionists and stored in text files. Participants were randomly assigned to either an empathy or control condition, and the former involved a pre-experiment intervention consisting of a reading task emphasizing the malleability and importance of empathy in interpersonal relationships. Participants from dyads in the empathy condition were aware of each others' belonging in the same condition, and they were encouraged to incorporate the information gleaned from their reading tasks into their chat.

Method

We aimed to answer our main research question algorithmically and computationally by adopting a convergent three-pronged approach to analyzing this pilot dataset:

  1. NLP ๐Ÿ“
  2. Computer Vision ๐Ÿ‘๏ธโ€๐Ÿ—จ๏ธ
  3. Audio Signal Processing ๐Ÿ”‰

A host of interrelated methods were implemented in Python and R to analyze the transcribed speech:

NLP: Using natural language processing to analyze the semantic differences catalyzed by empathy

Does priming empathy cause speakers to...

  • ...linguistically mirror each other affectively?
    • Sentiment analysis (transformers, Microsoft Azure Cognitive Services, AFINN, LIWC, SEANCE)
  • ...linguistically mirror each other semantically?
    • Semantic similarity (tensorflow: universal sentence encoder)
  • ...self-disclose more frequently?
    • First-person pronoun counts (spacy)
  • ...speak more freely?
    • Profanity detection (profanity-check)

Computer vision: Using facial detection software to identify the visual effects of empathy on self-presentation

Does priming empathy cause speakers to...

  • ...visually mirror each other's body language affectively?
    • Facial emotion detection (cv2, Microsoft Azure Face Detect API)

Audio signal processing: Assessing the effect of empathy on conversational acoustics

Does priming empathy cause speakers to...

  • ...acoustically mirror each other's pitch and volumne more strongly? (pydub, scipy)

empathytalk's People

Contributors

1nathanliang avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.