Giter Club home page Giter Club logo

intro2stats's Introduction

Introduction to Statistics

Bitdeli Badge

Inspired by Allen Downey's books Think Stats and Think Bayes, this is an attempt to learn Statistics using an application-centric programming approach.

Objective

Showcase real-life examples and what statistics to use in each of those examples. Almost every book teaches a concept and shows an example. Ultimately, every topic gets treated separately and no holistic view is presented. Here, we would take examples and see how to make sense out of it.

Topics covered

  • Mean, Median, Mode
  • Standard Deviation
  • Variance
  • Co-variance
  • Probability Distribution
  • Hypothesis Testing
  • t-test, p-value, chi-squared test
  • Confidence Intervals
  • Confidence levels and Sigificance levels
  • Correlation
  • Resampling (and uses in Big Data)
  • A/B Testing
  • A simple linear regression model

Workshop Plan

We would be using Marijuana prices in various states of the USA, along with demographic data of the USA based on the latest census data

There will be separate ipython notebooks - grouped by topic similarities. notebooks will be uploaded later Some examples include:

  • Find sum of people buying weed in a year, by various states.
  • Find mean of price in a week/month, by various states.
  • Find variance of price in selected states. Find variance of selected states by week of month
  • Define distribution. Plot histograms
  • Determining outliers (Plots, quantiles, box plots, percentiles) in weed price data
  • Continuous distributions(exponential distribution, normal distribution)
  • Introduction to Probability
  • Hypothesis testing. Check if weed price across states are similar or not. Check for different qualities of weed
  • Resampling
  • Simple regression model: Predict weed price for the next month. Understand the output and diagnostics
  • Introduction to A/B testing: Impact of regulation and deregulation on a couple of states

Prerequisites

  • Basics of Python. User should know how to write functions; read in a text file(csv, txt, fwf) and parse them; conditional and looping constructs; using standard libraries like os, sys; lists, list comprehension, dictionaries
  • It is good to know basics of the following:
    • Numpy
    • Scipy
    • Pandas
    • Matplotlib
    • Seaborn
    • IPython and IPython notebook - Everything here would be an IPython notebook
  • Software Requirements
    • Python 2.7
    • git - so that this repo can be cloned :)
    • virtualenv
    • Libraries from requirements.txt

Optional

Users could choose to install Anaconda, if they want. If using Anaconda or Enthought, please ensure that all libraries listed in the requirements.txt are installed.

Note to Windows Users: Neither of us use Windows. From past workshop experiences, Windows users have faced issues installing the way explained below. It is advisable to install Anaconda and ensure that all the libraries listed in the requirements.txt file are installed.

Setup Guide

####Clone the repository $ git clone https://github.com/rouseguy/intro2stats.git

####Create a virtual environment & activate $ cd intro2stats $ virtualenv env $ source env/bin/activate

####Install reqirements from requirements file $ pip install -r requirements.txt

####Note: Make sure you have libraries for png & freetype. Ubuntu users can install the below

apt-get install libfreetype6-dev
apt-get install libpng-dev

###Script to check if installation is fine for the workshop Please execute the following at the command prompt

$ python check_env.py

If any library has a FAIL message, please install/upgrade that library.


Creative Commons License
Introduction to Statistics using Python by Bargava and Raghotham is licensed under a Creative Commons Attribution 4.0 International License.

intro2stats's People

Contributors

bitdeli-chef avatar raghothams avatar rouseguy avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.