The main goal of this project is to build libraries and models rooted in deep learning to estimate the causal effects of an intervention on some measurable outcomes (e.g. the effect of a treatment or procedure on survival).

pip install --upgrade pip
pip install -r requirements.txt

While in the base directory of the repo, run:

python estimate.py

The results of all estimators will be stored in folder estimation_results.

• COM/S-Learner: OLS1, RF1, NN1;
• GCOM/T-Learner: OLS2, RF2, NN2;
• Inverse Probability Weighting (IPW);
• Double Machine Learning/R-Learner;
• TARNet
• Dragonnet

where OLS stands for Ordinary Least Squares, RF stands for Random Forest, and NN stands for Nerual Networks. They represent ML models that are linear, ensembled, and non-linear respectively.

Please see the description of the datasets in the data folder.

• IHDP-100
• Jobs
• TWINS

• Mean absolute error (MAE) of ATE
• Precision in Estimation of Heterogeneous Effect (PEHE)

The nuisance models are the models used in the paper Empirical Analysis of Model Selection for Heterogenous Causal Effect Estimation to estimate the ground truth for PEHE calculation.

While in the base directory of the repo, run:

python utils/nuisance_model_selection.py --dataset <dataset_name>

This uses AutoML to estimate the best model for each nuisance model. The results are stored in the estimation_results/<dataset_name>/models folder. The results for Jobs and TWINS are already stored in the repo.

• T-Learner 0
• T-Learner 1
• S-Learner
• Double Machine Learning (DML)
• Propensity

• IHDP-100
• Jobs
• TWINS

After performing estimation, run:

python evaluate.py

• Open the notebooks folder and click on the desired notebook.
• At the top of the notebook, click on the button.
• Follow the instructions in the Colab to run the code.

For the Demo_End2End_Causal_Estimation_Pipeline.ipynb notebook, to ensure that you've initialized it correctly, check the following:

• After running the first code block in Colab, your file directory should look like this:

(Note: you can press to refresh)

To check your code at commit time

pre-commit install

You can also get pre-commit to fix your code

pre-commit run