[]
(http://travis-ci.org/CartoDB/cartodb)
CartoDB is an open source tool that allows for the storage and visualization of geospatial data on the web.
It was built to make it easier for people to tell their stories by providing them with flexible and intuitive ways to create maps and design geospatial applications. CartoDB can be installed on your own server and we also offer a hosted service at cartodb.com.
If you would like to see some live demos, check out our videos on Vimeo. We hope you like it!
With CartoDB, you can upload your geospatial data (Shapefiles, GeoJSON, etc) using a web form and then make it public or private.
After it is uploaded, you can visualize it in a table or on a map, search it using SQL, and apply map styles using CartoCSS. You can even access it using the CartoDB API OVERVIEW and SQL API, or export it to a file.
In other words, with CartoDB you can make awesome maps and build powerful geospatial applications! Definitely check out the CartoDB Develop for interactive examples and code.
- A User Interface for uploading, creating, editing, visualizing, and exporting geospatial data.
- A geospatial database built on PostgreSQL and PostGIS 2.1
- An SQL API for running SQL queries over HTTP with results formatted using GeoJSON and KML
- A Map tiler that supports SQL and tile styling using CartoCSS
- Authentication using OAuth if required
- Ubuntu 12.04
- Postgres 9.3.x (with plpythonu extension)
- cartodb-postgresql extension
- Redis 2.2+
- Ruby 1.9.3
- Node.js 0.10.x
- CartoDB-SQL-API
- GEOS 3.3.4
- GDAL 1.10.x (Starting with CartoDB 2.2.0)
- PostGIS 2.1.x
- Mapnik 2.1.1
- Windshaft-cartodb
- Varnish 2.1+ (WARNING: must be < 3.0!)
- ImageMagick 6.6.9+ (for the testsuite)
This is README is intended for Ubuntu 12.04. This doesn't mean that it can't be installed in other Linux versions or OSX systems, but that it's guaranteed to work only in Ubuntu 12.04. If anyone wants to share with us the installation process for any other system we will be more than happy to point it from this README. That said, there are also many successful installations on Amazon EC2, Linode, dedicated instances and development machines running OS X and Ubuntu 12.04+.
CartoDB is under heavy development. This means that at some point this README can fail at some point. If you detect it, please let us know and we will fix it as soon as we can. Also if you feel that something is wrong or even it's missing we will be also happy to fix it.
For any doubt about the process you can ask in our Google Group
If you want to give it a try, download CartoDB by cloning this repository:
$ git clone --recursive https://github.com/CartoDB/cartodb.git
Or you can just download the CartoDB zip file.
Add CartoDB Base PPA
sudo add-apt-repository ppa:cartodb/base
Add CartoDB GIS PPA
sudo add-apt-repository ppa:cartodb/gis
Add CartoDB Mapnik PPA
sudo add-apt-repository ppa:cartodb/mapnik
Add CartoDB Node PPA
sudo add-apt-repository ppa:cartodb/nodejs
Add CartoDB Redis PPA
sudo add-apt-repository ppa:cartodb/redis
Add CartoDB PostgreSQL PPA
sudo add-apt-repository ppa:cartodb/postgresql-9.3
Add CartoDB Varnish PPA
sudo add-apt-repository ppa:cartodb/varnish
Resfresh repositories to use the PPAs
sudo apt-get update
unp is required for archive file upload support
sudo apt-get install unp
zip is required for table exports
sudo apt-get install zip
GEOS is required for geometry function support.
sudo apt-get install libgeos-c1 libgeos-dev
GDAL is requires for raster support.
sudo apt-get install gdal-bin libgdal1-dev
JSON-C is required for GeoJSON support.
sudo apt-get install libjson0 python-simplejson libjson0-dev
PROJ4 is required for reprojection support.
sudo apt-get install proj-bin proj-data libproj-dev
PostgreSQL is the relational database that powers CartoDB.
sudo apt-get install postgresql-9.3 postgresql-client-9.3 postgresql-contrib-9.3 postgresql-server-dev-9.3
plpython is required for Python support
sudo apt-get install postgresql-plpython-9.3
Currently there is an error with credential-based connections for development, and all connections must be performed using method "trust" inside config file pg_hba.conf
.
/etc/postgresql/9.3/main$ sudo vim pg_hba.conf
And change inside all local connections from peer/md5/... to trust.
Then restart postgres and you're done.
sudo /etc/init.d/postgresql restart
PostGIS is the geospatial extension that allows PostgreSQL to support geospatial queries. This is the heart of CartoDB!
cd /usr/local/src
sudo wget http://download.osgeo.org/postgis/source/postgis-2.1.2.tar.gz
sudo tar xzf postgis-2.1.2.tar.gz
cd postgis-2.1
sudo ./configure --with-raster --with-topology
sudo make
sudo make install
Finally, CartoDB depends on a geospatial database template named
template_postgis
. In the example script below (can be saved for examples as template_postgis.sh
), make sure that the
path to each SQL file is correct:
#!/usr/bin/env bash
POSTGIS_SQL_PATH=`pg_config --sharedir`/contrib/postgis-2.1
createdb -E UTF8 template_postgis
createlang -d template_postgis plpgsql
psql -d postgres -c \
"UPDATE pg_database SET datistemplate='true' WHERE datname='template_postgis'"
psql -d template_postgis -c "CREATE EXTENSION postgis"
psql -d template_postgis -c "CREATE EXTENSION postgis_topology"
psql -d template_postgis -c "GRANT ALL ON geometry_columns TO PUBLIC;"
psql -d template_postgis -c "GRANT ALL ON spatial_ref_sys TO PUBLIC;"
Before executing the script, change to the postgres user:
sudo su - postgres
./template_postgis.sh
Alternatively, you may run the lines of the template_postgis.sh
script one by one by entering Postgres as follows:
sudo su - postgres
POSTGIS_SQL_PATH=`pg_config --sharedir`/contrib/postgis-2.1
createdb -E UTF8 template_postgis
createlang -d template_postgis plpgsql
psql -d postgres -c "UPDATE pg_database SET datistemplate='true' WHERE datname='template_postgis'"
psql -d template_postgis -c "CREATE EXTENSION postgis"
psql -d template_postgis -c "CREATE EXTENSION postgis_topology"
psql -d template_postgis -c "GRANT ALL ON geometry_columns TO PUBLIC;"
psql -d template_postgis -c "GRANT ALL ON spatial_ref_sys TO PUBLIC;"
exit
git clone https://github.com/CartoDB/pg_schema_triggers.git
cd pg_schema_triggers
sudo make all install PGUSER=postgres
sudo make installcheck PGUSER=postgres # to run tests
cd ..
git clone https://github.com/CartoDB/cartodb-postgresql.git
cd cartodb-postgresql
git checkout cdb
sudo make all install
sudo PGUSER=postgres make installcheck # to run tests
NOTE: if test_ddl_triggers fails it's likely due to an incomplete installation of schema_triggers. You need to add schema_triggers.so to the shared_preload_libraries setting in postgresql.conf
Check https://github.com/cartodb/cartodb-postgresql/ for further reference
We implemented CartoDB in the Ruby programming language, so you'll need to install Ruby 1.9.3. You can use rvm:
sudo curl -L https://get.rvm.io | bash
sudo su
source /home/username/.rvm/scripts/rvm
source /etc/profile.d/rvm.sh
exit
Open the ~/.bash_profile file and add the source ~/.profile
line at the end of the file
Install Ruby and its related resources
rvm install 1.9.3
sudo apt-get install ruby-bundler
sudo apt-get install rubygems
The tiler API and the SQL API are both Node.js apps.
sudo apt-get install nodejs npm
sudo add-apt-repository ppa:cartodb/nodejs-010
sudo apt-get update; sudo apt-get upgrade
sudo apt-get dist-upgrade
We currently run our node apps against version 0.10. You can install NVM to handle multiple versions in the same system:
curl https://raw.github.com/creationix/nvm/master/install.sh | sh
Then you can install and use any version, for example:
nvm install v0.8.9
nvm use 0.8.9
Components of CartoDB, like Windshaft or the SQL API depend on Redis.
sudo apt-get install redis-server
This needs to be done from the cartodb local copy.
To install the Python modules that CartoDB depends on, you can use
easy_install
.
You need to have some dependencies installed before using pip:
sudo apt-get install python2.7-dev
sudo apt-get install build-essential
sudo su
apt-get install python-setuptools
easy_install pip
export CPLUS_INCLUDE_PATH=/usr/include/gdal
export C_INCLUDE_PATH=/usr/include/gdal
pip install --no-use-wheel -r python_requirements.txt
exit
If the previous step fails, try this alternative:
export CPLUS_INCLUDE_PATH=/usr/include/gdal
export C_INCLUDE_PATH=/usr/include/gdal
sudo pip install --no-install GDAL
cd /tmp/pip_build_root/GDAL
sudo python setup.py build_ext --include-dirs=/usr/include/gdal
sudo pip install --no-download GDAL
Varnish is a web application accelerator. Components like Windshaft use it to speed up serving tiles via the Maps API.
sudo apt-get install varnish=2.1.0-2cdb~precise1
Varnish should allow telnet access in order to work with CartoDB, so you need to edit the /etc/default/varnish
file and in the DAEMON_OPTS
variable remove the -S /etc/varnish/secret \
line.
Mapnik is an API for creating beautiful maps. CartoDB uses Mapnik for creating and styling map tiles.
sudo apt-get install libmapnik-dev python-mapnik mapnik-utils
The CartoDB SQL API component powers the SQL queries over HTTP. To install it:
git clone git://github.com/CartoDB/CartoDB-SQL-API.git
cd CartoDB-SQL-API
git checkout master
npm install
cp config/environments/development.js.example config/environments/development.js
To run CartoDB SQL API in development mode, simply type:
node app.js development
The Windshaft-cartodb component powers the CartoDB Maps API. To install it:
git clone git://github.com/CartoDB/Windshaft-cartodb.git
cd Windshaft-cartodb
git checkout master
npm install
cp config/environments/development.js.example config/environments/development.js
To run Windshaft-cartodb in development mode, simply type:
node app.js development
sudo apt-get install imagemagick
Congratulations! Everything you need should now be installed. Celebrate by drinking a cold beer before continuing. :)
Time to run your development version of CartoDB. Let's suppose that we are going to create a development env and that our user/subdomain is going to be 'development'
export SUBDOMAIN=development
# Enter the `cartodb` directory.
cd cartodb
# Start redis, if you haven't done so yet
# Redis must be running when starting either the
# node apps or rails or running the ``create_dev_user script``
# NOTE: the default server port is 6379, and the default
# configuration expects redis to be listening there
redis-server
# If you are using rvm, create a new gemset
rvm use 1.9.3@cartodb --create && bundle install
# If it's a system wide installation
sudo bundle install
# Make the created gemset your default one
rvm use 1.9.3@cartodb --default
# Configure the application constants
mv config/app_config.yml.sample config/app_config.yml
vim config/app_config.yml
# Configure your postgres database connection details
mv config/database.yml.sample config/database.yml
vim config/database.yml
# Add entries to /etc/hosts needed in development
echo "127.0.0.1 ${SUBDOMAIN}.localhost.lan" | sudo tee -a /etc/hosts
# Create a development user
#
# The script will ask you for passwords and email
#
# Read the script for more informations about how to perform
# individual steps of user creation and settings management
#
sh script/create_dev_user ${SUBDOMAIN}
Start the resque daemon (needed for import jobs):
$ bundle exec script/resque
Finally, start the CartoDB development server on port 3000:
$ bundle exec rails s -p 3000
You should now be able to access
http://<mysubdomain>.localhost.lan:3000
in your browser and login with the password specified above.
See UPGRADE file for instructions about upgrading CartoDB.
For upgrade of Windshaft-CartoDB and CartoDB-SQL-API see the relative documentation.
For a full list of CartoDB utility tasks:
bundle exec rake -T
You can also use foreman to run the full stack (cartodb server, sql api, tiler, redis and resque), using a single command:
bundle exec foreman start -p $PORT
where $PORT is the port you want to attach the rails server to.
Please ensure CartoDB-SQL-API, Windshaft-cartodb, and Redis are all running for full experience.
Manual configuration is needed for the
public/javascripts/environments/development.js
file which configures
Windshaft-cartodb tile server URLs.
Installing the full stack might not always be smooth due to other component updates, so if you run into problems installing CartoDB, please check this list of problems and solutions first to see if your problem already happened in the past and somebody else found a workaround, solution or fix to it.
See TESTING
- Fernando Blat (ferblape)
- Javier Álvarez Medina (xavijam)
- Simon Tokumine (tokumine)
- Alvaro Bautista (batu)
- Fernando Espinosa (ferdev)
- Sergio Alvarez Leiva (saleiva)
- Javier de la Torre (jatorre)
- Andrew W Hill (andrewxhill)
- Javi Santana (javisantana)
- Javier Arce (javierarce)
- Aaron Steele (eightysteele)
- Luis Bosque (luisico)
- Sandro Santilli (strk)
- David Arango (demimismo)
- Xabel Álvarez (johnhackworth)
- Lorenzo Planas (lorenzoplanas)
- Alejandro Martínez (iamzenitram)
- Carlos Matallín (matallo)
- Rafa Casado (rafacas)
- Diego Muñoz (kartones)
- Raul Ochoa (rochoa)
- Nicolás M. Jaremek (NickJaremek)