anthill / open-moulinette Goto Github PK
View Code? Open in Web Editor NEWScripts to clean Open-Data.
License: MIT License
Scripts to clean Open-Data.
License: MIT License
Is your license MIT or something else? It would be great to mention this in the repository, but I cannot find the information. Thanks!
There are some interesting data with IRIS geo in population censur 2011
The CAF
folder seems to generate files with lat-lon coordinates (geo_point_2d
and geo_shape
) with 10+ decimals of precision.
8 decimals (about 1mm) is more than enough is most cases.
http://gis.stackexchange.com/questions/8650/how-to-measure-the-accuracy-of-latitude-and-longitude
You should check how much size you can spare by keeping only 8 decimals in your coordinates.
There is a new edition of data.
http://www.insee.fr/fr/themes/detail.asp?reg_id=99&ref_id=revenu-pauvrete-menage
But I can't see any Iris anymore. Do you know anything about it ?
There are 2015 files in Caf website.
in https://github.com/anthill/open-moulinette/blob/master/insee/mk_data.py ?
You know these insee files better than I do but I suggest to use
[x for x in df.columns if x[:5] == 'NB_F1' and len(x) == 7]
instead of an explicit list
It seems that TrancheAge2013.csv is now missing from CAF website.
Dénombrement et répartition des foyers allocataires selon l’âge du responsable dossier - par commune
I have send a mail to data Caf Team to more infos.
Documentation for impot_locaux is not easy. Informations come from impot.gouv.fr.
If we take features BB00
, it is a FNB
but we don't know what is a FNB
.
We only have :
TFPNB
: La taxe foncière sur les propriétés non bâtiesTFPB
: La taxe foncière sur les propriétés bâtiesTH
: La taxe d'habitationCFE
: La cotisation foncière des entreprisesCVAE
: La cotisation sur la valeur ajoutée des entreprisesTSE
: La taxe spéciale d'équipement au profit de la région d'Île-de-France et d'établissements publicsTEOM
: La taxe d'enlèvement des ordures ménagèresIFER
: Les impositions forfaitaires sur les entreprises de réseauxTASCOM
: La taxe sur les surfaces commercialesHi there,
I'm working on Oise department (60) and I realised that 19 iris (eq 7 communes) are missing from the output. I compared with the 2013 ' reference table (here : http://www.insee.fr/fr/methodes/default.asp?page=zonages/iris.htm), excluding the case 'Iris = commune'.
Here is the list :
Any idea of where it comes from ? I could not figure it out.
Many thanks
We have to select feature to sum them. For some type of feature, there are sometimes sub-features. We can't sum them.
Problem with Python script to get BasrevenuCom sources.
Bonjour,
Serait-il possible d'extraire les données qui concernent un territoire en particulier en donnant comme argument un code département ou région au script ?
Pascal
Got an error when trying to make :
\open-molinette-insee\insee>make
process_begin: CreateProcess<NULL, rm -rf data, ...> failed.
make >e=2>: Le fichier spécifié est introuvable.
make : **[download] Erreur 2
Might be my bad, running on Win7 and using GnuWin to makefile.
When we want to download all Insse's files :
It seems we have to find and update all url in Makefile
corresponding to the file.
Waiting news from Insee via Twitter
There is a new year (2016) to add to impot_locaux (2013, 2014 & 2015).
Maybe have to add it to data.gouv.fr
insee/Makefile
. Some URLs has been changed.I take some random points in DOM TOM to compare with insee-iris's results :
I have a problem after i run the script that the shape of the output is [52004 rows x 1 columns]
any clues ?
There are some new data from Insee 2015 :
Don't have time to work on it.
Les éléments d'imposition à la fiscalité locale
Bonjour,
Disposant d'un environnement Windows, et étant assez peu familier avec le script et l'usage qu'il en est fait, est-il possible de récupérer directement le fichier qui concatène les données de l'Insee (output.csv 750 Mo) ?
Je vous remercie.
Official link : http://www.insee.fr/fr/methodes/default.asp?page=zonages/iris.htm
When an iris database is loaded we should check coehrence with the official reference.
For past years, we could also update iris when possible (merging, renaming, etc.)
Help windows-users to survive !
In the output.csv file there are duplicated/renamed columns:
In [4]: iris_data[["P11_POP0610_y","P11_POP0610_x"]]
Out[4]:
P11_POP0610_y P11_POP0610_x
8244 2.657657 2.657657
8245 9.264451 9.264451
8249 59.842819 59.842819
8250 36.122749 36.122749
8252 76.274345 76.274345
8253 0.000000 0.000000
8255 70.970911 70.970911
8257 23.676515 23.676515
8258 76.594980 76.594980
8263 6.185141 6.185141
8265 66.090180 66.090180
8270 91.759323 91.759323
8273 75.359878 75.359878
8277 51.389227 51.389227
8278 91.075531 91.075531
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.