anilsener / iedatachallange-django-analytics-project Goto Github PK

IE 2nd term project prototype application based on Telefonica Mobility and BBVA Credit Card Payments. Provider data is strictly disclosed; but you can use the code in any purpose you desire. MVC stack framework using python Django. Api integrations with Expedia and Twitter Streaming API. Important work on TripAdvisor webscraping. NLP (NLTK) for Topic based sentiment analysis(Trip Advisor Reviews), Timeseries forecasting, Recommendation Engine, Leaflet Data Visualization, NetworkX SNA (python and JS). BBVA data is neglected because of lack of data integrity and necessary categories. I hope this work can be helpful to practicioners of Django framework and analytics. This application is developed in a very short term with Agile methodology, therefore it is normal that there are problems and inconsistencies of code quality. For example we tried to use mongoengine and Django framework document models as a common data source; but we faced with difficulties time to time because of lack of accurate documentation in web. Whenever we resolved we followed the accurate coding practice. Please followup the model usage practice in the last view in views.py to comply with MVC, do not use pymongo directly. Mongoengine will provide features like DBConnectionPooling that will facilitate a scalable architecture.