devprabal / synkrino Goto Github PK
View Code? Open in Web Editor NEWA simple web scraping project with cool web interface for comparing trending mobile prices on 3 sites- amazon, flipkart and paytmMall
A simple web scraping project with cool web interface for comparing trending mobile prices on 3 sites- amazon, flipkart and paytmMall
Make a loading page which has to appear before scrapper result page and after clicking on Submit button.
Use an SVG or a SCSS for full page loading display. Or increase the width of gif with the existing CSS
Separate script and style from index.html to another files and include them at appropriate positions/folders.
It should be removed from display as soon as scrapper is ready with its result.
Its integration with Flask
Maybe outline the development process rather than the working of synkrino.
Although, the created environment is activated through the installer.sh
script, yet pip fails to install dependencies (from the requirements.txt file) into the environment. It installs it outside the environment (base). Improve this.
Make a script to run the app.py
program in the synenv
virtual environment.
Write scraping code for other trending products for 2 platforms- Amazon and Flipkart.
Maintain a dictionary (maybe as an external file or in the code itself) for all products and their homepages on Amazon and Flipkart.
Integrate the code in app.py
and put a switch case to check conditions for which product to scrape when Submit button is clicked.
Improve get_price_amazon()
and get_price_flipkart()
functions to accept product url
as a parameter for generalisation and reduction of redundant code in app.py
I tested it to be running in Ubuntu 16.04.6 LTS using a Virtual Machine and downloading the installer.sh script and running it.
Can we create a docker image and make a container for testing on Ubuntu16.04.6 LTS ?
Make it appear beautiful.
It should contain the "Go Back" button.
Cache stored entries will reduce fetching time.
Try writing a makefile which will build the environment for app.py to be executed instead of the installer.sh file.
Is it possible?
Is it required?
Is it(make) a better way to do than installer.sh or is it something different?
Is the xpath same? Can we replace getElementById by xpath?
Should the project be abandoned and marked no longer supported?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.