Comments (13)
Basically Docker is an environment for virtualization using containers (LXC, linux kernel feature) and other linux/unix features like cgroups, UnionFS, etc with all beneficies that provides. (isolation, security, resources management, etc).
Each container is a linux process, sharing the kernel (and other linux libs) with all containers and Linux Host. It is the difference with the conventional VMM (like VBox or VMWare) that uses and runs a complete SO over an hypervisor.
Here in this project the approach is the portability, because you only need to install docker in host. All dependencies (nodejs, npm and node_modules) are builded in the Docker Image. Then, when you need to scrap a site just run a docker container from these image and it's all.
Sorry for my english :P
NOTE: This is only a very short introduction to Docker and how to benefit us!
For complete Docs, here.
from scrape-it.
Thanks, @shouze! If that's helpful, let's do it. Contributions are welcome!
I didn't work with Docker, but I'm open to accept any changes that make this tool better. ✨
from scrape-it.
Hi @IonicaBizau, please creates a new repository for the Dockerfile
, (like scrape-it-docker). I'll fork it and contribute with this :)
from scrape-it.
@brunocascio Is there any specific reason why we should create a different project for the Docker thingy?
from scrape-it.
@IonicaBizau Because i'll use npm package for create the image, and don't need anything of the source repo. Would be possible use this repo, but think is a wrong place. Anything, let me know :)
from scrape-it.
@brunocascio I have no idea how Docker works at all. Maybe can you tell me more about workflow?
from scrape-it.
@brunocascio Thanks! And what is the difference of having the Dockerfile
in this repository or in another one?
I'm still not sure how creating a new project helps. Is it just the download size, since you're saying the code will come from npm?
Thanks! 😁
from scrape-it.
Add a Dockerfile
in this repo would be ok. But this file will have not nothing to do here.
Also, If somebody want to use Dockerfile should clone the repo with ALL files instead of only the Dockerfile.
It's only my opinion :)
Otherwise, please let me know and i'll make a pull-request here 💃
from scrape-it.
@brunocascio Ah, I see! Is it because Docker takes the packages from git?
The repo itself is pretty tiny anyways. I'm also for splitting if that will be faster. 😁
from scrape-it.
Docker will take packages from npm instead of git.
So, I'll make a pull-request here later :)
from scrape-it.
Ah, great! Then I guess it's fine to add it here. Maybe later if anyone will complain about it we can split it. 😄
Thanks!
from scrape-it.
@IonicaBizau Great! :)
from scrape-it.
Fixed via #31. 🎉
from scrape-it.
Related Issues (20)
- Encoding issue with Spanish accents HOT 3
- Cannot find name Cheerio / CheerioSelector / CheerioStatic HOT 1
- Add support for conditional selector HOT 1
- Meta Data HOT 1
- no space between tag HOT 1
- Move scrapeHTML into its own package HOT 1
- Headers of type HTTP/2 HOT 1
- scrapeHTML is not defined HOT 1
- Alternative selectors for one element HOT 1
- Scrape a table with image links. HOT 1
- Parsing tables and xpath
- Can't select nth element HOT 1
- Scrape Behind Login HOT 1
- commas on next line in readme HOT 1
- $ is not a function in a Remix App HOT 1
- Doesn't return tag script attribute value HOT 1
- Doesn't work with :nth-child selector HOT 1
- [Feature request] "OR" query
- Can't use :not(:fist-child) nor eq in listItem HOT 1
- Type error with the how field of type ScrapeOptionElement
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from scrape-it.