Giter Club home page Giter Club logo

doctoscrap's Introduction

Hi there ๐Ÿ‘‹

Hi, I'm Lucas. I'm a full-stack developer from France ๐Ÿ‡ซ๐Ÿ‡ท.

If you found value in something I have created or just want to say hello, feel free to drop me a line @lucasportet.

doctoscrap's People

Contributors

dependabot[bot] avatar l-portet avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar

doctoscrap's Issues

Scrapping error

Config.js :

module.exports = {
  query: {
    type: 'dentiste',
    location: 'provence-alpes-cote-d-azur'
  }
}

Error message :

(base) โžœ doctoscrap git:(master) โœ— npm start

[email protected] start
node index.js

โœ” Setting all up and fetching website
โ ™ Scraped 0 pages (may take a while, grab a beer)node:internal/process/promises:289
triggerUncaughtException(err, true /* fromPromise */);
^

Error [TypeError]: Cannot read properties of null (reading 'getAttribute')
at evaluate (evaluate at getNextPageURL (/Users/Phamtom/Desktop/doctoscrap/src/run.js:53:23), :4:49)
at #evaluate (/Users/Phamtom/Desktop/doctoscrap/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/ExecutionContext.js:222:56)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async ExecutionContext.evaluate (/Users/Phamtom/Desktop/doctoscrap/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/ExecutionContext.js:117:16)
at async IsolatedWorld.evaluate (/Users/Phamtom/Desktop/doctoscrap/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/IsolatedWorld.js:124:16)
at async CdpFrame.evaluate (/Users/Phamtom/Desktop/doctoscrap/node_modules/puppeteer-core/lib/cjs/puppeteer/api/Frame.js:347:20)
at async CdpPage.evaluate (/Users/Phamtom/Desktop/doctoscrap/node_modules/puppeteer-core/lib/cjs/puppeteer/api/Page.js:828:20)
at async getNextPageURL (/Users/Phamtom/Desktop/doctoscrap/src/run.js:53:12)
at async goNextPage (/Users/Phamtom/Desktop/doctoscrap/src/run.js:44:15)
at async Timeout. (/Users/Phamtom/Desktop/doctoscrap/src/run.js:35:21)

Node.js v21.6.1

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.