The code given in this repository to close the sign window seems to expire,since changes are made in html script . S, Can you provide code to close the pop- up sign up window automatically.

Hi, Thanks.
Im learning data science, I needed to scrape the glass door website but seems to fail when the cookies (Accept Cookies) pop up.
Please help if possible.

Hi,
It seems that for your code, when selenium clicks the next page button. It just re scrape everything from the beginning, and did not collect the new jobs from the new page.

The error comes from the line :
driver.execute_script("arguments[0].click();", job_button)
Note : I used this instead of your original code : #job_button.click() #You might

But now as I iterate over 500 or more , I am getting StaleElementReferenceException error,

Traceback (most recent call last):
File "C:\Users\suy\Documents\Github Backup\Glassdoor_Salary_Project\data_collection.py", line 15, in
dataframe = sc.get_jobs("data scientist",frame,False,path,2)

File "C:\Users\suy\Documents\Github Backup\Glassdoor_Salary_Project\glassdoor_scrapper.py", line 63, in get_jobs
driver.execute_script("arguments[0].click();", job_button)

File "C:\Users\suy.conda\envs\nlp\lib\site-packages\selenium\webdriver\remote\webdriver.py", line 636, in execute_script
'args': converted_args})['value']

File "C:\Users\suy.conda\envs\nlp\lib\site-packages\selenium\webdriver\remote\webdriver.py", line 321, in execute
self.error_handler.check_response(response)

File "C:\Users\suy.conda\envs\nlp\lib\site-packages\selenium\webdriver\remote\errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)

StaleElementReferenceException: stale element reference: element is not attached to the page document
(Session info: chrome=83.0.4103.116)

Please let me know if you know this error.