Hello!
It seems that cloudflare is detecting the bot and preventing it from working correctly. I''ve tried running it from a Debian VPS and obtained the following:
python3.9 namescraper.py --headless --query domain.com --output output.txt --sessionfile session.txt securitytrails [+] Selected module: "SecurityTrails" [+] Saving results to file "output.txt" [+] Looking up "capitalone.com" (subdomains) Traceback (most recent call last): File "/home/user/tools/NameScraper/namescraper.py", line 111, in <module> scraper.lookup(query, lookup_type=lookup) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 194, in lookup return scraper(domain) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 190, in generic_domain_scraper return self.__selenium_scraper_domains(domain, lookup_type) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 64, in __selenium_scraper_domains sample = self.wait.until( File "/usr/local/lib/python3.9/dist-packages/selenium/webdriver/support/wait.py", line 105, in until raise TimeoutException(message, screen, stacktrace) selenium.common.exceptions.TimeoutException: Message:
While using without --headless, I've been able to see that cloudflare captcha is stoping the bot.
Is there anything possible to make it work??
Thanks a lot!!
Hello!
It seems that cloudflare is detecting the bot and preventing it from working correctly. I''ve tried running it from a Debian VPS and obtained the following:
python3.9 namescraper.py --headless --query domain.com --output output.txt --sessionfile session.txt securitytrails [+] Selected module: "SecurityTrails" [+] Saving results to file "output.txt" [+] Looking up "capitalone.com" (subdomains) Traceback (most recent call last): File "/home/user/tools/NameScraper/namescraper.py", line 111, in <module> scraper.lookup(query, lookup_type=lookup) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 194, in lookup return scraper(domain) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 190, in generic_domain_scraper return self.__selenium_scraper_domains(domain, lookup_type) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 64, in __selenium_scraper_domains sample = self.wait.until( File "/usr/local/lib/python3.9/dist-packages/selenium/webdriver/support/wait.py", line 105, in until raise TimeoutException(message, screen, stacktrace) selenium.common.exceptions.TimeoutException: Message:While using without --headless, I've been able to see that cloudflare captcha is stoping the bot.
Is there anything possible to make it work??
Thanks a lot!!