Selenium and Scrapy web scraper doesn't work (score = 0.1)

It could be reCAPTCHA made by google. First of all, you need to check html responses to see, if it exists. If problem is connected with captcha, you need to use api from paid source, that will take captcha and solve it.

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spiders I worked with 50+ differenct individuals/startups/companies and helped them archive their goals. Here's what you will get by working with me: * Working only on projects that I can deliver 100% * Ridiculous quality of work * Smart suggestions on increasing results/revenue and decreasing costs * Responsibility for tasks/project I work on * Reliability * Short response time * Good sense of humor ;) Hope I could awake you interest in me. Thank you for your attention. Shuaixing.(call me Shuaixing L.)

Dear Hiring Manager.⭐ I am a python programmer and I have faced many python problems.. Hope you give this project to me.. Relevant Skills and Experience I have worked with python + web development with Django framework and worked with several libraries in python including Selenium, Beautiful Soup, Flask, Django, Scrapy and many more. I have that much experience to complete your project. If you give me an opportunity I assure you that I will give you my best. Thanks . :)

hi, I have read you description in detail. I have experience with SCRAPY AS WELL AS SELENIUM scrapers in PYTHON. I can look at the code and resolve the issue. ALSO, i believe scrapers made using WEBREQUESTS are faster and more reliable as compare to SELENIUM based scrapers. But lets discuss the details in private chat. Looking forward to your reply.

want to see the source code. can try with proxy rotation and user agent. These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping.

Hi there, I have scraped amazon, aliexpress, yellow pages ,yelp ,zomato etc. I have 500GB internet with 20mbps speed, i have 6 systems I can do it. I have done many related projects like this. If you are provide this work, it will help my career also. Give me a chance to do this. Waiting for your precious reply. Thank you. Please Check my mastery work at:- https://www.freelancer.in/u/Stephenrajs *Why you are choose me 1. 24/7 hours support 2. Quick response 3. Deliver on time 4. Smooth communication. I assure that I can satisfy you completely and want to have a long term relationship with you. Best Regards Stephenrajs

Hi, Python Ninja here! I have understood your requirement with the Selenium and Scrapy web scraper work, and I am very confident with that. I can make it work for you. I am Usman. I have 6 years of experience in the Web & Mobile App Development Department and Designing. I have reviewed the description and understand it very well. I want to start the project right now, just need to discuss it little to more clear the image of the project. Please come to inbox so that we can lock the scope of the project. I am an expert in my domain areas like PHP, Laravel, CodeIgniter, My SQL, Angular, React, Node, Mongo DB, Ionic, React Native, Android, Java, IOS, Swift & Golang. I have extensive knowledge of Html5, Css3, Javascript, Ajax, jQuery, Bootstrap, and Payment Integration modules as well. I assure you that you will experience the WOW factor in my work. I am looking forward to your response. Many Thanks Usman Adil

Hey there! Selenium scraper here, I can do any sort of data mining or web scraping that you need to be done in a reasonable amount of time. I have years of Python, HTML, CSS and JavaScript experience under my belt and am ready to apply it to whatever your project requires! Here are some examples of things I've done for clients before: Writing custom website scrapers to get you the data you need! Scraping census data on a large scale and finding correlations in the data Mining hundreds of thousands of tweets and performing sentiment analysis Transforming data into Python data structures like pandas data frames. Creating PDF and document scrapers to help you sift through thousands of documents in minutes and get exactly the information you're after. Creating & managing a Django, Flask, or other pythons web-framework website. E-commerce data harvesting/Scraping bots/scripts development. Web Scraping of any publicly available data. Web Scraping of the business listing. Data collection from any directory/listing. Any type of Web Automation. Kindly reply to me, I am waiting for your kind response Thanks

The blocking issue can be because of Google ReCaptcha. i faced this problem in when i was try to scrap google search results on Mass amount. i didnt totally bypass it but i was able to avoid it for much longer time using different country domain of google while searching google. it helped me to raise my score from 15 to 70 approximate (max is 100)

Hello there, Hope you are doing good...!!! As per your requirement, I am very much suitable for the job kindly invite me for a chat for further discussion regarding the project. I have more than 6 years of experience in web & mobile app development you will get good quality work from me. Thank you