Find Jobs
Hire Freelancers

Distribute Outbound Requests to Farm of Proxy Servers

$3000-5000 USD

Ditutup
Dibuat hampir 10 tahun yang lalu

$3000-5000 USD

Dibayar ketika dikirim
I have a web application that for certain interactions must query Google and other sites that do not offer APIs. A HTTP request is made and the page is scraped, The issue is that I am quickly blocked, either straight-up or forced to fill in a captcha. No good. What I would like is a platform that I can configure with many different private proxy accounts. I submit the request through this system. This system intelligently distributes incoming requests to the proxy servers randomly. When blocks are detected, that proxy must be removed from the farm. The details of the system will be more complicated I'm sure - but that's the general idea. Be able to route HTTP requests through a pool of proxy servers in order to avoid getting blocked by sites that prohibit scraping. The system should be housed on AWS or Google App Engine. Google App Engine would be ideal. I will only entertain responses that prove you understand the problem and are willing to work through a decent solution. Canned responses will be ignored immediately.
ID Proyek: 5992422

Tentang proyek

10 proposal
Proyek remot
Aktif 10 tahun yang lalu

Ingin menghasilkan uang?

Keuntungan menawar di Freelancer

Tentukan anggaran dan garis waktu Anda
Dapatkan bayaran atas pekerjaan Anda
Uraikan proposal Anda
Gratis mendaftar dan menawar pekerjaan

Tentang klien

Bendera UNITED STATES
Evansville, United States
5,0
2
Memverifikasi Metode pembayaran
Anggota sejak Mei 17, 2014

Verifikasi Klien

Terima kasih! Kami telah mengirim Anda email untuk mengklaim kredit gratis Anda.
Anda sesuatu yang salah saat mengirimkan Anda email. Silakan coba lagi.
Pengguna Terdaftar Total Pekerjaan Terpasang
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Memuat pratinjau
Izin diberikan untuk Geolokasi.
Sesi login Anda telah kedaluwarsa dan Anda sudah keluar. Silakan login kembali.