Find Jobs
Hire Freelancers

Modify my web crawler to not have race condition

$10-30 USD

Selesai
Dibuat hampir 8 tahun yang lalu

$10-30 USD

Dibayar ketika dikirim
I would like my web crawler script be fixed so that when saving the file into chunks of specified number of lines to not have a race condition. The race condition occurs when I run multiple instances of the crawler from the shell. *For example, I need to have the output from the crawler, [login to view URL], [login to view URL], ... files have only 10 lines per file even when accessed simultaneously from other instances of the same script. It now has a problem of each outputted file having over 10 lines per file, and this is not desired. The crawler needs to be able to make sure the outputted chunks of files are specified number of lines even when running multiple instances and accessing the same file. The actual specified number of the lines per file is 50,000 lines per file. The variable in [login to view URL] $lines_per_file determines how many lines per line I believe the needed knowledge is: race condition, concurrency, forking etc.
ID Proyek: 10696959

Tentang proyek

2 proposal
Proyek remot
Aktif 8 tahun yang lalu

Ingin menghasilkan uang?

Keuntungan menawar di Freelancer

Tentukan anggaran dan garis waktu Anda
Dapatkan bayaran atas pekerjaan Anda
Uraikan proposal Anda
Gratis mendaftar dan menawar pekerjaan
Diberikan kepada:
Avatar Pengguna
I can update the code so you can run multiple instances and it will still have correct number of line in the output file. Thanks. Roman
$105 USD dalam 1 hari
5,0 (602 ulasan)
7,6
7,6
2 freelancer menawar dengan rata-rata $178 USD untuk pekerjaan ini
Avatar Pengguna
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$250 USD dalam 5 hari
5,0 (308 ulasan)
7,7
7,7

Tentang klien

Bendera JAPAN
Hiratsuka-shi, Japan
5,0
29
Memverifikasi Metode pembayaran
Anggota sejak Agu 3, 2007

Verifikasi Klien

Terima kasih! Kami telah mengirim Anda email untuk mengklaim kredit gratis Anda.
Anda sesuatu yang salah saat mengirimkan Anda email. Silakan coba lagi.
Pengguna Terdaftar Total Pekerjaan Terpasang
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Memuat pratinjau
Izin diberikan untuk Geolokasi.
Sesi login Anda telah kedaluwarsa dan Anda sudah keluar. Silakan login kembali.