Import 10 million records 2GB .csv (5 parts) every hour to MySQL

Ditutup

27 freelancer menawar pada rata-rata $160 untuk pekerjaan ini

aaravsoft

Hello, I will provide you desktop application for window where it will download csv file from companieshouse website and update the changes on your mysql database which few minute. You set interval time manually ( Lagi

$150 USD dalam 2 hari
(51 Ulasan)
5.8
richestuser

I am talented PHP , mySQL ,javescript ,AJAX, WORDpress developer. I have very reasonable rate .I do WORDPRESS PHP , MySQL programming more than 5 years and within this period I had been working as slave coder.So, I Lagi

$250 USD dalam 3 hari
(60 Ulasan)
5.6
wee493

A t2.micro should would for basic importing and everything . Would need to discuss how you'd be querying the data to get a more accurate guess on what EC2 server would be needed or if you'd need dedicated MySQL. I can Lagi

$250 USD dalam 3 hari
(87 Ulasan)
5.9
pgu555d720e9981c

i will say i am perfect in doing these types of jobs i have also developed many websites with old csv data i will be fast and accurate in uploading full data to your server looking forward thanks

$55 USD dalam 3 hari
(50 Ulasan)
5.1
oda79

Hello! I am ready to help you with your task! Do you need an unattended script to do this import job? Please do not hesitate to contact me via messenger!

$250 USD dalam 20 hari
(11 Ulasan)
4.8
$155 USD dalam 3 hari
(24 Ulasan)
4.7
testotorko

Hi, I read carefully your project, and I wanna do it for you. If you wanna work together, send me a message to discuss details. I am an experienced Web Developer and Web Designer, and have worked with wide variety of s Lagi

$150 USD dalam 11 hari
(19 Ulasan)
4.8
stoyanovalexandr

Hello, I am a skilled unix and network engineer with 5 years of experience in unix based systems, virtualization like proxmox,esxi,xen,virsh, iptv,zimbra etc. I like to automate system working with additional shell scr Lagi

$111 USD dalam 1 hari
(26 Ulasan)
4.2
shiva1888

Hi I have been in this industry for 5 years and such jobs are my daily practice.I can assure you that if you work with me once, you will always work with me for these kind of projects.

$250 USD dalam 3 hari
(4 Ulasan)
3.4
$155 USD dalam 10 hari
(4 Ulasan)
3.1
djcarras

hi, i can help you with your project. According to the site, notifies the date of the last update, so I do not see that you need to run a process every hour, but I can do. send me more information about via freelancer Lagi

$333 USD dalam 5 hari
(2 Ulasan)
2.4
stescovich

Hello, Thanks for reading my propusal. First of all let me tell you that loading such amount of data won't be fast. Since you need to do it in steps to prevent problems in DB. Secondly I would suggest you to r Lagi

$100 USD dalam 20 hari
(2 Ulasan)
2.2
imran5757

Hi There, We can setup aws RDS instance which is highly available and the best performance database for mysql. Initially we would setup micro instance db if the queries are taking time to process then we can upgrade i Lagi

$60 USD dalam 2 hari
(4 Ulasan)
2.1
vw1313054vw

I will deliver a satisfactory job that will impress you. I crave for a chance to prove to you my worth and abilities.

$100 USD dalam 2 hari
(0 Ulasan)
0.0
mephri

Hello. Assuming data integrity is good (fields consistency and no junks) this could be done fast. Standard MySQL setup is sufficient (we are not talking about data access and processing here, right?) as long as the AWS Lagi

$155 USD dalam 3 hari
(0 Ulasan)
0.0
gototakuya

I am an expert of full-stack web development and have similar experience with your requirement. although I am new to here freelancer and earn achievements for future so i will bid reasonable price. My planning is b Lagi

$35 USD dalam 3 hari
(0 Ulasan)
0.0
maikahj

You need a Bitnami Lamp Stack AMI. Hello, my name is Maikah Jusu and I am the Lead Designer at GameMythix (http://www.gamemythix.com). We’re now extending our services beyond our studio. We’re now freelancing and w Lagi

$200 USD dalam 5 hari
(0 Ulasan)
0.0
davideschirinzi

I would recommend to use: an rds with mysql or aurora as database with 20.000 provisioned IOps ebs volume (r3 instance family or I family depending on the needs of computing power of the queries). To import the file ca Lagi

$250 USD dalam 3 hari
(0 Ulasan)
0.0
kaippally

there could be easier ways to do this.

$111 USD dalam 5 hari
(0 Ulasan)
0.0
fb54ec414445702

How I understand, you need the application, which can automatically download the data from "http://download.companieshouse.gov.uk/en_output.html" every 60 minutes and makes import the data to SQL data base on MySQL. I Lagi

$155 USD dalam 10 hari
(0 Ulasan)
0.0