Find Jobs
Hire Freelancers

dynamic CSV to SQL server import - automated using SSIS C#

₹1500-12500 INR

Ditutup
Dibuat sekitar 6 tahun yang lalu

₹1500-12500 INR

Dibayar ketika dikirim
Project Requirement: I want to create a solution to load a dynamic csv file to SQL table. Following requirements need to be met: 1. The input CSV/TXT file could have any number of columns. 2. Column Delimiter of input file could be comma(,), pipe (|), tab (<tab>), basically it could be different for different file but will be standard in a single file 3. Row delimiter could be [CR][LF] or [LF] or [CR] etc 4. The solution should load all the contents of this file to a SQL server table. (sql version could be 2012/2014 etc) 5. The destination table will be created based on the column names in the header row of the input file 6. All the destination table columns should have sql data type nvarchar(max) 7. Destination table should have PAGE type compression in SQL server 8. Preferably the solution should be a SSIS package or a programatically generated and executed SSIS that loads any files into a table it creates. 9. Solution should just accept a path to the CSV/TXT file and should be able to figure out everything else automatically (number of columns, create table and then load) 10. I should be able to use this to load to SQL 2012, SQL 2014, SQL 2016 Performance requirements 1. The input files I have are very heavy 50GB, 70GB, 80GB etc, so the solution needed should be able to work with such files and also load the the data quickly 2. I already have a few solutions: a) Load csv into a single column table and then parse the column names and data to a table will multiple columns, this process is too slow, so its not acceptable b) use C# script to read header row from csv file, create a table and then load the data using C#. This process is also slow So the requirement is to have the solution as fast as a BCP task in SSIS. I am able to build a static BCP where filename is provided, column structure is static, this works fast but need is to make this dynamic. Copyright requirement: 1. Cannot use any thing that is patented to someone 2. Cannot used a paid library, SSIS addon, every thing should be developed in house 3. you can simply use C#, SSIS, script component etc.... microsoft provided features, so there is no question of using anything copyrighted Documentation Requirements 1. Everything should provide should be documented, so it can be easily reproduced by me on a new installation of SQL/SSIS/Visual Studio etc 2. Code needs to be commented, so every line to code has an explanation
ID Proyek: 16256939

Tentang proyek

16 proposal
Proyek remot
Aktif 6 tahun yang lalu

Ingin menghasilkan uang?

Keuntungan menawar di Freelancer

Tentukan anggaran dan garis waktu Anda
Dapatkan bayaran atas pekerjaan Anda
Uraikan proposal Anda
Gratis mendaftar dan menawar pekerjaan
16 freelancer menawar dengan rata-rata ₹9.413 INR untuk pekerjaan ini
Avatar Pengguna
Hi, I have gone through your REQUIREMENT. I can help you in this as I have much EXPERIENCE in Asp.net, C#, MVC, JSON Web services , ATOM Web services. Can we discuss the REQUIREMENT in detail? We work on different platform like:- . Website designing/ website developing(Asp.net, C#, html, css) .server side scripting language(php) .wordpress Asp.net C# MVC Wordpress Html CSS Web Development and Web Designing. JSON Web services ATOM Web services E-commerce Web development
₹10.000 INR dalam 20 hari
4,9 (17 ulasan)
5,0
5,0
Avatar Pengguna
I have 8 + years of experience of working on SSIS & SQL server based technologies. I have completed these typed of projects in the past .
₹13.333 INR dalam 6 hari
5,0 (4 ulasan)
4,9
4,9
Avatar Pengguna
I have ready package to load a file and import data , i will do for all files as well if you would like to take it . please let me know
₹8.888 INR dalam 2 hari
4,9 (22 ulasan)
4,6
4,6
Avatar Pengguna
Please review my profile. https://www.freelancer.com/u/vw7590795vw.html I have 8 years and 3 months experience in SQL and 5 years and 5 months experience in SSRS, SSIS. Please let me know more details and when we will start. Sky pe: jikenjd
₹6.500 INR dalam 5 hari
5,0 (25 ulasan)
4,3
4,3
Avatar Pengguna
A proposal has not yet been provided
₹13.333 INR dalam 10 hari
4,4 (9 ulasan)
3,7
3,7
Avatar Pengguna
A proposal has not yet been provided
₹12.500 INR dalam 3 hari
0,0 (0 ulasan)
0,0
0,0
Avatar Pengguna
A proposal has not yet been provided
₹9.288 INR dalam 5 hari
0,0 (0 ulasan)
0,0
0,0
Avatar Pengguna
I have worked similar project where i have to load hedis measures. It is a healthcare quality measure project.
₹6.666 INR dalam 3 hari
0,0 (0 ulasan)
0,0
0,0
Avatar Pengguna
I am currently a Business Intelligence Consultant, where I work with ETL and also with reports and Dashboards. With ETL I work with SSIS, where to read the data of a text file to load in a table of SQL, to me it is quiet, probably what will give more work is the question of the file being mutito heavy, but already I worked with tables where they had 100 million records. I am available.
₹8.888 INR dalam 10 hari
0,0 (0 ulasan)
0,0
0,0
Avatar Pengguna
Hi... It's Easy to do this work in normal form when we insert data from any type of file like (CSV,text,docx) to database....But when we insert 50GB of data it mean it carry lots of rows ... and lots of time... so don't worry I will do this work in proper way ... Now I tell something about myself I'm Akash and I'm software developer (.net Specialist) I currently working on CBS(Core banking solution) project . in that project Also have same cases when we insert lots of customers data from Database to file and file to Database... so I have good experience for how we do your work... I'm already done this job.. Thanks..
₹8.888 INR dalam 3 hari
0,0 (0 ulasan)
0,0
0,0

Tentang klien

Bendera INDIA
India
0,0
0
Anggota sejak Feb 5, 2013

Verifikasi Klien

Terima kasih! Kami telah mengirim Anda email untuk mengklaim kredit gratis Anda.
Anda sesuatu yang salah saat mengirimkan Anda email. Silakan coba lagi.
Pengguna Terdaftar Total Pekerjaan Terpasang
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Memuat pratinjau
Izin diberikan untuk Geolokasi.
Sesi login Anda telah kedaluwarsa dan Anda sudah keluar. Silakan login kembali.