Find Jobs
Hire Freelancers

Price comparison website in Django

$250-750 USD

Berlangsung
Dibuat lebih dari 3 tahun yang lalu

$250-750 USD

Dibayar ketika dikirim
Hi I am looking for someone to develop a price comparison website in Django using Scrapy (or something better) & Selenium - code must be documented in English. It should allow to crawl a "variable" number of separate sites (using a number of "spiders") that can pull out product details such as Product ID, Title, Price, Vendor, Description, Image, URL and Stock Position etc. This information should then be placed in a PostgrSQL database to be displayed using Web2py/Django. There should also be a way of the URL to the products be changed to affiliate links. Expected Features: a) The Products Table in the server database should be automatically populated by the scraper. The required fields are Product ID, Title, Price, Vendor, Stock Position, Payment Options, Delivery Time b) Easy extensibility to add more functionality in future. c) Posibility to scrape indefinite number of ecommerce sites and easy adding new stores d) Should work with any type of ecommerce also ones using JavaScript e) Primary URLs to be saved with the date of last successful scraping, to enable scheduling of periodic repeat scrapings so that the prices of the products are always up to date. f) While executing scraping, only those fields that have changed since last scrape are to be extracted and the original table entry for the product to be "updated", as required. In case of new products, the details to be "inserted" as a new row in the Products Table. g) The website should be very fast to provide the best user experience h) URL to the comparison products within the website to be changed to affiliate links when available. i) Posibility of adding reviews and rating for each product and each store, and user accounts for example for favourite product lists etc. j) Website should have design similar to ecommerce website for example something like Aliexpress with carousel, fatured products and advertisement features, and also fully customizable. k) It should count all the redirections to the external stores and provide full statistics of the usage of the site by user, store etc. l) It should list all the compared prices from different stores from the lowest to the highest but the first few could be choosen manually from featured stores even if they are higher than other prices m) Categories and subcategories view should have filters on the left side so the user can easily filter out the products he wants. When needed new categories could be added. n) Every store should have its separate page with different information as for example recent rates and reviews, brands sold etc. o) Website should be also mobile friendly if you have examples of previous work please share them. Additionally if you have advice on the a better architecture/solution I am open to ideas. Expected Skills: Web Scraping, Scrapy, Selenium, Python, Data Mining, Javascript, MySQL
ID Proyek: 28323067

Tentang proyek

18 proposal
Proyek remot
Aktif 3 tahun yang lalu

Ingin menghasilkan uang?

Keuntungan menawar di Freelancer

Tentukan anggaran dan garis waktu Anda
Dapatkan bayaran atas pekerjaan Anda
Uraikan proposal Anda
Gratis mendaftar dan menawar pekerjaan
Diberikan kepada:
Avatar Pengguna
Dear Client, How are you? I am Full Stack Web Developer and Web Scraping Expert with more than 6 years experience in the field. Experienced in Python and PHP backend development, my work includes Django, Flask, Wordpress web Development. Experienced in MySQL, PostgreSQL, Mongo DB development. My project includes Airline Logistics Integration, Bank Online Payment Integration, Web Scraping Recaptcha site etc. Expert in Linux and Windows System. Works with Linux Ubuntu, Centos Server management with Apache and WSGI Thank you. Marlon
$400 USD dalam 30 hari
5,0 (17 ulasan)
4,4
4,4
18 freelancer menawar dengan rata-rata $550 USD untuk pekerjaan ini
Avatar Pengguna
Hi! I am a web developer and Python expert. I can start work right now and successfully deliver final result to you. I can deliver your project in shortest time and successfully. Thanks.
$500 USD dalam 7 hari
5,0 (38 ulasan)
6,1
6,1
Avatar Pengguna
Hi, First of all, thanks for very detailed explanations of what you exactly want. The only possible issue might be with the "indefinite number of ecommerce websites". Every website has a different architecture and source code therefore each website requires "its own special scraper bot". So, whenever you want to add a new eccommerce website, a bot should be created. However in terms of "extensibility", newly created bots can easily be integrated with the rest of the system. You also want speed, which means the key part of this project will be the backend side. You need some really well done scrapers that will work 7/24 with no issues. This is what I am really good at. I have many scrapers that I created for several purposes. Amazon, e-bay, Alibaba, ali express, google news, google-yandex-bing maps, real-time stock price scrappers and many more. The easier part is the web-dev part with Django. This part is not as complicated since you have a clear image of what you want. However, if you want the finished project to be some "real deal" I humbly recommend working with a team of two. One backend pro and a front-end. A backend pro -like myself- can also create a website. However the backend will be fast but the design might be lacking compared to top tier works. A front end pro or a web-dev can also implement these scrappers. But they won't get close to my or another scrapper guru's finished work. I know many talented front end devs and I can form a team within the budget.
$500 USD dalam 30 hari
5,0 (22 ulasan)
5,7
5,7
Avatar Pengguna
Hi, We at Tecogno Solutions are a team of Passionate Data Science and Full Stack professionals having more than five years of combined experience in multiple areas including Backend, Frontend, Machine learning (ML) and Artificial Intelligence (AI). We have developed multiple projects similar SCRAPING projects. We have a strong command over Python, Flask, Django, Scrapy, Beautiful Soup, Selenium, Node.js, Google Dialogflow, Spacy, Rasa, Twilio, NLP, CNN, Bert, Albert, AWS, GCP, Google API's etc. Thus we are capable of Building the email service provider for your startup. For further information please refer to our Profile or visit or website. Thanks!
$750 USD dalam 7 hari
4,8 (4 ulasan)
5,5
5,5
Avatar Pengguna
Hi, We have gone through your requirement and believe that we would be the perfect fit for you. We are an agency having 5+ years of experience in the field of customized website designs, app development. Designing is our passion and we ensure your highest satisfaction. We have a team of experienced full stack developers with a focus on Python/Django. We have build some of these projects: 1. OCR and NLP projects- text extraction, summarization and generation of automated answers using NLTK, Spacy 2. Regression modules including analysis for correlation between stock prices and planetary positions We offer - A complete hands on approach and full dedication to your project. - Quality and original work in time - On time project delivery - Prompt connectivity through Skype, Chat and Email - With a “can do' attitude We would love to chat with you and discuss further details. We look forward to hearing from you and working together!
$450 USD dalam 18 hari
4,5 (25 ulasan)
5,2
5,2
Avatar Pengguna
Hello, Hope you're doing good.! Before the bid, let me tell you in brief about myself. I am a Data scientist with over 3 years of working experience and have done many projects on AI for clients. Some of them are Sentiment Analysis, Image Classification, Text Classification, Chatbots, Price prediction system, Text summarisation, Article spinner and so on. The technologies I work upon are Machine learning, Deep learning, Computer vision, NLP, Chatbots etc. I have a experience of 3 years in working on django and flask frameworks as well. I have integrated almost all my projects on django and flask for web applications. I have worked on data mining for extraction of data from multiple sources using selenium, Scrapy, requests and beautiful soup. I have read your requirements and can definitely help you out with this one. Let's talk in detail about what you need and start working on it. Looking forward to hear from you.
$1.000 USD dalam 15 hari
5,0 (8 ulasan)
4,8
4,8
Avatar Pengguna
Hi, I have already work on such such project, I will show you my work if you want and it is not possible with the selenium, we have to use other modules of python to to scrap the dynamic website or we have to use API. Would like discuss more in details. Thanks
$1.000 USD dalam 7 hari
5,0 (7 ulasan)
4,6
4,6
Avatar Pengguna
Hi I am interested in working on this project with you but We need to discuss more details. Lets discuss and finalize all details and milestones for the project. thanks
$500 USD dalam 7 hari
4,6 (17 ulasan)
4,8
4,8
Avatar Pengguna
Hey, I'm Arnav I'm an experienced Software Engineer/ Fullstack Developer with a skillset comprising of web development (frontend & backend), automation, machine learning, deep learning, data mining, data analysis, API development, database architecture and database management. Languages I am proficient in - Python, Javascript, Java, C, C++, Bash I have previously worked with various Python libraries, and am comfortable using libraries/frameworks such as Django, Flask, Selenium Web driver, numpy, pandas, tensorflow, pytorch, pyqt, matplotlib, etc. Im comfortable with JS libraries such as Node, Express, React & Angular and also the .NET core framework. I'm also skilled in jQuery and AJAX. Having said that, I believe I can deliver you the project on time and as per your requirements. Hit me up so that we can discuss the details further.
$475 USD dalam 7 hari
4,4 (26 ulasan)
4,5
4,5
Avatar Pengguna
Good Morning!! Hope you are doing well.. I have strong 5 years of experience in Python, Django, React.js along with Back-end technologies like: Python, Django, Django REST-Framework, and Front-End technologies like: React, JavaScript, Odoo, Odoo SaaS, etc. As well, experienced SCRAPED data from 13 websites. So I'm very comfortable with helping you with this project. I am ready to start full-time work immediately and assure you to provide high-quality results in a given time frame. I have strong 5 years of experience in Python, Django, Odoo, Docker along with front-end, back-end technologies including - Python / Django / Django REST Framework / Flask - JavaScript / React / Material-Ui - HTML5 / CSS3 / Bootstrap - PostgreSQL / SQLite - Heroku / AWS S3 - GitHub / Git Moreover, - Python-based APIs, Django REST-Framework, Django REST Swagger (OpenAPI) & Custom Authentication. - Test-Driven Development: PyTest, Mixer, Mock, Django Request Factory, Django REST-Framework APIClient & Coverage. My previous work in Scrapping:- -> SCRAPE NEWS FROM 13 WEBSITES AND ADD TO OUR WEBSITE Scraping of posted news from 13 other websites and perform semantic analysis , if news looks positive then only post to the client new portal (Technologies Used:- Python, Selenium, ReactJs Postgresql) Aslo have Experience scraping eCommerce sites & Experience with IP rotation. Please text me for deep discussion. Regards, Neha.
$500 USD dalam 7 hari
4,8 (1 ulasan)
2,0
2,0
Avatar Pengguna
Handle the staff including manage related to staff which is, handle human resource task as a handle staff card, recorded sick leave of staff. I also manage staff allowance, create every official letter that required from manager and also do every task company including filing, handle every license company and etc related to administration management.
$500 USD dalam 7 hari
0,0 (0 ulasan)
0,0
0,0
Avatar Pengguna
i am akshay the best date entry master of india i am trying to complete my work before end of the time I'm a very hard and fast worker. I'm reliable, detail-oriented, and self-motivated. I take every job seriously and give each job 110%.
$500 USD dalam 7 hari
0,0 (0 ulasan)
0,0
0,0
Avatar Pengguna
Hi, I can make this project. I made a lot of site with Django framework and a lot of monitor system for scrape data from different sites. I used Scrapy and it's very good for making different custom spiders. I have worked for projects that required data from sites like: amazon, eBay, and many different. Accept my request and you will not regret it!
$600 USD dalam 14 hari
0,0 (0 ulasan)
0,0
0,0

Tentang klien

Bendera MEXICO
Mexico City, Mexico
0,0
0
Memverifikasi Metode pembayaran
Anggota sejak Nov 27, 2020

Verifikasi Klien

Terima kasih! Kami telah mengirim Anda email untuk mengklaim kredit gratis Anda.
Anda sesuatu yang salah saat mengirimkan Anda email. Silakan coba lagi.
Pengguna Terdaftar Total Pekerjaan Terpasang
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Memuat pratinjau
Izin diberikan untuk Geolokasi.
Sesi login Anda telah kedaluwarsa dan Anda sudah keluar. Silakan login kembali.