Crawling sites dataPekerjaan
Perlu extract data di menggunakan aplikasi RPA (Ui Path, UI Vision dll) Aplikasi yang di run akan melakukan crawling data dan membuat hasil berupa Excel dari list all project dari SIRUP. Source Aplikasi dan Hasil, akan menjadi milik pemberi kerja
Saya butuh Sebuah Plugin yang bisa grabbing novel dari sumber novel indonesia dengan ketentuan : 1. novel yg di grabbing tidak langsung di posting ke wordpress tapi di post ke cdn Blogspot dulu dan url dari blogspot nya di masukkan ke wordpress setelah itu baru di post (Jika ada cara yg lebih simpel silahkan komunikasikan) 2. Bisa Bulk Grabbing 3. Grabbing Perchapter 4. Bisa Auto Post Juga By Cronjob jika Website target Update komik - Thema Wordpress Yang kami gunakan hestia dari themeisle - Jika Butuh Vps Akan Kami siapkan *Jika ada Saran yg lebih Bagus bisa di jelaskan untuk mempermudah Pekerjaan
...Framework saat ini : Backend : Code Igniter Front End : Bootstrap Timeline Management via Trello ya. Feature tambahan seperti : - Integrasi dengan Payment Gateway (espay) dan WhatsApp (woo-wa). - Register cepat via FB, Google Account, dan Twitter. - Setiap order success, notif melalui WA dan Email. - Penyesuaian tampilan Landing Page - Notif admin CS ketika ada order, seperti di Shopee. - Script Crawling PHP utk Bank Mandiri, saat ini sudah ada. Namun tidak bisa berjalan lg, (yg sudah existing dan ongoing yaitu : BCA, BNI) Mohon jangan approve workspace ini jika tidak memiliki kapasitas dengan scope yg sudah d jelaskan. Mempunyai ide untuk pengembangan fitur lainnya, point plus. Detail akan diberikan ketika shortlist freelancer. Mohon memberikan portofolio secara detail. Semak...
Tahap-tahap proses ada 4: 1.Crawling data dari twitter 2. Preprocessing 3. LDA (latent dirichlet allocation) proses pengelompokan 4. TSIM(proses penghitungan untuk menentukan user yang paling berpengaruh) NB: - User sudah ditentukan 15 user portal berita indonesia, dan proses yang belum dilakukan hanya proses ke 3 dan 4 - saya berikan file jurnal acuan saya -sebenarnya ini skripsi saya, saya hanya minta proses 3-4 saja
Kami membutuhkan freelancer untuk melakukan scraping dari website tablenya sendiri simple hanya berisi 4 column rownya sekitar 30ribuan row. Tools terserah menggunakan apa saja, yang penting bisa di export ke file excel
Dibutuhkan freelance kebutuhan Intelligent Research Crawler untuk bagian Big Data Mining, project ini bertujuan untuk meng-crawling yang berhubungan dengan data yang telah ditetapkan dalam media sosial beserta berita terkini. Dan dapat menyediakan API. Durasi project ini selama 6 bulan.
Dibutuhkan freelance untuk kebutuhan Intelligent Research Crawler, project ini bertujuan untuk meng-crawling yang berhubungan dengan data yang telah ditetapkan dalam media sosial beserta berita terkini. Dan dapat menyediakan API. Durasi project selama 6 bulan.
mendapatkan gambaran tentang isu pemberitaan pada 10 media online dalam periode 3 bulan.
Membuat situs web dengan Google Sites Google Sites adalah aplikasi online gratis yang menjadikan pembuatan situs web semudah mengedit dokumen. Anda dapat mengubahsuaikan situs sesuai keinginan, dan bahkan mengunggah gambar yang terkait dengan bisnis atau layanan Anda. Lalu, Anda dapat menggunakan URL situs web itu dalam iklan AdWords sehingga calon pelanggan diarahkan ke situs tersebut saat mengeklik iklan Anda. Berikut ini cara membuat situs baru: Kunjungi Masuk dengan Akun Google Anda. Jika Anda tidak memiliki akun, klik Daftar ke Sites dan ikuti langkah-langkah untuk membuat Akun Google. Klik tombol Buat situs baru untuk memulai. Namai situs web Anda. Setelah Anda memasukkan nama, URL akan dibuat secara otomatis dalam kotak di bawah ini.
We are looking for a skilled freelancer to assist us with a high-speed web scraping project. Our existing web scraping scripts have been developed and deployed, but we need to optimize the scraping process to achieve faster data extraction rates. Responsibilities: Optimize existing web scraping scripts for speed and efficiency. Deploy and manage web scraping scripts on platforms such as Scrapy Cloud, Apify, AWS Lambda, or Azure. Implement techniques to ensure high-speed data extraction (e.g., parallel processing, distributed crawling, efficient request handling). Monitor and troubleshoot scraping processes to ensure uninterrupted operation. Collaborate with our team to understand project requirements and adjust scraping strategies as needed. Requirements: Proven exp...
My website has over 100000 pages and I am looking for an expert to ensure that all pages are indexed in Google search. While I've done some work on the SEO, it's not comprehensive enough....looking for an expert to ensure that all pages are indexed in Google search. While I've done some work on the SEO, it's not comprehensive enough. What I need the most is assistance with page indexing as well as a general look over to see if there's anything else that could be improved upon. Right now 5 lac pages are indexed, 2.5lacs are crawled not indexed and remaining has to be submitted for crawling. Key requirements: - Experience with SEO and particularly page indexing. - Ability to do a general audit of the website and suggest any other improvements. - Good underst...
I'm looking to increase organic traffic to my simple static website hosted on Google sites. Address is It is a small skin and laser clinic business which relies on local audience. - Goals: * Improve search engine rankings for increased visibility. - Geographical Focus: * Emphasis is on enhancing local area SEO. - Keywords: * Looking for an expert who can effectively incorporate location-based and industry-specific keywords into my website's content and meta tags. Skills needed for this job should include expertise in SEO, Google Sites, keywords research and optimization, and SEO Writing. Experience with local SEO would be a bonus. I need a specialist who can tackle this task with finesse and professionalism, ultimately driving more organic traffic t...
I require a savvy data scraping professional who can efficiently collect specified details from retail giants Amazon, eBay, and Walmart. I'm interested in: - Extracting product details (name, price, description) This activity should be performed daily. The ideal candidate would have experience in data scraping, particularly from the mentioned websites. Proficiency in appropriate tools and a keen attention to detail is expected to ensure high-quality, timely, and consistent data harvesting.
...installing SSL certificates on Azure hosting. We run two .NET based sites on a single Azure instance - they are: We have control of the domain, but need to work with our client for control of the subdomain. We will purchase a multi-domain Comodo SSL certificate from NameCheap (potentially a new PositiveSSL Multi-Domain certificate again) and have you activate it and install it on the Azure service. The current SSL is due to expire on the 28th May 2024. Key Requirements: - Install the SSL certificate on an Azure instance hosting my two .NET sites. - Ensure that both sites are configured to run with HTTPS. The ideal candidate for this
...Python, Java, or C++ will be a plus. Though the user has not provided insights into the specific features desired for this project, common elements of search engines include web crawling, indexing, and ranking algorithms. Your familiarity with these or willingness to research and incorporate them will be essential to your success in this project. The user did not specifically state the purpose of the search engine, however it could be for personal, business, or educational use. Balancing these needs could be a crucial part of the project. Skills and Experience Needed: • Knowledge of search engine architecture: web crawling, indexing, and ranking algorithms • Strong problem-solving capabilities • Excellent communication skills to understand the user's ...
I'm in need of a comprehensive contact list for Queensland-based mine sites. I'd like the list to include: - Company name and contact details - Mine site location and address - Contact person and title I'm looking for a high volume of entries, so ideally more than 50 mine sites should be included. The final deliverable should be an Excel spreadsheet. Ideal freelancers for this project should be experienced in data mining and collection. You should be thorough and detail-oriented to ensure all information is accurate. Knowledge of Queensland's mining industry would be a plus.
I am urgent...in need of a freelancer with skills in web scraping, data extraction and web crawling. Your task will be to gather specific information from an online directory of race events throughout the world. Key Responsibilities: - Set up a weekly automated web scraping process. - Extract and deliver the following data points: Event name, Event date, Event location, online registration page, contact form page, and contact information along with some other info that we can grab. Required Skills and Experience: - Proficiency in web scraping and data extraction. - Capable of setting up an automated weekly process. - Ability to perform the task ASAP. - Strong attention to detail to ensure accuracy of information. Please note that timeliness and data a...
I'm looking for a talented web designer who can transform my existing Wix website to mirror the aesthetic and functionality of high-end watch brand websites like and Richard Mille's. Key Requirements: - Menu Bar Design: I'm particularly interested in having a sleek, user-friendly menu bar that is similar to those on the aforementioned sites. - Product Display Layout: I need the product pages to have a clean and sophisticated layout that aligns with the luxury brand style. - Scrolling Pages: I like the concept of scrolling pages that these websites have, so I'd like this feature incorporated into my own website. Additional Features: - E-commerce Functionality: I'm also in need of an e-commerce functionality to enable customers to make purchases directly f...
You should find and tell me how to fix the problems of INP and CLS (mobile and desktop) on different page type. Web sites are available on request No FTP or access to code.
I am seeking the services of a VPN expert with the knowledge and expertise to aid in accessing legal sports betting sites, which are currently inaccessible due to restrictions put in place by internet service providers. The purpose of this engagement is to enable unrestricted access to reputable legal sports betting sites, while ensuring the highest standards of online privacy and security are maintained. The ideal VPN expert will possess a deep understanding of the nuances involved in accessing geo-restricted content and possess the requisite technical proficiency to provide reliable, fast and secure VPN services. Additional bonus when freelancer has installed sucessful system.
I'm in need of an experienced professional who can develop a search engine to cater to specific multimedia content requirements. Key Requirements: - The search engine should be capable of web crawling and indexing multimedia content (images and videos) from various online sources. - Prioritization of multimedia content: The engine should prioritize multimedia content in its search results. - Handling multimedia metadata: The engine is expected to extract metadata from images and videos, and also perform image/video recognition. I'm open to suggestions on the best approach to implementing these features, but the end goal is a user-friendly and efficient multimedia search engine. Ideal Skills and Experience: - Proven experience in developing search engines, especially t...
...target keywords. Execute Content Strategy: Developing a content strategy that aligns with SEO goals, creating high-quality, engaging content optimized for search engines and user experience. Link Building: Building a network of high-quality backlinks from reputable websites to improve domain authority and rankings. Technical SEO: Identifying and fixing technical issues that may impact search engine crawling and indexing, such as site speed, mobile-friendliness, and site structure. Monitoring and Reporting: Tracking key SEO metrics like organic traffic, keyword rankings, and conversion rates, and providing regular reports to stakeholders to measure the effectiveness of SEO efforts. Staying Updated: Keeping abreast of industry trends, algorithm updates, and best practices to adapt ...
I'm in need of a developer skilled in Python or a similar language to create a program that will scan multiple websites for broken links. Here are specific requirements: - The focus should be on external links; internal lin...in Python or a similar language to create a program that will scan multiple websites for broken links. Here are specific requirements: - The focus should be on external links; internal links are not of interest in this project. - The program must be able to detect and report Dead external links and Error 404 links. - The output should be provided in a text file format. Experience in website crawling and parsing, and a strong understanding of web protocols and formats (HTTP, HTML) are needed for this job. Experience working with similar projects would be...
I'm seeking a skilled freelancer to revamp and expand my current website on Zoho Sites. The main tasks include: 1. Redesigning the existing layout: I'm looking to modernize the design to improve aesthetics and user experience. 2. Addition of new sections: Details on these new sections will be provided later, but be prepared to integrate them smoothly into our new layout. 3. Improving performance: The website's loading times need reduction and optimization for mobile compatibility is paramount. The website currently has less than ten pages. Ideal skills include proficiency in Zoho Sites, graphic design capabilities for layout changes, and an understanding of website performance optimization techniques. Taking this role means you will need to be commu...
I'm aiming to increase my bookings coming from OTA (Online Trave...increase my bookings coming from OTA (Online Travel Agencies), particularly through and Expedia. Here's what I need: - A proficient freelancer who can develop a winning OTA revenue management strategy. - A distinctive approach that will lead to an increase in bookings on third-party travel sites. - Integration with and Expedia to streamline the process. Ideal skills and capabilities: - Strong background in OTA management, including working with third-party travel sites like and Expedia. - In-depth understanding of revenue management strategies. - Demonstrated success in increasing OTA bookings. - Familiarization with ’s and Expedia’s API for direct linking and integration.
I'm in need of a Python script that can crawl through a list of websites provided in an Excel file and export all the webpages it finds into a new Excel file. This task i...the websites, not just a specific piece of information. Key Requirements: - The script must be able to read a list of websites from an Excel file. - The script should use natural crawling mechanisms, not sitemap, to find all the webpages on each website. - All the webpages found on the websites should be exported into a new Excel file. The purpose of this script is to aid in analyzing the content of these websites, so it's crucial that all pages are scraped. Ideal Skills: - Proficiency in Python programming, particularly web scraping. - Knowledge of Excel file handling in Python. - Experience with w...
...URL - own mailing list (mail chimp or native to platform) Key tasks include: - Migrating existing sites built on Shopify and Woocommerce into one site - either Shopify or Webflow - Implementing a shared backend inventory across the two storefronts, supplemented by individual branding and mailing lists. - We want option to select which products will be displayed in which store. (most of the products will be visible in both stores, but certain products only on one store). - The inventory should be shared between both stores, so that if ProductA in sold in ShopA, then the stock_inventory should still match in both ShopA and ShopB. - Preserving the multi-language feature from the existing sites (English & Traditional Chinese) - Incorporating a comprehensive product sear...
I'm looking for an experienced SEO specialist to help improve the search engine ranking of several product listing websites. Key Aspects: - I need your expertise for 4 or more websites. - The primary goal is to enhance search engine ranking. - These websites are mainly comprised of product listings. Skills required: - Proven track record in SEO, particularly in e-commerce and product listing websites. - Up-to-date knowledge of search engine algorithms. - Experience in increasing search engine ranking, not just traffic. - Excellent communication skills and ability to provide clear reports and recommendations. Your role will be pivotal in boosting the visibility of these websites online, so that they can attract more potential customers. Please include relevant examples of your ...
We are looking for a better solution than ordering shared hosting accounts for each domain. We have many woo-commerce webstores that all run off different domains on different servers. We want to move all websites to the same server, and still have them run at optimal speeds. We need someone to make proper suggestion (such as a dedi server) and have the ability to set it up, migrate websites, configure domains, etc. Please be sure to add WCMGRT1 to your bid or it will be considered spam, ignored and removed.
...week Only the corresponding screen can be viewed Approximately 300-400 new businesses expected to be registered each month: Development needed to accommodate the expected volume of registrations Development to prevent IP bans Detailed feature description: Member Login Sign-up Permission assignment Individual inquiry Immediate rank crawling Tracking target management Individual input Bulk Excel upload & download Keyword-based crawling On/Off Deletion Background crawling of tracking targets Naver Place keyword (1 daily query) Rank change history Generate a shareable URL (reset every week) Display in a popup from step 3...
I'm using WordPress as my CMS, and my website is currently verified in Google Search Console. I'm encountering an issue where the file appears to be unreachable. This is concerning, as it can affect how my website is crawled and indexed by search engines. Key points: - The file on my WordPress site is curre...file on my WordPress site is currently unreachable according to GSC. - I need a professional who can help identify the root cause of the problem and provide a solution. Ideal Candidate: - Experienced with Google Search Console and resolving technical issues within it. - Proficient in WordPress and its underlying structure. - Strong understanding of and how it impacts search engine crawling and indexing. - Good troubleshooting and problem-solving skills.
We are a private higher education institute facing a critical situation. Our website, powered ...guarantee smooth operation. 5 - Testing and Quality Assurance: Conduct rigorous testing to verify that all services, functionalities, and integrations are functioning flawlessly post-migration. We require someone with expertise in WordPress and Moodle administration, along with proficiency in server management and cybersecurity protocols. It is imperative that the freelancer prioritizes security and data integrity throughout the entire process. Additionally, we kindly request: - An estimation of the time needed to complete the project, including individual timelines for each task. - A detailed breakdown of the costs associated with the project, including any additional expenses that ...
I need a python program that can fetch player profiles as images from CricHeroes and store them into a folder. The ID and profile link of these players will be provided in a JSON array. Here is what the program need...fetch the profile images. - If a player's profile link is no longer accessible or can't be crawled, the program should attempt to access the link again at a later time. - The images should be saved in a standard resolution PNG format. - In the case of duplicates, the program should overwrite the existing image with the new one. The ideal candidate for this project is proficient in Python, web crawling, and working with JSON arrays. Knowledge in image handling and error management is also necessary. example link :
Project Description: We are seeking a proficient Python developer to complete and refine a web crawling application with a graphical user interface (GUI). The primary function of this application is to extract specific job-related data from websites based on input parameters such as job title and location. Key Responsibilities: Review and refine existing Python code for web crawling to ensure robust and efficient data extraction. Develop and implement a user-friendly GUI that allows users to input search criteria easily. Ensure the application can parse and extract data accurately from various webpage structures. Output the extracted data into a structured spreadsheet format. Test the application to ensure its reliability and accuracy under diffe...
I am experiencing significant issues with indexing on my business website. Specifically, I am facing problems with pages not getting indexed and multiple indexing errors. The SEO plugin I am currently utilizing is Yoast SEO. Ideally, I require a specialist with: * Proven expe...am facing problems with pages not getting indexed and multiple indexing errors. The SEO plugin I am currently utilizing is Yoast SEO. Ideally, I require a specialist with: * Proven experience in resolving indexing issues on business websites. * Expert knowledge in handling Yoast SEO and optimizing it for better performance. * Ability to identify and rectify indexing errors to ensure seamless crawling and indexing by search engines. * Proficiency in providing strategic solutions to prevent such issues in t...
Move both and to vps from shared hosting. Move databases. Install mariah, php admin, conf nginx, move cron jobs, etc.
...analytics to create a list of 2,000 websites with high Domain Authority (DA) and Page Authority (PA). I am particularly interested in: This sheet requires all the sites that could not stay live for long time, the fraud site is not required. And if my budget is low, then at least work worker - Sites with a DA score of 60-80 - Variety of types including blogs, eCommerce sites, news sites, SMO, press release sites, and more. The successful freelancer will have a deep understanding of: - How to identify and assess high websites - The significance of backlinks Your deliverable will be a clean, organized sheet listing the sites and their corresponding DA and PA scores. I am keen on details so please verify all information before submission. Ens...
Hi Hassan, as discussed, this is for implementing the consent banner on our sites and transmitting the info to GA4
I have a project focused on crawling results via AWS Lambda functions and AWS REST API. Here's what I need: - Implementation of AWS Lambda functions. I have a python script and have previously successfully deployed on AWS lambda not sure why its facing error now - Triggering the lambda on a AWS REST API call Ideally, I'm looking for someone with robust experience in Python, AWS Lambda functions and amazon REST API. I'm looking for Developer who have experience working with aws services like lambda, aws api gateway and python. The projects is small and straight forward (~ max 2-3 hours) and need someone to deploy the REST api and ready python script.
I'm in immediate need of a skilled freelancer who can help me migrate my 2 Sites (Wordpress and Laravel) websites to a DigitalOcean server. Additionally, I require some server configurations, specifically upgrading the PHP version and installing SSL certificates and configuring the digitalocean server configuration to support subdomain. Key Responsibilities: - Migrate 2 Sites (Wordpress and Laravel) to DigitalOcean server - Upgrade PHP version - Install SSL certificates - Configure cloud server to support subdomain creation Ideal Skills and Experience: - Proficiency in WordPress - Proficiency in Laravel - Experience with DigitalOcean server - Familiarity with PHP - SSL certificate installation expertise This project is under a pressing timeline, so I need someone ...
I am looking for a software developer who can help me with two important tasks. - Firstly, I need a new website built. This will involve creating a platform from scratch, ensuring it is user-friendly, visually appealing and functions impeccably. - In addition, I also need improvements made to my existing website. These improvements are key to enhancing the site's performance, user experience, and overall aesthetics. Ideal skills for this job include: - Proficiency in web software development - Strong understanding of UX/UI principles - Ability to create visually appealing designs - Experience in improving existing websites Your task is to help me create a new website and augment my current one. It is important that you have a keen eye for detail and an ability to deliver high-qu...
...Integrating Data Processing APIs into the application * Maintaining and improving the performance after deployment * Python and the ability to build web crawlers using standard python crawling packages and frameworks In terms of expertise, the ideal freelancer for this project should have: * Profound knowledge in Javascript, PHP, HTML, Python, and async programming. * Considerable experience in web application development * Previous work with API integration, particularly in the area of Data Processing APIs. * Good Python skills in web crawling If you have a track record in creating robust web applications and integrating APIs, your skills are needed here. Success in this project would mean delivering a web application that runs smoothly and provides seaml...
I'm looking for an advanced SEO professional with a strong background in backlink acquisition and a focus on Italian news sites. Key Requirements: - Proven experience in increasing website traffic through backlinks. - Expertise in creating backlinks specifically from quality Italian news websites. - Ability to comprehensively track and analyse the impact of the backlinks. With your skillset, I aim to significantly increase my website's traffic, reinforcing its online presence in the Italian market. Please share your past experience in increasing traffic through quality backlinks, specifically from news websites. Applicants with a successful track record in European SEO strategies will be given precedence.
I'm looking for an experienced crawler specialist to help me crawl databases, and specifically collect certain datasets. Key Project Requirements: - Crawler Type: The focus for this project wi...databases, and specifically collect certain datasets. Key Project Requirements: - Crawler Type: The focus for this project will be on databases, not websites or APIs. - Objective: The primary goal is to extract specific datasets from these databases. - Data Format: The extracted data should be delivered in CSV format. Ideal Skills and Experience: - Proficiency in database crawling and data extraction is a must. - Previous experience in collecting specific datasets from databases is highly preferred. - Familiarity with working with CSV data format. Ple...
I'm looking for a professional with strong experience in building backlinks to help improve the visibility of my website. The main goal is to increase the site's visibility, especially through high-quality backlinks from educational or government websites. Key Requirements: - The primary goal is to improve keyword rankings through backlinks - Backlinks should be from educational or government websites - An ideal freelancer should have proven experience in SEO and link-building - Success of this project will be measured by the improvement in keyword rankings This is a fantastic opportunity for someone who has a strong understanding of search engine optimization and can deliver high-quality backlinks. I'm looking for someone who can deliver a measurable improvement in the we...
I am seeking a competent web crawling specialist who can efficiently extract text content from a specific website's news updates. Here’s what I require: • Extract information from news updates within the target website. • Save the extracted data in Excel format. • Deliver clean, organized, and structured data. Ideal skills and experience: • Expertise in web crawling and scraping tools. • Previous experience working with news or media websites. • Proficiency in data extraction and Excel. • Strong attention to details. I appreciate a freelancer who can show some examples of their previous data extraction projects, especially in a news context.
I'm seeking a meticulous and experienced professional in Octoparse to construct a responsive web crawling template. This crawler will be solely focused on an eCommerce platform, aiming to capture extensive product information. Key Responsibilities: - Capture specifics like the URL, category, and SKU for every product. Ideal Candidate: - Knowledgeable in Octoparse. - Proven experience in data mining and web crawling. - Detailed understanding of eCommerce platforms and product specifications. - Ability to maintain precision across multiple product categories and large datasets. I look forward to seeing your proposals and discussing this project further with you.
I'm looking for an experienced web cr...to extract text content and links from various websites. I need data from the whale watch section of The full crypto address within the links should be associated with their name counter part in a spreadsheet or organized file. I have included a highlted picture demostrating the fields I need. They should be done for the full 6 pages. Requirements: - Experience: Please detail your experience in web crawling and provide examples of previous work. - Delivery: The extracted data should be delivered in a spreadsheet file. It's crucial for the freelancer to have in-depth knowledge of web scraping and data extraction. The tool should be efficient and robust, capable of handling a high volume of data wit...
