Build Web Scraper

Ditutup

Deskripsi

Hi,

Can you make PHP Java web scraper/crawler for any website by putting a code into PHP file?

Normally, I put a simple htmldom to my PHP file as following:

<?php

function getDetail($ASIN){

$returndata="";

$contents=curlContent($ASIN);

$html = new simple_html_dom();

$pageURL="http://".$_SERVER['HTTP_HOST'].$_SERVER['REQUEST_URI'];

if(!empty($contents))

{

$html->load($contents);

if($html->find('div[class="product-details-and-care"] ul')){

foreach($html->find('div[class="product-details-and-care"] ul') as $detail){

$returndata=$detail->plaintext;

$regex = '#<img([^>]*) src="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';

$regex = '#<a([^>]*) href="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';

$returndata = preg_replace($regex,'',$returndata);

}

}

else {echo "There is currently no description for this product. We do not represent or warrant that product descriptions or other Content on this Site is accurate, complete, reliable, current, or error-free.";}

$html->clear();

unset($html);

}

return $returndata;

}

echo getDetail($ASIN);

?>

$ASIN is a page url variable of any web page and this case I using with any product page of [url removed, login to view] such as [url removed, login to view]

A function will find element UL under div class of product-details-and-care and will print data as plaintext when visiting a page and connect with $ASIN, if not found or can't access page will print custom text as 'There is currently no description...'

However, I got a problem when currently this code seems to be old-fashioned or get restricted to access and print data on my webpage.

So, I want to know can you make or develop a code with other language in java or etc to working with my PHP file to let all websites allow me to crawl and scrape their content to displayed on my webpage?

Thank

Keahlian AJAX, Java, Javascript, PHP, Web Scraping

Lihat lebih lanjut: consuming web service classic asp using http post, build interactive calendar using visual basic, open web page button click using, bypass web master craiglist usa using, using case else function php, build job site using cakephp, system requirements build inventory system using php mysql, build dealer locator using coldfusion, flash using php variable, build dating website using gwt, mysql error code 1054 using case, build joomla template using photoshop, build custom usb drive case, build sample website using dotnetnuke, web build tenders

ID Proyek: #12704340

13 freelancer menawar pada rata-rata $59 untuk pekerjaan ini

techwelfare

yes, let's clarify the requirement in details also if you want us to share our skill and previous work let us know.. hope to hear you soon.. Thanks & Regards RIMSHA

$121 USD dalam 6 hari
(128 Ulasan)
6.8
thewebscraper

Hi, I am an expert web scraper. I can easily modify your script using PHP Goutte. I look forward to your acceptance

$40 USD dalam 1 hari
(11 Ulasan)
5.3
NewJhelum

Hi, I have gone through your requirement and I'm very interested in this job. Yes I already did this type of jobs and its more easier for me to do this job. You can also check my profile's reviews and ratings about my Lagi

$35 USD dalam 3 hari
(29 Ulasan)
4.6
ghsinfotech

Hello Sir My name is Gurjot Singh, I'm working with IT from 8 years. My thinking is when im working on client site so for me i think im working on mine. I'm new here so thats why i don't have any reviews.I would like t Lagi

$40 USD dalam 3 hari
(2 Ulasan)
3.1
nwnz

Dear Hiring Manager, I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. My work experience as shown in my profile have helped me develop mastery in We Lagi

$37 USD dalam 2 hari
(1 Ulasan)
2.6
$35 USD dalam 3 hari
(4 Ulasan)
2.4
MrScraper

Hi there, thanks for the project. Please tell me if you want me to send you the demo app? You do not have any obligation about it . I like to make similar bots, I find your idea very challenging. Thanks, MrS Lagi

$222 USD dalam 3 hari
(1 Ulasan)
1.3
$40 USD dalam 3 hari
(0 Ulasan)
0.8
$40 USD dalam 2 hari
(0 Ulasan)
0.0
addaxagency

I am the best for this project because i working on this materials since 3 years already os i have the experience on it, as you can see i have only excellent feedbacks from my customers.I have worked on 120+ projects i Lagi

$40 USD dalam 3 hari
(0 Ulasan)
0.0
amit03915

Hi This is Amit Sharma and i have 8+ years of experience in Digital Marketing. My primary skills are SEO, SMO, PPC and Link-building. I can give you an excellent result for your keywords. What can i do best from Lagi

$40 USD dalam 3 hari
(0 Ulasan)
0.0
ParekhBhakti

Hiiii! How r u? Respected sir! I have checked your project and would like to have your project. I m confident to fulfill your requirements in timely manner,along with quality work. Our t Lagi

$35 USD dalam 3 hari
(0 Ulasan)
0.0
astuteexplore

Astute is having dedicated testing team with expertise on PHP programming. 1. We have Managed and maintained development of PHP backend for dynamic database driven websites 2. Provided technical support in the assura Lagi

$40 USD dalam 3 hari
(0 Ulasan)
0.0