Laravel: Write a script to crawl my website to find and list links

  • Status Diselesaikan
  • Anggaran $10 - $30 USD
  • Total Penawaran 3

Deskripsi Proyek

I need a freelancer to write a script that will crawl the entire blog section of my website and retrieve all of the links (broken and unbroken), then dump those links (along with the page origin and the request status) into a log file.

The page origin path must be relative to my domain. The page origin, link url, and request status must be on one line, seperated by a comma, and then a space ( ", ") Like this:

PAGE ORIGIN, LINK URL, REQUEST STATUS

======

for example:

/blog/my-awesome-blog-post, [url removed, login to view], 200

/blog/another-blog-post, [url removed, login to view], 400

/blog/another-blog-post, [url removed, login to view], 500

/blog/what-a-great-blog-post, [url removed, login to view], 301

The crawler should crawl all links at [url removed, login to view]*

Also, the crawler should EXCLUDE my search route: [url removed, login to view]*

Dapatkan penawaran gratis untuk proyek seperti ini
Diselesaikan oleh:

Ingin menghasilkan uang?

  • Atur anggaran Anda dan kerangka waktunya
  • Uraikan proposal Anda
  • Dapatkan bayaran untuk pekerjaan Anda

Pekerjakan para freelancer yang juga menawar di proyek ini

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online