Laravel: Write a script to crawl my website to find and list links

Proyek ini berhasil diselesaikan oleh sszelag dengan harga $80 USD dalam sehari.

Dapatkan penawaran gratis untuk proyek seperti ini
Pemberi kerja bekerja
Anggaran Proyek
$10 - $30 USD
Diselesaikan Dalam
1 hari
Total Penawaran
Deskripsi Proyek

I need a freelancer to write a script that will crawl the entire blog section of my website and retrieve all of the links (broken and unbroken), then dump those links (along with the page origin and the request status) into a log file.

The page origin path must be relative to my domain. The page origin, link url, and request status must be on one line, seperated by a comma, and then a space ( ", ") Like this:



for example:

/blog/my-awesome-blog-post, [url removed, login to view], 200

/blog/another-blog-post, [url removed, login to view], 400

/blog/another-blog-post, [url removed, login to view], 500

/blog/what-a-great-blog-post, [url removed, login to view], 301

The crawler should crawl all links at [url removed, login to view]*

Also, the crawler should EXCLUDE my search route: [url removed, login to view]*

Ingin menghasilkan uang?

  • Atur anggaran Anda dan jangka waktunya
  • Uraikan proposal Anda
  • Dapatkan bayaran atas pekerjaan Anda

Pekerjakan para freelancer yang juga menawar di proyek ini

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online