Protecting my website from crawler and scraper (30$).
Hello! Thank you for having interest in this topic.
As you know, Crawling and scraping have been always generalized. Even if you don't have very deep knowledge about it, you can make your own crawling tool just following a few steps in a tutorial that you could easily see in online.
But still, there seem to be a way have a shield, control from it.
[login to view URL]
This is the website I happened to find accidently.
When you navigate to the link and try right-clicking, or Ctrl+Shift+C, or Ctrl+S to download the webpage as html file.
This is all blocked. Also it sends the pop-up message "You are not allowed to copy content or view source"
I was surprised when I found this website. Because I thought it's technically, impossible.
But in this website, not only blocking 'right-clicking', it also blocks to view the source of the webpage.
So here I'm questioning specifics below.
How is protecting as such is possible? How did they install such blocking system to stay away from the crawl bot?
Do you know exact name of the service that the website is implementing to defend their own content?
Is it really possible to defend and block crawl/scraping access to your website and domain just like this website, Or it's just blocking it surface and it's actually possible to be by-passed?
Could you try install the same system as the website? I linked?
Other theoretical suggestions are welcome. (already built software tool or websites that showing the categorized form webs)
If you already have developed a similar task, this would be the best.
Reward is only 30$. It's quite small in general view,
But in this post I wanna get theoretical structure idea of these. Not demanding to build it right away.
If we could get match well in this post by questioning and answering, I will proceed right next procedure to dedicate about building related tool/project/websites with you. :)
Thank you for reading! Have a good day and bid me if you think you can complete one. Anytime !
And I am willing to respond very quickly to explain and describe more what I exactly need.
also, if you can really make it out well this time in this project, I will promise to carry out further projects with you. Thanks alot.