spider/extract info from directory(repost)(repost)

Need a coder who is experienced in spider/extraction software AND who has experience extracting WHOIS info (just email address) AND also extra pagerank value (google PR). You also need to have experience with Proxy servers in case that your IP is banned. I dont need the software but only need a coder to extract urls from a directory - so, you simply make a script to extract urls from teh directory i specify to you and then you give me the output files when finished. I both want a complete accumulated list of all urls it finds in the directory - as well as one individual text file per "category" (say "shopping" or "art"). These individual text files must have one url per line and the file must be named after the category that the urls are extracted from. Also, you must supply an accumulated list with all urls with their title, description and url as "HTML/"A href" code with one info per line and then a blank line space before the next information (for the next website) For each url then the pagerank is listed and I ONLY want the urls that have MINIMUM Pagerank 2. The directory have about 20.000 urls and is very easy for a crawler/spider software to crawl since all is text. that's it :-) Please write what experience you have with this type job (extraction, getting WHOIS info and getting PR info) and why you are the right coder for this task. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform text