eBay spider

------------------------------- Wanted for scientific research ------------------------------- What: Script/application that can spider the (completed) auctions on eBay sites (at least .com / .nl / .de) for items containing a certain key word (eg "mobile phone"), extracts the data mentioned below, and writes it to some readable dataformat (eg comma separated ascii: one line per auction-item). Example: Hammersnipe's "Deep Analysis" does what I want, but does not extract enough data (and separates Seller / Item data). And I only need a simple GUI around it. Language: Any scripting language you like, as long as the code is readable (Perl, VB, ...) so that I can make adaptations to the code if I want to. Or make it a windows app. Full description of items to be extracted in enclosed file. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Installation package that will install the software (in ready-to-run condition) on the platform(s) specified in this bid request. 3) Complete ownership and distribution copyrights to all work purchased. Delivery deadline: within a couple of weeks. - - - list of data to be extracted - - - **item:** (auction) number, product, brand, item category, auction start and end date and time, auction period (# days), auction site ([login to view URL] / [login to view URL] / [login to view URL]), reserve price, asking price, **auction settings:** "buy now" is possible (yes / no), currency, buy now price, bid increment, creditcard possible, moneyorder possible, cashiers check possible, personal check possible, payment is possible through other method, cash possible, wire payment possible, C.O.D. possible, paypal possible, auto incasso possible with, shipment costs, buyer pays shipment cost, buyer pays auction cost **seller:** name, is member since, location, reputation number, "kind" (power-seller etc), is shopowner?, is newbie, # number of comments, # of positive comments, # unique positive comments, # neutral comments, # unique neutral comments, # negative comments, # unique negative comments, # same for comments in last 7 days / 4 weeks / 6 months, # bid retractions last 7 days, 4 weeks, 6 months, **buyer data:** see seller **auction:** first bid, endprice (highest bid), # of bids, # of bidders, # of bids in last 5 minutes, # of bids in last minute, it was a "buy now" purchase (y/n), actual end date and time, minimum price was reached, time of last bid, number of bids per bidder, bidding prices **if possible:** [1] ======================================================= description: # of words description: pictures used description: # pictures used (In fact, I would be interested in any kind of more qualitative data that can be extracted automatically, for instance, related to the kind of words used on a page.) [2] ======================================================= Allow the possibility to exclude certains . For instance: "mobile phone NOT Nokia". Ideal would be if a search option would exist as in eBay's advanced search ([login to view URL]). ## Platform Either windows app (preferred) or Script (PHP/Perl/Python ...).