Consultancy for News Aggregator database/crawler

Hi there We are looking to ultimately create a aggregator database website similar to: [login to view URL] [login to view URL] [login to view URL] and we require consultancy and work to do this. Consultancy to specify what is required as well as the work to do it We already have a prototype built, but we are looking for someone who has EXISTING skills in this area as the current prototype does not work well. Therefore anyone who bids must be able to demonstrate that they have done this kind of thing before. Here is what I THINK we need: 1. creation of database structure to handle large volume of data. This data does NOT need to be kept for a long time though and so needs to be purged at intervals 2. a crawler that will read RSS feeds 3. Automatic categorization of news (if possible) by region/country and by industry. Only if possible and willing to listen to ideas for this we also want the following: 1) ability to add in RSS feeds - either manually or ideally to have a system that will grab them from sites or crawl directories to find them and add them. We are DEFINITELY looking for someone with knowledge here 2) someone with prior knowledge of this industry who can add value to what I have said above. We are more than willing to split this project if there is someone who only has knowledge of how to build up the database of RSS feeds Also, we do NOT wish to have blog feeds in here Looking forward to reviewing your comments. Feel free to email me any questions you may have along with your suggestions One final point... We will not entertain anyone just sending a "pleased give me more info" type messages nor people who just post a price. We're looking for professional people who have a good grasp of our requirements Finally, this must run under Linux and mysql Good luck Ade ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform Linux, mysql