Can you provide reliable large scale scraping, long term? - WickedFire - Affiliate Marketing Forum

NathanRidley · 07-05-2011, 03:13 PM

I need to set up a deal with someone who can reliably provide scraped data. I do not care how the data is obtained (don't ask, don't tell) - I just care that it can be acquired reliably and that the arrangement can be made long term.

The sorts of data I want will include PageRank, backlink counts from various sources, DMOZ/yahoo directory checks and so forth. I expect to be performing hundreds of thousands of queries per day and have no issue with an ongoing payment arrangement.

I would be wanting to either access the data via something like a REST API (or similar). If you have the capacity to do this and are interesting in doing business, please let me know.

Choller · 07-05-2011, 03:42 PM

Spiders and Scrapers

Bofu2U · 07-05-2011, 03:45 PM

If you can't find someone after this thread dies down a little, contact me I know a few people that may be interested once I find out the details.

...and +1 for Mattseh.

NathanRidley · 07-05-2011, 06:02 PM

Thanks for the link, I've contacted Mattseh, though I am still interested in all my options if anyone else is interested.

07-05-2011, 03:13 PM	#1 (permalink)
NathanRidley Member Join Date: Jul 2008 Posts: 95 iTrader: 0 / 0%	Can you provide reliable large scale scraping, long term? I need to set up a deal with someone who can reliably provide scraped data. I do not care how the data is obtained (don't ask, don't tell) - I just care that it can be acquired reliably and that the arrangement can be made long term. The sorts of data I want will include PageRank, backlink counts from various sources, DMOZ/yahoo directory checks and so forth. I expect to be performing hundreds of thousands of queries per day and have no issue with an ongoing payment arrangement. I would be wanting to either access the data via something like a REST API (or similar). If you have the capacity to do this and are interesting in doing business, please let me know. Share Share this post on Digg Del.icio.us Technorati Twitter

07-05-2011, 03:45 PM	#3 (permalink)
Bofu2U Automation Specialist Join Date: May 2007 Location: Baltimore, Murdaland Posts: 8,293 iTrader: 78 / 100%	If you can't find someone after this thread dies down a little, contact me I know a few people that may be interested once I find out the details. ...and +1 for Mattseh. Share Share this post on Digg Del.icio.us Technorati Twitter __________________ Read This About The Penguin Update Contempt / Business Caffeine

07-05-2011, 06:02 PM	#4 (permalink)
NathanRidley Member Join Date: Jul 2008 Posts: 95 iTrader: 0 / 0%	Thanks for the link, I've contacted Mattseh, though I am still interested in all my options if anyone else is interested. Share Share this post on Digg Del.icio.us Technorati Twitter

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Writer for Education, Universities and Colleges - Long term work	bluehat	Content	1	04-15-2011 04:39 AM
Guest Posts & Guest Posters - Long term opportunity	BeePk	Sell, Buy & Trade	0	04-08-2011 01:58 AM
WANTED - Article Writers for Long Term Relationships	profezor	Sell, Buy & Trade	9	01-08-2009 10:58 AM
Simple way to 10k! - Long Term Content Sites	maverick	Shooting The Shit	2	06-03-2007 02:11 PM
Long term stability with slightly lower payout, or high paying short term income	darkdrift	Shooting The Shit	11	09-18-2006 04:12 PM