mattseh

SimpleSearchScraper: It can scrape stuff. It can scrape from pretty much any search engine. Want one added? I'll add it, or you can do it yourself within a few minutes. Think of how many sites there are with a search function that would be useful to scrape....



Dumps to CSV (example) or to a txt file of just URLs.

Support proxies as standard.

You can buy it for $37 here!

__________________
You have a right to obey.

eliquid

i just bought this and ran it 3 times and already made $300.. thats $100 profit per run!

you betta buy this shit yo, im burning and churning already

__________________
.
.

eliquid

Alright, Ive had more time to play with this and it is a great little tool.

Im sure some of you guys have other tool sets that can perform this action, but for something that I can run multiple instances of, is very very simple to use, and can be customized to the hilt, this cant be beat.

Not only can I run searches and see which of my keywords generated which result in Google, Yahoo, Bing and Twitter, I can set my own engines. Wanna run something in Ask? How about Dogpile? Maybe a competitors site that has a search box in it? Yes you can do all that and more.

Matter of fact, with a little work you can make it work on sites that dont have a search function.

How about just checking your own rankings in the SERP's? Yes and double yes.

Think of it as a simplified regex app. You input what URLs to start with, you define the regex patterns you want, and you define the columns in the regex as well for the CSV output and your done. Add in proxies and tweak the settings some, and your off and running baby.

Next time you wanna scrape some data in bulk from pretty much any page or site and do it in a multi threaded environment, this is the must have tool for the job.

__________________
.
.

igl00

ive tested the software. works really good and believe me ive tried many scrapers before. the option of adding own search engines is great

__________________

alan8888

I don't understand how u make money ??


I don't get it, what is the main function of this program? what's different with scrapebox. for scraping. can u mention more funtion for this product.

eliquid

I feel bad for you mate for not knowing..

You need to buy this and use it to scrape stuff. If you dont know how to scrape content, you need this tool.

Why do you wanna scrape content? So you can quickly make sites and articles which can make you money.

Instead of scraping, you could use this to collect urls for research into a niche or simply keep track of your SERP rankings.

I ran this a few times and collected some nice scraped content for a niche I was building and took that content and made 3 sites out of it and also some articles.

__________________
.
.

espey127

Hey Matt,

I was told by another member that your tool would be able to provide page results for a given set of keywords per url. Is this true? How does it work? If so, is there a limitation to the length of the url being analyzed?

Heres what I'm after:
ABC.com has keywords; see, jane, walk, dog. What is the current position of this url in Google, Bing & Yahoo for these keywords?
See-10; Jane - 32; Walk-57; Dog-105

abc.com/123 has; why, do good girls, like bad boys
Why-1; Do Good Girls-150; Like Bad Boys-52

espey127

I answered my own question by looking at the example you provided. This leaves me with two questions.

1) Is there a limitation to the length of the url being analyzed?
2) Is there a keyword position limitation?

mattseh

It'll scrape up to 1000 results in google, up to I think 200 in Bing. Not sure what you mean by length of URL limitation, it should be able to handle all normal URLs.

Thanks!

__________________
You have a right to obey.

turbolapp

Not sure but maybe he means can it do more than website.com.? ex website.com/index.html website.com/whatever-the-fuck.html....ect
This is just on my mind cause I was trying to get seobook rankcheck to do this the other day and it couldn't.

but unless something is different about Matt's tool than it was 2 days ago, it doesn't do what this guy thinks it does. It doesn't check keywords based on urls. It's the other way around, it checks which urls are ranking for particular keywords. Now you could enter in all those keywords you were asking about and maybe work something out in excel to see if there is a particular url that you are looking for? Or maybe there's something else you could do to the actual tool it's self, not my department, but I'm pretty sure out of the box it doesn't do that.

...unless I'm completely misunderstanding the original question and then, move along nothing to see.

__________________
Workflowy Best Free Organizational App. Period.

espey127

Thanks for clarifying Turbolapp.

A script or tool like Rank Checker is what I am after. The issue with Rank Checker is that there is a limit of 100 charters per url. most of our url's are a little longer. With this said, can Simple Search Scraper do this or do you have one the will? Or, can you point me in the right direction?

guerilla

Good Lord why?

__________________
Change Your Life
Twitter ^ YouTube

Thank you for your attentiveness,
the forward thrusters, engage on you busters,
I cut the mustard.

espey127

It's not by choice, it's the nature of ecomm.

TheDon16

To clarify... This doesn't scrape actual content from the sites?

It just scrapes a list of urls with targeted content to later scrape and use some other way?

mattseh

It can be made to with some knowledge of engines.txt, but its main purpose is to scrape search engine results.

__________________
You have a right to obey.

S M W

just purchased and it was worth every penny! so far i've only played around with it but can see that you priced it too low, lol.

anyway, can you give me an example of how to manipulate the engines.txt? i'm interested in scraping sites and posting the results on niche blogs. lets say i wanted to search for nursing jobs near las vegas that are listed on the careerbuilder.com search engine - how would i do that?

woj34

Is it possible to use complex expressions e.g. +"buy viagra" +"add reply" ? If it is then how?

mattseh

It is, I'm in the middle of typing up a detailed tutorial on how to setup custom scrapes. If you mean is it possible to search for those things using google/bing/yahoo, yes it is.

__________________
You have a right to obey.

igl00

soon ill put rewiev on blackhatpwnage blog

__________________

mattseh

http://dl.dropbox.com/u/2326797/Mega...2_ACDE345A.zip

Version 2 is out, a few bug fixes, complex queries should now work properly!

__________________
You have a right to obey.

S M W

Thanks for the update.

fallenskywalker

sb has very similar functionalities, what makes this different or better? the ability to add se via reg expressions?

sorry for this stupid question but the example csv given shows url, title, position and keyword scraped. how does this scrape content and article? you need to navigate to the individual scraped urls to get the content afterwards?