Bots to Browse Websites thru Proxies

G

goddesspoo

Banned
Oct 10, 2010
101
1
0
California
www.emc2blog.com
Hey guys, I'm looking to build a bot that browses through websites via proxies. But I'm looking to extremely randomize every process via customized algorithms.

And I want to do this in a multi-threading manner. Rendering as many as 5k unique searches a day with over 5k combinations of browsing behaviors.

Let's put a team together that can do this.

:D
 


Good call dchuk, that htmlunit looks mighty interesting.

I've fiddled around with watin but it has issues. It doesn't scale very well and it's dependent on internet explorer.

The .net version of htmlunit: Html Agility Pack looks much more scalable and you can deploy to server easier. Now all I have to do is find some time to learn how to use it!
 
^Watin is VERY scalable and easily multithreaded. Just attach is to a WebControl instance.
 
+1 tainted,

I've just started with watin, I used one instance of internet explorer to fill in a couple of forms so far. Will have to try and multithread it.
 
gnu.org/software/ pythonwebkit/

This has basic browser control and dom bindings... it takes a very small amount of system resources.

It needs a little bit more functionality exposed to python to actually be useful.
 
You must log in or register to reply here.
Top Bottom