Bulk find internal pages

[Choller]

I have a list of around 1000 sites that I'd like to find as much internal links as possible.

With one site I could throw it into scrapebox or even google and scrape it. But now I have 1000 sites. Is there a bulk tool or any other way to export these pages?

 

[dchuk]

if you're on windows, use xenu link sleuth. If you want to code something, use mattseh's library

 

[mattseh]

It seems the market is there D

Choller, hit me up for a beta coming soon

 

[Choller]

Thanks, +1 !

 

[Kalibastro]

Maybe i can do this for you...