webtraffic1

I have about 100,000 pages on my site and the content changes often. I currently have 3,614 URLs in the web index on Google.

How do I get more URLs indexed by Google?

Nebraska

1. Re-evaluate your internal linking structure. Make reaching every page on your site something that can be done in 3 clicks. While that is unlikely, it's a very good goal to keep in mind as you rebuild the internal linking.
2. Gain *quality* in bound links. Some will need to be pointed at the home page and more importantly - you will need to deep link some of your content.

Step #2 only works well if you are able to properly implement step #1. I see similar situations all the time.... A website has tens of thousands of pages, but only a handful are indexed by Google. This almost always means the site has a poor linking structure.

NOTE: an XML sitemap is NOT a replacement for a good internal linking plan.

- Joe

goninme

1) content is key. you must have original, unique content on your deep pages. this is by far the most important point which ultimately decides most of the chance that your site will get indexed fully and will get traffic or not. if you dont have enough unique content per deep page - generate it. lots of methods for doing this - translation, related pages, doubling links with anchor text, autogenerating screenshots, watermarking, generating MP3s from text, etc etc etc.

2) good site structure internal linking. every deep page must be reachable within 2-3 clicks from the root page. every deep page must link to 20+ other pages in a relevant manner (related/similar stuff, recently visited stuff from this page, etc).

3) speed. your deep pages must load FAST. if your site loads slowly, you can practically forget it from the outset - Googlebot doesnt like that and its unlikely you'll ever get much traffic from G unless you gain some astronomic PR.

4) external links. this is less important than 1 and 2 for megasites, because its not like you'll ever get backlinks pointing at even 10% of your deep pages anyway (well, there are somewhat grey-blackhattish widget tricks for doing it, but i'd keep my fingers away from that if you dont want to risk a ban). we have numerous sites with over 1 mil pages indexed which have just a few hundred backlinks in YSE and like 5 in G.

there's much more, but this is the basics.

C.Rebecca

- First of all, create a good Sitemap and submit it to Google webmaster tools.
- Create a good internal linking structure
- Ping the search engines

moneylong

use ping.fm

ChuckBass

Ping those sites using Bulkping or Pingfarm, I'm using those for indexing hundreds of links.

Nebraska

Ping, without a solid internal linking structure will not work. Sure, you may get Google's attention, but you wont keep it. Unsupported pages will be placed in the supplemental index - sort of a sandbox for pages rather than sites.

I have worked on many successful large sites (well over 1 million pages). If you want to keep pages indexed and earning visitors you will need to develop an internal linking plan.

HankHill

Like goninme said, you need original content, and a way to let it all flow together easily.

copednic

Use Google Webmaster tools than u should generate a full XML sitemap.

lukeking

agreed with the previous posts
just ping those links on pingomatic or pingfarm

Bompa

As others have said, deep linking. Get links to those inner pages and
Google will consider them important.

So many people need this that I am starting a specialized
service for it very soon


Bompa

__________________

1yerrot

Bompa, PM me when you launch that service.

__________________

adelzaman

submit stories on digg
stumbleupon

ilovewf

try to use google webmaster tools, setup crawling rate medium..