Google Sitemaps question - GoFuckYourself.com

gnet · 05-22-2009, 04:01 PM

I've been submitting quite a few sitemaps to google's webmaster tools. Each sitemap has a list of 50,000 URLs. It sounds like a lot, but believe it or not, I plan to upload millions of pages to google.

Here's how... every search result on my site is an entirely dynamic page, with custom titles, h2 tags, meta tags, clean URLs and content -- even if no results are found.

For example: if you search for "Perfect", you get 1800 results, an appropriate title tag, h2, meta, the works.
http://www.ovidz.com/Videos/Perfect

If you add "Blowjob" to the search, you get 113 results.
http://www.ovidz.com/Videos/Perfect-Blowjob

You can go a third level deep and add, say, "Asian" to the search and you'll still get results:
http://www.ovidz.com/Videos/Perfect-Blowjob-Asian

And so on. You can add any combination of keywords to the search and you'll get some kind of result.

I have a total of about 10,000 tags in my database. I'm generating these sitemaps by cycling through the `tags` table with random tag combinations.

So,...

10000 x 10000 = 99,990,000 URLs (two random tags)

10000 x 10000 x 10000 = 999,700,020,000 URLs (three random tags)

So my question is, will any flags be raised at google when they see 100's of thousands of URLs being submitted from one site every day? If so, what will happen?

Jdoughs · 05-23-2009, 08:41 AM

Generating any amount of pages is fine, its the quality of the pages that is the issue.

If you fuck up and have 10-15 poor pages its one thing, but if you fuck up and have 10,000 shitty ones, its obviously going to devalue your site.

If you can keep them all unique, relevant, and actually seem like that many pages is needed, then you will be ok. They will not punish anyone for being too big or growing to fast, its the other factors that will crush you.

Basically I would say having tons of pages as fine, as long as that many pages is needed to show or display your content. But generating pages just to have pages is silly and most of the time will just create disasters out of simple mistakes.

gnet · 05-23-2009, 09:10 AM

Thanks for your comments.

I'm not really generating pages for the sake of generating pages. Every page does have some level of relevency. If someone's on Google and searching for "Hot Webcam Asian Strip", I want Google to have that search page indexed (http://www.ovidz.com/Videos/Hot-Webcam-Asian-Strip). I'm not really creating that page, per se. It's the same search results page, but with new keywords injected into the URL. Know what I mean?

The saying goes: Google's existence solely relies on the relevency of their search results. I feel I'm contributing to their relevency by submitting links to every possible search query. Even if the results yield less than 5 results. But, we're talking millions and possibly billions of pages. That's the part that has me concerned.

bmchunu · 05-24-2009, 01:22 AM

I would say you need to change the way you work things.
You are looking at a big duplicate content penalty. You will have lots of different page, with the same/similar content.

What you need to do is have separate lists of tags. Primary, secondary and then the rest. Hhmmm let me try and explain that again.
Seperate lists ... 1st level keywords, 2nd level Keywords, 3rd Level etc.

Example
1st Level = Hot, Sexy, Cute, Fat, Thin
2nd Level = Blonde, Asian, Latina, Lesbian
3rd Level = strip, show, tease, play, toy, masturbate, ass, boobs

This will reduce the total number of pages you have as you will now have maybe 200 X 200 X 400 or something like that ... but should significantly increase the quality of the pages.

gnet · 05-25-2009, 12:29 PM

What constitutes a "duplicate content penalty"? All of the URLs will have different results, thus, different content.

The world penalty scares me and is exactly what I'm trying to avoid.

Kelli58 · 05-25-2009, 06:16 PM

Duplicate content is exactly what the name means ......... two pages with exactly the same content. IT doesn't matter what the URL is, what matters is the content on the pages being delivered. If you say Hello 14 and I say hello 14 and your friend also says hello 14, two uf us will likely suffer the duplicate content penalty.

gnet · 05-26-2009, 12:52 AM

But that's not the case here. We're not posting links to pages with duped content. Every group of keywords will yield some kind of results.

The only time you'll get duplicate content to some degree would be if you searched for a keyword (Example: /Videos/Nurse) and have it yield 10 results, and then add another keyword to the search (Example: /Videos/Nurse-Blonde) which will yield 5 results. Five of those 10 results will be the same, BUT, the pages won't be identical.

Even on pages where no results will be found, we'll still have dynamic content on the page (ie: Recently watched videos, popular videos, and so on). No two pages will ever generate the same content.

Jdoughs · 05-26-2009, 06:11 AM

Quote:

Originally Posted by gnet

But that's not the case here. We're not posting links to pages with duped content. Every group of keywords will yield some kind of results.

The only time you'll get duplicate content to some degree would be if you searched for a keyword (Example: /Videos/Nurse) and have it yield 10 results, and then add another keyword to the search (Example: /Videos/Nurse-Blonde) which will yield 5 results. Five of those 10 results will be the same, BUT, the pages won't be identical.

Even on pages where no results will be found, we'll still have dynamic content on the page (ie: Recently watched videos, popular videos, and so on). No two pages will ever generate the same content.

It's dup content. Just because the search is refined more doesn't mean its any less duplicate. The content blocks are displayed on hundreds of other pages, no matter how you try to twist it, this fact remains.

Duplicate content has nothing to do with pages being identical, it has everything to do with content being generated or used in more then one spot. It means using chunks of content repeatedly on the same domain or across others.

If you want to display the same blocks of content you need a way to spin it so its not the same content shown on 100 different pages, but no matter what understand, just generating mass pages isnt going to do shit for you.

gnet · 05-26-2009, 09:57 AM

Quote:

Originally Posted by Jdoughs

It's dup content. Just because the search is refined more doesn't mean its any less duplicate. The content blocks are displayed on hundreds of other pages, no matter how you try to twist it, this fact remains.

I see what you're saying. Unless the content for a page lives solely on that particular page, then it's a unique page. Otherwise, it's duplicate content even if just one search result appears on more than one search.

Quote:

Duplicate content has nothing to do with pages being identical, it has everything to do with content being generated or used in more then one spot. It means using chunks of content repeatedly on the same domain or across others.

If you want to display the same blocks of content you need a way to spin it so its not the same content shown on 100 different pages, but no matter what understand, just generating mass pages isnt going to do shit for you.

What I was hoping to do was build targeted and relavent pages for search results. If someone is searching for "Asian amateur dildo", I'd want my "/Videos/Asian-Amateur-Dildo" page indexed and displayed on the search result.

I understand google's endless search for relavency, but wouldn't these pages help their users find what they're looking for?

joesmack · 05-26-2009, 10:25 AM

There are pros and cons to what you are doing. I am facing the same dillema actually. Having a vast amount of pages allows you to return results for a vast number of google searches. Unfortunately the rank Google gives us for these vast number of pages is not very high. But, as I have noticed through looking at my logs, there are many searches that people are using that dont have 10 results so I get indexed in the top 10.

But as those searches become more popular, I am in a position to get bumped out of the top 10 first because of my content dillution.

If somebody searched google for asian teen blowjobs google wont give you 3 search results for
/Asian-Teen-Blowjobs/
/Blowjobs-Asian-Teen/
/Teen-Asian-Blowjobs/

You will only get 1 search result right?

So it would be a good idea to do like bmchunu said and apply all credit to /Asian-Teen-Blowjobs/

gnet · 05-26-2009, 12:58 PM

I hear what you're saying. When we generate these URLs, we'll be generating permutations to avoid identical keywords in the search field.

My concern right now has to do with the the dupe content penalty mentioned above. The site doesn't have a single hardcoded page. Every page is dynamicly generated by the search results page.

SeanLEE · 05-26-2009, 01:23 PM

A good benchmark to know if your plan is working is when Google gives your search result sitelinks

Your site looks brandspanking new you've got some work to do.

A bunch of pages with no traffic are useless.

And then once you get the sitelinks- the next step is Page Rank.

Also your domain name is a factor- I launched OnlinePornTube.com yesterday as a test, and because of the top level keywords it's allready getting a few hundred uniques a day.

All this to say -just because you have a million vids in your database- that doesnt guarantee top placement.

And then offcourse the last factor- tube traffic is sub par- these guys dont want to buy anything...

So use that thing as a gateway tool to make more.

Your site looks great by the way.

If youd like to jumpstart your traffic a little bit more- check my sig we can help you.

Best of luck- it can only get better.
SeanLEE

gnet · 05-26-2009, 03:49 PM

I understand google doesn't care about the size of my database. I was hoping to leverage the variety of search terms in my favor by submitting individual URLs to google. Of course everyone's goal is to have top billing on google's search results, but right now, I simply want these pages indexed. I'm just wondering if google will slap me in the face for dumping millions of URLs on them.

And yes, my site is brand spanking new. It's still in beta as we're working out the kinks. We're doing things a little different (some can say we're doing it all wrong). But, we're first focusing on functionality, usability, and content. We're hoping this will help spread the site through word of mouth. We have been noticing an increase in direct traffic, but we'll see if that continues. Once traffic comes in, we'll then analyze the traffic patterns. And then, find a way to monetize the traffic. Until that day, we don't plan to inject any ads into the site until we determine the best route.

As far as the domain goes, we were looking for something brandable, easy to remember. It might turn around and bite us in the ass, but that's why we chose that domain and not one consisting of top level keywords.

Again, that's for your reply. I'm learning quite a bit.

SeanLEE · 05-26-2009, 06:30 PM

Quote:

Originally Posted by gnet

We're doing things a little different (some can say we're doing it all wrong).

Thats when you know your doing everything right. Dont follow the leaders - there fste is known... keeping do it all wrong- and watch how right it becomes!

I like your style.. you sound like a winner.

SeanLEE

Jdoughs · 05-27-2009, 01:06 AM

Quote:

Originally Posted by gnet

I understand google doesn't care about the size of my database. I was hoping to leverage the variety of search terms in my favor by submitting individual URLs to google. Of course everyone's goal is to have top billing on google's search results, but right now, I simply want these pages indexed. I'm just wondering if google will slap me in the face for dumping millions of URLs on them.

Of course they will, generating millions of shitty pages is going to sink you like the Titanic. Generating tons of pages is only going to magnify any mistakes you make.

Not sure how else to say it. But it seems your mind is made up to do it that way anyways, so I say giver.

Jdoughs · 05-27-2009, 01:12 AM

Quote:

Originally Posted by SeanLEE

A good benchmark to know if your plan is working is when Google gives your search result sitelinks

Your site looks brandspanking new you've got some work to do.

A bunch of pages with no traffic are useless.

And then once you get the sitelinks- the next step is Page Rank.

Also your domain name is a factor- I launched OnlinePornTube.com yesterday as a test, and because of the top level keywords it's allready getting a few hundred uniques a day.

All this to say -just because you have a million vids in your database- that doesnt guarantee top placement.

And then offcourse the last factor- tube traffic is sub par- these guys dont want to buy anything...

So use that thing as a gateway tool to make more.

Your site looks great by the way.

If youd like to jumpstart your traffic a little bit more- check my sig we can help you.

Best of luck- it can only get better.
SeanLEE

Sometimes its better to keep your mouth shut when you don't understand something and leave people wondering, as opposed to opening it and letting everyone know how clueless you are.

This man's livelihood may well rely on advice you give him here so lets try to only offer advice on stuff we have a clue about.

gnet · 05-27-2009, 11:13 AM

Quote:

Originally Posted by Jdoughs

Of course they will, generating millions of shitty pages is going to sink you like the Titanic. Generating tons of pages is only going to magnify any mistakes you make.

But what would make them shitty. I see these pages as being very relavent. It's not like i'm flooding google with pages that aren't relavent to what people are searching for on google. /Amateur-Blonde-Dildo will yield different results from /Amateur-Brunette-Dildo.

What makes these pages "shitty"?

Quote:

Not sure how else to say it. But it seems your mind is made up to do it that way anyways, so I say giver.

My mind hasn't been made up. This is why I'm asking. I don't want to be penalized by google for injecting millions of URLs (URLs that I think are relavent). But, I guess the real question is: are these pages really relavent? If someone is searching google for "blonde amateur using dildo", I would think my /Amateur-Blonde-Dildo page is exactly what the person is looking for. Or, am I completely off?

bmchunu · 05-27-2009, 12:44 PM

/Amateur-Blonde-Dildo --> /Amateur-Brunette-Dildo

The above example you made is the right way to go. Just avoid going /Amateur-Brunette-Dildo /Amateur-Dildo-Brunette /Dildo-Amateur-Brunette and you should be fine.

As said earlier ... Start small and see how it goes first, because any mistake you make will be amplified. Seo is a game of patience. If you need any further advice hit me up on ICQ.

pornguy · 05-29-2009, 06:44 PM

Quote:

Originally Posted by gnet

What constitutes a "duplicate content penalty"? All of the URLs will have different results, thus, different content.

The world penalty scares me and is exactly what I'm trying to avoid.

What ever google wants it to mean at the time..

On top of that what you are doing is somewhat considered Black Hat SEO and can not only get your domains and IP range banned, but all the IPS the host has. In which case someone is gonna be pissed at you

brassmonkey · 05-30-2009, 07:57 AM

omg u didnt jack the thread

Quote:

Originally Posted by SeanLEE

A good benchmark to know if your plan is working is when Google gives your search result sitelinks

Your site looks brandspanking new you've got some work to do.

A bunch of pages with no traffic are useless.

And then once you get the sitelinks- the next step is Page Rank.

Also your domain name is a factor- I launched OnlinePornTube.com yesterday as a test, and because of the top level keywords it's allready getting a few hundred uniques a day.

All this to say -just because you have a million vids in your database- that doesnt guarantee top placement.

And then offcourse the last factor- tube traffic is sub par- these guys dont want to buy anything...

So use that thing as a gateway tool to make more.

Your site looks great by the way.

If youd like to jumpstart your traffic a little bit more- check my sig we can help you.

Best of luck- it can only get better.
SeanLEE

05-22-2009, 04:01 PM	#1
gnet Confirmed User Join Date: Jul 2004 Posts: 292	Google Sitemaps question I've been submitting quite a few sitemaps to google's webmaster tools. Each sitemap has a list of 50,000 URLs. It sounds like a lot, but believe it or not, I plan to upload millions of pages to google. Here's how... every search result on my site is an entirely dynamic page, with custom titles, h2 tags, meta tags, clean URLs and content -- even if no results are found. For example: if you search for "Perfect", you get 1800 results, an appropriate title tag, h2, meta, the works. http://www.ovidz.com/Videos/Perfect If you add "Blowjob" to the search, you get 113 results. http://www.ovidz.com/Videos/Perfect-Blowjob You can go a third level deep and add, say, "Asian" to the search and you'll still get results: http://www.ovidz.com/Videos/Perfect-Blowjob-Asian And so on. You can add any combination of keywords to the search and you'll get some kind of result. I have a total of about 10,000 tags in my database. I'm generating these sitemaps by cycling through the `tags` table with random tag combinations. So,... 10000 x 10000 = 99,990,000 URLs (two random tags) 10000 x 10000 x 10000 = 999,700,020,000 URLs (three random tags) So my question is, will any flags be raised at google when they see 100's of thousands of URLs being submitted from one site every day? If so, what will happen? __________________ ICQ: 442-748

05-23-2009, 08:41 AM	#2
Jdoughs Confirmed User Industry Role: Join Date: Mar 2004 Location: Great White North Posts: 5,794	Generating any amount of pages is fine, its the quality of the pages that is the issue. If you fuck up and have 10-15 poor pages its one thing, but if you fuck up and have 10,000 shitty ones, its obviously going to devalue your site. If you can keep them all unique, relevant, and actually seem like that many pages is needed, then you will be ok. They will not punish anyone for being too big or growing to fast, its the other factors that will crush you. Basically I would say having tons of pages as fine, as long as that many pages is needed to show or display your content. But generating pages just to have pages is silly and most of the time will just create disasters out of simple mistakes. __________________ LinkSpun - Premier Adult Link Trading Community - ICQ - 464/\281/\250 Be Seen By New Webmasters/Affiliates * Target out webmasters/affiliates based on niches your sites are for less than $20 a month. AmeriNOC - Proudly hosted @ AmeriNOC!

05-23-2009, 09:10 AM	#3
gnet Confirmed User Join Date: Jul 2004 Posts: 292	Thanks for your comments. I'm not really generating pages for the sake of generating pages. Every page does have some level of relevency. If someone's on Google and searching for "Hot Webcam Asian Strip", I want Google to have that search page indexed (http://www.ovidz.com/Videos/Hot-Webcam-Asian-Strip). I'm not really creating that page, per se. It's the same search results page, but with new keywords injected into the URL. Know what I mean? The saying goes: Google's existence solely relies on the relevency of their search results. I feel I'm contributing to their relevency by submitting links to every possible search query. Even if the results yield less than 5 results. But, we're talking millions and possibly billions of pages. That's the part that has me concerned. __________________ ICQ: 442-748

05-24-2009, 01:22 AM	#4
bmchunu Confirmed User Industry Role: Join Date: May 2005 Posts: 320	I would say you need to change the way you work things. You are looking at a big duplicate content penalty. You will have lots of different page, with the same/similar content. What you need to do is have separate lists of tags. Primary, secondary and then the rest. Hhmmm let me try and explain that again. Seperate lists ... 1st level keywords, 2nd level Keywords, 3rd Level etc. Example 1st Level = Hot, Sexy, Cute, Fat, Thin 2nd Level = Blonde, Asian, Latina, Lesbian 3rd Level = strip, show, tease, play, toy, masturbate, ass, boobs This will reduce the total number of pages you have as you will now have maybe 200 X 200 X 400 or something like that ... but should significantly increase the quality of the pages. __________________ I write original keyword rich content. Hit me up on ICQ. ICQ# : 430 353 679 Free Adult Directory - Submit Your Site NOW!! - Free Porn

05-25-2009, 12:29 PM	#5
gnet Confirmed User Join Date: Jul 2004 Posts: 292	What constitutes a "duplicate content penalty"? All of the URLs will have different results, thus, different content. The world penalty scares me and is exactly what I'm trying to avoid. __________________ ICQ: 442-748

05-25-2009, 06:16 PM	#6
Kelli58 Confirmed User Industry Role: Join Date: Aug 2006 Location: Texas Posts: 2,099	Duplicate content is exactly what the name means ......... two pages with exactly the same content. IT doesn't matter what the URL is, what matters is the content on the pages being delivered. If you say Hello 14 and I say hello 14 and your friend also says hello 14, two uf us will likely suffer the duplicate content penalty. __________________ Kandy AI 🍭🍬 Take a bite out of censorship 🍭🍬 We believe in empowering adults to use AI as they see fit. 👉 Get AI to write your scene descriptions for you 👈

05-26-2009, 12:52 AM	#7
gnet Confirmed User Join Date: Jul 2004 Posts: 292	But that's not the case here. We're not posting links to pages with duped content. Every group of keywords will yield some kind of results. The only time you'll get duplicate content to some degree would be if you searched for a keyword (Example: /Videos/Nurse) and have it yield 10 results, and then add another keyword to the search (Example: /Videos/Nurse-Blonde) which will yield 5 results. Five of those 10 results will be the same, BUT, the pages won't be identical. Even on pages where no results will be found, we'll still have dynamic content on the page (ie: Recently watched videos, popular videos, and so on). No two pages will ever generate the same content. __________________ ICQ: 442-748

05-26-2009, 10:25 AM	#10
joesmack Registered User Join Date: Dec 2006 Posts: 9	There are pros and cons to what you are doing. I am facing the same dillema actually. Having a vast amount of pages allows you to return results for a vast number of google searches. Unfortunately the rank Google gives us for these vast number of pages is not very high. But, as I have noticed through looking at my logs, there are many searches that people are using that dont have 10 results so I get indexed in the top 10. But as those searches become more popular, I am in a position to get bumped out of the top 10 first because of my content dillution. If somebody searched google for asian teen blowjobs google wont give you 3 search results for /Asian-Teen-Blowjobs/ /Blowjobs-Asian-Teen/ /Teen-Asian-Blowjobs/ You will only get 1 search result right? So it would be a good idea to do like bmchunu said and apply all credit to /Asian-Teen-Blowjobs/ __________________ JS Last edited by joesmack; 05-26-2009 at 10:27 AM..

05-26-2009, 12:58 PM	#11
gnet Confirmed User Join Date: Jul 2004 Posts: 292	I hear what you're saying. When we generate these URLs, we'll be generating permutations to avoid identical keywords in the search field. My concern right now has to do with the the dupe content penalty mentioned above. The site doesn't have a single hardcoded page. Every page is dynamicly generated by the search results page. __________________ ICQ: 442-748

05-26-2009, 01:23 PM	#12
SeanLEE Confirmed User Join Date: Feb 2006 Location: Miami, FL Posts: 1,556	A good benchmark to know if your plan is working is when Google gives your search result sitelinks Your site looks brandspanking new you've got some work to do. A bunch of pages with no traffic are useless. And then once you get the sitelinks- the next step is Page Rank. Also your domain name is a factor- I launched OnlinePornTube.com yesterday as a test, and because of the top level keywords it's allready getting a few hundred uniques a day. All this to say -just because you have a million vids in your database- that doesnt guarantee top placement. And then offcourse the last factor- tube traffic is sub par- these guys dont want to buy anything... So use that thing as a gateway tool to make more. Your site looks great by the way. If youd like to jumpstart your traffic a little bit more- check my sig we can help you. Best of luck- it can only get better. SeanLEE __________________ I spammed in threads! Last edited by SeanLEE; 05-26-2009 at 01:26 PM..

05-26-2009, 03:49 PM	#13
gnet Confirmed User Join Date: Jul 2004 Posts: 292	I understand google doesn't care about the size of my database. I was hoping to leverage the variety of search terms in my favor by submitting individual URLs to google. Of course everyone's goal is to have top billing on google's search results, but right now, I simply want these pages indexed. I'm just wondering if google will slap me in the face for dumping millions of URLs on them. And yes, my site is brand spanking new. It's still in beta as we're working out the kinks. We're doing things a little different (some can say we're doing it all wrong). But, we're first focusing on functionality, usability, and content. We're hoping this will help spread the site through word of mouth. We have been noticing an increase in direct traffic, but we'll see if that continues. Once traffic comes in, we'll then analyze the traffic patterns. And then, find a way to monetize the traffic. Until that day, we don't plan to inject any ads into the site until we determine the best route. As far as the domain goes, we were looking for something brandable, easy to remember. It might turn around and bite us in the ass, but that's why we chose that domain and not one consisting of top level keywords. Again, that's for your reply. I'm learning quite a bit. __________________ ICQ: 442-748

05-27-2009, 12:44 PM	#18
bmchunu Confirmed User Industry Role: Join Date: May 2005 Posts: 320	/Amateur-Blonde-Dildo --> /Amateur-Brunette-Dildo The above example you made is the right way to go. Just avoid going /Amateur-Brunette-Dildo /Amateur-Dildo-Brunette /Dildo-Amateur-Brunette and you should be fine. As said earlier ... Start small and see how it goes first, because any mistake you make will be amplified. Seo is a game of patience. If you need any further advice hit me up on ICQ. __________________ I write original keyword rich content. Hit me up on ICQ. ICQ# : 430 353 679 Free Adult Directory - Submit Your Site NOW!! - Free Porn