Business So simple but worls like a charm. - GoFuckYourself.com

suesheboy · 07-16-2014, 06:44 AM

Simply putting a URL in a search engine to look for it triggers the Search Engine to go back and index it.

Forget submitting pages and all the other bullshit.

...of course sitemaps in HTML and XML are a good thing too.

(worKs like a charm too)

Klen · 07-16-2014, 06:46 AM

So basically all you have to do is to type "domain.com" in search and that's it ?How long to re-index it ?

suesheboy · 07-16-2014, 07:43 AM

Yep. I see sometimes a visit within the hour.

suesheboy · 07-16-2014, 07:44 AM

Make that domain.com/newpage.html

AaronM · 07-16-2014, 07:56 AM

I create unique content for every page I put out there. This takes me a lot of time and involves many steps.

Setting up a proper robots.txt and sitemap then linking them to webmaster tools is a one time thing that will eliminate the need for me to take the additional step of searching for the page to kick start the spiders.

nm_ · 07-16-2014, 09:18 AM

nice, didnt know this had an effect ;]

submitting new pages to index in "Fetch as Google" under GWT works well. Also noticed that posting links to the new page on active twitter accounts usually gets things indexed faster too

freecartoonporn · 07-16-2014, 09:50 AM

thanks for the tip,

suesheboy · 07-16-2014, 10:35 AM

..Aaron it works for bing/yahoo too. Not as much traffic but it helps.

I also can prove without a doubt that yahoo/msn indexes links from Adword ads

AaronM · 07-16-2014, 02:42 PM

Quote:

Originally Posted by suesheboy

..Aaron it works for bing/yahoo too.

Both of which also have webmaster tools that are pinged with every update I do. ;)

Not saying your info is useless, just not necessary if you set things up right the first time.

armysmoke · 07-16-2014, 02:45 PM

Quote:

Originally Posted by suesheboy

Simply putting a URL in a search engine to look for it triggers the Search Engine to go back and index it.

Forget submitting pages and all the other bullshit.

...of course sitemaps in HTML and XML are a good thing too.

(worKs like a charm too)

Thanks for the tip

420 · 07-16-2014, 03:48 PM

Nice pro tip AM <3

Seth Manson · 07-16-2014, 03:51 PM

I create thousands of links everyday for the spiders to follow to my sites. Works like a charm.

WDF · 07-16-2014, 03:59 PM

Have you ever Skyped a URL or IP to someone and watched unmarked spiders crawl it?

anexsia · 07-16-2014, 04:43 PM

Quote:

Originally Posted by AaronM

I create unique content for every page I put out there. This takes me a lot of time and involves many steps.

Setting up a proper robots.txt and sitemap then linking them to webmaster tools is a one time thing that will eliminate the need for me to take the additional step of searching for the page to kick start the spiders.

Yup, I set up all my new websites in their corresponding webmaster tools at Google, Bing, Yandex, etc - works great.

AaronM · 07-16-2014, 04:59 PM

Quote:

Originally Posted by WDF

Have you ever Skyped a URL or IP to someone and watched unmarked spiders crawl it?

I haven't noticed this with Skype but I see it every time I post or IM a link on FB.

facebookexternalhit
07-16-2014 06:47 am PDT
173.252.74.118
United States Kirksville, MO

AaronM · 07-16-2014, 05:20 PM

Sent a link on Skype 11 minutes ago....No spiders yet.

The Porn Nerd · 07-16-2014, 06:22 PM

With the http or just the www?

I did this with Google earlier today for one of my brand-new sites I have not yet submitted to Google via Webmaster Tools.

So far: nada.

Maybe takes awhile?

dichotomy · 07-16-2014, 07:17 PM

hmm, my bot just posted new scraped YT content on almost forgotten sites that I built 6 months ago (testing new scraping/custom spun curation on autopilot...). post looks good, ofc - went and looked it up in Giggle... no joy yet, but it's been minutes.. usually about 3-5 days if you don't touch it with social signals...

And I have actually just been thinking about the same thing - what if you search it and make bots crawl...faster... might make a sense in a weird perverted way :-)

mchol · 07-16-2014, 10:20 PM

I never tried this before.

07-16-2014, 06:44 AM	#1
suesheboy Confirmed User Industry Role: Join Date: Nov 2002 Location: FL - TN/NC Posts: 5,211	So simple but worls like a charm. Simply putting a URL in a search engine to look for it triggers the Search Engine to go back and index it. Forget submitting pages and all the other bullshit. ...of course sitemaps in HTML and XML are a good thing too. (worKs like a charm too) __________________ Adult Web Site Domain Names For Sale Adult Sex Toy Domain Names For Sale Tantric Delights, Sex Toys Blog, Tantric Sex Toys Last edited by suesheboy; 07-16-2014 at 06:46 AM..

07-16-2014, 07:43 AM	#3
suesheboy Confirmed User Industry Role: Join Date: Nov 2002 Location: FL - TN/NC Posts: 5,211	Yep. I see sometimes a visit within the hour. __________________ Adult Web Site Domain Names For Sale Adult Sex Toy Domain Names For Sale Tantric Delights, Sex Toys Blog, Tantric Sex Toys

07-16-2014, 07:44 AM	#4
suesheboy Confirmed User Industry Role: Join Date: Nov 2002 Location: FL - TN/NC Posts: 5,211	Make that domain.com/newpage.html __________________ Adult Web Site Domain Names For Sale Adult Sex Toy Domain Names For Sale Tantric Delights, Sex Toys Blog, Tantric Sex Toys

07-16-2014, 09:50 AM	#7
freecartoonporn Confirmed User Industry Role: Join Date: Jan 2012 Location: NC Posts: 7,683	thanks for the tip, __________________ SSD Cloud Server, VPS Server, Simple Cloud Hosting \| DigitalOcean

07-16-2014, 10:35 AM	#8
suesheboy Confirmed User Industry Role: Join Date: Nov 2002 Location: FL - TN/NC Posts: 5,211	..Aaron it works for bing/yahoo too. Not as much traffic but it helps. I also can prove without a doubt that yahoo/msn indexes links from Adword ads __________________ Adult Web Site Domain Names For Sale Adult Sex Toy Domain Names For Sale Tantric Delights, Sex Toys Blog, Tantric Sex Toys

07-16-2014, 06:46 AM	#2
Klen Industry Role: Join Date: Aug 2006 Location: Little Vienna Posts: 32,235	So basically all you have to do is to type "domain.com" in search and that's it ?How long to re-index it ?

07-16-2014, 07:56 AM	#5
AaronM Too lazy to set a custom title Industry Role: Join Date: Oct 2001 Location: ┌∩┐ ◣_◢ ┌∩┐ Posts: 46,909	I create unique content for every page I put out there. This takes me a lot of time and involves many steps. Setting up a proper robots.txt and sitemap then linking them to webmaster tools is a one time thing that will eliminate the need for me to take the additional step of searching for the page to kick start the spiders.

07-16-2014, 09:18 AM	#6
nm_ Confirmed User Industry Role: Join Date: May 2011 Location: San Diego Posts: 328	nice, didnt know this had an effect ;] submitting new pages to index in "Fetch as Google" under GWT works well. Also noticed that posting links to the new page on active twitter accounts usually gets things indexed faster too

07-16-2014, 03:48 PM	#11
420 cuck Industry Role: Join Date: Mar 2003 Posts: 11,571	Nice pro tip AM <3

07-16-2014, 03:51 PM	#12
Seth Manson Please dont fuck animals Industry Role: Join Date: Jul 2010 Location: Henderson, NV Posts: 3,988	I create thousands of links everyday for the spiders to follow to my sites. Works like a charm.

07-16-2014, 03:59 PM	#13
WDF Confirmed User Industry Role: Join Date: Jan 2013 Location: Nashville,TN. Music City U.S.A. Posts: 2,248	Have you ever Skyped a URL or IP to someone and watched unmarked spiders crawl it? __________________ Please HELP

07-16-2014, 05:20 PM	#16
AaronM Too lazy to set a custom title Industry Role: Join Date: Oct 2001 Location: ┌∩┐ ◣_◢ ┌∩┐ Posts: 46,909	Sent a link on Skype 11 minutes ago....No spiders yet.

07-16-2014, 06:22 PM	#17
The Porn Nerd Living The Dream Industry Role: Join Date: Jun 2009 Location: Inside a Monitor Posts: 19,609	With the http or just the www? I did this with Google earlier today for one of my brand-new sites I have not yet submitted to Google via Webmaster Tools. So far: nada. Maybe takes awhile? __________________ My Affiliate Programs: Porn Nerd Cash \| Porn Showcase \| Aggressive Gold Over 90 paysites to promote! Now on Teams: peabodymedia

07-16-2014, 07:17 PM	#18
dichotomy Confirmed User Industry Role: Join Date: Jun 2003 Location: Near Tunguska Posts: 135	hmm, my bot just posted new scraped YT content on almost forgotten sites that I built 6 months ago (testing new scraping/custom spun curation on autopilot...). post looks good, ofc - went and looked it up in Giggle... no joy yet, but it's been minutes.. usually about 3-5 days if you don't touch it with social signals... And I have actually just been thinking about the same thing - what if you search it and make bots crawl...faster... might make a sense in a weird perverted way :-) __________________ #_ https://se.marketing/

07-16-2014, 10:20 PM	#19
mchol Confirmed User Industry Role: Join Date: May 2014 Posts: 156	I never tried this before.