So simple but worls like a charm.
 

Simply putting a URL in a search engine to look for it triggers the Search Engine to go back and index it.

Forget submitting pages and all the other bullshit.:thumbsup

...of course sitemaps in HTML and XML are a good thing too.


(worKs like a charm too)

So basically all you have to do is to type "domain.com" in search and that's it ?How long to re-index it ?

Yep. I see sometimes a visit within the hour.

Make that domain.com/newpage.html

I create unique content for every page I put out there. This takes me a lot of time and involves many steps.

Setting up a proper robots.txt and sitemap then linking them to webmaster tools is a one time thing that will eliminate the need for me to take the additional step of searching for the page to kick start the spiders. :2 cents:

nice, didnt know this had an effect ;]

submitting new pages to index in "Fetch as Google" under GWT works well. Also noticed that posting links to the new page on active twitter accounts usually gets things indexed faster too

thanks for the tip,

..Aaron it works for bing/yahoo too. Not as much traffic but it helps.

I also can prove without a doubt that yahoo/msn indexes links from Adword ads

Both of which also have webmaster tools that are pinged with every update I do. ;)

Not saying your info is useless, just not necessary if you set things up right the first time. :2 cents:

Thanks for the tip :thumbsup

Nice pro tip AM <3

I create thousands of links everyday for the spiders to follow to my sites. Works like a charm.

Have you ever Skyped a URL or IP to someone and watched unmarked spiders crawl it?

Yup, I set up all my new websites in their corresponding webmaster tools at Google, Bing, Yandex, etc - works great.

I haven't noticed this with Skype but I see it every time I post or IM a link on FB.


facebookexternalhit
07-16-2014 06:47 am PDT
173.252.74.118
United States Kirksville, MO

Sent a link on Skype 11 minutes ago....No spiders yet.

With the http or just the www?

I did this with Google earlier today for one of my brand-new sites I have not yet submitted to Google via Webmaster Tools.

So far: nada.

Maybe takes awhile?

hmm, my bot just posted new scraped YT content on almost forgotten sites that I built 6 months ago (testing new scraping/custom spun curation on autopilot...). post looks good, ofc - went and looked it up in Giggle... no joy yet, but it's been minutes.. usually about 3-5 days if you don't touch it with social signals...

And I have actually just been thinking about the same thing - what if you search it and make bots crawl...faster... might make a sense in a weird perverted way :-)

I never tried this before.