Google Now Using RSS feeds to discover new URLs
In: web 2.0
30 Oct 2009Google has recently announced that it is now using RSS/Atom feeds to discover new webpages.
RSS/Atom feeds have been very popular in recent years as a mechanism for content publication. They allow readers to check for new content from publishers. Using feeds for discovery allows us to get these new pages into our index more quickly than traditional crawling methods. We may use many potential sources to access updates from feeds including Reader, notification services, or direct crawls of feeds.
In order for us to use your RSS/Atom feeds for discovery, it’s important that crawling these files is not disallowed by your robots.txt. To find out if Googlebot can crawl your feeds and find your pages as fast as possible, test your feed URLs with the robots.txt tester in Google Webmaster Tools.
Source: Official Google Webmaster Central blog
Comment Form
About this blog
Hello, Welcome to Tech Inspiration. Here, we try to keep you up-to-date with Technology updates, Web 2.0, Software reviews, gadgets and more!; We hope you will love it and visit us more often. You can follow our feed here. If you have any questions, feel free to contact us. Hope you enjoy Tech Inspiration and take it easy.
Categories
- apple (15)
- Cameras (4)
- iPhone Tips (42)
- linux (11)
- Lists (162)
- Mobile Phones (40)
- Mp3 Players (1)
- news (8)
- Notebooks (32)
- Other (43)
- shareables (11)
- Tech Tips (110)
- Tips (142)
- Utilities (155)
- web 2.0 (96)
- Browsers (18)
- windows (31)
- Julien: Nowadays it is important to test website on mobile devices (smartphones and tablets) too. Browshot ( [...]
- panos: in safari I just uninstalled Genieo and everything is back to normal again [...]
- dylan: this is ridiculous none of the things i have tried have worked im so pissed off and clearly all the [...]
- Vikash: Hey where is 56kbps Modem/Fax Data Card on ASUS 1000H Eee-PC? [...]
- Nick: eSnips is really annoying me. I've tried numerous things, from uninstall programs to going to about: [...]
- How to extend battery life on android phones using JuiceDefender Battery Saver
- PCAnywhere Alternatives
- How to download Norton Internet Security 2012 for cheap
- How to take Screenshot of Samsung Galaxy S2 Screen
- Tip to extend battery life on Samsung Galaxy S2
- How to fix xampp apache error – side-by-side configuration is incorrect
- How to improve website performance & search engine rankings easily
- How to ping old blog posts in wordpress
- How to Test website in multiple browsers
- How to check DNS propagation status or website availability