Search Engines Looking to Clean up the Web

While often regarded as rivals, Google, Yahoo! and Microsoft announced a collaboration to clean up the web.  The three search engines will clean up the web by setting web standards for web publishers. This will eliminate the problem of having duplicate pages on the web.

The cleaning of duplicate pages will be of great benefit for users and publishers alike. Without all of the clutter, search engines can and will be able to index pages at a faster rate.  Additionally, the web clean up will mean a sweep of spam pages.  Google engineers are looking at all kinds of problems that would need solving in the web clean up. For instance,  many websites have several URLs within websites that all point to the same page. Google’s solution is an indicator of the principal URL and the duplicate—which would enable search engines to determine which URL is indexed.
Moreover, all three major search engines will ensure that they follow the same forms of web standards.