Picture of a target

Website-Owners Club.Com  

Working together on Target ... helping each other


Home Page     Membership     About Us     Contact Us     Site Map

Marketing Tips
 

Username

Password


Coming Soon


Join our Membership




 

Submitting Sitemaps using robots.txt





You can tell Google and other search engines about your Sitemap (WHAT IS THE NAME OF THE SITEMAP FILE AND WHERE IT CAN BE FOUND) by adding the following line INSIDE your robots.txt file (SHOWING THE NAME OF YOUR SITEMAP AND the complete path to your Sitemap).

You need to place the file robots.txt in the root directory of your server and your robots.txt file might read as follows

User-Agent: *
Disallow: /terms*
Disallow: /priv*
Disallow: /*.php
Allow: /
Sitemap: http://domain.com/Sitemap.xml (because file in the root directory)


YOUR Sitemap.xml FILE WILL THEN BE LOCATED IN YOUR ROOT DIRECTORY
AND YOUR SITEMAP.XML FILE NAME MUST COMMENCE WITH A CAPITAL S
(TO EDIT YOUR XML FILE - YOU CAN RENAME THE FILE TO A .TXT FILE
EDIT AS REQUIRED - THEN RENAME TO Sitemap.xml AND SAVE AS A UTF-8 FILE FORMAT).

THE GOOGLE SEARCH BOTS ARE EXTREMELY ACTIVE AND LOOK AT THOUSANDS OF SITES DAILY
SO IT WOULD SAVE THE BOT TIME BY EDITING THE .XML FILE SO THAT FILES THAT DO NOT
CHANGE REGULARLY SUCH AS TERMS OF USE, POLICY STATEMENT, ABOUT US ETC SHOW A
CHANGE FREQUENCY OF YEARLY WHEREAS YOUR HOME PAGE MIGHT SHOW A FREQUENCY OF MONTHLY.

SHOULD YOUR SITE BE SO LARGE (MORE THAN 50,000 URL'S) THEN USE SEVERAL SITEMAPS
AND NAME THEM SitemapsA.xml SitemapsB.xml SitemapsC.xml in which event - to ensure
all your 3 files are read - your line in the robots.txt file should read

User-Agent: *
Disallow: /terms*
Disallow: /priv*
Disallow: /*.php
Allow: /
Sitemap: http://domain.com/SitemapA.xml
Sitemap: http://domain.com/SitemapB.xml
Sitemap: http://domain.com/SitemapC.xml


We still recommend that you submit your sitemap through your Webmaster Tools account so you can make sure that the Sitemap was processed without any issues and to get additional statistics about your site.



 
Welcome       Sign-Out
  .



 


Go to Top


Home Page     Membership     About Us     Contact Us     Site Map

Marketing Tips


Disclaimer: Subject to change - Government changes, market fluctuations, corporate decisions and other factors.
If you are experiencing any technical difficulties you can contact the webmaster (use @ symbol) website-ownersclub.com
The use of this site is subject to our Terms of Use and Privacy Policy. This page last updated:
Use of this web site constitutes acceptance of our Terms of Use and Privacy Policy.
We are authorized to use certain Copyright and Trademark material from various Advertising Suppliers.

Copyright © 2009 website-ownersclub.com  All Rights Reserved