|
|
|
| |
Welcome
Time Now:
Sat Jul 31, 2010 1:01 am
All times are GMT
|
|
|
|
|
|
|
|
|
|
| |
SEO 1 Forums
>
Webmastering >
Am I using comment correctly in this robots.txt?
ohcnetwork
Senior Member
Joined: 31 Mar 2005
Good Posts: 1486
|
| Am I using comment correctly in this robots.txt? |
 |
|
I have the following robots.txt, and I want anything written after "#" to be ignored, meaning that I want anything written after "#" to be interpreted as comment. Am I using comment correctly in this robots.txt?
code:
User-agent: *
# Don't disallow indexing pages for now.
# Disallow: /post-*.html$
Disallow: /updates-topic.html*$
Disallow: /stop-updates-topic.html*$
Disallow: /ptopic*.html$
Disallow: /ntopic*.html$
User-agent: linksmanager
Disallow: /
User-agent: LinksManager.com
Disallow: /
User-agent: Teoma
Crawl-delay: 3
Degree : Health Chat
Finance : Film |
Sat Apr 02, 2005 12:09 pm |
|
|
Andrew
Senior Member
Joined: 21 Feb 2005
Good Posts: 997
Location: apache/domlogs
|
Perfectly fine. |
|
Sat Apr 02, 2005 3:58 pm |
|
|
|
|
|
|
|
|
|
