Re: robots erro msg -- WEB400

Subject: Re: robots erro msg
From: Bryan Dietz <bdietz400@xxxxxxxxx>
Date: Sun, 04 Nov 2007 11:02:29 -0500
List-archive: <http://archive.midrange.com/web400>
List-help: <mailto:web400-request@midrange.com?subject=help>
List-id: Web Enabling the AS400 / iSeries <web400.midrange.com>
List-post: <mailto:web400@midrange.com>
List-subscribe: <http://lists.midrange.com/mailman/listinfo/web400>, <mailto:web400-request@midrange.com?subject=subscribe>
List-unsubscribe: <http://lists.midrange.com/mailman/listinfo/web400>, <mailto:web400-request@midrange.com?subject=unsubscribe>

I think a quick google search would give many opinions:

http://www.google.com/search?q=use+robots.txt&sourceid=navclient-ff&ie=UTF-8&rlz=1B2GGGL_enUS208US208

Bryan

Jim Franz said the following on 11/4/2007 9:47 AM:

[error] File /xxx/robots.txt does not exist [error] URI in request GET /robots.txt HTTP/1.0 is not valid
Looking for a good doc on how to populate a robots.txt file - customer
wants to make sure this is not interfering with search engine placement. As usual, same cust does not want to spend$$ for this to be done by
professional search engine co.
jim

As an Amazon Associate we earn from qualifying purchases.

Follow-Ups:

Re: robots erro msg , Jim Franz

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.