Re: robots erro msg

["Jim Franz" <franz400@xxxxxxxxxxxx>]

> I think a quick google search would give many opinions:

yes - over 2 million opinions.
most are products that generate the file.
between google & david's link I should be able to figure this out.
jim

----- Original Message ----- 
From: "Bryan Dietz" <bdietz400@xxxxxxxxx>
To: "Web Enabling the AS400 / iSeries" <web400@xxxxxxxxxxxx>
Sent: Sunday, November 04, 2007 11:02 AM
Subject: Re: [WEB400] robots erro msg


> I think a quick google search would give many opinions:
>
> http://www.google.com/search?q=use+robots.txt&sourceid=navclient-ff&ie=UTF-8&rlz=1B2GGGL_enUS208US208
>
>
> Bryan
>
> Jim Franz said the following on 11/4/2007 9:47 AM:
> > [error]             File /xxx/robots.txt does not exist
> > [error]             URI in request GET /robots.txt HTTP/1.0 is not valid
> >
> > Looking for a good doc on how to populate a robots.txt file - customer
> > wants to make sure this is not interfering with search engine placement.
> > As usual, same cust does not want to spend$$ for this to be done by
> > professional search engine co.
> > jim
> --
> This is the Web Enabling the AS400 / iSeries (WEB400) mailing list
> To post a message email: WEB400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/web400
> or email: WEB400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/web400.