OT: Google link?
The point of the thread is you should choose one or the other for Google to
index... having mirror pages like a MM dynamic page and the identical MO
static page apparently removes BOTH pages from the index according to the
original posts. MO pages are MUCH faster than MM pages, so I have everyone
seeing the MO pages instead. With this latest theory, it's better to be
safe then sorry... so I added the disallow in my robots.txt.
If you want Google to spider the MM pages only:
User-agent: *
Disallow: /catalog/ (or whatever you have MO using for a directory)
If you want Google to spider the MO pages only:
User-agent: *
Disallow: /Merchant2/ (or whatever your host uses for a MM directory)
Marc
At 09:07 AM 5/17/2005, you wrote:
>Okay, I would use the robot.txt IF I wanted Google to spider the MO and
>not spider the dynamic stuff? Is it better to have Google spidering MO?
>
>Leslie
>
>
> If using Merchant Optimizer (calling it MO now because it's shorter)...
> > add
> > a line in your robots.txt file:
> >
> > User-agent: *
> > Disallow: /Merchant2/
> >
> > I have a few others in my robots.txt, but that's because the bottom two
> > are
> > nasty... with the last one sucking up resources every time it visits.
> >
> > Then... in your .htaccess file I have it pointing so that the MO
> > directory. In my case www.sausagesource.com/catalog/index.html is the
> > default index instead of the normal
> > www.sausagesource.com/Merchant2/merchant.mvc which is commonplace. In my
> > .htaccess it starts off with this:
> >
> > Options -Indexes
> > DirectoryIndex /catalog/index.html
> >
> > Marc
> >
> >
> >
> > At 07:35 AM 5/17/2005, you wrote:
> >>So this renders Merchant Optimizer worthless???? And dump static
> >> "doorway"
> >>pages? Use just what Miva Merchant generates? Only have static
> >>informational pages? What a week to head to NYC - guess I should be a the
> >>conference that is going on next to the Streaming Media - Google is one
> >> of
> >>teh sponsors there....didn't see FindWhat listed though.
> >>
> >>Leslie <-- is ready to freakin scream.
> >
The point of the thread is you should choose one or the other for Google to
index... having mirror pages like a MM dynamic page and the identical MO
static page apparently removes BOTH pages from the index according to the
original posts. MO pages are MUCH faster than MM pages, so I have everyone
seeing the MO pages instead. With this latest theory, it's better to be
safe then sorry... so I added the disallow in my robots.txt.
If you want Google to spider the MM pages only:
User-agent: *
Disallow: /catalog/ (or whatever you have MO using for a directory)
If you want Google to spider the MO pages only:
User-agent: *
Disallow: /Merchant2/ (or whatever your host uses for a MM directory)
Marc
At 09:07 AM 5/17/2005, you wrote:
>Okay, I would use the robot.txt IF I wanted Google to spider the MO and
>not spider the dynamic stuff? Is it better to have Google spidering MO?
>
>Leslie
>
>
> If using Merchant Optimizer (calling it MO now because it's shorter)...
> > add
> > a line in your robots.txt file:
> >
> > User-agent: *
> > Disallow: /Merchant2/
> >
> > I have a few others in my robots.txt, but that's because the bottom two
> > are
> > nasty... with the last one sucking up resources every time it visits.
> >
> > Then... in your .htaccess file I have it pointing so that the MO
> > directory. In my case www.sausagesource.com/catalog/index.html is the
> > default index instead of the normal
> > www.sausagesource.com/Merchant2/merchant.mvc which is commonplace. In my
> > .htaccess it starts off with this:
> >
> > Options -Indexes
> > DirectoryIndex /catalog/index.html
> >
> > Marc
> >
> >
> >
> > At 07:35 AM 5/17/2005, you wrote:
> >>So this renders Merchant Optimizer worthless???? And dump static
> >> "doorway"
> >>pages? Use just what Miva Merchant generates? Only have static
> >>informational pages? What a week to head to NYC - guess I should be a the
> >>conference that is going on next to the Streaming Media - Google is one
> >> of
> >>teh sponsors there....didn't see FindWhat listed though.
> >>
> >>Leslie <-- is ready to freakin scream.
> >
Comment