how did google get this

how did google get this

Posted by: WayneD
Posted on: 2008-10-15 16:07:00

I renamed a directory 'gps_save' and somehow google indexed it. It has search info for:

www.cmcboulder.org/gps_save/winterschedule2008.doc

But the directory was renamed, so has no links to it, and the doc doesnt either. The root directory has a index.html file, so no directory listing is there.... But there must be someway to do a listing even though there is a index.html file there? anyone know how?

Re: how did google get this

Posted by: jidanni
Posted on: 2008-10-15 18:55:00

Did you mention it to your friends via GMail, or let some other Google desktop application get a whiff of it?

Re: how did google get this

Posted by: jidanni
Posted on: 2008-10-15 18:57:00

Without a robots.txt entry, everything's fair game to them.

Edited by jidanni on 10/15/08 06:58 PM (server time).

Re: how did google get this

Posted by: WayneD
Posted on: 2008-10-15 19:54:00

no, it was a save directory where i put some backup data, while I worked on the real one - so no need for any access. I usually stash stuff outside of the web area, but that was just a temporary place to backup some files while I worked on new versions on the live area.

yes, I know how to traverse a web site with robots - I've written some, but still don't know how it can list a directory that has a index.html file.....and without listing it, it can't find the names of random named directories within that first directory...

Re: how did google get this

Posted by: CajuCLC
Posted on: 2008-10-16 00:10:00

I created account on google.com/webmasters to control them.
I use Joomla and JoomlaWatch to see bots, etc...
Google was making my website so slow with more than 1000 requests! So I blocked some folders.


Re: how did google get this

Posted by: lrosenstein
Posted on: 2008-10-16 18:24:00

I did a Google search and it returned a sitemap file that lists a bunch of directories. Perhaps this is including directories that you did not intend.



Larry

Re: how did google get this

Posted by: WayneD
Posted on: 2008-10-16 19:00:00

duh, that's it. Thanks!!

The auto sitemap software reveals all.....and I didn't put that in place and forgot it was there.

Thanks again!

Tags: root directorygoogledirectory listing