Re: [xml-dev] Can Searchbots Find Web Pages That Aren't Linked To?

["Pete Cordell" <petexmldev@codalogic.com>]

Hi Roger,

I think your conclusion is correct.  However, I don't think you've given the 
search engines long enough to find your pages if they could find you.  For 
example, Google works on something like a 4 week cycle of scanning the web 
and then updating it's database.  In my experience, even if it found the 
pages, there's no guarantee it would put them in the index.

What you need is to create a control page that is created at the same time, 
but _is_ linked into some page.

But as I said, I think your conclusion is correct.

HTH,

Pete Cordell
Codalogic
For XML C++ data binding visit http://www.codalogic.com/lmx/
----- Original Message ----- 
From: "Costello, Roger L." <costello@mitre.org>
To: <xml-dev@lists.xml.org>
Sent: Sunday, March 09, 2008 11:45 AM
Subject: [xml-dev] Can Searchbots Find Web Pages That Aren't Linked To?


Hi Folks,

I was interested in knowing if searchbots can find web pages that
aren't link to.

So, I conducted a simple experiment:

http://www.xfront.com/can-searchbots-find-unlinked-web-pages/index.html

/Roger

_______________________________________________________________________

XML-DEV is a publicly archived, unmoderated list hosted by OASIS
to support XML implementation and development. To minimize
spam in the archives, you must subscribe before posting.

[Un]Subscribe/change address: http://www.oasis-open.org/mlmanage/
Or unsubscribe: xml-dev-unsubscribe@lists.xml.org
subscribe: xml-dev-subscribe@lists.xml.org
List archive: http://lists.xml.org/archives/xml-dev/
List Guidelines: http://www.oasis-open.org/maillists/guidelines.php