1 Dec 2005 05:25
Re: Bot update
Yes very much like WAIS and with each gopher server, for this particular project (searching Johns database), maintaing a part of the larger data set. The idea being that your searching a static database and each link points to the cached database and therefore faster than WAIS as it was used and could still be used. I feel there is a distinction between WAIS and using WAIS software to work on one static database, even if done similarly because with WAIS there was alot of lag and latency which we could trim by selecting servers and groups of servers dedicated for the project. And maybe we should have some people running WAIS anyhow. John had some ideas for pygopherd to be more easily traversed through directories by google spidering... what of a way to have the full text be googled and derived from pygopherds html-ized pages, in this way one would run a pygopherd server with the 28G data on it and let google spider it and then make a gopher gateway to google http://gophersite:80/bigdataset. That way google does the work of the search and its brought back "down" into gopherland. Just more thoughts.. Chris On Wed, 30 Nov 2005 12:06:58 +0300 "R.A.Pavlov" <webmaster@...> wrote: > On Tue, Nov 29, 2005 at 09:03:35PM -0600, Chris wrote: > > Some other possibilities came to mind, things such as breaking it up into datasets and having various boxen here as well as at other gophers each maintain a dataset or sets. > > And this is close to the idea of WAIS searches where each server indexes > its own content and other servers maintain lists of links to these WAIS > servers. If you mean that each gopher server maintains a database > of its own content. > > By the way I have some progress with WAIS and will show some results to > the public very soon. >(Continue reading)
> When the paper works gets all done (*glares at John if he hasn't already done what I asked him to do*)
> I'll be handing out (to those who come by enough) fancy gopherproject cloaks.
>
> The logs for the channel are avaliable at gopher://igneous-rock.homeunix.net/1/irclogs/
RSS Feed