
From golda Tue May  7 17:05:57 2002
Subject: Re: Glimpse Question on stop list control
To: SteveDickerson@pricechopper.com
Date: Tue, 7 May 2002 17:05:57 -0500 (CDT)
From: "Golda Velez" <golda@iwhome.com>
In-Reply-To: <ONEIKNCPJJGNJIALOGPOKENBDAAA.steved@mail.golub.com> from "Steve Dickerson" at May 07, 2002 03:16:35 PM
X-Mailer: ELM [version 2.5 PL3]
Content-Length: 2517      

Hi Steve

Hm - looks like there are several variables you could try tweaking, I haven't ac
tually experimented with these myself, but it sounds like increaseing all of

MAX_DISPARITY
MIN_OCCURRENCES
MAX_UNION
MAX_ABSOLUTE

significantly would be a good thing to start with.  Particularly MAX_ABSOLUTE, since for an index of the size you mention it sounds like a word could easily occur more than 16K times.  I would try multiplying each value by 2, 4, and 8 and see if that helps.  Since you don't have to reindex, it should be quick to test each change.

Note, those settings only affect a byte-level index (using -b flag on glimpseindex), is that what you are using?

--Golda
> 
> 
> This is a multi-part message in MIME format.
> 
> --------------InterScan_NT_MIME_Boundary
> Content-Type: text/plain;
> 	charset="us-ascii"
> Content-Transfer-Encoding: 7bit
> 
> Hi Golda.  This is Steve Dickerson from Price Chopper.  I believe we are
> running 4.12.6 currently and about a year ago did one of the commercial
> purchases.
> 
> I am looking at defs.h and the MAX values for control over stop lists and
> wonder if you could suggest a setting to effectively reduce or eliminate the
> agrep aspect of the engine.  Often times our searches will drop into the
> "Must SEARCH files" which causes very slow searching.
> 
> My current partition sizes range in the 1/2 gig size with index components
> ranging in the 20-100 meg range.  I use multiple concatenated glimpse db
> components and the entire current textual data would run in the 50 gig range
> if put into 1 piece uncompressed.
> 
> I also use the gzip/gunzip filter during search and indexing.
> 
> Thank you for any advice you can give me on this.
> 
> Steve Dickerson
> 
> 
> --------------InterScan_NT_MIME_Boundary
> Content-Type: text/plain;
> 	name="InterScan_Disclaimer.txt"
> Content-Transfer-Encoding: 7bit
> Content-Disposition: attachment;
> 	filename="InterScan_Disclaimer.txt"
> 
> ----------------------------------------------------------------------------------------------------------
> Price Chopper Supermarkets, Inc.
> A Golub Corporation Company.
> 
> http://www.pricechopper.com
> 
> This communication is for informational purposes only.
> Any comments, opinions, or statements made herein do not
> necessarily reflect those of Golub Corp., its subsidiaries and affiliates.
> -----------------------------------------------------------------------------------------------------------
> 
> --------------InterScan_NT_MIME_Boundary--
> 



From golda Tue May  7 17:10:29 2002
Subject: Re: Problems (again) uploading bird list
To: parker@wingsbirds.com (parker)
Date: Tue, 7 May 2002 17:10:29 -0500 (CDT)
From: "Golda Velez" <golda@iwhome.com>
In-Reply-To: <3CD85983.264BB027@wingsbirds.com> from "parker" at May 07, 2002 03:47:31 PM
X-Mailer: ELM [version 2.5 PL3]
Content-Length: 2315      

Argh!  Permissions again...maybe I need to run a nightly script just setting the birdlist permissions explicitly every day so they stop getting screwed up.  I'm not even sure why they are not what they should be in this case, the file was just not group-writable so the web interface failed to change it.

Anyhow, the correct bird list is up now and I removed all the extra links on the listindex page...

--G
> 
> 
> --------------29BA0AC5BE63E393B48D924B
> Content-Type: text/plain; charset=us-ascii
> Content-Transfer-Encoding: 7bit
> 
> Hi Golda.
> 
> re: egypt.html
> 
> For some reason, when I type in the CORRECT code for uploading the March
> 2002 bird list (egypmar02.txt) the March 2001 bird list loads onto the
> website under the March 2002 link.  Any obvious explanations?
> 
> The March 2002 bird list differs from previous bird lists in that it
> contains more columns but I've tested the different format out before
> and didn't find a problem.
> 
> Thanks.
> 
> Parker
> 
> --
> 
> Please note that while wings@wingsbirds.com remains our
> standard e-mail address to which all general messages
> should be sent, you can now also reach us individually at:
> 
> greer@wingsbirds.com
> parker@wingsbirds.com
> shawneen@wingsbirds.com
> will@wingsbirds.com
> 
> 
> --------------29BA0AC5BE63E393B48D924B
> Content-Type: text/html; charset=us-ascii
> Content-Transfer-Encoding: 7bit
> 
> <!doctype html public "-//w3c//dtd html 4.0 transitional//en">
> <html>
> Hi Golda.
> <p>re: egypt.html
> <p>For some reason, when I type in the CORRECT code for uploading the March
> 2002 bird list (egypmar02.txt) the March <b>200<u>1</u> </b>bird list loads
> onto the website under the March 2002 link.&nbsp; Any obvious explanations?
> <p>The March 2002 bird list differs from previous bird lists in that it
> contains more columns but I've tested the different format out before and
> didn't find a problem.
> <p>Thanks.
> <p>Parker
> <p>--
> <p>Please note that while wings@wingsbirds.com remains our
> <br>standard e-mail address to which all general messages
> <br>should be sent, you can now also reach us individually at:
> <p>greer@wingsbirds.com
> <br>parker@wingsbirds.com
> <br>shawneen@wingsbirds.com
> <br>will@wingsbirds.com
> <br>&nbsp;</html>
> 
> --------------29BA0AC5BE63E393B48D924B--
> 
> 


