headers
jsnavely.geo | 1 Mar 2003 01:37
Picon
Favicon

Re: How to?

--- In bnr1 <at> yahoogroups.com, "TonyC <anthonyhc50 <at> y...>" <anthonyhc50 <at> y...> wrote:
> I will refresh 3 or 4 groups at the same time.  During the 
> refreshing, one group is ready to open.  I will open that group,
> and mark a article to download.  But it won't until all the other
> groups are done refreshing.  How do I get BNR to temporarily hold
> the refresh, and download the article, once the article is
> downloaded then BNR can resume refreshing.
> Anthony

If you want to force articles to download before header refreshes, then you need to go to each group and set
the "Header Refresh Priority For This Newsgroup" to a negative number so that all article entries in the
queue will have higher scores than the header entries.

A couple issues to keep in mind:
1) If a particular header refresh has already started, it will not stop in the middle of downloading that
block of headers.  The NNTP specification does not have any means of halting and resuming a download that is
in process.  Once it starts, it keeps going until it is finished, or the connection is lost.
2) There are some deadlocking issues with viewing groups while headers are still downloading from
multiple servers.  It seems to do okay with a one or two slow servers like BigGulp still downloading
headers, but if you have lots of faster servers running, you run the risk of causing the program to lockup
from a deadlock.

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Get 128 Bit SSL Encryption!
http://us.click.yahoo.com/FpY02D/vN2EAA/xGHJAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
Post message: bnr1 <at> yahoogroups.com
Subscribe:  bnr1-subscribe <at> yahoogroups.com
(Continue reading)

Permalink | Reply | 0 comments |
headers
DaneMan | 1 Mar 2003 12:00
Picon

Re: No Such article in group

Hi Jeff

> From:"DaneMan" <daneman <at> m...> wrote:
> I have not expire settings (-1 on both) and not auto refresh. I
> have two servers with one connection each. Servers are my ISP's
> server and Giganews. I got 8 newsgroups in total right now with
> 50.000 to 500.000 headers in each (om giga).

> From: "jsnavely.geo" <jsnavely.geo <at> yahoo.com>
>Setting the "Delete expired articles every __ days" setting 
>to -1 is strongly discouraged.  Doing so would mean that the 
>program will never delete any expired articles, so the database 
>will continue to grow as you download headers until you reach 
>the 1 GB limit, when then it will fail.
>
>The "Auto-expire articles not refreshed in __ days" option is 
>not quite as bad as individual articles will still expire when 
>you are refreshing headers or attempting to download the 
>expired files, but will also tie up portions of the database, if 
>you stop refreshing a group.
>
>The recommended settings are to set the Delete option to 1 
>day, and the Auto-Expire option to approximately the same 
>number of days as the longest retention provided by your 
>servers.

If so (and I don't doubt your words!!) there is something I have totally misunderstood. I 
thought that a group refresh would get all new headers and detele the ones outside the 
range of the server (same as delete the expired ones).
(Continue reading)

Permalink | Reply | 1 comment |
headers
jsnavely.geo | 1 Mar 2003 13:39
Picon
Favicon

Re: No Such article in group

--- In bnr1 <at> yahoogroups.com, "DaneMan" <daneman <at> m...> wrote:
> If so (and I don't doubt your words!!) there is something I have
> totally misunderstood. I thought that a group refresh would get all
> new headers and detele the ones outside the range of the server
> (same as delete the expired ones). 

When the article expires from a group, it only removes the reference to it from the server-group table for
that combination of server and group.  The actual article record remains in the database until deleted by
the DB cleanup routine every __ days on startup.  This is so that the flags will all still be there if this
article suddenly shows up again on another server-group pairing, and would allow eliminated redundant
header downloaded when using XHDR, since it doesn't have to redownload the Subject, Author and Date
headers for that article.

> btw. This might be totally useless after the latest fix but if the
> expired headers actually is in the db... would it be a big job to
> make them viewable (with a filer setting) and then a way to mark
> them as new (or un-expired) ?  I still think giganews sometimes
> reports a body as "not there" and when I try with another reader it
> downloads fine (it does the same on the other reader (pan for
> linux), marks the download as bad and when I mark it again it
> downloads fine so it's not a BNR bug). I'm not sure it's always
> after a timeout but it's surely mostly after an timeout.
> 
> I would like that feature if it's easy, but we can also wait and
> see if my problem disapear with the download-timeout fix.

When an article expires, the offset to that article is deleted from the Article-ID array, so there is no way
for the program to know which article that Article-ID pointed to or which articles had been available on a
specific server-group pairing without downloading the headers again.  If the failed articles do not come
back automatically when you restart BNR2, then try using the Group|Reset then Group|Refresh commands to
(Continue reading)

Permalink | Reply | 0 comments |
headers
warpedc0re | 1 Mar 2003 13:55
Picon
Favicon

Jeff Snavely: normal quit on kill

Like most ppl that keep track of many large newsgroups, I use multiple
databases/instances of BNR2.  In order to run all those BNR2, I use
Task Scheduler to run different ones at different times of the day
(because of connection limits to news servers).

The problem I have repeatedly is that Task Scheduler will do a hard
KILL on BNR2 while it's running (downloading headers or articles).
When that instance of BNR2 restarts the next time, the database is
corrupted (as one would expect).  Can BNR2 have a more gentle response
(i.e. quit only when all the threads have finished downloading) and
close the database?

What other solutions do ppl use to deal with automatically running
BNR2 in the background for harvesting?  Thank you for this GREAT 
PROGRAM! :)

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Get 128 Bit SSL Encryption!
http://us.click.yahoo.com/LIgTpC/vN2EAA/xGHJAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
Post message: bnr1 <at> yahoogroups.com
Subscribe:  bnr1-subscribe <at> yahoogroups.com
Unsubscribe:  bnr1-unsubscribe <at> yahoogroups.com
List owner:  bnr1-owner <at> yahoogroups.com
Group homepage: http://groups.yahoo.com/group/bnr1
BNR homepage: http://www.bnr2.org/ 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
(Continue reading)

Permalink | Reply | 1 comment |
headers
Chris | 1 Mar 2003 15:10
Picon
Favicon

test message

test message, please ignore

-- 
  Regards
  Chris
  Registered Linux user #283774  <at>  http://counter.li.org
  8:10am  up 2 days,  1:58,  4 users,  load average: 0.26, 0.06, 0.02

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Get 128 Bit SSL Encryption!
http://us.click.yahoo.com/LIgTpC/vN2EAA/xGHJAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
Post message: bnr1 <at> yahoogroups.com
Subscribe:  bnr1-subscribe <at> yahoogroups.com
Unsubscribe:  bnr1-unsubscribe <at> yahoogroups.com
List owner:  bnr1-owner <at> yahoogroups.com
Group homepage: http://groups.yahoo.com/group/bnr1
BNR homepage: http://www.bnr2.org/ 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
Permalink | Reply | 0 comments |
headers
jenius | 1 Mar 2003 19:39

ETA on 64Bit Dbase


Hello Jeff,

Any ETA on the new databse version?

-----------
Vik

------------------------ Yahoo! Groups Sponsor ---------------------~-->
New Yahoo! Mail Plus. More flexibility. More control. More power.
Get POP access, more storage, more filters, and more.
http://us.click.yahoo.com/Hcb0iA/P.iFAA/46VHAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
Post message: bnr1 <at> yahoogroups.com
Subscribe:  bnr1-subscribe <at> yahoogroups.com
Unsubscribe:  bnr1-unsubscribe <at> yahoogroups.com
List owner:  bnr1-owner <at> yahoogroups.com
Group homepage: http://groups.yahoo.com/group/bnr1
BNR homepage: http://www.bnr2.org/ 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
Permalink | Reply | 1 comment |
headers
chakotay22002 | 1 Mar 2003 21:49
Picon
Favicon

kill exe files

If I want to kill .exe files from BNR, what do I put in the RegEx 
field.  When I put *.exe it shows Error: Pearlre Nothing to repeat.

Please help.

Allen

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Get 128 Bit SSL Encryption!
http://us.click.yahoo.com/LIgTpC/vN2EAA/xGHJAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
Post message: bnr1 <at> yahoogroups.com
Subscribe:  bnr1-subscribe <at> yahoogroups.com
Unsubscribe:  bnr1-unsubscribe <at> yahoogroups.com
List owner:  bnr1-owner <at> yahoogroups.com
Group homepage: http://groups.yahoo.com/group/bnr1
BNR homepage: http://www.bnr2.org/ 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
Permalink | Reply | 2 comments |
headers
Linx Wiler | 1 Mar 2003 22:48
Picon
Favicon

Re: kill exe files

--- In bnr1 <at> yahoogroups.com, "chakotay22002 <chakotay2 <at> e...>" 
<chakotay2 <at> e...> wrote:
> If I want to kill .exe files from BNR, what do I put in the RegEx 
> field.  When I put *.exe it shows Error: Pearlre Nothing to repeat.
> 
> Please help.
> 
> Allen

Allen,

[RegEx]
HIDE IF MATCHING a REGULAR EXPRESSION
       [x]filename 
       (.exe)

Works fine. 
Then go back to the [General] tab and check 
[x]active by deafault when opening a newsgroup

if you want it to be active by Default....

Linx

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Get 128 Bit SSL Encryption!
http://us.click.yahoo.com/LIgTpC/vN2EAA/xGHJAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
(Continue reading)

Permalink | Reply | 0 comments |
headers
jsnavely.geo | 1 Mar 2003 22:53
Picon
Favicon

Re: Jeff Snavely: normal quit on kill

--- In bnr1 <at> yahoogroups.com, "warpedc0re <warpedc0re <at> y...>" <warpedc0re <at> y...> wrote:
> The problem I have repeatedly is that Task Scheduler will do a hard
> KILL on BNR2 while it's running (downloading headers or articles).
> When that instance of BNR2 restarts the next time, the database is
> corrupted (as one would expect).  Can BNR2 have a more gentle
> response (i.e. quit only when all the threads have finished
> downloading) and close the database?

If the Task Scheduler would send a polite shutdown message, then BNR2 would shutdown properly.  If it just
kills the process without warning, then BNR2 doesn't have a chance.

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Get 128 Bit SSL Encryption!
http://us.click.yahoo.com/LIgTpC/vN2EAA/xGHJAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
Post message: bnr1 <at> yahoogroups.com
Subscribe:  bnr1-subscribe <at> yahoogroups.com
Unsubscribe:  bnr1-unsubscribe <at> yahoogroups.com
List owner:  bnr1-owner <at> yahoogroups.com
Group homepage: http://groups.yahoo.com/group/bnr1
BNR homepage: http://www.bnr2.org/ 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
Permalink | Reply | 0 comments |
headers
jsnavely.geo | 1 Mar 2003 22:57
Picon
Favicon

Re: ETA on 64Bit Dbase

--- In bnr1 <at> yahoogroups.com, jenius <at> c... wrote:
> 
> Hello Jeff,
> 
> Any ETA on the new databse version?

Whenever everything is converted over to handle the larger offsets.  I'm still constantly finding
functions hard coded to Integer or Cardinal for file offsets, which I have been converting over to a custom
type that is currently defined as Cardinal, but can later be globally switched over to Int64, when the
change is made.

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Get 128 Bit SSL Encryption!
http://us.click.yahoo.com/LIgTpC/vN2EAA/xGHJAA/dkFolB/TM
---------------------------------------------------------------------~->

Important Addresses:
Post message: bnr1 <at> yahoogroups.com
Subscribe:  bnr1-subscribe <at> yahoogroups.com
Unsubscribe:  bnr1-unsubscribe <at> yahoogroups.com
List owner:  bnr1-owner <at> yahoogroups.com
Group homepage: http://groups.yahoo.com/group/bnr1
BNR homepage: http://www.bnr2.org/ 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
Permalink | Reply | 0 comments |

Gmane