headers
Matthias Andree | 5 Oct 2007 09:20
Picon
Picon

Re: Pattern for only_groups_pcre (Leafnode 1).

On Fr, 2007-09-21 at 21:02 +0100, Adam Funk wrote:
> >>  and
> >> that I was still getting some binary groups with non-English names, so
> >> I've arrived at this:
> >> 
> >>   only_groups_pcre = ^([\+\-\w]+)(\.[\-\w]+(?<!binaries|binary|mp3|warez|binares|binarios|binari))*$
> >> 
> >> Does that cover all the characters that can legitimately appear in
> >> newsgroup names?  Any other comments or suggestions?
> >
> > As far as I see the current usefor draft (for lack of better
> > documentation), section 3.1.4 in
> > http://tools.ietf.org/html/draft-ietf-usefor-usefor-12 I'd say that's
> > sufficient if the exclusion catches all your binary groups, the
> > newsgroup name can be ALPHA, DIGIT, +, - or _, with . obviously as
> > component separator.
> 
> Thanks.  Does the pattern look right overall?  (As far as I can tell,
> it works.)

Well, you can use pcregrep to match the pattern against your active file
and see what it filters out and what it lets pass. :-)

--

-- 
Matthias Andree <matthias.andree@...>
Permalink | Reply | 1 comment |
headers
Adam Funk | 5 Oct 2007 11:53
Favicon

Re: Pattern for only_groups_pcre (Leafnode 1).

On 2007-10-05, Matthias Andree wrote:

> On Fr, 2007-09-21 at 21:02 +0100, Adam Funk wrote:
>> >>  and
>> >> that I was still getting some binary groups with non-English names, so
>> >> I've arrived at this:
>> >> 
>> >>   only_groups_pcre = ^([\+\-\w]+)(\.[\-\w]+(?<!binaries|binary|mp3|warez|binares|binarios|binari))*$
>> >> 
>> >> Does that cover all the characters that can legitimately appear in
>> >> newsgroup names?  Any other comments or suggestions?
>> >
>> > As far as I see the current usefor draft (for lack of better
>> > documentation), section 3.1.4 in
>> > http://tools.ietf.org/html/draft-ietf-usefor-usefor-12 I'd say that's
>> > sufficient if the exclusion catches all your binary groups, the
>> > newsgroup name can be ALPHA, DIGIT, +, - or _, with . obviously as
>> > component separator.
>> 
>> Thanks.  Does the pattern look right overall?  (As far as I can tell,
>> it works.)
>
> Well, you can use pcregrep to match the pattern against your active file
> and see what it filters out and what it lets pass. :-)

I've been using it for a while so what's in my active file *is* what
it passes.  ;-)  And I think it's right.

Thanks.
(Continue reading)

Permalink | Reply | 0 comments |
headers
Angel Martin Alganza | 6 Oct 2007 19:56
Picon

Two (or more) systems synchronization

Hello,

I am using leafnode for a few years already and I am really delighted
with it.  I read my news using tin 'locally' (at the same box as
leafnode is running).  When I am working on a different box, I still
run tin on the leafnode box through a 'screen' session.

What I would like to do is somehow synchronize my notebook to my mail
box so that I can read my newsgroups both online (at the leafnode box
or at any other online box) and off-line (at my notebook without
permanent internet connection.  Of course, I want that posts that I
have already read in either of them don't show up in the other.

The ideal thing would be that my notebook news got synchronized with
my main box, then I go off-line, I read and write my news and, when I
connect my notebook again, it synchronizes again to my main box
(sending the posts I've written on the notebook, receiving new posts
and deleting the posts I've read from the main box ---so that they
don't show up when I read new on it---).

Is there a way to do that or should I just install leafnode also on my
notebook and look for a way to synchronize the boxes at the reader
(tin) level?  What would you suggest me to do?

Thanks for your interest and help.
And many thanks to the leafnode authors for such a great piece of soft.

Greetings,
Ángel
(Continue reading)

Permalink | Reply | 13 comments |
headers
Martin | 6 Oct 2007 22:26
Picon
Favicon

Re: Two (or more) systems synchronization

Hello,

Am 06.10.2007 schrieb Angel Martin Alganza:
> What I would like to do is somehow synchronize my notebook to my mail
> box so that I can read my newsgroups both online (at the leafnode box
> or at any other online box) and off-line (at my notebook without
> permanent internet connection.  Of course, I want that posts that I
> have already read in either of them don't show up in the other.

That's tricky.

Here's why:

First of all, each server gives article numbers. So when your leafnode
finds a new article, it increases the current article number for the
group, and gives it to the article. Your first task is: Keep the
article numbers synchronized. 

While using only two computers with one polling directly from the
other, this sounds easy. But it isn't: If the first computer finds an
article cancelled or superseded, before the second updates its news
spool, there's a difference in numbers. And it will be there forever
(or at least until the difference increases). If I remember correctly,
there's some solution with INN. I'm not sure, whether one wants to use
it. And I'm not sure, whether one wants to use INN just for this
purpose.

Second problem: Your news server does not know about read articles at
all. It just doesn't care. News server don't store data just for one
user. Their spool is intended to be read by everyone.
(Continue reading)

Permalink | Reply | 12 comments |
headers
Thufir | 7 Oct 2007 07:46
Picon

Re: rss into leafnode

I like the idea :)

are you familiar with <code.google.com/p/feed-on-feeds/>?  It's RSS into 
a MySQL database.

I like your idea, though, because Google Groups e-mail lists exist as RSS 
feeds, but may not be available through gmane.  Once your script has it 
in leafnode, a reply will make its way back to the e-mail list?

-Thufir
Permalink | Reply | 2 comments |
headers
Reiner Steib | 7 Oct 2007 14:33
X-Face

Re: Two (or more) systems synchronization

On Sat, Oct 06 2007, Martin wrote:

> If I remember correctly, there's some solution with INN.

I also heard about this INN feature.  It would be nice to have such a
feature in leafnode, i.e. fetch articles from a remote newsserver and
keep the articles as on the server.  This scenario seems to be quite
common.  It would probably require that there's only a single server
(the "master") in the "slave's" leafnode setup.

> In short: In your current client/server-solution it's very difficult to
> complete this task. Maybe some copying of the newsspool and the newsrc
> would help. Be aware, that this may break things for your
> leafnode-system. I don't know.

I've been using such a setup for years: On the main machine, there's
the "master" leafnode spool.  Via rsync, I synchronize the spool (and
leafnode config files) to the notebook ("slave" leafnode) when online.
On the slave, I never run fetchnews.  This keeps the article numbers
in sync.  Additionally you need to sync your .newsrc or similar file
of your newsreader.

Caveats:

- Exclude out.going and failed.posting from rsync when doing the
  master -> slave sync.  Instead, you need to sync out.going from
  slave to master when online (and run fetchnews -P on the master).

- Matthias doesn't want to guarantee that the spool layout stays at it
  is (traditional news spool: one directory per group, one file per
(Continue reading)

Permalink | Reply | 3 comments |
headers
Martin | 7 Oct 2007 23:24
Picon
Favicon

Re: Two (or more) systems synchronization

Am 07.10.2007 schrieb Reiner Steib:
> On Sat, Oct 06 2007, Martin wrote:
> 
> > If I remember correctly, there's some solution with INN.
> 
> I also heard about this INN feature.  It would be nice to have such a
> feature in leafnode, i.e. fetch articles from a remote newsserver and
> keep the articles as on the server.  This scenario seems to be quite
> common.  It would probably require that there's only a single server
> (the "master") in the "slave's" leafnode setup.

I do not think, that this is a good idea, as long as you do not have
the master under your own control.

Every "big" server now and then renumbers its articles. Whenever this
is the case, and your slave depends and relies on the article numbers
on the master, you have to re-pull the complete spool. Another problem
could be the automatic detection. 

But having a master and a slave leafnode site, things are quite easy.
You and the original poster found a way. 

Maybe, there could be a little more support (syncing between two
leafnodes directly without rsync or something, maybe more UUCP-like),
especially when Matthias decides to change the spool-format. But you
should not be able to run leafnode in slave-mode, when *YOU* do not
control the master.

> Caveats:
>
(Continue reading)

Permalink | Reply | 0 comments |
headers
Angel Martin Alganza | 7 Oct 2007 23:43
Picon

Re: Two (or more) systems synchronization

Hello Martin,

Thank you very much for such a great amount of interesting information.

On Sat, Oct 06, 2007 at 10:26:13PM +0200, Martin wrote:

> First of all, each server gives article numbers. So when your leafnode
> finds a new article, it increases the current article number for the
> group, and gives it to the article. Your first task is: Keep the
> article numbers synchronized.

Does that mean that for a given group article numbers never get used
again?  I mean, is there one and only one article number 1 even when
the first post gets erased?

If that's how I have understood, it's very good news for me, since
synchronization at the server level is easy, then.  I simply need to
rsync /var/spool/news/ from my main box to my laptop, right?  I then
need my laptop not to fetch news from a server or anything other than
run leafnode to serve news to my news reader (tin).  Am I mistaken?

> While using only two computers with one polling directly from the
> other, this sounds easy. But it isn't: If the first computer finds an
> article cancelled or superseded, before the second updates its news
> spool, there's a difference in numbers. And it will be there forever

As long as I rsync main-box -> laptop I keep the numbers the same,
won't I?  Unless I haven't understood something properly (English is
not my mother tongue, you know).
(Continue reading)

Permalink | Reply | 7 comments |
headers
Matthias Andree | 8 Oct 2007 09:11
Picon
Picon

Re: Two (or more) systems synchronization

Reiner Steib schrieb am 2007-10-07:

> On Sat, Oct 06 2007, Martin wrote:
> 
> > If I remember correctly, there's some solution with INN.
> 
> I also heard about this INN feature.  It would be nice to have such a
> feature in leafnode, i.e. fetch articles from a remote newsserver and
> keep the articles as on the server.  This scenario seems to be quite
> common.  It would probably require that there's only a single server
> (the "master") in the "slave's" leafnode setup.

Well, cloning/synchronizing article numbers might require some work to
leafnode, but is certainly doable (requires some internal work though
because currently storing articles is "use high level watermark with
automatic increment, but the supersedes code might help us getting where
we want), even if not on short notice.

Offering IMAP access however - well, that's going to be tough. I wonder
if a leafnode plugin for Dovecot (for instance) would be feasible,
worthwhile or reasonable.

I presume we require some cleaning-up of internal interfaces (namely,
encapsulate the whole article access in a module on its own).

However, I'm not going to be able to evaluate that in the next few
weeks, probably not in October (real-life obligations taking away my
time; fetchmail 6.3.9 is also way overdue and delayed).

> I've been using such a setup for years: On the main machine, there's
(Continue reading)

Permalink | Reply | 1 comment |
headers
Matthias Andree | 8 Oct 2007 09:17
Picon
Picon

Re: Two (or more) systems synchronization

Angel Martin Alganza schrieb am 2007-10-07:

> Does that mean that for a given group article numbers never get used
> again?  I mean, is there one and only one article number 1 even when
> the first post gets erased?

Yes, article numbers aren't usually recycled (except if the active file
gets damaged or lost, then article numbers might get reused), leafnode
currently has no renumber utility or facility.

> If that's how I have understood, it's very good news for me, since
> synchronization at the server level is easy, then.  I simply need to
> rsync /var/spool/news/ from my main box to my laptop, right?  I then
> need my laptop not to fetch news from a server or anything other than
> run leafnode to serve news to my news reader (tin).  Am I mistaken?

Looks like Reiner's suggestion - mind his caveats though :-)

> > While using only two computers with one polling directly from the
> > other, this sounds easy. But it isn't: If the first computer finds an
> > article cancelled or superseded, before the second updates its news
> > spool, there's a difference in numbers. And it will be there forever
> 
> As long as I rsync main-box -> laptop I keep the numbers the same,
> won't I?  Unless I haven't understood something properly (English is
> not my mother tongue, you know).

You will if you run rsync rather than fetchnews.

> That's also very convenient for me (I think), since I simply need then
(Continue reading)

Permalink | Reply | 0 comments |

Gmane