Olly Betts | 1 Apr 13:52
Favicon
Gravatar

Re: how to compile java-swig under linux.

On Mon, Mar 31, 2008 at 08:50:24AM -0500, Jarrod Roberson wrote:
> it looks like the command line option to tell SWIG what package to use is in
> the make file already.

Hmm, it's there but commented out.  I tried adding it back in, but make
fails.  It looks like it no longer finds other classes in the package.
I don't really know how this is supposed to work, which is probably why
I commented out the option before.

If you want to take a look, this is the patch to Makefile.am:

http://oligarchy.co.uk/xapian/patches/java-swig-makefile-package.patch

If you make the same change to Makefile.in, you don't need to run
automake, etc which may be simpler if you don't have suitable versions
installed.

Cheers,
    Olly
Cory Wright | 1 Apr 20:44
Picon
Gravatar

Missing Debian Packages

Hi All,

Since the xapian website outage on March 25th, I've noticed that my  
daily Debian updates are failing with 404 errors.   In fact,  http://xapian.org/debian 
  does not seem to exist.

Are there plans to restore the Debian repository?   I would like to  
update to 1.0.6, but I'm waiting for official packages first.

Thanks in advance,

Cory

P.S. http://xapian.org/search.php seems to be broken as well.
Olly Betts | 2 Apr 02:49
Favicon
Gravatar

Re: Missing Debian Packages

On Tue, Apr 01, 2008 at 01:44:30PM -0500, Cory Wright wrote:
> Since the xapian website outage on March 25th, I've noticed that my  
> daily Debian updates are failing with 404 errors.   In fact,
> http://xapian.org/debian does not seem to exist.

Yes (as Richard mentioned in his message).  Apologies for any
inconvenience.

> Are there plans to restore the Debian repository?   I would like to  
> update to 1.0.6, but I'm waiting for official packages first.

They'll be restored once we can get to the old server, which seems to be
taking longer than expected.  But I haven't packaged 1.0.6 for
Debian/Ubuntu yet.

It's possible I have a copy of the 1.0.5 packages on my desktop machine,
but it's refusing to boot since being shipped to NZ, so I can't
trivially copy them off anyway.  The chroots I build packages in are on
this machine too, which is the main reason why I've not packaged 1.0.6
yet.

> P.S. http://xapian.org/search.php seems to be broken as well.

Unfortunately I couldn't find a copy of the Omega templates it uses.

Cheers,
    Olly
Lars Kruse | 2 Apr 05:56
Picon

Using special characters in query terms

Hi,

I would like to search for filenames in a xapian database.

For now my query for "foo-bar.po" turns into the following:
  Xapian::Query((foo:(pos=1) PHRASE 3 bar:(pos=2) PHRASE 3 po:(pos=3)))

This query is successful, if I used the term generator to tokenize "foo-bar.po"
during indexing.

The problem is: this workaround makes it impossible to distinguish between
"foo-bar.po" and "foo/bar.po".

A similar problem was described here:
http://grokbase.com/topic/2006/08/07/xapian-discuss-search-with-symbols-causes-search-time-to-hemorrhage/oO3ndMNfB_B9PY-NntCHJT9STto
But I couldn't follow the link to the bug database
(http://www.xapian.org/cgi-bin/bugzilla/show_bug.cgi?id=22), since bugzilla
seems to be unavailable at the moment.

My question: is there any way to protect special characters in a query?

thanks for your time,
Lars
James Aylett | 2 Apr 09:35

Re: Missing Debian Packages

On Wed, Apr 02, 2008 at 01:49:11AM +0100, Olly Betts wrote:

> They'll be restored once we can get to the old server, which seems to be
> taking longer than expected.

Turns out the guy who should be able to give me access to this is on
holiday, but didn't bother mentioning this to most people. I've got
someone checking to see if the old server is still powered; if not,
I'll go and collect it next week and power it from home. If it is, we
should be able to pull files off it in place, again probably early
next week.

J

--

-- 
/--------------------------------------------------------------------------\
  James Aylett                                                  xapian.org
  james <at> tartarus.org                               uncertaintydivision.org
James Aylett | 2 Apr 09:37

Re: Using special characters in query terms

On Wed, Apr 02, 2008 at 05:56:57AM +0200, Lars Kruse wrote:

> My question: is there any way to protect special characters in a query?

Briefly: you probably need to avoid both TermGenerator and
QueryParser, and roll your own to get complete control over how you
generate terms out of document and query text. Queries themselves
don't care how you construct the terms.

J

--

-- 
/--------------------------------------------------------------------------\
  James Aylett                                                  xapian.org
  james <at> tartarus.org                               uncertaintydivision.org
Lars Kruse | 2 Apr 10:40
Picon

Re: Using special characters in query terms

Hi,

> > My question: is there any way to protect special characters in a query?
> 
> Briefly: you probably need to avoid both TermGenerator and
> QueryParser, and roll your own to get complete control over how you
> generate terms out of document and query text. Queries themselves
> don't care how you construct the terms.

ok - so I was just too much focused on the QueryParser.
Thanks for your help - it works now!

regards,
Lars
Colin Bell | 2 Apr 12:31
Picon

Re: UTF-8 Corruption

This is really good stuff. Many thanks for all your help Olly. I hope  
all goes well in NZ.

Regards

Colin

On 31 Mar 2008, at 03:30, Olly Betts wrote:

> On Thu, Mar 20, 2008 at 02:08:00PM +0000, Colin Bell wrote:
>>
>>> If you pass data through Xapian::Utf8Iterator before doing anything
>>> with it, then this will fix bad UTF-8.  This is essentially what
>>> omindex does to deal with this problem.
>>
>> I take it that Xapian::Utf8Iterator will only fix bad UTF-8 not
>> convert to UTF-8?
>
> I'm not quite sure what you're asking.  Utf8Iterator returns Unicode
> code point values, and for bad UTF-8 sequences, these will be for
> those bytes read as ISO-8859-1.
>
> But it doesn't ever modify the bytes being iterated over - generally  
> the
> fixed sequence would be longer, so this couldn't be done in place
> anyway.
>
> So if you want the data as valid UTF-8, you need to read with
> Utf8Iterator and write the returned Unicode code point values out  
> again
(Continue reading)

Andreas Marienborg | 2 Apr 18:04
Picon
Gravatar

Re: Missing Debian Packages


On Apr 2, 2008, at 2:49 AM, Olly Betts wrote:

> On Tue, Apr 01, 2008 at 01:44:30PM -0500, Cory Wright wrote:
>> Since the xapian website outage on March 25th, I've noticed that my
>> daily Debian updates are failing with 404 errors.   In fact,
>> http://xapian.org/debian does not seem to exist.
>
> Yes (as Richard mentioned in his message).  Apologies for any
> inconvenience.
>
>> Are there plans to restore the Debian repository?   I would like to
>> update to 1.0.6, but I'm waiting for official packages first.
>
> They'll be restored once we can get to the old server, which seems  
> to be
> taking longer than expected.  But I haven't packaged 1.0.6 for
> Debian/Ubuntu yet.
>
> It's possible I have a copy of the 1.0.5 packages on my desktop  
> machine,
> but it's refusing to boot since being shipped to NZ, so I can't
> trivially copy them off anyway.  The chroots I build packages in are  
> on
> this machine too, which is the main reason why I've not packaged 1.0.6
> yet.
>

I put a copy of the 1.0.5 files I found in my apt-cache here if anyone  
needs them
(Continue reading)

Olly Betts | 3 Apr 01:02
Favicon
Gravatar

Re: Missing Debian Packages

On Wed, Apr 02, 2008 at 01:49:11AM +0100, Olly Betts wrote:
> It's possible I have a copy of the 1.0.5 packages on my desktop machine,
> but it's refusing to boot since being shipped to NZ, so I can't
> trivially copy them off anyway.  The chroots I build packages in are on
> this machine too, which is the main reason why I've not packaged 1.0.6
> yet.

I ordered a USB external SATA disk housing yesterday, which arrived just
now.  I've successfully copied off the 1.0.5 packages and uploaded them
to the new server.

I have a feeling there was a symlink or two that needed adding, but I
don't recall the details.  If you have a problem, please let me know
and I'll try to fix it.

I don't think I have the RPMs or omega templates though.  Fabrice/Tim:
if you have them still, let me know.  Otherwise they should reappear
early next week.

I now have the GPG key used to sign the archive too, so should be able
to sort out 1.0.6 packages fairly soon.

Cheers,
    Olly

Gmane