info | 1 Jan 2005 02:30
Favicon

[sqlite] Compression

Hello all,

First of all, allow me to wish everyone a Happy New Year and I hope it'll be a good one for all.

My question is (and I've raised this topic back in September, but didn't get back to it since), does anyone
have a free/commercial add-on for SQLite v3 to perform on-the-fly compression/decompression of data,
preferably on a field level (compress just one of the fields, not the whole table)?

Thank you,

   Dennis

// MCP, MCSD
// ASP Developer Member
// Software for animal shelters!
// www.smartpethealth.com
// www.amazingfiles.com
Ahmet Aksoy | 1 Jan 2005 14:09

Re: [sqlite] Advice needed for a new group member

Hi Mike,
I'll check your wrapper as son as possible.
Do you think that  version 3.x to be preferred to version 2.8.x?
My sql clauses are generally very simple. I'm using no triggers, etc.
Do you think that version 2.8.x will be enough for me? (Considering I've 
been using MsAccess.)
Thanks a lot.
Ahmet Aksoy

mike wrote:

>When used correctly, sqlite is the fastest SQL engine I have seen  (I am
>also using D7). So, yes, it would be a good choice.
>You need some API wrapper for sqlite, there are a few around including my
>own :) (see contrib)
>
>  
>

Ahmet Aksoy | 1 Jan 2005 15:15

[sqlite] What is that message?

Hi,
When I send a message to the group, I get the following message.
What is it? Who is Stiaan? Why should I contact him?
Ahmet Aksoy

Hello ahmetax@...

I regret to inform you that Stiaan is no longer employed by IndusProject Developers as he decided to pursue
new opportunities with a different company.

Please contact him for his new email address.

The Indus mail server

AJ Bourg | 1 Jan 2005 23:22
Picon

Re: [sqlite] What is that message?

It is an auto-response email generated because Stiaan is(was)
apparently subscribed to this mailing list at one point.

On Sat, 01 Jan 2005 16:15:56 +0200, Ahmet Aksoy <ahmetax@...> wrote:
> Hi,
> When I send a message to the group, I get the following message.
> What is it? Who is Stiaan? Why should I contact him?
> Ahmet Aksoy
> 
> Hello ahmetax@...
> 
> I regret to inform you that Stiaan is no longer employed by IndusProject Developers as he decided to pursue
new opportunities with a different company.
> 
> Please contact him for his new email address.
> 
> The Indus mail server
> 
>

David M. Cook | 2 Jan 2005 00:43

Re: [sqlite] Object Relational Mapping Tools with Sqlite

On Thu, Dec 30, 2004 at 10:41:50AM -0800, sgoldstein@... wrote:

> Has anyone been successful using an object relational mapping tool with
> Sqlite?  I'm looking for such a tool that has a non-commercial free
> license.

For Python: http://www.sqlobject.org

If you're using Java, I'd consider hibernate with the hsqldb pure java
database:

http://www.hibernate.org
http://hsqldb.sourceforge.net/

Dave Cook

Roger Binns | 2 Jan 2005 01:18

Re: [sqlite] Compression

> My question is (and I've raised this topic back in September, but 
> didn't get back to it since), does anyone have a free/commercial 
> add-on for SQLite v3 to perform on-the-fly compression/decompression 
> of data, preferably on a field level (compress just one of the fields, 
> not the whole table)?

Related to this I would love to see reference counting of values.
For example if I add the string "foobar" in 27 different places,
it only gets stored once with a reference count of 27.

There are various places that have done compression:

  http://www.sqliteplus.com/

There is also mention of compression at

  http://www.hwaci.com/sw/sqlite/prosupport.html

If you are working on a commercial product and SQLite has made your
product better and/or improved your development process then it is
fair and worthwhile to pay for that. 

Roger

Andy Lutomirski | 2 Jan 2005 02:11
Picon

[sqlite] deadlock detection?

Assuming that users wait when SQLITE_BUSY is returned instead of just 
giving up, a deadlock is possible.  Let A and B be two users:

A: begin; select; insert;
B: begin; select;
B: insert; (busy, so waits and polls occasionally)
A: commit; (busy, so waits and polls occasionally)

Is there any plan to allow detection or prevention of this case?  I see 
three solutions.

1. Tell users to only insert or update after BEGIN IMMEDIATE.  That will 
prevent this deadlock.  But prevents might break a lot of uses.

2. Add something like sqlite3_safe_write(), which will upgrade to a 
RESERVED lock (acts like an insert or update without actually changing 
anything).  If it works, return success.  Otherwise, decide if we're 
BUSY or DEADLOCKED:

If the caller is UNLOCKED (only happens if it's the first use of a 
deferred transaction), then we're BUSY since there's no deadlock possible.

If the caller is SHARED and there is no write pending (see below), 
return BUSY since we can't deadlock.

If the caller is SHARED and there is a write pending, then return 
DEADLOCKED.

If we return BUSY for any reason, this function would need to atomically 
set a write pending flag of some sort, to warn off future writers.
(Continue reading)

info | 2 Jan 2005 02:34
Favicon

Re: [sqlite] Compression

Thank you Roger,

I'm not against paying (that's why I said "commercial").

Have you (or anyone) used SQLite++? What are your thoughts on it?

Thank you,

   Dennis

// MCP, MCSD
// ASP Developer Member
// Software for animal shelters!
// www.smartpethealth.com
// www.amazingfiles.com
----- Original Message ----- 
From: "Roger Binns" <rogerb@...>
To: <sqlite-users@...>
Sent: Sunday, January 02, 2005 11:18 AM
Subject: Re: [sqlite] Compression

>> My question is (and I've raised this topic back in September, but 
>> didn't get back to it since), does anyone have a free/commercial 
>> add-on for SQLite v3 to perform on-the-fly compression/decompression 
>> of data, preferably on a field level (compress just one of the fields, 
>> not the whole table)?
> 
> Related to this I would love to see reference counting of values.
> For example if I add the string "foobar" in 27 different places,
> it only gets stored once with a reference count of 27.
(Continue reading)

sganz | 2 Jan 2005 02:42
Favicon

Re: [sqlite] Compression

Compression in the DB is interesting I think the commercial prod mentioned
just does a field compress and that is all. In general this only works on
larger blob like fiels as the overhead of the compressor is usually
somewhat high and lets not forget extra overhead of comp/decomp. The idea
I was playing with a while back (zlib) was a global db dictionary for
compression, but as memory got cheep and larger I dropped the project. The
simple token compression (like the old days of faircom's btree package,
sybase IQ, Monet, etc are much nicer). It would be a neat feature.

Sandy

>> My question is (and I've raised this topic back in September, but
>> didn't get back to it since), does anyone have a free/commercial
>> add-on for SQLite v3 to perform on-the-fly compression/decompression
>> of data, preferably on a field level (compress just one of the fields,
>> not the whole table)?
>
> Related to this I would love to see reference counting of values.
> For example if I add the string "foobar" in 27 different places,
> it only gets stored once with a reference count of 27.
>
> There are various places that have done compression:
>
>   http://www.sqliteplus.com/
>
> There is also mention of compression at
>
>   http://www.hwaci.com/sw/sqlite/prosupport.html
>
> If you are working on a commercial product and SQLite has made your
(Continue reading)

info | 2 Jan 2005 02:48
Favicon

Re: [sqlite] Compression

Well, actually that's exactly what I need - compression of large fields, not 
the whole database.

   Dennis

// MCP, MCSD
// ASP Developer Member
// Software for animal shelters!
// www.smartpethealth.com
// www.amazingfiles.com
----- Original Message ----- 
From: <sganz@...>
To: <sqlite-users@...>
Sent: Sunday, January 02, 2005 12:42 PM
Subject: Re: [sqlite] Compression

> Compression in the DB is interesting I think the commercial prod mentioned
> just does a field compress and that is all. In general this only works on
> larger blob like fiels as the overhead of the compressor is usually
> somewhat high and lets not forget extra overhead of comp/decomp. The idea
> I was playing with a while back (zlib) was a global db dictionary for
> compression, but as memory got cheep and larger I dropped the project. The
> simple token compression (like the old days of faircom's btree package,
> sybase IQ, Monet, etc are much nicer). It would be a neat feature.
>
> Sandy
>
>>> My question is (and I've raised this topic back in September, but
>>> didn't get back to it since), does anyone have a free/commercial
>>> add-on for SQLite v3 to perform on-the-fly compression/decompression
(Continue reading)


Gmane