Flávio R. C. Sousa | 1 Apr 2008 17:01
Picon

Re: Sedna 3.0

 

Hello Steve,

       I think that the management of memory (Sedna) is not efficient, but it has improved considerably in recent versions. It's important to remember that Sedna is a "recent" system. Moreover, among all Native XML Databases, Sedna is the only one that supports all the features of a traditional database.
      I believe that the Sedna Team will improve the management of memory and other features soon.


On Mon, Mar 31, 2008 at 10:42 AM, Steve Howe <howesteve <at> gmail.com> wrote:
Hello Ivan,

> Currently you can use BLOBs impelemented through XML Schema binary types
> using XML:DB API by Charles Foster (http://www.cfoster.net/sedna).
Ok, I just saw it's Java, and I don't use it as well, however the same
question applies, how is it stored internally in Sedna: if it's base64-based
or something like that, it's useless except as a quick (but slow) hack.

--
Best Regards,
Steve Howe

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
Sedna-discussion mailing list
Sedna-discussion <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/sedna-discussion



--
Flávio R. C. Sousa, Prof.
Federal University of Ceará, Brazil
http://www.great.ufc.br/~flavio
Alan shouls | 3 Apr 2008 00:10
Picon
Favicon

Re: Sedna 3.0


Hi Sedna Team,

Do you have an expected release date for 3.0? 

I am hoping to assign one of our engineers to evaluate using Sedna as a potential back-end of our application
- however as we are OSX based we can not do this until we have an OSX version that we can evaluate.

I ask about a release date as we are coming to the end of our current development cycle and it is a really good
time to start this kind of investigative/research work.

Best regards

Alan Shouls
_________________________________________________________________
Pack up or back up–use SkyDrive to transfer files or keep extra copies. Learn how.
hthttp://www.windowslive.com/skydrive/overview.html?ocid=TXT_TAGLM_WL_Refresh_skydrive_packup_042008

Muralidharan Kendai | 3 Apr 2008 20:17
Picon

Exception in running a query

Sedna team,
I am facing an exception when i tried to run a query which has the special characters like "&,{,}" in it.

 Query execution failed (SEDNA Message: ERROR XPST0003 It is a static error if an expression is not a valid instance of the grammar defined in A.1 EBNF. Details: unknown token: '&', line: 1 ).

For Eg, when i tried to run the following query, i am getting the exception.

UPDATE insert <project><Name>"TestProject"</Name><ProjectFileName>"C:\Test"</ProjectFileName><ProjectFolderPath>"C:\Test"</ProjectFolderPath><ProjectDescription>Test&Sedna{Project}</ProjectDescription></project> into document("Test.xml")/projects


Is there alternative way to handle these special characters or  how to update a xml document which has special characters.

Muralidharan Kendai | 3 Apr 2008 20:33
Picon

Exception in running a query

Sedna team,
I am facing an exception when i tried to run a query which has the special characters like "&,{,}" in it.

 Query execution failed (SEDNA Message: ERROR XPST0003 It is a static error if an expression is not a valid instance of the grammar defined in A.1 EBNF. Details: unknown token: '&', line: 1 ).

For Eg, when i tried to run the following query, i am getting the exception.

UPDATE insert <project><Name>"TestProject"</Name><ProjectFileName>"C:\Test"</ProjectFileName><ProjectFolderPath>"C:\Test"</ProjectFolderPath><ProjectDescription>Test&Sedna{Project}</ProjectDescription></project> into document("Test.xml")/projects


Is there alternative way to handle these special characters or  how to update a xml document which has special characters.


Ivan Shcheklein | 3 Apr 2008 21:12
Picon

Re: Exception in running a query

Hi Muralidharan,

Here is citation from the XML specification (http://www.w3.org/TR/2006/REC-xml-20060816):

The ampersand character (&) and the left angle bracket (<) MUST NOT appear in their literal form, except when used as markup delimiters, or within a comment, a processing instruction, or a CDATA section. If they are needed elsewhere, they MUST be escapednumeric character references or the strings "&amp;" and "&lt;" respectively. The right angle bracket (>) may be represented using the string "&gt;", and MUST, for compatibility, be escaped using either "&gt;" or a character reference when it appears in the string "]]>" in content, when that string is not marking the end of a CDATA section.

Ivan Shcheklein,
Sedna Team

Muralidharan Kendai | 3 Apr 2008 23:22
Picon

Re: Exception in running a query

Hi,
This is my sample xml file


  <?xml version="1.0" standalone="yes" ?>
- <projects>
- <project>
  <Name>'test'</Name>
  <ProjectFileName>'C:/My Documents/Delete/test/test.xml'</ProjectFileName>
  <ProjectFolderPath>'C:/My Documents/Delete/test'</ProjectFolderPath>
  <ProjectDescription>'Sample&Test{Project}'</ProjectDescription>
  </project>
  </projects>

How to insert &, {, } characters in xml. I can use &amp; for & , but for open brace & close brace is there any equivalent.

Thanks
Muralidharan


On Thu, Apr 3, 2008 at 12:12 PM, Ivan Shcheklein <vano_msu-JGs/UdohzUI@public.gmane.org> wrote:
Hi Muralidharan,

Here is citation from the XML specification (http://www.w3.org/TR/2006/REC-xml-20060816):

The ampersand character (&) and the left angle bracket (<) MUST NOT appear in their literal form, except when used as markup delimiters, or within a comment, a processing instruction, or a CDATA section. If they are needed elsewhere, they MUST be escapednumeric character references or the strings "&amp;" and "&lt;" respectively. The right angle bracket (>) may be represented using the string "&gt;", and MUST, for compatibility, be escaped using either "&gt;" or a character reference when it appears in the string "]]>" in content, when that string is not marking the end of a CDATA section.

Ivan Shcheklein,
Sedna Team

Ivan Shcheklein | 3 Apr 2008 23:40
Picon

Re: Exception in running a query

Muralidharan, you should escape { and } by repeating them twicely, e.g.:

<a>aaaa{{aaaa}}</a>

Ivan

On Fri, Apr 4, 2008 at 1:22 AM, Muralidharan Kendai <muralidharan.kk-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
Hi,
This is my sample xml file


  <?xml version="1.0" standalone="yes" ?>
- <projects>
- <project>
  <Name>'test'</Name>
  <ProjectFileName>'C:/My Documents/Delete/test/test.xml'</ProjectFileName>
  <ProjectFolderPath>'C:/My Documents/Delete/test'</ProjectFolderPath>
  <ProjectDescription>'Sample&Test{Project}'</ProjectDescription>
  </project>
  </projects>

How to insert &, {, } characters in xml. I can use &amp; for & , but for open brace & close brace is there any equivalent.

Thanks
Muralidharan


On Thu, Apr 3, 2008 at 12:12 PM, Ivan Shcheklein <vano_msu-JGs/UdohzUI@public.gmane.org> wrote:
Hi Muralidharan,

Here is citation from the XML specification (http://www.w3.org/TR/2006/REC-xml-20060816):

The ampersand character (&) and the left angle bracket (<) MUST NOT appear in their literal form, except when used as markup delimiters, or within a comment, a processing instruction, or a CDATA section. If they are needed elsewhere, they MUST be escapednumeric character references or the strings "&amp;" and "&lt;" respectively. The right angle bracket (>) may be represented using the string "&gt;", and MUST, for compatibility, be escaped using either "&gt;" or a character reference when it appears in the string "]]>" in content, when that string is not marking the end of a CDATA section.

Ivan Shcheklein,
Sedna Team


Maxim Grinev | 4 Apr 2008 13:57

Re: Sedna 3.0

Charles and Steve,

having read this discussion I also have to agree with you that Sedna should share buffers between databases.
We should think about it and include it in our to-do list.

But please note that:
1) Memory consumption of XML databases will alsways be higher than in relational databases. In rdb everything is more or less predictable. If we read/modify an item (which is a tuple in rdb) we alway deal with only one page. If we read/modify an item in XML database it might occupy unpredictable number of pages. So to be efficient a database should have relatively large buffers (100 Mb  or even more). So we are talking about sharing buffers, not reducing its size. Is it ok for your applications?
2) As ZNV mentioned it will be not easy to implement it in Sedna but we should do it.

Maxim Grinev
Sedna team




2008/3/31, Charles Foster <charles-huu879ivjHnR7s880joybQ@public.gmane.org>:
Hi,

I have to agree with Steve about memory issues, I currently use 2 hosting
packages.

1 is a high cost dedicated root server, and can install anything I want.
2 is a shared machine with my own Tomcat server, I am given 2 MySQL
Databases each running within the same server.

I use Sedna on the dedicated root server, but am still not happy with its
memory consumption.

As far as a shared machine goes, installing and running Sedna is just not
a option at the moment whether doing it myself or the host provider
themselves running 1 server with multiple databases. In this environment I
am currently forced to use eXist instead.

Regards,


Charles


> Hello ZVN,
>> Hello Steve,
>>
>> I believe we could fix the memory issue. This will require complex
>> redesign of Sedna. Basicly we have to change the responsibility and
>> communication of Sedna processes. Currently there exists a separate
>> process for each database running the separate instance of buffer
>> manager. This leads to 100MB (when default configuration is in effect)
>> RAM used per DB - no matter how high the actual load is.
>>
>> We could rearrange things and merge all SM-s into a single process.
>> This is a lot of work. I am willing to make this changes - along with
>> other enhancements to the buffer manager and overal cleanup of Sedna
>> system design. However I need a solid reasoning to convince the team
>> to invest effort in this project. Any ideas?
> I think I do: without that kind of management, we won't ever see Sedna
> deployed in the wild. If you have a shared server, for instance, you can
> safely deploy PostgreSQL or MySQL because they can manage hundreds of
> databases at once, using the memory you reserve for them. Sedna however
> will
> choke the server's memory with only a few databases. That means expensive
> (dedicated) hardware will have to be used for running Sedna.
>
> I have developed a web framework in Python which uses Sedna and lxml [1]
> but I
> can't see it deployed on actual hosting providers because of the high
> Sedna
> memory requirements. Most VPS plans start with 64 or 128Mb of ram, for
> instance.
>
> Besides, it's a question of efficiency. Why wasting more memory then
> needed ?
>
> I'd however keep each database connection running in a separate process
> and
> use a send process that would be the inter-process shared buffers manager.
> This is the approach PostgreSQL uses, and will avoid a crashed connection
> to
> shut down all the other connections or the whole database system. A
> similar
> implementation could be done in a single process using a buffers manager
> and
> threaded connections, however that could be a bit harder to implement due
> to
> threads compatibility issues among different operating systems.
>
> --
> Best Regards,
> Steve Howe
>
> [1] http://codespeak.net/lxml/
>

> -------------------------------------------------------------------------
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
> _______________________________________________
> Sedna-discussion mailing list
> Sedna-discussion-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
> https://lists.sourceforge.net/lists/listinfo/sedna-discussion
>


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
Sedna-discussion mailing list
Sedna-discussion-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/sedna-discussion

Maxim Grinev | 4 Apr 2008 14:02

Re: Sedna 3.0

Charles,

I have a question about "shared machine" as I don't have a lot of experience with using hosting packages. If you rent a shared machine and suppose that the Sedna memory consumption is reduced, may you install Sedna on it? Or it can be done only by the host provider?

And can you see any other problems (except memory consumption) of running Sedna on a shared machine?

Thanks,
Maxim Grinev
Sedna team

2008/3/31, Charles Foster <charles-huu879ivjHnR7s880joybQ@public.gmane.org>:
Hi,

I have to agree with Steve about memory issues, I currently use 2 hosting
packages.

1 is a high cost dedicated root server, and can install anything I want.
2 is a shared machine with my own Tomcat server, I am given 2 MySQL
Databases each running within the same server.

I use Sedna on the dedicated root server, but am still not happy with its
memory consumption.

As far as a shared machine goes, installing and running Sedna is just not
a option at the moment whether doing it myself or the host provider
themselves running 1 server with multiple databases. In this environment I
am currently forced to use eXist instead.

Regards,


Charles


> Hello ZVN,
>> Hello Steve,
>>
>> I believe we could fix the memory issue. This will require complex
>> redesign of Sedna. Basicly we have to change the responsibility and
>> communication of Sedna processes. Currently there exists a separate
>> process for each database running the separate instance of buffer
>> manager. This leads to 100MB (when default configuration is in effect)
>> RAM used per DB - no matter how high the actual load is.
>>
>> We could rearrange things and merge all SM-s into a single process.
>> This is a lot of work. I am willing to make this changes - along with
>> other enhancements to the buffer manager and overal cleanup of Sedna
>> system design. However I need a solid reasoning to convince the team
>> to invest effort in this project. Any ideas?
> I think I do: without that kind of management, we won't ever see Sedna
> deployed in the wild. If you have a shared server, for instance, you can
> safely deploy PostgreSQL or MySQL because they can manage hundreds of
> databases at once, using the memory you reserve for them. Sedna however
> will
> choke the server's memory with only a few databases. That means expensive
> (dedicated) hardware will have to be used for running Sedna.
>
> I have developed a web framework in Python which uses Sedna and lxml [1]
> but I
> can't see it deployed on actual hosting providers because of the high
> Sedna
> memory requirements. Most VPS plans start with 64 or 128Mb of ram, for
> instance.
>
> Besides, it's a question of efficiency. Why wasting more memory then
> needed ?
>
> I'd however keep each database connection running in a separate process
> and
> use a send process that would be the inter-process shared buffers manager.
> This is the approach PostgreSQL uses, and will avoid a crashed connection
> to
> shut down all the other connections or the whole database system. A
> similar
> implementation could be done in a single process using a buffers manager
> and
> threaded connections, however that could be a bit harder to implement due
> to
> threads compatibility issues among different operating systems.
>
> --
> Best Regards,
> Steve Howe
>
> [1] http://codespeak.net/lxml/
>

> -------------------------------------------------------------------------
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
> _______________________________________________
> Sedna-discussion mailing list
> Sedna-discussion-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
> https://lists.sourceforge.net/lists/listinfo/sedna-discussion
>


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
Sedna-discussion mailing list
Sedna-discussion-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/sedna-discussion

Charles Foster | 4 Apr 2008 15:21
Gravatar

Re: Sedna 3.0

Understood, one thing I'd like to see in the future is support for
collections that only accept documents that conform to a user defined XML
Schema.

Not only would this be beneficial in terms of developers using Sedna
knowing whether or not an XML document is valid by the Database
complaining when they tried to insert or update.

But surely this would also help with things like Sedna knowing how to
index the data easily, this surely would reduce the unpredictability
problem too?

Regards,

Charles

> Charles and Steve,
>
> having read this discussion I also have to agree with you that Sedna
> should
> share buffers between databases.
> We should think about it and include it in our to-do list.
>
> But please note that:
> 1) Memory consumption of XML databases will alsways be higher than in
> relational databases. In rdb everything is more or less predictable. If we
> read/modify an item (which is a tuple in rdb) we alway deal with only one
> page. If we read/modify an item in XML database it might occupy
> unpredictable number of pages. So to be efficient a database should have
> relatively large buffers (100 Mb  or even more). So we are talking about
> sharing buffers, not reducing its size. Is it ok for your applications?
> 2) As ZNV mentioned it will be not easy to implement it in Sedna but we
> should do it.
>
> Maxim Grinev
> Sedna team
>
>
>
>
> 2008/3/31, Charles Foster <charles@...>:
>>
>> Hi,
>>
>> I have to agree with Steve about memory issues, I currently use 2
>> hosting
>> packages.
>>
>> 1 is a high cost dedicated root server, and can install anything I want.
>> 2 is a shared machine with my own Tomcat server, I am given 2 MySQL
>> Databases each running within the same server.
>>
>> I use Sedna on the dedicated root server, but am still not happy with
>> its
>> memory consumption.
>>
>> As far as a shared machine goes, installing and running Sedna is just
>> not
>> a option at the moment whether doing it myself or the host provider
>> themselves running 1 server with multiple databases. In this environment
>> I
>> am currently forced to use eXist instead.
>>
>> Regards,
>>
>>
>> Charles
>>
>>
>> > Hello ZVN,
>> >> Hello Steve,
>> >>
>> >> I believe we could fix the memory issue. This will require complex
>> >> redesign of Sedna. Basicly we have to change the responsibility and
>> >> communication of Sedna processes. Currently there exists a separate
>> >> process for each database running the separate instance of buffer
>> >> manager. This leads to 100MB (when default configuration is in
>> effect)
>> >> RAM used per DB - no matter how high the actual load is.
>> >>
>> >> We could rearrange things and merge all SM-s into a single process.
>> >> This is a lot of work. I am willing to make this changes - along with
>> >> other enhancements to the buffer manager and overal cleanup of Sedna
>> >> system design. However I need a solid reasoning to convince the team
>> >> to invest effort in this project. Any ideas?
>> > I think I do: without that kind of management, we won't ever see Sedna
>> > deployed in the wild. If you have a shared server, for instance, you
>> can
>> > safely deploy PostgreSQL or MySQL because they can manage hundreds of
>> > databases at once, using the memory you reserve for them. Sedna
>> however
>> > will
>> > choke the server's memory with only a few databases. That means
>> expensive
>> > (dedicated) hardware will have to be used for running Sedna.
>> >
>> > I have developed a web framework in Python which uses Sedna and lxml
>> [1]
>> > but I
>> > can't see it deployed on actual hosting providers because of the high
>> > Sedna
>> > memory requirements. Most VPS plans start with 64 or 128Mb of ram, for
>> > instance.
>> >
>> > Besides, it's a question of efficiency. Why wasting more memory then
>> > needed ?
>> >
>> > I'd however keep each database connection running in a separate
>> process
>> > and
>> > use a send process that would be the inter-process shared buffers
>> manager.
>> > This is the approach PostgreSQL uses, and will avoid a crashed
>> connection
>> > to
>> > shut down all the other connections or the whole database system. A
>> > similar
>> > implementation could be done in a single process using a buffers
>> manager
>> > and
>> > threaded connections, however that could be a bit harder to implement
>> due
>> > to
>> > threads compatibility issues among different operating systems.
>> >
>> > --
>> > Best Regards,
>> > Steve Howe
>> >
>> > [1] http://codespeak.net/lxml/
>> >
>>
>> >
>> -------------------------------------------------------------------------
>> > Check out the new SourceForge.net Marketplace.
>> > It's the best place to buy or sell services for
>> > just about anything Open Source.
>> >
>> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
>> > _______________________________________________
>> > Sedna-discussion mailing list
>> > Sedna-discussion@...
>> > https://lists.sourceforge.net/lists/listinfo/sedna-discussion
>> >
>>
>>
>> -------------------------------------------------------------------------
>> Check out the new SourceForge.net Marketplace.
>> It's the best place to buy or sell services for
>> just about anything Open Source.
>>
>> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
>> _______________________________________________
>> Sedna-discussion mailing list
>> Sedna-discussion@...
>> https://lists.sourceforge.net/lists/listinfo/sedna-discussion
>>
>


Gmane