Wolfgang Meier | 1 Sep 09:33 2006
Picon

Re: Compiling SVN checkout of DLN branch

Hi Christian,

> Here are a few more lines from the end of the compile run:
>
>     [javac] /Volumes/WXP/chris/svn/existDLN/src/org/exist/dom/DocumentOrderComparator.java:59:
> cannot find symbol
>     [javac] symbol  : method getParentId(org.exist.dom.DocumentImpl,long,int)

Ok, this makes sense: all these files were removed in the DLN branch.
Somehow, the tool you used to process the switch did not clean up the
directory and left the offending files in there (should not happen
when using the command line SVN client or eclipse). For example,
DocumentOrderComparator is not needed in DLN: the DLN scheme orders
nodes in document order by default.

Wolfgang

P.S.: a new release candidate is already available for download at
sourceforge. It will be publicly announced within an hour or so.

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
Oystein Reigem | 1 Sep 09:51 2006
Picon
Picon

Re: Mass import - Java Heap Space

Andrew Nagy wrote:

>Hello, I began some load testing of exist today.  I have 1 XML file that 
>has about 500,000 records in it.  I created a script that broke each 
>record into an individual XML document and then attempts to save the 
>record into exist using the REST interface.  After I hit about 57,000 
>records I began to see memory errors - "java.lang.OutOfMemoryError: Java 
>heap space".  Then shortly after I saw the following message "Exception 
>in thread "P1-9" java.lang.OutOfMemoryError: Java heap space ... 
>failure." which pretty much killed exist.  If I attempt to go to the 
>admin.xql interface I see the error message "Java heap space".
>
>My installation of exist is pretty much out of the box.  I am sure there 
>is plenty of customization that needs to happen.
>
>Can anyone tell me if their is a better way to import 500,000+ records 
>into exist and what customizations might be best to lighten the memory 
>limits?
>  
>
I have been successful in importing 250,000 records from a total of 50 
files, with a "put *.xml" command from the Webstart Client. Total file 
volume is 300MB = 250MB tags + 50MB data. Each record contains 60 
elements, but in a typical record half of the elements are empty. I've 
never tried the REST interface for loading data (only for storing query 
result lists from a python cgi). I've never tried to load as large a 
number of files as yours. But if your volume of data is comparable with 
mine perhaps that might indicate it's not the total volume of data that 
is the bottleneck. Perhaps it's the large number of files. Perhaps you 
might reorganize your records into fewer files. But I don't really know 
(Continue reading)

Phillip B Oldham | 1 Sep 10:26 2006
Picon

alternative to response:set-header() in eXist-snapshot-20060316?

Is there an alternative to response:set-header() in eXist-snapshot-20060316? I've been looking through the docs, but they've changed recently due to the new versioning scheme, etc.

--
Phillip B Oldham
phillip.oldham <at> gmail.com
+44(0)78 4110 4880
//refactored.net/ | //iyoti.com/ | //dysfunksion.co.uk/

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open
Mihai Cristea | 1 Sep 11:31 2006
Picon

Profiling XQuery from Exist

Hi

I have a very large xquery and i want to improve it, but i need to find 
out where the performance problems appear.
Could you recommend me a good profiling tool in order to do that ?

Thanks in advance

--

-- 
Mihai Cristea
Special Projects Division
MuseGlobal, S.A.
Craiova, Romania

Tel: + 40 251 413496
Fax: + 40 251 418935
Mobile: 0741.686211
Email: mihai.cristea <at> museglobal.ro
URL: www.museglobal.ro

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
Pierrick Brihaye | 1 Sep 11:37 2006
Picon

Re: Profiling XQuery from Exist

Hi,

Mihai Cristea a écrit :

> I have a very large xquery and i want to improve it, but i need to find 
> out where the performance problems appear.
> Could you recommend me a good profiling tool in order to do that ?

Google :
exist xml database xquery profiler

--

-- 
Pierrick Brihaye, informaticien
Service régional de l'Inventaire / DRAC Bretagne
mailto:pierrick.brihaye <at> culture.gouv.fr / tél : +33 (0)2 99 29 67 78
Avez-vous lu http://usenet-fr.news.eu.org/fr-chartes/rfc1855.html ?

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
Phillip B Oldham | 1 Sep 12:22 2006
Picon

Re: alternative to response:set-header() in eXist-snapshot-20060316?

Thanks Dannes... seems as though the only "header" function I have available is request:set-date-header(). I'll give that a go, and see whether I can "hack" through it.

On 9/1/06, Dannes Wessels <dizzzz <at> gmail.com> wrote:
Hi

On 9/1/06, Phillip B Oldham <phillip.oldham <at> gmail.com> wrote:
> Is there an alternative to response:set-header() in eXist-snapshot-20060316?
> I've been looking through the docs, but they've changed recently due to the
> new versioning scheme, etc.

Your *local* eXist install contains all documentation related to your
exist version (http://localhost:8080/exist or so). On www.exist-db.org
the documentation is normally in sync with the code archive.

Most of the new session: and response: functions came from "response:"
once. Please could you check?

regards

Dannes



--
# Dannes Wessels # The Netherlands #
# Jabber / ICQ / MSN / AIM / Yahoo / google.com/talk #



--
Phillip B Oldham
phillip.oldham <at> gmail.com
+44(0)78 4110 4880
//refactored.net/ | //iyoti.com/ | //dysfunksion.co.uk/
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open
Phillip B Oldham | 1 Sep 12:31 2006
Picon

Re: alternative to response:set-header() in eXist-snapshot-20060316?

Nope... can't get it to return the header I need. Also tried to use request:stream-binary() to set the header, but I get an empty response and can't binary64 encode the XML data to stream back.

Any other ideas on how I can output a header?

On 9/1/06, Phillip B Oldham <phillip.oldham <at> gmail.com> wrote:
Thanks Dannes... seems as though the only "header" function I have available is request:set-date-header(). I'll give that a go, and see whether I can "hack" through it.


On 9/1/06, Dannes Wessels < dizzzz <at> gmail.com> wrote:
Hi

On 9/1/06, Phillip B Oldham <phillip.oldham <at> gmail.com> wrote:
> Is there an alternative to response:set-header() in eXist-snapshot-20060316?
> I've been looking through the docs, but they've changed recently due to the
> new versioning scheme, etc.

Your *local* eXist install contains all documentation related to your
exist version ( http://localhost:8080/exist or so). On www.exist-db.org
the documentation is normally in sync with the code archive.

Most of the new session: and response: functions came from "response:"
once. Please could you check?

regards

Dannes



--
# Dannes Wessels # The Netherlands #
# Jabber / ICQ / MSN / AIM / Yahoo / google.com/talk #



--
+44(0)78 4110 4880
//refactored.net/ | //iyoti.com/ | //dysfunksion.co.uk/



--
Phillip B Oldham
phillip.oldham <at> gmail.com
+44(0)78 4110 4880
//refactored.net/ | //iyoti.com/ | //dysfunksion.co.uk/
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open
Adam Retter | 1 Sep 12:33 2006
Picon

Re: alternative to response:set-header() ineXist-snapshot-20060316?


You could easily add response:set-header() to your version by doing an in place build.

{ Disclaimer - For saftety I suggest you make a copy of your $EXIST_HOME folder to another machine before attempting this }


Get the SetHeader.java file from SVN or a newer eXist and copy it into your $EXIST_HOME/src/org/exist/xquery/functions/response folder

Edit the file $EXIST_HOME/src/org/exist/xquery/functions/response/ResponseModule.java and add an entry for the set-header() function. I think it will be fairly obvious what you need to add when you look at the file.

Make a backup of your db from the admin client and perhaps a copy of your $EXIST_HOME/webapp/WEB_INF/data directory, we wouldnt want you to loose anything.

Shutdown eXist, then in $EXIST_HOME, just fun ./build.sh (or build.bat if your on windows), this will recompile your eXist in place and add the set-header() function.

Startup eXist and you should be good to go :-)




-----Original Message-----
From: exist-open-bounces <at> lists.sourceforge.net on behalf of Phillip B Oldham
Sent: Fri 9/1/2006 11:31 AM
To: Dannes Wessels
Cc: eXist ml
Subject: Re: [Exist-open] alternative to response:set-header() ineXist-snapshot-20060316?

Nope... can't get it to return the header I need. Also tried to use
request:stream-binary() to set the header, but I get an empty response and
can't binary64 encode the XML data to stream back.

Any other ideas on how I can output a header?

On 9/1/06, Phillip B Oldham <phillip.oldham <at> gmail.com> wrote:
>
> Thanks Dannes... seems as though the only "header" function I have
> available is request:set-date-header(). I'll give that a go, and see
> whether I can "hack" through it.
>
>
> On 9/1/06, Dannes Wessels <dizzzz <at> gmail.com> wrote:
> >
> > Hi
> >
> > On 9/1/06, Phillip B Oldham <phillip.oldham <at> gmail.com> wrote:
> > > Is there an alternative to response:set-header() in
> > eXist-snapshot-20060316?
> > > I've been looking through the docs, but they've changed recently due
> > to the
> > > new versioning scheme, etc.
> >
> > Your *local* eXist install contains all documentation related to your
> > exist version (http://localhost:8080/exist or so). On www.exist-db.org
> > the documentation is normally in sync with the code archive.
> >
> > Most of the new session: and response: functions came from "response:"
> > once. Please could you check?
> >
> > regards
> >
> > Dannes
> >
> >
> >
> > --
> > # Dannes Wessels # The Netherlands #
> > # Jabber / ICQ / MSN / AIM / Yahoo / google.com/talk #
> >
>
>
>
> --
>
> Phillip B Oldham
> phillip.oldham <at> gmail.com
> +44(0)78 4110 4880
> //refactored.net/ | //iyoti.com/ | //dysfunksion.co.uk/
>



--
Phillip B Oldham
phillip.oldham <at> gmail.com
+44(0)78 4110 4880
//refactored.net/ | //iyoti.com/ | //dysfunksion.co.uk/

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open
Dannes Wessels | 1 Sep 12:43 2006
Picon

Re: alternative to response:set-header() ineXist-snapshot-20060316?

On 9/1/06, Adam Retter <adam.retter <at> devon.gov.uk> wrote:
> You could easily add response:set-header() to your version by doing an in
> place build.

much better is to jump over to a recent release candiate.

regards

Dannes

--

-- 
# Dannes Wessels # The Netherlands #
# Jabber / ICQ / MSN / AIM / Yahoo / google.com/talk #

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
Phillip B Oldham | 1 Sep 13:12 2006
Picon

Re: alternative to response:set-header() ineXist-snapshot-20060316?

On 9/1/06, Adam Retter <adam.retter <at> devon.gov.uk> wrote:
You could easily add response:set-header() to your version by doing an in place build.

On 9/1/06, Dannes Wessels < dizzzz <at> gmail.com> wrote:
much better is to jump over to a recent release candiate.

Yes... however for the moment I'm stuck with the build I'm using, as we've no time/budget for an upgrade & test phase.

For the moment I'm going to do some apache re-writing and use PHP to "proxy" certain requests, adding a content-type header on output. Simplest fix for the moment, though its not elegant.

--
Phillip B Oldham
phillip.oldham <at> gmail.com
+44(0)78 4110 4880
//refactored.net/ | //iyoti.com/ | //dysfunksion.co.uk/
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

Gmane