Chris Lamprecht | 1 Dec 08:21 2005
Picon

Re: open source YourKit licence

I'm not a direct committer, although I have submitted a few patches,
some of which have been applied by Erik I think (small fixes and
testcases).  If this is good enough, I'd love a license.  I'd use it
for profiling Lucene (no kidding), as it's the CPU intensive part of
our app.  Previously I've just used java's built-in profiling
command-line options and JRockit's reporting stuff.
-chris

On 11/30/05, Yonik Seeley <yseeley <at> gmail.com> wrote:
> Does anyone have experience with YourKit & the open source license?
> I was just asking for a license for myself (see email below), and the
> web page actually says that the logo is optional (and many other
> apache projects http://www.yourkit.com/customers/index.jsp seemingly
> exclude it.)
>
> Still, they are providing something for free, and they probably
> deserve a bump... maybe something like the credits here:
> http://db.apache.org/ojb/
>
> So,
> a) do any other committers want a license, and
> b) would we be willing to put their logo somewhere in exchange?
>
> -Yonik
>
> ---------- Forwarded message ----------
> From: sales <at> yourkit.com <sales <at> yourkit.com>
> Date: Nov 30, 2005 6:56 AM
> Subject: Re: open source YourKit licence
> To: Yonik Seeley <yseeley <at> gmail.com>
(Continue reading)

Volodymyr Bychkoviak (JIRA | 1 Dec 12:58 2005
Picon

[jira] Created: (LUCENE-475) RAMDirectory(Directory dir, boolean closeDir) constructor uses memory inefficiently.

 RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
--------------------------------------------------------------------------------------

         Key: LUCENE-475
         URL: http://issues.apache.org/jira/browse/LUCENE-475
     Project: Lucene - Java
        Type: Improvement
  Components: Store  
    Reporter: Volodymyr Bychkoviak

recently I found that  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
files from source index are read entirely intro memory as single byte array which is after all is thrown
away. And if I want to load my 200M optimized, compound format index to memory for faster search I should
give JVM at least 400Mb memory limit. For larger indexes this can be an issue.

I've attached patch how to solve this problem.

--

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira
Volodymyr Bychkoviak (JIRA | 1 Dec 13:00 2005
Picon

[jira] Updated: (LUCENE-475) RAMDirectory(Directory dir, boolean closeDir) constructor uses memory inefficiently.

     [ http://issues.apache.org/jira/browse/LUCENE-475?page=all ]

Volodymyr Bychkoviak updated LUCENE-475:
----------------------------------------

    Attachment: RamDirectory.diff

>  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> --------------------------------------------------------------------------------------
>
>          Key: LUCENE-475
>          URL: http://issues.apache.org/jira/browse/LUCENE-475
>      Project: Lucene - Java
>         Type: Improvement
>   Components: Store
>     Reporter: Volodymyr Bychkoviak
>  Attachments: RamDirectory.diff
>
> recently I found that  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> files from source index are read entirely intro memory as single byte array which is after all is thrown
away. And if I want to load my 200M optimized, compound format index to memory for faster search I should
give JVM at least 400Mb memory limit. For larger indexes this can be an issue.
> I've attached patch how to solve this problem.

--

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
(Continue reading)

Volodymyr Bychkoviak (JIRA | 1 Dec 13:04 2005
Picon

[jira] Commented: (LUCENE-475) RAMDirectory(Directory dir, boolean closeDir) constructor uses memory inefficiently.

    [ http://issues.apache.org/jira/browse/LUCENE-475?page=comments#action_12359036 ] 

Volodymyr Bychkoviak commented on LUCENE-475:
---------------------------------------------

Oh, I didn't described my solution...
Solution is simle: use 1k buffer to copy files from source  index to ram files

>  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> --------------------------------------------------------------------------------------
>
>          Key: LUCENE-475
>          URL: http://issues.apache.org/jira/browse/LUCENE-475
>      Project: Lucene - Java
>         Type: Improvement
>   Components: Store
>     Reporter: Volodymyr Bychkoviak
>  Attachments: RamDirectory.diff
>
> recently I found that  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> files from source index are read entirely intro memory as single byte array which is after all is thrown
away. And if I want to load my 200M optimized, compound format index to memory for faster search I should
give JVM at least 400Mb memory limit. For larger indexes this can be an issue.
> I've attached patch how to solve this problem.

--

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
(Continue reading)

Doug Cutting | 1 Dec 18:38 2005
Picon

Re: open source YourKit licence

Yonik Seeley wrote:
> a) do any other committers want a license, and

Why not just include all committer names?

> b) would we be willing to put their logo somewhere in exchange?

Perhaps we should reserve that until we find that Lucene has been 
significantly improved by YourKit.

Doug
Yonik Seeley | 1 Dec 18:47 2005
Picon

Re: open source YourKit licence

I'll propose that to them.

On 12/1/05, Doug Cutting <cutting <at> apache.org> wrote:
> Yonik Seeley wrote:
> > a) do any other committers want a license, and
>
> Why not just include all committer names?
>
> > b) would we be willing to put their logo somewhere in exchange?
>
> Perhaps we should reserve that until we find that Lucene has been
> significantly improved by YourKit.
>
> Doug

-Yonik
Now hiring -- http://forms.cnet.com/slink?231706
Hoss Man (JIRA | 1 Dec 19:37 2005
Picon

[jira] Commented: (LUCENE-475) RAMDirectory(Directory dir, boolean closeDir) constructor uses memory inefficiently.

    [ http://issues.apache.org/jira/browse/LUCENE-475?page=comments#action_12359068 ] 

Hoss Man commented on LUCENE-475:
---------------------------------

I'm no expert on File I/O, so i don't know if this is/isn't a good change to make, but i deplore constants:

If this patch is a good idea, then i'd like to suggest that instead of a static constant for the buffer size, a
new constructor arg be added specifying the buffer size, with the default (ie: no value, or "0" specified)
being to use the old behavior (ie: a buffer the same size as the file)

>  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> --------------------------------------------------------------------------------------
>
>          Key: LUCENE-475
>          URL: http://issues.apache.org/jira/browse/LUCENE-475
>      Project: Lucene - Java
>         Type: Improvement
>   Components: Store
>     Reporter: Volodymyr Bychkoviak
>  Attachments: RamDirectory.diff
>
> recently I found that  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> files from source index are read entirely intro memory as single byte array which is after all is thrown
away. And if I want to load my 200M optimized, compound format index to memory for faster search I should
give JVM at least 400Mb memory limit. For larger indexes this can be an issue.
> I've attached patch how to solve this problem.

--

-- 
This message is automatically generated by JIRA.
(Continue reading)

Bernhard Messer (JIRA | 1 Dec 22:37 2005
Picon

[jira] Commented: (LUCENE-475) RAMDirectory(Directory dir, boolean closeDir) constructor uses memory inefficiently.

    [ http://issues.apache.org/jira/browse/LUCENE-475?page=comments#action_12359083 ] 

Bernhard Messer commented on LUCENE-475:
----------------------------------------

I like the patch and find it very helpful if one tries to load larger indices into RAMDirectory.

Hoss Man,

why do you would like to have a new constructor to adjust the internal buffer size. I do not see any reason to
make the buffersize configurable from outside. The tests i made with different sizes didn't show any
difference on performace or disk usage. The new implementation would be similar to BufferedIndexOutput
where the internal buffer size couldn't be changed either. Do i miss something ?

>  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> --------------------------------------------------------------------------------------
>
>          Key: LUCENE-475
>          URL: http://issues.apache.org/jira/browse/LUCENE-475
>      Project: Lucene - Java
>         Type: Improvement
>   Components: Store
>     Reporter: Volodymyr Bychkoviak
>  Attachments: RamDirectory.diff
>
> recently I found that  RAMDirectory(Directory dir, boolean closeDir)  constructor uses memory inefficiently.
> files from source index are read entirely intro memory as single byte array which is after all is thrown
away. And if I want to load my 200M optimized, compound format index to memory for faster search I should
give JVM at least 400Mb memory limit. For larger indexes this can be an issue.
> I've attached patch how to solve this problem.
(Continue reading)

Erik Hatcher (JIRA | 1 Dec 22:52 2005
Picon

[jira] Resolved: (LUCENE-288) [patch] better support gcj compilation

     [ http://issues.apache.org/jira/browse/LUCENE-288?page=all ]

Erik Hatcher resolved LUCENE-288:
---------------------------------

    Resolution: Fixed
     Assign To:     (was: Lucene Developers)

applied with the recommended comments

> [patch] better support gcj compilation
> --------------------------------------
>
>          Key: LUCENE-288
>          URL: http://issues.apache.org/jira/browse/LUCENE-288
>      Project: Lucene - Java
>         Type: Bug
>   Components: Search
>     Versions: 1.4
>  Environment: Operating System: All
> Platform: Other
>     Reporter: Andi Vajda
>  Attachments: 15411.txt
>
> In order to workaround http://gcc.gnu.org/bugzilla/show_bug.cgi?id=15411 the
> attached patch is necessary.

--

-- 
This message is automatically generated by JIRA.
-
(Continue reading)

Erik Hatcher (JIRA | 1 Dec 22:52 2005
Picon

[jira] Closed: (LUCENE-288) [patch] better support gcj compilation

     [ http://issues.apache.org/jira/browse/LUCENE-288?page=all ]

Erik Hatcher closed LUCENE-288:
-------------------------------

> [patch] better support gcj compilation
> --------------------------------------
>
>          Key: LUCENE-288
>          URL: http://issues.apache.org/jira/browse/LUCENE-288
>      Project: Lucene - Java
>         Type: Bug
>   Components: Search
>     Versions: 1.4
>  Environment: Operating System: All
> Platform: Other
>     Reporter: Andi Vajda
>  Attachments: 15411.txt
>
> In order to workaround http://gcc.gnu.org/bugzilla/show_bug.cgi?id=15411 the
> attached patch is necessary.

--

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira
(Continue reading)


Gmane