Manoj | 4 May 21:07 2016
Picon

[MarkLogic Dev General] Need to copy more thatn 10k files in single transaction

Hi All,
   I need to copy more than 10k files from one directory to another after updating certain parts of the files in a single transaction(with ability to rollback in case of any failure). What is the best way to do it.
When I was trying for larger set of file using xdmp:invoke with isolation as 'same-statement' I faced timeouts in marklogic


Thanks & Regards
Manoj
<div><div dir="ltr">Hi All,<div>&nbsp; &nbsp;I need to copy more than 10k files from one directory to another after updating certain parts of the files in a single transaction(with ability to rollback in case of any failure). What is the best way to do it.</div>
<div>When I was trying for larger set of file using xdmp:invoke with isolation as 'same-statement' I faced timeouts in marklogic</div>
<div><br></div>
<div><br></div>
<div>Thanks &amp; Regards<br>
</div>
<div>Manoj</div>
</div></div>
Vinod Kumar Tiwari | 2 May 08:35 2016
Picon

[MarkLogic Dev General] ML 7.0 time limit exceed Issue

Hello,

I am facing one issue regarding time limit exceed while execute xdmp:lock-for-update. How to fix this?



Regards
<div><div dir="ltr">
<div>Hello,</div>
<div><br></div>
<div>I am facing one issue regarding time limit exceed while execute xdmp:lock-for-update. How to fix this?</div>
<div><br></div>
<div><br></div>
<div><br></div>
<div>Regards</div>
</div></div>
judie pearline | 2 May 07:52 2016
Picon

[MarkLogic Dev General] Copy to clipboard Option

Hi All,

Is there any option/API in Marklogic that supports "Copy to clipboard" option. Or an indirect way to achieve it?.

Any help or suggestions would be helpful.  

Regards,
Judy
<div><div>
<div>Hi All,</div>
<div><br></div>
<div dir="ltr">Is there any option/API in Marklogic that supports "Copy to clipboard" option. Or an indirect way to achieve it?.</div>
<div dir="ltr"><br></div>
<div dir="ltr">Any help or suggestions would be helpful. &nbsp;</div>
<div><br></div>
<div>Regards,</div>
<div>Judy</div>
</div></div>
Tim | 1 May 23:11 2016
Picon

[MarkLogic Dev General] What is the best practice for obtaining document content from the results of a search:search query in MarkLogic 7?

I see that MarkLogic 8 contains the extract-document-data option, but this
is not available in MarkLogic 7.  I simply want to extract content from the
document specified in the path attribute for each match result. What is the
best practice for doing so?

Thank you!

Tim Meagher

Andreas Hubmer | 28 Apr 18:14 2016

[MarkLogic Dev General] Memory consumption / range indexes

Hello,

I have the problem that some MarkLogic servers (ML8 on Windows) use more memory, the longer they run. Every day a few percent of memory are consumed additionally. Eventually all memory is used and the servers becomes slower. After a restart they are pretty fast again.
My first guess was that the caches are too large and eventually get swapped. So I reduced the cache sizes but this did not help.

The application has quite a lot of range indexes, so maybe this is a reason. As they are implemented with memory mapped files, they are maybe not reported correctly by the Windows task manager.
So I would like to find out how much memory the range indexes of the database consume. 
Ideally I would like to know the number of bytes for each index. Second best I would like to have a total to see the difference after adding/removing a range index.
Is that possible?

Does <memory-size> of xdmp:forest-status() return the sizes of a forest's range indexes (per stand)? Or does it include other memory as well?
Does the list include in-memory-stands?

I am not sure what is consuming the memory and why the consumption rises day by day.
Maybe you can answer at least some of my questions!

Thanks,
Andreas



--
Andreas Hubmer
Senior IT Consultant

EBCONT enterprise technologies GmbH 
Millennium Tower
Handelskai 94-96
A-1200 Vienna

OUR TEAM IS YOUR SUCCESS

UID-Nr. ATU68135644
HG St.Pölten - FN 399978 d
<div><div dir="ltr">Hello,<div><br></div>
<div>I have the problem that some MarkLogic servers (ML8 on Windows) use more memory, the longer they run. Every day a few percent of memory are consumed additionally. Eventually all memory is used and the servers becomes slower. After a restart they are pretty fast again.</div>
<div>My first guess was that the caches are too large and eventually get swapped. So I reduced the cache sizes but this did not help.</div>
<div><br></div>
<div>The application has quite a lot of range indexes, so maybe this is a reason. As they are implemented with memory mapped files, they are maybe not reported correctly by the Windows task manager.</div>
<div>So I would like to find out how much memory the range indexes of the database consume.&nbsp;<br>
</div>
<div>Ideally I would like to know the number of bytes for each index. Second best I would like to have a total to see the difference after adding/removing a range index.</div>
<div>Is that possible?</div>
<div><br></div>
<div>Does &lt;memory-size&gt; of xdmp:forest-status() return the sizes of a forest's range indexes (per stand)? Or does it include other memory as well?</div>
<div>Does the list include in-memory-stands?</div>
<div><br></div>
<div>I am not sure what is consuming the memory and why the consumption rises day by day.</div>
<div>Maybe you can answer at least some of my questions!</div>
<div><br></div>
<div>Thanks,</div>
<div>Andreas</div>
<div><br></div>
<div>
<br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">
<div dir="ltr">
<span>Andreas Hubmer</span><br>
</div>
<div>Senior IT Consultant</div>
<div dir="ltr"><br></div>
<div dir="ltr">EBCONT enterprise technologies GmbH&nbsp;</div>
<div dir="ltr">Millennium Tower</div>
<div dir="ltr">Handelskai 94-96</div>
<div dir="ltr">A-1200 Vienna</div>
<div dir="ltr"><br></div>
<div dir="ltr">OUR TEAM IS YOUR SUCCESS</div>
<div dir="ltr"><br></div>
<div dir="ltr">UID-Nr. ATU68135644</div>
<div dir="ltr">HG St.P&ouml;lten - FN 399978 d</div>
</div></div></div></div></div>
</div>
</div></div>
Manoj | 27 Apr 23:33 2016
Picon

[MarkLogic Dev General] XQSync property USE_MULTI_STMT_TXN

Hi All,
   I want to understand the usage of the property "USE_MULTI_STMT_TXN" in XQSync. If this property is set to true will xqsync rollback the documents it copied in case of any failures it encounters?

Thanks & Regards
Manoj
<div><div dir="ltr">
<div class="gmail_extra">Hi All,</div>
<div class="gmail_extra">&nbsp; &nbsp;I want to understand the usage of the property "<span>USE_MULTI_STMT_TXN" in XQSync. If this property is set to true will xqsync rollback the documents it copied in case of any failures it encounters?</span>
</div>
<div class="gmail_extra"><br></div>
<div class="gmail_extra">Thanks &amp; Regards</div>
<div class="gmail_extra">Manoj</div>
</div></div>
Kapoor, Pragya | 27 Apr 11:00 2016

[MarkLogic Dev General] start and end time xquery

Hi,


I need to find out the start and end time of the function executed in xquery.


For example when I click on the link find Collections( this is an xquery in which html is also embedded), this calls another xqy file on which the code for finding new collections is written.


Now, I need to find the start and end time for this function.

For this, I tried using fn:current-dateTime() at the start and end of this function and saving these values in an xml which is in turn stored in db.


But since it is a single transaction, both start and end time is same.


I think, for finding endTime we can use xdmp:elapsed-time and add that to  fn:current-dateTime(). but how to add time to dateTime, to get again the dateTime format?


Some other approach is also welcomed.


Thanks

Pragya


"This e-mail and any attachments transmitted with it are for the sole use of the intended recipient(s) and may contain confidential , proprietary or privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this e-mail or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful."
<div>
<div>
<p><span></span></p>
<p>Hi,</p>
<p><br></p>
<p>I need to find out the start and end time of the function executed in xquery.</p>
<p><br></p>
<p>For example when I click on the link find Collections( this is an xquery in which&nbsp;html is also embedded), this calls another xqy file on which the code for finding new collections
 is written.</p>
<p><br></p>
<p>Now, I need to find the start and end time for this function.</p>
<p>For this, I tried using fn:current-dateTime() at the start&nbsp;and end of this function and saving&nbsp;these values in an xml which is in&nbsp;turn stored&nbsp;in db.</p>
<p><br></p>
<p>But since it is a single transaction, both start and end time is same.</p>
<p><br></p>
<p>I think, for finding endTime&nbsp;we can use xdmp:elapsed-time and add that to&nbsp;<span>&nbsp;</span><span>fn:current-dateTime().
 but how to add time to dateTime, to get again the dateTime format?</span></p>
<p><span><br></span></p>
<p><span>Some other
 approach is also welcomed.</span></p>
<p><span><br></span></p>
<p><span>Thanks</span></p>
<p><span>Pragya</span></p>
<span></span><br><p></p>
</div>
"This e-mail and any attachments transmitted with it are for the sole use of the intended recipient(s) and may contain confidential , proprietary or privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and
 destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this e-mail or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful."
</div>
Kapoor, Pragya | 27 Apr 10:23 2016

[MarkLogic Dev General] Start & end Time


Hi,


I need to find out the start and end time of the function executed in xquery.


For example when I click on the link find Collections( this is an xquery in which html is also embedded), this calls another xqy file on which the code for finding new collections is written.


Now, I need to find the start and end time for this function.

For this, I tried using fn:current-dateTime() at the start and end of this function and saving these values in an xml which is in turn stored in db.


But since it is a single transaction, both start and end time is same.


I think, for finding endTime we can use xdmp:elapsed-time and add that to  fn:current-dateTime(). but how to add time to dateTime, to get again the dateTime format?


Some other approach is also welcomed.


Thanks

Pragya

"This e-mail and any attachments transmitted with it are for the sole use of the intended recipient(s) and may contain confidential , proprietary or privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this e-mail or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful."
<div>
<div>
<p><br></p>
<p>Hi,</p>
<p><br></p>
<p>I need to find out the start and end time of the function executed in xquery.</p>
<p><br></p>
<p>For example when I click on the link find Collections( this is an xquery in which&nbsp;html is also embedded), this calls another xqy file on which the code for finding new collections is written.</p>
<p><br></p>
<p>Now, I need to find the start and end time for this function.</p>
<p>For this, I tried using fn:current-dateTime() at the start&nbsp;and end of this function and saving&nbsp;these values in an xml which is in&nbsp;turn stored&nbsp;in db.</p>
<p><br></p>
<p>But since it is a single transaction, both start and end time is same.</p>
<p><br></p>
<p>I think, for finding endTime&nbsp;we can use xdmp:elapsed-time and add that to&nbsp;<span>&nbsp;</span><span>fn:current-dateTime().
 but how to add time to dateTime, to get again the dateTime format?</span></p>
<p><span><br></span></p>
<p><span>Some other approach is also welcomed.</span></p>
<p><span><br></span></p>
<p><span>Thanks</span></p>
<p><span>Pragya</span></p>
</div>
"This e-mail and any attachments transmitted with it are for the sole use of the intended recipient(s) and may contain confidential , proprietary or privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and
 destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this e-mail or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful."
</div>
Ankit Bhardwaj | 26 Apr 11:39 2016

[MarkLogic Dev General] Sort cts:search results by cts:score without using expicit loop

Hi,

I want to get results of cts:search data sorted on the basis of cts:score. I am using following code -

(
        if ($direction = "descending")
        then
            for $result in cts:search (...)
            order by cts:score($result) descending
            return $result/element()
        else
            for $result in cts:search (...)
            order by cts:score($result) ascending
            return $result/element()
    )[$first-result to $last-result]
Is there any way out of getting results from cts:search in a sorted manner itself?

The problem with the current code is that in the case of large data set it gives XDMP-EXPNTREECACHEFULL
error. Increasing the size of Expanded Tree Cache is not an option. So I need to do something in this part
only. Any suggestions around this?

Thanks,
Ankit Bhardwaj
Will Thompson | 26 Apr 00:53 2016

[MarkLogic Dev General] Field weight rules for child with excluded parent

The documentation on fields states "If a field has two or more elements with different weights and, if one of
those elements is a child of another element, then the weight of the parent element is used and the weight of
the child element is ignored." But it's not clear what happens when an ancestor and descendant have
weights and the direct parent of the descendant is excluded. For example, say I have a document:

<X>
  <A>
    <B>
      <C>

Document root is excluded, <A> is included with weight=1, <B> is excluded, and <C> is included with
weight=2. Will a field match for a term in <C> be weighted with 1 or with 2? Is it possible to check how indexed
weights contribute to scores to confirm that a configuration like this is working as intended?

-Will
Gene Thomas | 25 Apr 23:24 2016
Picon
Picon

[MarkLogic Dev General] Automate clearing expanded tree cache

Hi,

 

I have been requested to automate clearing the expanded tree cache on each server in a cluster following a roxy deployment.

 

Currently we use QConsole on each server and run xdmp:expanded-tree-cache-clear().

Is there a way to use the admin:group-hosts() function to retrieve the list of hosts and then execute the query for each host?

 

Gene Thomas

 

<div><div class="WordSection1">
<p class="MsoNormal">Hi,<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal">I have been requested to automate clearing the expanded tree cache on each server in a cluster following a roxy deployment.<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal">Currently we use QConsole on each server and run xdmp:expanded-tree-cache-clear().<p></p></p>
<p class="MsoNormal">Is there a way to use the admin:group-hosts() function to retrieve the list of hosts and then execute the query for each host?<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal">Gene Thomas<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
</div></div>

Gmane