Alan Orth | 29 May 10:20 2015
Picon

How to back up Solr data?

I currently back up PostgreSQL and assetstore data via nightly snapshots and syncing offsite (S3, whatever), but as far as I know there's no way to atomically snapshot DSpace's Solr; ie, during the time it takes to `cp` my 8GB of Solr data, the data has changed, so the backup is not atomic and likely inconsistent. I can shut down Tomcat of course, but... that seems a bit excessive.

Upstream Solr has some discussion of backing up from read-only slaves[0], but I wanted to know if anyone had a solution for this. We're using DSpace 4.3.

Cheers,

[0] https://cwiki.apache.org/confluence/display/solr/Backing+Up

--
Alan Orth
alan.orth-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
https://alaninkenya.org
https://mjanja.ch
"In heaven all the interesting people are missing." -Friedrich Nietzsche
GPG public key ID: 0x8cb0d0acb5cd81ec209c6cdfbd1a0e09c2f836c0
------------------------------------------------------------------------------
------------------------------------------------------------------------------
Code 2 dogears | 29 May 08:53 2015
Picon

about handles/purl

Hello everyone. I have installed dspace in my organistaion. Here
dspace will be used only by organisation members. So is it necessary
to install handle server (or register for handle service) or use purl?
Can't I just use dspace without installing  them. I am new to dspace.
Please reply soon.

------------------------------------------------------------------------------
Fitchett, Deborah | 29 May 06:26 2015
Picon
Picon

XOAI and filters based on access permissions

Hi there,

 

We’re on DSpace 3.1 and have just switched over to XMLUI. All we know about DSpace we learned from a 2-day workshop and from working through this XLMUI switch, so please bear with us!

 

Currently we have our XOAI feed set up such that it effectively excludes items from two collections:

·          “Restricted thesis” collection – theses accessible to our own staff and students only. Items have anonymous READ access, but bitstreams are restricted

·         “Symplectic” collection – intended as a dark archive of copyrighted material kept for internal purposes. Items and bitstreams are all access-restricted.

 

Firstly, we’ve noticed that while this excludes the items from ListIdentifiers and from ListRecords, the metadata for the “Symplectic” collection is still returned in a GetRecord request if you know the handle. (It isn’t returned in the “Restricted thesis” collection.) This is unexpected and very undesirable for us. Can anyone explain it and/or suggest a way to ensure this doesn’t happen?

 

 

Secondly, we’d like to move to a situation where:

·          “Restricted thesis” collection is included  (at least in one OAI context – this is so we can harvest it into our library’s discovery layer Primo)

·         “Symplectic” collection remains excluded from OAI

 

Our current settings:

1.       We have dspace.cfg to: harvest.include.restricted.oai = false
We understood this to mean that only items with anon READ would be exposed to OAI, however it’s since been suggested that this has nothing to do with XOAI, and indeed our experience showed no result to switching this between true and false.

2.       We also have <Filter refid=”bitstreamaccessFilter” /> on our OAI context

 

(Before I continue, whenever we make a change in dspace.cfg or xoai.xml and related files we are then stopping/restarting dspace and then running the “dspace oai import -cv” job. If this isn’t sufficient to pick up our changes and refresh the cache and we should be doing something else, or doing things in a different order, please let us know, as this may explain everything!)

 

After some changing settings back and forth in our Dev environment we’ve managed to get a situation precisely opposite to what we want, but not in a way that’s very enlightening, and also with no idea how we got there as our settings are now the same as when we started but our results aren’t. Here is a chart I’ve entitled “OAI matrix of woes”:

 

Context

Verb

# Items in:
All

# Items in:
Restricted theses

(items have anon READ; bundles/bitstreams are restricted)

# Items in:
Symplectic
(items and bundles/bitstreams are restricted)

request
(bitstreamaccessFilter)

ListIdentifiers

3705

1888

105

ListRecords

1863

8

105

GetRecord

returns record

returns record if bundle TEXT anon READ (and other bundles/bitstreams restricted); otherwise does not exist

does not exist

custom
(no filter)

ListIdentifiers

5712

1888

106

ListRecords

5712

1888

105

GetRecord

returns record

returns record

returns record

 

How can we:

·         (As in our first question) Make ListIdentifiers, ListRecords, and GetRecord all behave the same in terms of access?

·         Include items in the feed where the item has anonymous READ, even if some or all of the bundles and bitstreams are restricted?

·         While excluding items where the item is restricted?

 

Thanks very much for any clues!

 

Nāku noa, nā

 

Deborah Fitchett

Senior Advisor, Digital Access

Library, Teaching and Learning

 

p +64 3 423 0358

e deborah.fitchett <at> lincoln.ac.nz | w library.lincoln.ac.nz

 

Lincoln University, Te Whare Wānaka o Aoraki

New Zealand's specialist land-based university

 


P Please consider the environment before you print this email.
"The contents of this e-mail (including any attachments) may be confidential and/or subject to copyright. Any unauthorised use, distribution, or copying of the contents is expressly prohibited. If you have received this e-mail in error, please advise the sender by return e-mail or telephone and then delete this e-mail together with all attachments from your system."
------------------------------------------------------------------------------
------------------------------------------------------------------------------
Borda, Susan | 28 May 23:35 2015

Mirage2 customization

Hi-
This afternoon I modified the default colors in Mirage2 _bootstrap_variables.scss (in tomcat/webapps/xmlui/themes/Mirage2/styles/classic_mirage_color_scheme/) followed by mvn package  from  [dspace-src]. I also restarted tomcat.

My color changes aren’t showing, do I need to do a mvn package –Dmirage2.on=true? I was able to change the logo just fine (but that doesn’t require a rebuild)

Any advice would be great.

Thanks,
susan
— 
Susan Borda
Digital Technologies Development Librarian
Montana State University Library
406-994-1873


------------------------------------------------------------------------------
------------------------------------------------------------------------------
Murray, Gregory | 28 May 23:29 2015

Getting started with UI customization: sitemap file not found

Hello,

I am new to DSpace and trying to get started with UI customization. I'm comfortable at the Unix/Linux
command line, but I'm not a system administrator. I'm working with a source (not binary) installation of
DSpace 5.1 on Ubuntu. I'm following the "Manakin theme tutorial" here:

	https://wiki.duraspace.org/display/DSPACE/Manakin+theme+tutorial

I'm finding that I can edit /dspace/config/xmlui.xconf to indicate any of the pre-installed themes
(Mirage, Reference, Classic, Kubrick, template), restart Tomcat, and the new theme gets applied
successfully. But if I indicate a theme in a directory I've made, Tomcat returns an error message (details
below). For example, if I copy the "template" directory and call it "test" like so:

	cd /dspace/webapps/xmlui/themes
	cp -r template test

and then edit /dspace/config/xmlui.xconf to indicate the "test" theme like so:

	<theme name="test" regex=".*" path="test/" />

then when I restart Tomcat it returns this error:

	java.io.FileNotFoundException: jndi:/localhost/xmlui/themes/test/sitemap.xmap

I don't see how it can be a permissions problem, because both the "template" and "test" directories have the
same owner and permissions, and the files in those directories have the same owner and permissions. That
is, the directories appear to be identical except for the name. Any ideas as to why setting the config to this:

	<theme name="template" regex=".*" path="template/" />

works just fine, whereas this:

	<theme name="test" regex=".*" path="test/" />

fails?

Thanks,
Greg

PS. For the newbie, it's not clear whether the changes described in the tutorial should happen in the source
directory at ~/dspace-5.1-src-release/dspace-xmlui/src/main/webapp/themes -- or in
/dspace/webapps/xmlui/themes -- or both. The tutorial indicates the source directory, but it refers to
DSpace 1.5, so that's not necessarily accurate. Based on the error message described above -- which says
".../xmlui/themes/..." -- apparently UI customizations are supposed to be made in
/dspace/webapps/xmlui/themes. So the tutorial needs to be updated, right?

------------------------------------------------------------------------------
Maatari | 28 May 21:43 2015
Picon

Integration Tests in dspace

Hi, 

Does anyone an example of integration test ? 

In particular  how would you do to programmatically submit an item and and
see how your consumer react to it, or more generally ensure that a service
handle it properly. 

Best,

Maatari

--
View this message in context: http://dspace.2283337.n4.nabble.com/Integration-Tests-in-dspace-tp4678105.html
Sent from the DSpace - Tech mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Layale Bassil | 28 May 15:56 2015

Exception when trying to add a new submission to DSpace 4.2

Hello,

 

I create a new submission and approve it and when I click on Add to Archive I get the following exception:

 

java.lang.RumeException Error while attempting to create identifier for Item id…

 

Any idea of how to fix it? Is is a bug in the installation we did?

 

Thanks.

------------------------------------------------------------------------------
------------------------------------------------------------------------------
alastair.duncan | 28 May 15:37 2015
Picon

Re: DSpace-cris

Sending again as I was not registered on the mailing list :-O

 

Alastair

 

From: Duncan, Alastair (STFC,RAL,SC)
Sent: 28 May 2015 09:54
To: 'Andrea Bollini'
Cc: 'dspace-tech'
Subject: RE: DSpace-cris

 

Hi Andrea,

 

Sorry this is an installation behind a firewall, I’m looking at it to see if it is suitable for our needs.

 

The listTabs.htm causes a document not found error to be displayed in the browser with nothing in the log files :

 

Error: Document Not Found

 

The createTabs.htm causes an InternalSystemError to be displayed in the browser with this exception in the log files snipped to show the cause :

 

Caused by: java.lang.IllegalArgumentException: id to load is required for loading

                at org.hibernate.event.spi.LoadEvent.<init>(LoadEvent.java:87)

                at org.hibernate.event.spi.LoadEvent.<init>(LoadEvent.java:59)

                at org.hibernate.internal.SessionImpl$IdentifierLoadAccessImpl.load(SessionImpl.java:2421)

                at org.hibernate.internal.SessionImpl.get(SessionImpl.java:974)

                at it.cilea.osd.common.dao.impl.GenericDaoHibernateImpl.read(GenericDaoHibernateImpl.java:85)

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:606)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at it.cilea.osd.common.dao.impl.NamedQueryIntroductionAdvisor$1.invoke(NamedQueryIntroductionAdvisor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)

                at com.sun.proxy.$Proxy234.read(Unknown Source)

                at it.cilea.osd.common.service.PersistenceService.get(PersistenceService.java:163)

                at it.cilea.osd.common.service.PersistenceService$$FastClassByCGLIB$$b40d0435.invoke(<generated>)

                at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191)

                at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:110)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)

                at org.dspace.app.cris.service.ApplicationService$$EnhancerByCGLIB$$63de70c9.get(<generated>)

                at org.dspace.app.webui.cris.controller.DynamicObjectDetailsController.extractDynamicObject(DynamicObjectDetailsController.java:238)

                at org.dspace.app.webui.cris.controller.DynamicObjectDetailsController.handleDetails(DynamicObjectDetailsController.java:79)

                at it.cilea.osd.jdyna.web.controller.SimpleDynaController.handleRequestInternal(SimpleDynaController.java:116)

                at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)

                at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)

                at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)

                at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)

                at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)

                ... 33 more

 

Alastair

 

From: Andrea Bollini [mailto:a.bollini <at> cineca.it]
Sent: 28 May 2015 08:46
To: Duncan, Alastair (STFC,RAL,SC)
Subject: Re: DSpace-cris

 

Hi Alastair,
as we want to keep DSpace-CRIS as close as possible to the mainstream DSpace community we have decided to not setup a dedicated mailing list.
To get support you can write directly to the dspace-tech mailing list (dspace-tech <dspace-tech <at> lists.sourceforge.net>), put dspace-cris somewhere in the subject is enough to get folks from Cineca or other users of DSpace-CRIS aware of your request.

The issue that you report is something new, we have never seen this kind of problem and it looks really strange to me that a .jsp page is directly accessed.

The url of the admin pages are
<dspace-cris-url>/cris/administrator/rp/listTabs.htm
<dspace-cris-url>/cris/administrator/rp/createTabs.htm

Is your installation publicly accessible? feel free to include dspace-tech in cc in your reply.

Andrea

Il 27/05/2015 17.42, alastair.duncan-mr7rJwJf9L21Qrn1Bg8BZw@public.gmane.org ha scritto:

Hi Andrea,

 

I hope you don’t mind me contacting you directly but I’ve not found a forum where I can post my query.

 

I’m interested in the DSpace cris that you have created and I have installed it using the instructions on the github website. It is up and running but I have a problem accessing some of the administration pages. I can access

 

/jspui/cris/administrator/rp/index.htm

 

but when I try and access the link “Layout configuration (Public view)” I get “Error: Document Not Found” I’ve tried this on different versions 4.1.0, 4.2.0, 4.3.0 and 5.2.0 with the same results. I suspect something is configured incorrectly but I can’t see what it is. I have also tried running the base-configuration-crismodule.sql script which seems to load the default values into the database but I still can’t get to the admin pages. Looking with chrome developer tools I can see the failing url:

 

/jspui/dspace-cris//tabs/tabList.jsp

 

If I remove the extra / then I can get to the page ok but if I click on the “Create new tab” link then I get an internal server error which shows as an array out of bounds exception in the server logs.

 

Any help would be appreciated.

 

Regards

 

Alastair



--

Andrea Bollini

Soluzioni per la Ricerca Istituzionale

Cineca

 

Via dei Tizii, 6

00185 Roma, Italy

tel. +39 06 44 486 087 - mob. +39 348 82 77 525

http://www.cineca.it

------------------------------------------------------------------------------
------------------------------------------------------------------------------
Hilton Gibson | 28 May 14:05 2015
Picon

DSpace XMLUI theme customisation help wiki

Hi All

I have greatly updated the wiki pages for DSpace XMLUI theme customisation.
See links below.

You are welcome to use the instructions.
The instructions are targeted at those who have basic web 2.0 design skills.

Cheers

Hilton Gibson
Ubuntu Linux Systems Administrator
Stellenbosch University Library

------------------------------------------------------------------------------
------------------------------------------------------------------------------
Vladimir Tomić | 28 May 13:52 2015

Show all items in a collection (but not in communities) by default

Hi,

We're using DSpace 4, with XMLUI.

We've had a request from our client to hide recent submissions from 
repository, community and collection pages. Now, the collection page 
looks empty and we wanted to show all items in a collection, like the 
page that is rendered when user clicks on "Browse -> This Collection -> 
Titles".

We changed 
"/xmlui/themes/OurTheme/lib/xsl/aspect/artifactbrowser/collection-list.xsl", 
the following part, which appears twice:
<a href="{ <at> OBJID}">

to this:
<a href="{ <at> OBJID}/browse?type=title">

Now, when a user is browsing through the repository, when they click on 
a collection in a list on a community page, they get a collection's 
"browse by title".

The thing we're having trouble customizing is the trail (breadcrumbs). 
When rendering the trail, we would like for a trail collection element's 
hyperlink to have the same appendix - "/browse?type=title".

Is there a way to check whether a trail element is a collection, and 
then alter it's  <at> target? Or maybe there's a more elegant way to show all 
of collection's items?

Thank you in advance!

Kind regards,
Vladimir

Attachment (smime.p7s): application/pkcs7-signature, 4440 bytes
------------------------------------------------------------------------------
------------------------------------------------------------------------------
Rajat Gupta | 28 May 11:10 2015

Translation of Item Submission forms.

Hello Friends,

We are currently translating a dspace instance of Dspace 5.x and have translated most of the content in the message.properties file. We converted English to Arabic using Google and then converted the Arabic to Unicode text using a unicode converter. 

Although we converted the whole message.properties file the Item submission form does not seem to show any changes. We found that we have to translate the input forms.xml file. 

My questions are  

1. whether by translating input forms.xml site our problem will be solved (the input submission forms will come in arabic?)

2. Can I use the Item submissions forms in both English and Arabic language?

Thanks in advance. 

Regards,

Rajat Gupta
------------------------------------------------------------------------------
------------------------------------------------------------------------------

Gmane