edgar.soldin | 4 Feb 12:31 2016
Picon

Re: WebDAV SSL certificate verify failed

On 04.02.2016 12:14, Richard McGraw wrote:
> On Thu, 4 Feb 2016 11:56:06 +0100
> edgar.soldin <at> web.de wrote:
> 
>>>
>>> Here is -v9 output.
>>> It does not say much.
>>>   
>>
>> right it doesn't ;(.. anyway.. please try the cacert.pem attached.
>> that one works for me. best if you define it explicitly in the
>> command line.
>>
>> .. ede
> 
> Thanks.
> It works here too with --ssl-cacert-file=thisfile !
> 
> All I know is that a certificate for *.webdav.hidrive.strato.com is
> issued by a 'thawte SSL CA - G2' certificate which is issued by
> 'thawte Primary Root CA'.
> 

ok, we narrowed it down to your new cacert.pem obviously. do you want to investigate furtehr?

..ede/duply.net

PS: jfyi, just now i am working on adding support for default system certs, as implemented in python 2.7.9+
wton1@gmx.de | 2 Feb 21:18 2016
Picon
Picon

webdavs and large sync volume failing

Hi,

I am trying to use Duplicity and duply to backup appr 60GB data to webdavs storage.

The script is running on a raspberrypi with raspbian jessie

Small backups are working.
I have tried to run this backup in one go, it failed; I then split into 15GB chunks it failed again with exit
code 137

Any ideas what to do / where to look for?
Is the webdavs access not stable enough for such backup?
Is it maybe a performance issue with the raspberry

btw I started the backup script via a cron job, it was then running several hours before it failed.

Thanks for help.

copy from the output:

Start duply v1.9.1, time is 2016-02-01 21:06:02.
Using profile '/etc/duply/photo'.
Using installed duplicity version 0.6.24, python 2.7.9, gpg 1.4.18 (Home: ~/.gnupg), awk 'mawk 1.3.3 Nov
1996, Copyright (C) Michael D. Brennan', bash '4.3.30(1)-release (arm-unknown-linux-gnueabihf)'.
Autoset found secret key of first GPG_KEY entry ‚xxx' for signing.
Checking TEMP_DIR '/home/backup/tmp' is a folder (OK)
Checking TEMP_DIR '/home/backup/tmp' is writable (OK)
TODO: reimplent tmp space check
Test - Encrypt to ‚xxx' & Sign with ‚xxx' (OK)
Test - Decrypt (OK)
(Continue reading)

Rohit Shriwas | 2 Feb 06:52 2016
Picon

Where do files go when using the PyDrive backend?

Hey everybody,

So I just got started with Duplicity and tried the PyDrive backend for
remote storage. I created a project and made a service account as
mentioned in the man page and proceeded to take a backup. Everything
worked well and now I'm able to take incremental backups and list
existing files on the remote storage.

BUT.. I'm unable to see anything in my Google drive or anything under
Google's developer console options. Where do these files go and how do I
check how much quota is remaining in there?

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
Grant | 30 Jan 20:50 2016
Picon

Running out of disk space -- new full backup?

One of the systems I send my backups to is running out of space.  Is
the solution to delete all of the backups and run a new full backup?

- Grant
Richard McGraw | 28 Jan 11:35 2016
Picon
Gravatar

WebDAV SSL certificate verify failed

Hello,

At least a week ago, I started to get this error with a certain webdav
provider:

BackendException: SSL failed: [Errno 1] _ssl.c:510: error:14090086:SSL
routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed

With --ssl-no-check-certificate, this error does not occur.

The service is free-hidrive, the URL is like
webdavs://USER.webdav.hidrive.strato.com/users/USER/etc

I tried the --ssl-cacert-file option with a file containing (if I'm not
mistaken) the chain of issuers and the certificate
for *.webdav.hidrive.strato.com, but I got the same error.

Any ideas ?
Andreas Doll | 27 Jan 20:53 2016
Picon

Verification of filelists, multiprocessing

Hello

If I run

$ duplicity --encrypt-sign-key 123ABC12 /path/to/dir file://backup1

and then

$ duplicity verify file://backup1 /path/to/dir

everything works fine.
However, my setup is as follows: I run

$ duplicity --encrypt-sign-key 123ABC12 --include-globbing-filelist list.txt / file://backup2

with list.txt consisting of directories as well as files:

/path/to/dir
+ /usr/another/dir
+ /etc/foo/file
+ /etc/bar/another/file
- **

Sorry if I don't grok the manpage, but how can I verify file://backup2 using
the filelist list.txt?

Moreover: Judging from the manpage I assume it is not possible to use multiple
CPU cores to speedup de/encryption?

Thanks, 
(Continue reading)

Ezra Stevens | 20 Jan 00:46 2016

Restore has trouble with multiple encryption keys

Hi folks,

I'd like to be able to rotate my encryption keys occasionally when
using Duplicity (between backup chains only, not in the middle of a
chain). This works fine when I restore to the same machine I backed up
from, but not for restores to a different machine. Specifically, the
restore will fail repeatedly as it tries to synchronize the cache,
because it keeps trying to sync files that it can't decrypt with the
key it's been given. But if I give it different keys enough times, it
will eventually sync the whole cache and then be able to restore
properly (see shell transcript below). Is this a bug, or is what I'm
trying to do completely unsupported? Is there a way to convince
Duplicity to only sync the cache files for the chain it's actually
trying to restore? Should Duplicity print a warning when a user tries
to use different encryption keys within the same bucket?

Thanks,
Ezra Stevens

---

q <at> cowtown 13:52:02 ~$ duplicity --version
duplicity 0.7.06

# Back up an arbitrary directory with passphrase "alpha"
q <at> cowtown 14:23:11 ~$ PASSPHRASE=alpha duplicity full /home/q/tmp
sftp://q <at> localhost//home/q/duplicity-dest/
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: none
--------------[ Backup Statistics ]--------------
(Continue reading)

Roman Yepishev | 14 Jan 03:09 2016
Gravatar

RFC: MediaFire backend

Hi all,

I would like to submit my MediaFire duplicity backend for review and
comments. Please note that I am not affiliated with MediaFire and got
involved with backend development just because I thought "why not?"[0].

Branch: lp:~rye/duplicity/mediafire
File: http://bazaar.launchpad.net/~rye/duplicity/mediafire/view/head:/d
uplicity/backends/mediafirebackend.py

MediaFire is an online storage and collaboration company. Current
offering includes free plan that starts with 10GB, and a Pro plan which
offers 1TB of space for $4.99/mo (or $3.79/mo if billed annually).

This backend uses mediafire[1] library also developed by me
(GitHub[2]), so all of the upload complexity is hidden.

The code depends on the environment variables - MEDIAFIRE_EMAIL and
MEDIAFIRE_PASSWORD. Currently the service does not provide a reliable
way of supplying pre-authenticated tokens.

Not all of the uploads complete successfully - the server side may fail
to respond or the upload may fail for an unspecified reason. The client
attempts to retry failed uploads, as well as using the  <at> retry decorator
from duplicity itself.

The client also can produce pretty verbose logs of the HTTP session, so
the backend attempts to configure the logging according to duplicity
log level. Unfortunately, I found no way to re-use the handler from
duplicity itself, so the log output will go to stderr. This may be an
(Continue reading)

wighawag | 8 Jan 13:15 2016
Picon

Re: Questions

Hi,

(sorry for the potential double post)

New to duplicity and this looks like a cool project. I am planning to use it for backing up to blackblaze b2 storage which duplicity now support.

I have 3 questions :

- Does duplicity do global deduplication like zbackup (http://zbackup.org/) ? 
(in that case changing filename, moving... does not affect deduplication)

- Does duplicity ever change or delete files  on the repo or does it only append like zbackup does ? zbackup list it as a feature : "Repository consists of immutable files. No existing files are ever modified"

- In case of b2 support (or other dumb remote) how much transfer is performed ?
I suppose duplicity need to download the full archive in order to perform its deduplication logic, or can it be smarter ?

Thanks

On Fri, Jan 8, 2016 at 10:37 AM, wighawag <wighawag <at> gmail.com> wrote:
Hi,

New to duplicity and this looks like a cool project. I am planning to use it for backing up to blackblaze b2 storage which duplicity now support.

I have 3 questions :

- Does duplicity do global deduplication like zbackup (http://zbackup.org/) ? 
(in that case changing filename, moving... does not affect deduplication)

- Does duplicity ever change or delete files  on the repo or does it only append like zbackup does ? zbackup list it as a feature : "Repository consists of immutable files. No existing files are ever modified"

- In case of b2 support (or other dumb remote) how much transfer is performed ?
I suppose duplicity need to download the full archive in order to perform its deduplication logic, or can it be smarter ?

Thanks






_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
Kenneth Loafman | 7 Jan 13:59 2016
Gravatar

Daily PPA Builds

Hi,

It seems as though the PPA builds on Launchpad are a bit unstable at the moment.  I've finally retried the builds such that all of todays builds completed successfully.

I am not sure what is happening, but it's not in duplicity.  It was happening in both 32-bit and 64-bit builds on every package.  Resubmitting the entire build set would just change which builds failed.  Very odd.

I'll be checking it daily.

...Thanks,
...Ken

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
Remy van Elst | 28 Dec 06:25 2015
Picon
Gravatar

Duplicity as a static binary

Howdy,

I've got an older system (centos 4) where I'd like to run Duplicity to
make backups. Is there a way to "convert" duplicity, python 2.7.x and
the swift/keystone libs to a (single) static binary so it can run there?
Installing it all manually is possible, but a route I'd rather avoid.
Binary size is not an issue on this node.

There are quite a lot of tools and scripts to convert scripts or some
parts of cpython to a binary, but none at all that seem to do what I
want (the end result being just a few static binaries, duplicity,
python, swift and keystone).

Does anyone here have experience in doing that, and if so, what would be
the best route?

Cheers,
Remy

Attachment (smime.p7s): application/pkcs7-signature, 5061 bytes
_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Gmane