Eponymous - | 25 Jun 14:04 2015
Picon

Questions regarding symmetric encryption/signing

I'm reposting this as I haven't heard anything and don't know if it was because my original email didn't get through or not. I checked the archives and don't see it there either...

Thanks.

On 16 Jun 2015 15:24, "Eponymous -" <the.epon <at> gmail.com> wrote:
>
> Hi,
>
> I have a question regarding Duplicity and symmetric encryption.
>
> Firstly, I've read through the man page for Duplicity and also the
> entire GPG document: http://www.gnupg.org/documentation/guides.html
>
> I noticed Duplicity has --encrypt-key and --sign-key options which
> confuse me slightly.
>
> From what I understand symmetric encryption would be the best choice
> for my use-case of Duplicity since it will only be I who accesses the
> backed up data.
>
> My first question is how does Duplicity implement this?
>
> Does it simply use the PASSPHRASE (as defined as a shell variable) to
> both encrypt and decrypt the data or is this passphrase the one used
> for unlocking the GPG keyring and I still need to setup up GPG keys
> first?
>
> This takes care of encryption, so on to signing:
>
> How can I utilize symmetric encryption but also sign everything I
> backup? Surely signing needs a Private key to sign the computed hash
> and a Public key to verify?
>
> Again, does this need to be set up in advance with GPG?
>
> For both questions I'm really interested on how I configure Duplicity
> to work as the command line options are somewhat confusing to me.
>
> This seems like a really great program and I hope you can bear with me
> if these questions seem obvious.
>
> Thanks again for your time,

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
edgar.soldin | 23 Jun 10:49 2015
Picon

Fwd: [Duplicity-team] [Question #268450]: How to use OneDrive Backend?


does someone successfully use onedrive and can please help this guy below in our answer tracker? ..thx ede/duply.net

-------- Forwarded Message --------

New question #268450 on Duplicity:
https://answers.launchpad.net/duplicity/+question/268450

Hi!

Could anyone give me an example how to use duplicity with OneDrive?
In the documentation is written: onedrive://some_dir

I tried to generate links for folders on OneDrive, but that seemed to not work.

Regards,
Christoph
Scott Hannahs | 22 Jun 22:50 2015
Picon

Duplicity Testing...

I maintain the “fink” installer for duplicity on Mac OS X.  I have been asked why I haven’t had
duplicity run the built in test suite.  I think that the answer is that I have been lazy!  I started looking at
it and have a few questions.

The duplicity program has some testing built in when the installer runs in “test” mode.  I am not well
versed in python installers by any means.  But it appears that these tests are run with the installer command

setup.py -test

But this depends on some environment variable “python2” that should point to ???
% setup.py -test
env: python2: No such file or directory

If I run the tests manually I see that I need the packages “tox” and “pluggy” installed.  Is that
correct?  Are there others?

I have tox installed and just (maybe??) made a module to install pluggy.

I am also not clear on how duplicity uses a server during the test or does it just use the local file system?

-Scott

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
Laurent Lavaud | 10 Jun 16:59 2015
Picon

pydrive and google drive

Hello,

I have successfully connect and upload content with the pydrive backend but i failed to see the content on my
google drive.

I know it is not directly related to duplicity but if someone know how to visualize data uploaded with
pydrive on his google drive, let me know.

Thanks !
Bruce Merry | 8 Jun 18:31 2015
Picon

Fwd: AssertionError on every attempt

Hi

(apologies if this shows up twice - my first attempt was without
subscribing to the list, and since it didn't show up in the list
archives I'm assuming it went to the bit-bucket)

I've somehow managed to get my Google Drive into a state where every
time I run duplicity I get the error below. This occurred after I
started a full backup, which crashed on volume 27, restarted it, and
it later crashed again (I don't have the errors messages from those
backups saved, sorry). I'm using the PyDrive backend, specifically
https://code.launchpad.net/~bmerry/duplicity/pydrive-regular. I've
tried
- running duplicity cleanup (hits the same assertion)
- wiping out the .cache/duplicity directory to force resync (resyncs,
then hits the same assertion)

I've since noticed that I have two copies of
duplicity-full.20150607T094026Z.vol27.difftar.gpg in my Google Drive,
which probably explains why I get the assertion error, but I'm not
sure how to safely recover from this without ending up with a
corrupted backup. Is it safe to just delete one of them?

Traceback (most recent call last):
  File "/usr/local/bin/duplicity", line 1523, in <module>
    with_tempdir(main)
  File "/usr/local/bin/duplicity", line 1517, in with_tempdir
    fn()
  File "/usr/local/bin/duplicity", line 1371, in main
    do_backup(action)
  File "/usr/local/bin/duplicity", line 1396, in do_backup
    globals.archive_dir).set_values()
  File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py",
line 710, in set_values
    self.get_backup_chains(partials + backend_filename_list)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py",
line 835, in get_backup_chains
    add_to_sets(f)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py",
line 823, in add_to_sets
    if set.add_filename(filename):
  File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py",
line 105, in add_filename
    (self.volume_name_dict, filename)
AssertionError: ({27:
'duplicity-full.20150607T094026Z.vol27.difftar.gpg', 28:
'duplicity-full.20150607T094026Z.vol28.difftar.gpg', 29:
'duplicity-full.20150607T094026Z.vol29.difftar.gpg', 30:
'duplicity-full.20150607T094026Z.vol30.difftar.gpg', 31:
'duplicity-full.20150607T094026Z.vol31.difftar.gpg', 32:
'duplicity-full.20150607T094026Z.vol32.difftar.gpg', 33:
'duplicity-full.20150607T094026Z.vol33.difftar.gpg', 34:
'duplicity-full.20150607T094026Z.vol34.difftar.gpg', 35:
'duplicity-full.20150607T094026Z.vol35.difftar.gpg', 36:
'duplicity-full.20150607T094026Z.vol36.difftar.gpg', 37:
'duplicity-full.20150607T094026Z.vol37.difftar.gpg', 38:
'duplicity-full.20150607T094026Z.vol38.difftar.gpg', 39:
'duplicity-full.20150607T094026Z.vol39.difftar.gpg', 40:
'duplicity-full.20150607T094026Z.vol40.difftar.gpg', 41:
'duplicity-full.20150607T094026Z.vol41.difftar.gpg', 42:
'duplicity-full.20150607T094026Z.vol42.difftar.gpg', 43:
'duplicity-full.20150607T094026Z.vol43.difftar.gpg', 44:
'duplicity-full.20150607T094026Z.vol44.difftar.gpg', 45:
'duplicity-full.20150607T094026Z.vol45.difftar.gpg', 46:
'duplicity-full.20150607T094026Z.vol46.difftar.gpg', 47:
'duplicity-full.20150607T094026Z.vol47.difftar.gpg', 48:
'duplicity-full.20150607T094026Z.vol48.difftar.gpg', 49:
'duplicity-full.20150607T094026Z.vol49.difftar.gpg', 50:
'duplicity-full.20150607T094026Z.vol50.difftar.gpg', 51:
'duplicity-full.20150607T094026Z.vol51.difftar.gpg', 52:
'duplicity-full.20150607T094026Z.vol52.difftar.gpg', 53:
'duplicity-full.20150607T094026Z.vol53.difftar.gpg', 54:
'duplicity-full.20150607T094026Z.vol54.difftar.gpg', 55:
'duplicity-full.20150607T094026Z.vol55.difftar.gpg', 56:
'duplicity-full.20150607T094026Z.vol56.difftar.gpg', 57:
'duplicity-full.20150607T094026Z.vol57.difftar.gpg', 58:
'duplicity-full.20150607T094026Z.vol58.difftar.gpg', 59:
'duplicity-full.20150607T094026Z.vol59.difftar.gpg', 60:
'duplicity-full.20150607T094026Z.vol60.difftar.gpg'},
'duplicity-full.20150607T094026Z.vol27.difftar.gpg')

Thanks
Bruce
--
Dr Bruce Merry
bmerry < <at> > gmail <.> com
http://www.brucemerry.org.za/
http://blog.brucemerry.org.za/
edgar.soldin | 1 Jun 10:45 2015
Picon

Re: GoogleDrive no longer available via gdocs (AuthForInstalledApps)

Carlos,

just a heads up. just yesterday Ken committed the following changes.

- enabling Gdocs access via pydrive://
- making gdocs:// an alias for pydrive://
- keeping the old backend as gdata+gdocs://

if you want to spend some time on gdata w/ OAuth, this seems to be an example on how to use it
 http://stackoverflow.com/questions/16026286/using-oauth2-with-service-account-on-gdata-in-python

..ede

On 01.06.2015 10:15, Carlos Abalde wrote:
> Hi,
> 
> Sorry for this late answer. At the moment I'm on vacations with almost no access to the Internet. I'll be
back in a couple of days. However a move to a new house and a ton of pending work are kindly waiting for me. I'm
not using the Duplicity Google Drive storage anymore, that's why I didn't notice this. 
> 
> If nobody else is able to look into this I'll do that in a couple of weeks. Personally I think the plugin
should be rewritten from scratch. It was created a few days after my first 'Hello World' in Python. Anyway,
I'll try to look into this asap. Thanks for your patience :)
> 
> Best,
> __
> Carlos Abalde
> 
> P.S.: Message sent from my smartphone. Please, excuse my brevity.
> 
> On 27/5/2015, at 17:14, Kostas Papadopoulos <kpapad75 <at> travelguide.gr
<mailto:kpapad75 <at> travelguide.gr>> wrote:
> 
>> Just a quick heads-up that Google Drive isn't available via the gdocs API (AuthForInstalledApps) any
more ...
>>
>> A few weeks ago I had to tweak my Google account's setting "access for less secure apps" but since today it
won't login at all, with a 404 error:
>>
>>     --- Start running command STATUS at 15:03:46.662 ---
>>     Traceback (most recent call last):
>>       File "/usr/local/bin/duplicity", line 1523, in <module>
>>         with_tempdir(main)
>>       File "/usr/local/bin/duplicity", line 1517, in with_tempdir
>>         fn()
>>       File "/usr/local/bin/duplicity", line 1355, in main
>>         action = commandline.ProcessCommandLine(sys.argv[1:])
>>       File "/usr/local/lib/python2.7/dist-packages/duplicity/commandline.py", line 1093, in ProcessCommandLine
>>         globals.backend = backend.get_backend(args[0])
>>       File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line 223, in get_backend
>>         obj = get_backend_object(url_string)
>>       File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line 209, in get_backend_object
>>         return factory(pu)
>>       File "/usr/local/lib/python2.7/dist-packages/duplicity/backends/gdocsbackend.py", line 54,
in __init__
>>         self._authorize(parsed_url.username + ' <at> ' + parsed_url.hostname, self.get_password())
>>       File "/usr/local/lib/python2.7/dist-packages/duplicity/backends/gdocsbackend.py", line 134,
in _authorize
>>         captcha_response=captcha_response)
>>       File "/usr/lib/python2.7/dist-packages/gdata/client.py", line 441, in client_login
>>         captcha_token=captcha_token, captcha_response=captcha_response)
>>       File "/usr/lib/python2.7/dist-packages/gdata/client.py", line 373, in request_client_login_token
>>         response, ClientLoginFailed, response_body)
>>     ClientLoginFailed: Server responded to ClientLogin request: 404, https://developers.google.com/accounts/docs/AuthForInstalledApps
>>
>>
>>     15:03:47.956 Task 'STATUS' failed with exit code '30'.
>>     --- Finished state FAILED 'code 30' at 15:03:47.956 - Runtime 00:00:01.293 ---
>>
>> Apparently it isn't a temporary glitch.
>>
>>
>> Best regards,
>> KP
>>
edgar.soldin | 31 May 12:40 2015
Picon

Re: Consider replacing old gdocs:// backend with R.Levene's pydrive2://

On 30.05.2015 23:45, Kostas Papadopoulos wrote:
> Regarding the recent changes where Google has completely disabled the old GoogleDrive API (deprecated
since 2012) and the introduction of the pydrive methods ("personal" and "managed"), I'd like to suggest
to fully replace the old duplicity "gdocs" backend method with R.Levene's pydrive2 (as provided in
http://lists.nongnu.org/archive/html/duplicity-talk/2015-05/msg00040.html )
> 
> I think that simply naming it gdocs:// (instead of pydrive2://) would create less confusion among
newcomers to Duplicity.
> 

afaiu gdocs per se isn't deprecated but it's method of authentication currently used. pydrive2 seems to be
an alternative route to access gdocs.

please someone correct if i am wrong.

..ede/duply.net
Grant | 30 May 01:40 2015
Picon

Remove a file from backups

I recently realized that one of the files on my system contains
sensitive information in plain text.  I've now encrypted the file with
a password but it has been included in my duplicity archives in
unencrypted form.  Can I remove the unencrypted file from all of my
duplicity archives?  If not, is deleting all of the old archives and
running a fresh, full backup the right solution?  Since I create
backups unattended, I don't use a password to encrypt them.

- Grant
Laurent Lavaud | 28 May 10:59 2015
Picon

gdocs backend 404

Hello,

Since few days i got this error message when trying to sync on my gdocs account:

BackendException: Error while authenticating client: Server responded to ClientLogin request: 404, https://developers.google.com/accounts/docs/AuthForInstalledApps

It seems ClientLogin is a deprecated method and we must use OAuth 2.0, is there any solution or workaround ?

Thanks.

Duplicity 0.6.23 on an Ubuntu LTS 14.04.
Remy van Elst | 25 May 11:04 2015
Picon

Duplicity using 1.5 TB storage and loosing incremental backups?


Duplicity seems to loose it's status when trying to do a incremental
backup set over 14 days. The backup has been running for a while now
but it is using about 1.5 TB of backend storage since 2 weeks. It is
going to an Openstack swift object store as backend.

This is the command line:

     duplicity --asynchronous-upload --verbosity 9 --log-file
/var/log/duplicity.log --volsize 25 --tempdir="/tmp"
--file-prefix="vps1.sparklingclouds.nl."
--name="vps1.sparklingclouds.nl." --exclude-device-files
--exclude-globbing-filelist=/etc/duplicity-backup/exclude.conf
--full-if-older-than="14D" --no-encryption  / swift://duplicity-backup

This is what caught my eye in the verbose log file:

    File
vps1.sparklingclouds.nl.duplicity-full.20150430T034939Z.vol166.difftar.g
z
is part of known set
    File
vps1.sparklingclouds.nl.duplicity-full.20150430T034939Z.vol1660.difftar.
gz
is part of known set
    Found backup chain [Tue Mar 24 14:42:44 2015]-[Tue Mar 24 14:42:44
2015]
    Last full backup is too old, forcing full backup

The last full backup is from yesterday, and it should only do a full
backup every 14 days.

When I do a collection status it seems all the incremental backups are
gone:

Do note that I've got a wrapper script around duplicity which outputs
the status, storage used and config settings:

    # Hostname: vps1.sparklingclouds.nl
    # IP: 192.0.2.10
    # Storage used: 1.5T
    # Full backups to keep: 4
    # Create full backup if last full backup is older than: 14D
    -----------------------------------------
    # Duplicity collection status:
    # Local and Remote metadata are synchronized, no sync needed.
    # Last full backup date: Mon May 25 10:48:16 2015
    # Collection Status
    # -----------------
    # Connecting with backend: BackendWrapper
    # Archive dir: /root/.cache/duplicity/vps1.sparklingclouds.nl.
    # Found 4 secondary backup chains.
    # Secondary chain 1 of 4:
    # -------------------------
    # Chain start time: Tue Mar 24 14:42:44 2015
    # Chain end time: Tue Mar 24 14:42:44 2015
    # Number of contained backup sets: 1
    # Total number of contained volumes: 3009
    #  Type of backup set:                            Time:      Num
volumes:
    #                 Full         Tue Mar 24 14:42:44 2015
   3009
    # -------------------------
    # Secondary chain 2 of 4:
    # -------------------------
    # Chain start time: Wed Apr  8 05:49:18 2015
    # Chain end time: Wed Apr  8 05:49:18 2015
    # Number of contained backup sets: 1
    # Total number of contained volumes: 3104
    #  Type of backup set:                            Time:      Num
volumes:
    #                 Full         Wed Apr  8 05:49:18 2015
   3104
    # -------------------------
    # Secondary chain 3 of 4:
    # -------------------------
    # Chain start time: Thu Apr 16 05:49:37 2015
    # Chain end time: Thu Apr 16 05:49:37 2015
    # Number of contained backup sets: 1
    # Total number of contained volumes: 3128
    #  Type of backup set:                            Time:      Num
volumes:
    #                 Full         Thu Apr 16 05:49:37 2015
   3128
    # -------------------------
    # Secondary chain 4 of 4:
    # -------------------------
    # Chain start time: Thu Apr 30 05:49:39 2015
    # Chain end time: Thu Apr 30 05:49:39 2015
    # Number of contained backup sets: 1
    # Total number of contained volumes: 736
    #  Type of backup set:                            Time:      Num
volumes:
    #                 Full         Thu Apr 30 05:49:39 2015
    736
    # -------------------------
    # Found primary backup chain with matching signature chain:
    # -------------------------
    # Chain start time: Mon May 25 10:48:16 2015
    # Chain end time: Mon May 25 10:48:16 2015
    # Number of contained backup sets: 1
    # Total number of contained volumes: 0
    #  Type of backup set:                            Time:      Num
volumes:
    # -------------------------
    # No orphaned or incomplete backup sets found.

Why does this happen and how can I get this back to normal?
Attachment (0x1B7F88DC.asc): application/pgp-keys, 5488 bytes
_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
Tiernan OToole | 20 May 13:57 2015
Picon

HubiC progress not showing properly


morning all.

Im using Duplicity and HubiC together to backup some systems, and
noticed that if i put --progress at the end, it shows 0kb/s and
stalled and then when the upload finishes it jumps to 100%... Any
ideas what needs to be done here?

Thanks.

--Tiernan

Gmane