acd+acdcli backend hangs

I've just installed duplicity 0.7.07.1 with hopes of using Amazon Cloud
Drive as the backend.

I completed the setup as described in the documentation of acd_cli and it
seems operational.

When using duplicity, however, once it enters the acdcli backend and calls
sync, it simply hangs.

I don't know too much python, but took a look at the backend:
/usr/local/lib/python2.7/dist-packages/duplicity/backends/acdclibackend.py

I added the -v flag to the sync command on line 60 and placed a log.Info()
test output before and after this line, but it still hangs with no output
(beyond my "Calling sync" info output) and the acd_cli log file also
silent:

log.Info("Calling sync")
self.subprocess_popen(self.acd_cmd + " -v sync")
log.Info("Finished sync")

I ran acd_cli sync manually on the command line and it succeeds normally,
so why does it hang inside of duplicity? Is there a way to make python say
more what's going on when it goes to self.subprocess_popen()?

-------------------------------------------------

ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands!
$24.95 ONETIME Lifetime accounts with Privacy Features!  
15GB disk! No bandwidth quotas!
(Continue reading)

remove-all-inc-of-but-n-full seems not working

Hi,

I used duplicity-0.6.26 and duply-1.6.

Here is output of the status / collection-status {http://pastebin.com/QJ32mzWF}.

When I ran the command "duply backup-name purge-incr", it doesn't deleting incremental backups for May 18, 19, and 21. 
This is the verbose level 9 output after running the command above - {http://pastebin.ca/3609448}.

This is my configuration of backup-name set - {http://pastebin.com/YtrNaaKr}.

Have I misunderstood the commands and config file, or is there a legitimate issue?

Thanks in advance for any assistance.

Kind regards,

James


_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Backend API support

Hi list

I'm looking for some advice on which versions or how many versions of an API a backend should reasonably support.  The Azure backend uses the Microsoft Azure Storage SDK for Python (https://github.com/Azure/azure-storage-python) which is under active development.  This means that API objects and methods are a moving target.  I'm currently updating it to support the latest version and it's looking a bit "messy".  There are a few hasattr() calls to determine which objects to instantiate and which methods to call on those objects.

Does the duplicity project have any guidelines for this?  If so, please point me towards them.

If not, how many versions do you think a backend should support?  Should the supported/required versions be documented in the duplicity man page?


Thanks
Scott

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

duplicity very slow

Hi.  I wonder what is taking so long for duplicity to work?  Yesterday I
started one at 18:33, it said local and remote metadata was synced, no
sync necessary, but the backup (incremental) did not start till 21:08.
What is it doing for so long.  And to walk the tree looking for changes,
it took another 3.5 hours.  Can anyone tell me what gives here, any way
to speed things up?  I have about 1.3 terabytes of files, backing up to
azure storage.

Thanks in advance for any suggestions.

--

-- 
Your life is like a penny.  You're going to lose it.  The question is:
How do
you spend it?

         John Covici
         covici <at> ccs.covici.com

versions of an archived file

I am interested to get a list of versions (dates) of an archived file,
and can think only of a brute force way of doing this:
-- Get all the duplicity archive dates.
-- For each archive date, run a duplicity list command, and
    inspect whether the file of interest is in the list.
Is there an easier way?

Re: problems with decryption gpg times out

But when the list sends my own posts back to me, the to header is
rewritten to be my email address, so on other messages you would not see
a problem.

Scott Hannahs via Duplicity-talk <duplicity-talk <at> nongnu.org> wrote:

> Don’t see this.  Messages from the list have a different “To:” and “From:” Header fields.  For
example, this is the raw source of one of these messages.  The “From” is the original poster.  The
“To:” is the list address.  This is from one of John’s posts today.  Maybe there is a rewrite rule in
spamh.com where all of John’s mail goes?
> 
> From: covici <at> ccs.covici.com
> To: Discussion about duplicity backup <duplicity-talk <at> nongnu.org>
> 
> Maybe there are other fields that are confusing your email service, such as:
> 
> Reply-To: Discussion about duplicity backup <duplicity-talk <at> nongnu.org>
> Sender: "Duplicity-talk" <duplicity-talk-bounces+sth=p-hall.net <at> nongnu.org>
> Return-Path: <duplicity-talk-bounces+sth=p-hall.net <at> nongnu.org>
> X-Original-To: sth <at> p-hall.net
> 
> -Scott
> 
> > On May 16, 2016, at 16:59, covici <at> ccs.covici.com wrote:
> > 
> > Yes, I am getting the acknowledgements.  The reason I am not getting my
> > own posts is because the to and from header both are using my email
> > address, whereas on most other lists, the to header is to the list
> > itself.  This would be a config issue on the admin side of the list.
> > 
> > Thanks.
> > 
> > edgar.soldin <at> web.de wrote:
> > 
> >> John,
> >> 
> >> just for fun i activated the option that the list confirms if you post anything. do you receive
confirmations now? you can disable it again on the mailman conf if you want later. the link is in the footer
of every post.
> >> 
> 
> 
> _______________________________________________
> Duplicity-talk mailing list
> Duplicity-talk <at> nongnu.org
> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> 

--

-- 
Your life is like a penny.  You're going to lose it.  The question is:
How do
you spend it?

         John Covici
         covici <at> ccs.covici.com

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Re: problems with decryption gpg times out

Hmmm.  That only changes the label on the “From:” field not the actual email address.  It is now

"From: Scott Hannahs via Duplicity-talk <duplicity-talk <at> nongnu.org>"

On May 16, 2016, at 17:12, Kenneth Loafman via Duplicity-talk <duplicity-talk <at> nongnu.org> wrote:

OK, I just set from_is_list to change the From: to the list name.

Now, how many people are going to be broken by this change...

...Ken


_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Re: problems with decryption gpg times out

Probably it would have less problems if you could change the to address,
rather than the from one, but we shall see.

Kenneth Loafman via Duplicity-talk <duplicity-talk <at> nongnu.org> wrote:

> OK, I just set *from_is_list* to change the From: to the list name.
> 
> Now, how many people are going to be broken by this change...
> 
> ...Ken
> 
> On Mon, May 16, 2016 at 3:59 PM, <covici <at> ccs.covici.com> wrote:
> 
> > Yes, I am getting the acknowledgements.  The reason I am not getting my
> > own posts is because the to and from header both are using my email
> > address, whereas on most other lists, the to header is to the list
> > itself.  This would be a config issue on the admin side of the list.
> >
> > Thanks.
> >
> > edgar.soldin <at> web.de wrote:
> >
> > > John,
> > >
> > > just for fun i activated the option that the list confirms if you post
> > anything. do you receive confirmations now? you can disable it again on the
> > mailman conf if you want later. the link is in the footer of every post.
> > >
> > > questions, cause i am still not sure about these
> > >
> > > 1. you receive posts of others from the list?
> > > 2. you do _not_ receive your own posts?
> > > 3. your email provider is greenviewdata via some smtp25.com server? if
> > yes can you ask them if eggs.gnu.org is listed in one of their blacklists.
> > > 4. how is your mail server setup. did you install it from scratch. do
> > you have shell access? can you give details about that?
> > >
> > > btw. the gnu.org mx server's ip4 address is currently on one blacklist.
> > >  http://mxtoolbox.com/SuperTool.aspx?action=mx%3alists.gnu.org
> > >
> > > ..ede/duply.net
> > >
> > >
> > > On 12.05.2016 21:54, Kenneth Loafman wrote:
> > > > Odd, going to have to contact nongnu.org to get help on this one.  You
> > > > should be receiving everything, maybe even dupes.
> > > >
> > > >
> > > > On Thu, May 12, 2016 at 2:50 PM, <covici <at> ccs.covici.com> wrote:
> > > >
> > > >> That is where I got the information I gave you, from the logs.
> > > >>
> > > >> Kenneth Loafman <kenneth <at> loafman.com> wrote:
> > > >>
> > > >>> Have you checked your mail server's logs?
> > > >>>
> > > >>>
> > > >>> On Thu, May 12, 2016 at 2:34 PM, <covici <at> ccs.covici.com> wrote:
> > > >>>
> > > >>>> No sign of anything being received except from the list, but not my
> > > >>>> posts.  My message was at 14:47, but nothing further till 15:16
> > when I
> > > >>>> got yours.
> > > >>>>
> > > >>>> Kenneth Loafman <kenneth <at> loafman.com> wrote:
> > > >>>>
> > > >>>>> You seem to be getting all the messages the list sends, correct?
> > > >>>>>
> > > >>>>> You run your own email server?  What do the logs say about rejects?
> > > >> Any
> > > >>>>> rejections from nongnu.org?
> > > >>>>>
> > > >>>>>
> > > >>>>> On Thu, May 12, 2016 at 1:12 PM, <covici <at> ccs.covici.com> wrote:
> > > >>>>>
> > > >>>>>> As I thought, the option is set, but still not getting my own
> > > >>>>>> messages,the list owner now has to tracewhat is happening to a
> > > >>>>>> particular message.
> > > >>>>>>
> > > >>>>>> Kai Stian Olstad <list-duplicity <at> olstad.com> wrote:
> > > >>>>>>
> > > >>>>>>> On 12. mai 2016 19:23, covici <at> ccs.covici.com wrote:
> > > >>>>>>>> That page is onlhy for subscribing.  I can't get there right
> > > >> now,
> > > >>>> but I
> > > >>>>>>>> am sure this option is already set.
> > > >>>>>>>
> > > >>>>>>> No, it's also for change your subscription, in the bottom you'll
> > > >> see
> > > >>>>>>> "To unsubscribe from Duplicity-talk, get a password reminder, or
> > > >>>>>>> change your subscription options enter your subscription email
> > > >>>>>>> address:"
> > > >>>>>>>
> > > >>>>>>> --
> > > >>>>>>> Kai Stian Olstad
> > > >>>>>>>
> > > >>>>>>
> > > >>>>>> --
> > > >>>>>> Your life is like a penny.  You're going to lose it.  The question
> > > >> is:
> > > >>>>>> How do
> > > >>>>>> you spend it?
> > > >>>>>>
> > > >>>>>>          John Covici
> > > >>>>>>          covici <at> ccs.covici.com
> > > >>>>>>
> > > >>>>>> _______________________________________________
> > > >>>>>> Duplicity-talk mailing list
> > > >>>>>> Duplicity-talk <at> nongnu.org
> > > >>>>>> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > > >>>>>>
> > > >>>>>
> > > >>>>> ----------------------------------------------------
> > > >>>>> Alternatives:
> > > >>>>>
> > > >>>>> ----------------------------------------------------
> > > >>>>> _______________________________________________
> > > >>>>> Duplicity-talk mailing list
> > > >>>>> Duplicity-talk <at> nongnu.org
> > > >>>>> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > > >>>>
> > > >>>> --
> > > >>>> Your life is like a penny.  You're going to lose it.  The question
> > is:
> > > >>>> How do
> > > >>>> you spend it?
> > > >>>>
> > > >>>>          John Covici
> > > >>>>          covici <at> ccs.covici.com
> > > >>>>
> > > >>>> _______________________________________________
> > > >>>> Duplicity-talk mailing list
> > > >>>> Duplicity-talk <at> nongnu.org
> > > >>>> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > > >>>>
> > > >>>
> > > >>> ----------------------------------------------------
> > > >>> Alternatives:
> > > >>>
> > > >>> ----------------------------------------------------
> > > >>> _______________________________________________
> > > >>> Duplicity-talk mailing list
> > > >>> Duplicity-talk <at> nongnu.org
> > > >>> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > > >>
> > > >> --
> > > >> Your life is like a penny.  You're going to lose it.  The question is:
> > > >> How do
> > > >> you spend it?
> > > >>
> > > >>          John Covici
> > > >>          covici <at> ccs.covici.com
> > > >>
> > > >> _______________________________________________
> > > >> Duplicity-talk mailing list
> > > >> Duplicity-talk <at> nongnu.org
> > > >> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > > >>
> > > >
> > > >
> > > >
> > > > _______________________________________________
> > > > Duplicity-talk mailing list
> > > > Duplicity-talk <at> nongnu.org
> > > > https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > > >
> > >
> > > _______________________________________________
> > > Duplicity-talk mailing list
> > > Duplicity-talk <at> nongnu.org
> > > https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > >
> >
> > --
> > Your life is like a penny.  You're going to lose it.  The question is:
> > How do
> > you spend it?
> >
> >          John Covici
> >          covici <at> ccs.covici.com
> >
> > _______________________________________________
> > Duplicity-talk mailing list
> > Duplicity-talk <at> nongnu.org
> > https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> >
> 
> ----------------------------------------------------
> Alternatives:
> 
> ----------------------------------------------------
> _______________________________________________
> Duplicity-talk mailing list
> Duplicity-talk <at> nongnu.org
> https://lists.nongnu.org/mailman/listinfo/duplicity-talk

--

-- 
Your life is like a penny.  You're going to lose it.  The question is:
How do
you spend it?

         John Covici
         covici <at> ccs.covici.com
covici | 16 May 23:05 2016

duplicity very slow

Hi.  After my initial backup, I wanted to try a restore to see what
would happen.  It did  do it, but took several hours to just restore a
single file!  After saying that local and remote metadata were synced,
it took maybe a couple of hours till it said last full backup date and
then a long time to restore the file.  Is this expected behavior -- sure
I have a large backup on azure, but my signatures file is local, can't
it tell what volumes to decrypt from that?  I am now trying to do an
incremental backup and its more than an hour and it is still not saying
the last full backup date.

Thanks in advance for any suggestions.

--

-- 
Your life is like a penny.  You're going to lose it.  The question is:
How do
you spend it?

         John Covici
         covici <at> ccs.covici.com
covici | 14 May 14:45 2016

asynchronous upload -- does it work?

Hi.  I would like to use asynchronous upload option to upload to my
azure storage -- the manual says it is experimental -- in people's
experience is it working?

Thanks.

--

-- 
Your life is like a penny.  You're going to lose it.  The question is:
How do
you spend it?

         John Covici
         covici <at> ccs.covici.com
Andrew Claus | 11 May 21:20 2016
Picon

Over Uploading and Status Bar Not Making Sense

Hello All,

Cygwin, Duplicity 0.7.07.1, Python 2.7, GnuPG 1.4.20, boto3

I am trying to backup 1.7 GB to S3, but Duplicity seems to be running in a loop and keeping on uploading more than is necessary, but not of the right volumes. Right now the progress shows the below, and has been similar for a while. The temp directory only has files ending in 1,3,4. S3 only shows volume 1 uploaded.
4.0GB 00:47:00 [1.4MB/s] [=======================================> ] 99% ETA < 30sec
Thread-1: Uploaded 13508608/26214400 bytes
4.0GB 00:47:03 [990.6KB/s] [=======================================> ] 99% ETA < 30sec
Thread-2: Uploaded 18104320/26214400 bytes
Thread-4: Uploaded 15597568/26214400 bytes
Thread-3: Uploaded 14065664/26214400 bytes
4.1GB 00:47:06 [1.1MB/s] [=======================================> ] 99% ETA < 30sec
Thread-1: Uploaded 13647872/26214400 bytes
Thread-2: Uploaded 18243584/26214400 bytes
4.1GB 00:47:09 [1.2MB/s] [=======================================> ] 99% ETA < 30sec
Thread-1: Uploaded 13787136/26214400 bytes
Thread-2: Uploaded 18382848/26214400 bytes
Thread-3: Uploaded 14204928/26214400 bytes
4.1GB 00:47:12 [1.3MB/s] [=======================================> ] 99% ETA < 30sec
Thread-1: Uploaded 13926400/26214400 bytes
Thread-2: Uploaded 18522112/26214400 bytes
4.1GB 00:47:15 [1.3MB/s] [=======================================> ] 99% ETA < 30sec
Thread-4: Uploaded 15736832/26214400 bytes
Thread-1: Uploaded 14065664/26214400 bytes
Thread-3: Uploaded 14344192/26214400 bytes
Thread-2: Uploaded 18661376/26214400 bytes
4.1GB 00:47:18 [1.4MB/s] [=======================================> ] 99% ETA < 30sec
Thread-1: Uploaded 14204928/26214400 bytes


My options are as follows:
--timeout=500  
--asynchronous-upload 
--progress 
--s3-use-new-style 
--s3-use-multiprocessing 
--s3-use-server-side-encryption
--volsize 200 
--archive-dir /home/andrew/duplicity_hashes/
-vDEBUG

I tried putting it to a flash drive instead of S3 and could see each of the volumes being created in the temp directory and then appear in the flash drive in real time. It showed a correct total transfer amount, but oddly the status bar stayed at 0% and stalled while files were being transferred, and then suddenly jumped to 99% and then done.

I appreciate any help.

Thanks,
Andrew
_______________________________________________
Duplicity-talk mailing list
Duplicity-talk <at> nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Gmane