Daniel | 22 Apr 03:27 2014

copying live vmdk / vdi files

Hi,

I would like to backup my Virtual Box VM folder. I have VDI and VMDK 
files in there. I am told I have to shutdown those virtual machines 
first in order for rsync to copy them correctly. Is this correct ?

Thanks,

Dan
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

samba-bugs | 17 Apr 20:30 2014
Picon

[Bug 10557] New: .ssh/config settings are incompletely applied with -e or --rsh

https://bugzilla.samba.org/show_bug.cgi?id=10557

           Summary: .ssh/config settings are incompletely applied with -e
                    or --rsh
           Product: rsync
           Version: 3.1.1
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: normal
          Priority: P5
         Component: core
        AssignedTo: wayned <at> samba.org
        ReportedBy: kesten.broughton <at> gmail.com
         QAContact: rsync-qa <at> samba.org

.ssh/config settings are not applied at all without coaxing.
The IdentityFile setting is not passed to rsync.

For better formatting, see the report here.

http://unix.stackexchange.com/questions/94421/how-to-use-ssh-config-setting-for-each-server-by-rsync/125251#125251

If i force it with -F "path to .ssh/conf" then the IdentityFile is used
correctly, but the jump-hosting fails.

sudo /usr/local/bin/rsync -az -e "ssh -F /Users/kbroughton/.ssh/config -i
/Users/kbroughton/.ssh/identities/21ct_dev1_key"  /var/data/sources/data.tar.gz
cloud-user <at> 21ct-dev1-pivot:/home/cloud-user

(Continue reading)

samba-bugs | 16 Apr 20:29 2014
Picon

[Bug 10555] New: checksum-reading.diff causes rsync to segfault with large amount of files

https://bugzilla.samba.org/show_bug.cgi?id=10555

           Summary: checksum-reading.diff causes rsync to segfault with
                    large amount of files
           Product: rsync
           Version: 3.1.1
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: major
          Priority: P5
         Component: core
        AssignedTo: wayned <at> samba.org
        ReportedBy: haqthat <at> gmail.com
         QAContact: rsync-qa <at> samba.org

LOCAL RSYNC
command: rsync -rvc /tmp/dir1/ /tmp/dir2/

result:

building file list ...
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(226)
[sender=3.1.1pre1]

dmesg:

rsync[38216]: segfault at 2a36 ip 00000000004209b6 sp 00007fffa6fc7e50 error 6
in rsync[400000+6b000]
(Continue reading)

Erik Auerswald | 3 Apr 10:47 2014
Picon
Picon

[PATCH] Clarify escaping in wildcard patterns documentation

Hi,

the attached patch IMHO improves the man page regarding use of the
backslash as escape character in wildcard patterns.

Thanks,
Erik

P.S. Please keep me in Cc: as I am not subscribed to the list.
-- 
Premature optimization is the root of all evil.
                        -- Donald Knuth
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
samba-bugs | 14 Apr 22:10 2014
Picon

[Bug 10552] New: Sender checksum calculation significantly slower with compression enabled

https://bugzilla.samba.org/show_bug.cgi?id=10552

           Summary: Sender checksum calculation significantly slower with
                    compression enabled
           Product: rsync
           Version: 3.1.1
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: normal
          Priority: P5
         Component: core
        AssignedTo: wayned <at> samba.org
        ReportedBy: dougmiles <at> cox.net
         QAContact: rsync-qa <at> samba.org

I've noticed that with the -z option enabled, comparing two files that are
identical (or nearly so) but have different modification times takes
significantly longer than without the -z option.  It looks like the entire file
is compressed as the checksum is calculated even when no data needs to be
transmitted to the receiver.

To replicate:

Create test folders/files (using incompressible data to maximize effect):
mkdir a b
dd if=/dev/urandom of=a/a.tst bs=1M count=250
cp a/a.tst b/

run rsync without compression:
(Continue reading)

samba-bugs | 13 Apr 12:41 2014
Picon

[Bug 10551] New: Daemon infinite loop when no matched user in secrets

https://bugzilla.samba.org/show_bug.cgi?id=10551

           Summary: Daemon infinite loop when no matched user in secrets
           Product: rsync
           Version: 3.1.1
          Platform: x64
        OS/Version: Linux
            Status: NEW
          Severity: major
          Priority: P5
         Component: core
        AssignedTo: wayned <at> samba.org
        ReportedBy: ryan <at> finnie.org
         QAContact: rsync-qa <at> samba.org

Created attachment 9850
  --> https://bugzilla.samba.org/attachment.cgi?id=9850
Strace output of infinite loop

Hello.  Given a test module:

[test-module]
  path = /tmp
  auth users = *
  secrets file = /tmp/rsyncd.secrets

and secrets file:

gooduser:goodpass

(Continue reading)

a. | 12 Apr 20:48 2014
Picon

rsync's usage of ssh

I am trying to understand how rsync uses ssh. From what I understand of
the source, it simply opens a ssh connection and then simply pipes
rsync's data. But somehow my stomach tells me that this is not the whole
story.

For one, that would mean the whole (?) of rsync's protocol is only used
for not-ssh transmission. The biggest question for me right now is,
whether rsync, when transmitting remotely over ssh, is binding sockets
of some kind or if it is completely dependent on ssh for that.

For every bit of enlightenment in this regard I am very grateful!

alex.
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Marian Marinov | 12 Apr 02:08 2014

Re: RFC: Mount namespace option

Hi, I have a new version of the namespace patches which actually works :)

All comments(good and mostly bad :) ) is greatly appreciated.

Best regards,
Marian

On 04/03/2014 04:48 PM, Marian Marinov wrote:
 > Hello guys,
 > I'm working a lot with Linux Containers(LXC) and find it extremely nice to have the ability to rsync files
from the 
host machine to the container without the need of SSH.
 >
 > What I did was a simple patch, which added the new option --mount-ns-pid=PID and also added a call to
setns() in the 
 > do_fork() function.
 >
 > The idea is, that rsync will use the PID to create a path (/proc/PID/ns/mnt), open that path and give the
file 
descriptor to setns(), which in turn will switch to the new mount namespace and so, the file operations will
be done in 
 > the new mount namespace instead of the host's own mount namespace.
 >
 > Are you interested in such functionality for rsync?
 >
 > If you are interested, can we discuss the questions bellow?
 >
 > - Can someone tell me what is the accepted way of accepting patches?
 > I currently have the patches done for the 3.0.9 branch and for 3.1.0 branch.
 >
(Continue reading)

Thomas Knauth | 11 Apr 13:35 2014
Picon
Picon

rsync performance on large files strongly depends on file's (dis)similarity

Hi list,

I've found this post on rsync's expected performance for large files:

https://lists.samba.org/archive/rsync/2007-January/017033.html

I have a related but different observation to share: with files in the
multi-gigabyte-range, I've noticed that rsync's runtime also depends
on how much the source/destination diverge, i.e., synchronization is
faster if the files are similar. However, this is not just because
less data must be transferred.

For example, on an 8 GiB file with 10% updates, rsync takes 390
seconds. With 50% updates, it takes about 1400 seconds, and at 90%
updates about 2400 seconds.

My current explanation, and it would be awesome if someone more
knowledgeable than me could confirm, is this: with very large files,
we'd expect a certain level of false alarms, i.e., weak checksum
matches, but strong checksum does not. However, with large files that
are very similar, a weak match is much more likely to be confirmed
with a matching strong checksum. Contrary, with large files that are
very dissimilar a weak match is much less likely to be confirmed with
a strong checksum, exactly because the files are very different from
each other. rsync ends up computing lots of strong checksums, which do
not result in a match.

Is this a valid/reasonable explanation? Can someone else confirm this
relationship between rsync's computational overhead and the file's
(dis)similarity?
(Continue reading)

Saku Vainikainen | 10 Apr 15:58 2014

Re: [Bug 10522] --detect-renamed patch is causing deletions as if a 'delete flag' was supplied, when none have been


I was wondering why my primary NAS was empty the other day..

It seems that my data was saved by -b option and related parameters, because all my data was hidden in the
“Trashcan” -folder on the archive NAS.

I’m using rsync to make a safety copy of all files on my primary NAS:

rsync -vrtb --backup-dir=/mnt/archive/trashcan/ --suffix=".deleted-$(date +%Y%m%d%H%M%S)" --del
-f "P *trashcan*" /mnt/nas/ /mnt/archive/

Is this bug to be blamed for emptying my primary NAS?

Saku.

On 10.4.2014, at 5.50, samba-bugs <at> samba.org wrote:

https://bugzilla.samba.org/show_bug.cgi?id=10522

--- Comment #3 from J.R. <rsnc <at> opal.com> 2014-04-10 02:50:13 UTC ---
Created attachment 9840
--> https://bugzilla.samba.org/attachment.cgi?id=9840
revised patch  detect-renamed.diff

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
(Continue reading)

Fabian Cenedese | 11 Apr 08:48 2014
Picon

Re: Alternative rsync client for Windows

At 18:41 08. 04. 2014, Gilbert (Gang) Chen wrote:

>Hi, there,
>
>
>    We're pleased to announce the open beta of Acrosync, a native rsync client for Windows.  Key features
include: 
>    * Easy install, no more dependency on cygwin 
>    * Simple GUI, one click to start the sync 
>    * sync over ssh for security, or directly with an rsync daemon 
>    * For ssh, no need to set up password-less login 
>    * Built-in file system monitor to upload changed files instantly (just like Dropbox) 
>    * Support hourly incremental snapshot creation (just like Time Machine) 
>    * Can invoke Volume Shadow Copy Service to upload locked files
Do you have speed comparisons against cwrsync? Especially with many
small files, big directories etc. If bandwidth is limiting then this may not
make a big difference. However a (local) check if the most part is already
uptodate could be sped up.

Thanks

bye  Fabi

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Gmane