samba-bugs | 27 Apr 05:34 2015
Picon

[Bug 4621] Option to create ancestors of destination, like "mkdir -p"

https://bugzilla.samba.org/show_bug.cgi?id=4621

--- Comment #8 from Dan Jacobson <jidanni <at> jidanni.org> ---
Yes please implement this cpio --make-directories functionality !

http://stackoverflow.com/questions/18491548/rsync-create-all-missing-parent-directories

http://stackoverflow.com/questions/1636889/rsync-how-can-i-configure-it-to-create-target-directory-on-server/22908437#22908437

-- 
You are receiving this mail because:
You are the QA Contact for the bug.
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Frantisek Hanzlik | 27 Apr 00:08 2015
Picon

The easiest way to restore timestamps of files?

Please, is possible (with rsync) re-create files timestamps?
I mean something like choosing a "-T" in the program mirror- from
it's man page e.g. there:
http://sunsite.univie.ac.at/textbooks/mirror/mirror.html#Flags

"Do not do any file transfers just force the time-stamps of any local
files to be reset to be the same as the remote files. Normally only
used when initialising a mirror that already contains files retrieved
another way (e.g. from CDROM)."

This is the situation I have encountered several times - I have local
files which was downloaded from internet archive via FTP or obtained
somehow, these files have bad timestamp, and now I want use rsync for
their synchronization with the remote rsync server and also correct
their bad timestamp - of course without re-downloading. Is it possible?
-- 
Thanks in advance, Franta Hanzlik

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Hansjoerg Lipp | 24 Apr 05:21 2015
Picon

Hard links: incomplete backup or rsync does not terminate

Hi all,

when running backups, rsync sometimes does not terminate. I finally
managed to create a small test case which reproduces this behaviour
(another night without sleep, so sorry for the bad English...):

Using rsync 3.1.0 [no change in a quick test I ran after compiling
3.1.1] on Linux (x86_64) the following sequence causes rsync not to
terminate:

> mkdir srclt2                                                                                                               
> cd srclt2   
> echo x > a
> ln a b
> cd ..
> cp -aix srclt2 dstlt2
> rm dstlt2/b
> mkdir baklt2
> rsync -cavvHAXSl --exclude=gvfs --exclude=.gvfs --compare-dest=$PWD/dstlt2/. $PWD/srclt2/.
$PWD/baklt2/. >> testlt2.log 2>&1

The log (after SIGINT) is:

> sending incremental file list
> delta-transmission disabled for local transfer or --whole-file
> ./
> a is uptodate
> b
> a => b
> rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(632) [sender=3.1.0]
(Continue reading)

James Moe | 22 Apr 01:03 2015

Changing only file permissions


Hello,
  opensuse 13.2
  linux v3.16.7-7-desktop x86_64
  rsync v3.1.1

  I used rsync to copy /usr/ to another volume with these options:
--recursive --one-file-system --links --stats --itemize-changes
--quiet --delete --times
After I had modified the system to use the new /usr volume, I realized
I should have added:
--perms --owner --group --executability

  So the target volume has everything set as "root root", and useful
bits like the SetUID mode are missing.

  Is there a way to use rsync to restore only the
permissions/owner/user and mode flags on the target volume from the
source volume?

--

-- 
James Moe
moe dot james at sohnen-moe dot com
520.743.3936
samba-bugs | 21 Apr 13:53 2015
Picon

[Bug 11229] New: off-by-one in snprintf() check

https://bugzilla.samba.org/show_bug.cgi?id=11229

            Bug ID: 11229
           Summary: off-by-one in snprintf() check
           Product: rsync
           Version: 3.1.1
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: P5
         Component: core
          Assignee: wayned <at> samba.org
          Reporter: sbehrens <at> giantdisaster.de
        QA Contact: rsync-qa <at> samba.org

From 55639a2dbc7b2fd5bca9f7068ae0153627e8a7fa Mon Sep 17 00:00:00 2001
From: Stefan Behrens <sbehrens <at> giantdisaster.de>
Date: Tue, 21 Apr 2015 13:50:38 +0200
Subject: [PATCH] rsync: fix of-by-one in check of snprintf() result

Signed-off-by: Stefan Behrens <sbehrens <at> giantdisaster.de>
---
 io.c |    2 +-
 1 files changed, 1 insertions(+), 1 deletions(-)

diff --git a/io.c b/io.c
index b9a9bd082737..03e13d846fa0 100644
--- a/io.c
+++ b/io.c
(Continue reading)

Petros Aggelatos | 20 Apr 13:42 2015
Picon

Batch file larger than it should/could be?

Hi,

I'm trying to understand the behaviour of rsync when used with the --write-batch or --only-write-batch options. I did some tests where I had two fairly big file trees, think a rootfs, where their only difference was an extra file containing only one character. I noticed the batch file was ~100kB and after inspecting it with hexdump it looks like it contains the whole list of files including their timestamp and possibly size? (not sure about that) even though none of them have changed.

I tried several options to see if there is one of them that will cause the batch file to only contain the changed files but couldn't find any. My current approach is to find the list of files that changed between the 2 trees and then create a batch file using rsync invoked with only those specific files. In that case the one char change produces a 110 byte batch file.

Is there a reason that rsync includes the list of all the files in the batch file? Could this be improved by doing what I now do manually in rsync itself?

Best regards,
Petros Angelatos
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Hongyi Zhao | 18 Apr 07:50 2015
Picon

On the case `an identical item replaces the dots with spaces' for `--itemize-changes'.

Hi all,

The `--itemize-changes' has the following notes within the manual:

        The  other  letters  in  the string above are the actual letters
        that will be output if the associated attribute for the item  is
        being  updated or a "." for no change.  Three exceptions to this
        are: (1) a newly created item replaces each letter with  a  "+",
        (2)  an identical item replaces the dots with spaces, and (3) an
        unknown attribute replaces each letter with a "?" (this can hap‐
        pen when talking to an older rsync).

But, I cann't figure out the case for the `(2)  an identical item 
replaces the dots with spaces'. And I've never meet such things. Could 
you please give me some more hints or a minimal example on this case?

Regards
-- 
.: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :.

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Hongyi Zhao | 18 Apr 05:51 2015
Picon

Is it possiable to suppress the site-specified messages?

Hi all,

When connect to a remote rsync server, ofter it will give some site-
specified messages, say, the following one:

------------
 _______________________________________________________________
|         University of Science and Technology of China         |
|           Open Source Mirror  (mirrors.ustc.edu.cn)           |
|===============================================================|
|                                                               |
| Debian primary mirror in China mainland (ftp.cn.debian.org),  |
|     also mirroring a great many OSS projects & Linux distros. |
|                                                               |
| Currently we don't limit speed. To prevent overload, Each IP  |
| is only allowed to start upto 2 concurrent rsync connections. |
|                                                               |
| This site also provides http/https/ftp access.                |
|                                                               |
| Supported by USTC Network Information Center                  |
|          and USTC Linux User Group (http://lug.ustc.edu.cn/). |
|                                                               |
|    Sync Status:  http://mirrors.ustc.edu.cn/status/           |
|           News:  http://servers.blog.ustc.edu.cn/             |
|        Contact:  mirrors <at> ustc.edu.cn                          |
|_______________________________________________________________|

receiving file list ... 
[snip]
------------

If I want to suppress the messages before the following line with rsync 
client's args/options when connect to this rsync server:

receiving file list ...

Is this possible or not?

Regards
-- 
.: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :.

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Hongyi Zhao | 18 Apr 03:21 2015
Picon

Skip based on checksum not worked as expected when using with complex filter rules.

Hi all,

I've a local repository for Debian, and I'm doing some rsync testings on 
it.  See the following commands for detail:

werner <at> debian:~/software/LocalRepo$ rsync -amvHKLPRSB131072 -n \ 
ftp.uk.debian.org::debian/./dists/wheezy-updates/main/\
debian-installer/binary-amd64/Packages.gz \
repo.debian.local/debian/
[snip]
dists/wheezy-updates/main/debian-installer/binary-amd64/Packages.gz

sent 46 bytes  received 202 bytes  55.11 bytes/sec
total size is 20  speedup is 0.08 (DRY RUN)

werner <at> debian:~/software/LocalRepo$ rsync -amvHKLPRSB131072 -nc \ 
ftp.uk.debian.org::debian/./dists/wheezy-updates/main/\
debian-installer/binary-amd64/Packages.gz \
repo.debian.local/debian/
[snip]
sent 46 bytes  received 218 bytes  58.67 bytes/sec
total size is 20  speedup is 0.08 (DRY RUN)

As you can see, if I use checksum on that package, it shown that it's 
just the same to my local copy, so there is not need to be rsynced.

But when I use a complex rsync filter rules script based on checksum and 
others to check all of the stuff based on the corresponding rules, it 
shows that the above package need to be updated, see the following for 
detail:

1- My script is named as su_dists.rsync and the content of it is as 
follows, sorry for its complex ;-( 

___________ begin su_dists.rsync ____________

rsync -amvHKLPRSB131072 -nc --delete --delete-excluded \
-f +_dists/wheezy/**Translation-en* \
-f +_dists/wheezy/**binary-all/Packages.gz \
-f +_dists/wheezy/Release* \
-f P_dists/wheezy-backports/**Translation-en* \
-f P_dists/wheezy-backports/**binary-all/Packages.gz \
-f P_dists/wheezy-backports/Release* \
-f P_dists/wheezy-proposed-updates/**Translation-en* \
-f P_dists/wheezy-proposed-updates/**binary-all/Packages.gz \
-f P_dists/wheezy-proposed-updates/Release* \
-f +_dists/wheezy-updates/**Translation-en* \
-f +_dists/wheezy-updates/**binary-all/Packages.gz \
-f +_dists/wheezy-updates/Release* \
-f +_dists/wheezy/**binary-amd64/Packages.gz \
-f +_dists/wheezy/**installer-amd64/current/*** \
-f P_dists/wheezy-backports/**binary-amd64/Packages.gz \
-f P_dists/wheezy-backports/**installer-amd64/current/*** \
-f P_dists/wheezy-proposed-updates/**binary-amd64/Packages.gz \
-f P_dists/wheezy-proposed-updates/**installer-amd64/current/*** \
-f +_dists/wheezy-updates/**binary-amd64/Packages.gz \
-f +_dists/wheezy-updates/**installer-amd64/current/*** \
-f +_dists/wheezy/**binary-i386/Packages.gz \
-f +_dists/wheezy/**installer-i386/current/*** \
-f P_dists/wheezy-backports/**binary-i386/Packages.gz \
-f P_dists/wheezy-backports/**installer-i386/current/*** \
-f P_dists/wheezy-proposed-updates/**binary-i386/Packages.gz \
-f P_dists/wheezy-proposed-updates/**installer-i386/current/*** \
-f +_dists/wheezy-updates/**binary-i386/Packages.gz \
-f +_dists/wheezy-updates/**installer-i386/current/*** \
-f P_dists/jessie/*** \
-f P_dists/jessie-backports/*** \
-f P_dists/jessie-proposed-updates/*** \
-f P_dists/jessie-updates/*** \
-f P_pool/*** \
-f +_dists/***/ \
-f -_* ftp.uk.debian.org::debian/./ ./repo.debian.local/debian/

___________ end su_dists.rsync ____________

2- Then, I run my above script as follows to obtain all of the files 
filtered-out according to my filter rules and checkout the ones need to 
be updated based on checksum:  

werner <at> debian:~/software/LocalRepo$ bash su_dists.rsync|awk -F'/' \
'/^dists/ && $NF'
dists/wheezy-updates/Release
dists/wheezy-updates/Release.gpg
dists/wheezy-updates/contrib/binary-i386/Packages.gz
dists/wheezy-updates/contrib/debian-installer/binary-amd64/Packages.gz
dists/wheezy-updates/contrib/debian-installer/binary-i386/Packages.gz
dists/wheezy-updates/main/debian-installer/binary-amd64/Packages.gz
dists/wheezy-updates/main/debian-installer/binary-i386/Packages.gz
dists/wheezy-updates/non-free/binary-amd64/Packages.gz
dists/wheezy-updates/non-free/binary-i386/Packages.gz
dists/wheezy-updates/non-free/debian-installer/binary-amd64/Packages.gz
dists/wheezy-updates/non-free/debian-installer/binary-i386/Packages.gz
dists/wheezy-updates/non-free/i18n/Translation-en.bz2
dists/wheezy/contrib/debian-installer/binary-all/Packages.gz
dists/wheezy/contrib/debian-installer/binary-amd64/Packages.gz
dists/wheezy/contrib/debian-installer/binary-i386/Packages.gz
dists/wheezy/non-free/debian-installer/binary-all/Packages.gz
dists/wheezy/non-free/debian-installer/binary-amd64/Packages.gz
dists/wheezy/non-free/debian-installer/binary-i386/Packages.gz

As you can see, this time, the following file is considered to be updated:

dists/wheezy-updates/main/debian-installer/binary-amd64/Packages.gz

But it has been considered not need to be updated in my first run with 
the -c/--checksum option from the terminal other than the bash srcipt.

3- If I change my bash script into the following form, i.e., with the `--
no-t' option added to the args list:

___________ begin su_dists.rsync ____________

rsync -amvHKLPRSB131072 -nc --no-t --delete --delete-excluded \
-f +_dists/wheezy/**Translation-en* \
-f +_dists/wheezy/**binary-all/Packages.gz \
-f +_dists/wheezy/Release* \
-f P_dists/wheezy-backports/**Translation-en* \
-f P_dists/wheezy-backports/**binary-all/Packages.gz \
-f P_dists/wheezy-backports/Release* \
-f P_dists/wheezy-proposed-updates/**Translation-en* \
-f P_dists/wheezy-proposed-updates/**binary-all/Packages.gz \
-f P_dists/wheezy-proposed-updates/Release* \
-f +_dists/wheezy-updates/**Translation-en* \
-f +_dists/wheezy-updates/**binary-all/Packages.gz \
-f +_dists/wheezy-updates/Release* \
-f +_dists/wheezy/**binary-amd64/Packages.gz \
-f +_dists/wheezy/**installer-amd64/current/*** \
-f P_dists/wheezy-backports/**binary-amd64/Packages.gz \
-f P_dists/wheezy-backports/**installer-amd64/current/*** \
-f P_dists/wheezy-proposed-updates/**binary-amd64/Packages.gz \
-f P_dists/wheezy-proposed-updates/**installer-amd64/current/*** \
-f +_dists/wheezy-updates/**binary-amd64/Packages.gz \
-f +_dists/wheezy-updates/**installer-amd64/current/*** \
-f +_dists/wheezy/**binary-i386/Packages.gz \
-f +_dists/wheezy/**installer-i386/current/*** \
-f P_dists/wheezy-backports/**binary-i386/Packages.gz \
-f P_dists/wheezy-backports/**installer-i386/current/*** \
-f P_dists/wheezy-proposed-updates/**binary-i386/Packages.gz \
-f P_dists/wheezy-proposed-updates/**installer-i386/current/*** \
-f +_dists/wheezy-updates/**binary-i386/Packages.gz \
-f +_dists/wheezy-updates/**installer-i386/current/*** \
-f P_dists/jessie/*** \
-f P_dists/jessie-backports/*** \
-f P_dists/jessie-proposed-updates/*** \
-f P_dists/jessie-updates/*** \
-f P_pool/*** \
-f +_dists/***/ \
-f -_* ftp.uk.debian.org::debian/./ ./repo.debian.local/debian/

___________ end su_dists.rsync ____________

This time, I will obtain the correct file-lists that should be updated 
based on the checksum checking, see following for detail:

werner <at> debian:~/software/LocalRepo$ bash su_dists.rsync|awk -F'/' \
'/^dists/ && $NF'
dists/wheezy-updates/Release
dists/wheezy-updates/Release.gpg
dists/wheezy-updates/non-free/i18n/Translation-en.bz2

As you can see, for my case, there only have three files which need to be 
updated all toghether at the moment.

Any hints on the above issues?

Regards
-- 
.: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :.

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Hongyi Zhao | 16 Apr 12:21 2015
Picon

Rsync a directory via a linked name.

Hi all,

See the following for detail:

$ rsync -l ftp.cn.debian.org::debian/dists/wheezy/main/installer-amd64/
[snip]
drwxr-sr-x          4,096 2015/01/10 18:17:33 .
lrwxrwxrwx             18 2015/01/10 18:16:31 current -> 20130613+deb7u2
+b4
drwxr-xr-x          4,096 2013/05/01 05:33:52 20130430
drwxr-sr-x          4,096 2015/01/05 17:25:32 20130613+deb7u2+b4

In the above case, the current is a link to 20130613+deb7u2, I want to 
use the name of link directory, i.e., current, to retrieve the correspond 
stuff from remote server to my local host.  At the same time, exclude all 
of the other stuff in the installer-amd64 directory, for this case, it 
should be the directory 20130430. 

Considering that the sub-directories in installer-amd64 are often be 
renamed except the link directory name `current', so I want to only use 
the `current' as the directory name in my include/exclude rules for the 
above jobs. 

Any hints on how to write this rsync rules? 

Regards
-- 
.: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :.

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Дугин Сергей | 16 Apr 11:20 2015
Picon

rsync --delete

Hi, Rsync.

I want to help rsink delete a folder with a large number of files and folders. Tried this:
rsync -a --no-D --delete /dev/null /home/rc-41/data/000000000000061/2015-04-01-07-04/
skipping non-regular file "null"

rsync -a --no-D --delete /dev/zero /home/rc-41/data/000000000000061/2015-04-01-07-04/
skipping non-regular file "zero"

That's how it turns out
rsync -a --delete /empty_folder/ /home/rc-41/data/000000000000061/2015-04-01-07-04/
But this option is not satisfied as if the disk is 100% filled to create an empty folder does not work

mkdir /empty folder/
Disk quota ekstseeded

Got an error.

find /home/rc-41/data/000000000000061/2015-04-01-07-04/ -delete
I know not suitable

rm -rf /home/rc-41/data/000000000000061/2015-04-01-07-04/
is also not suitable

How to do it differently?

-- 
Sincerely,
  Dugin Sergey mailto: drug <at> qwarta.ru
  QWARTA

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Gmane