headers
Matt McCutchen | 1 Sep 2009 05:08

Re: unpack_smb_acl unknown error, + rsync maintainability

On Mon, 2009-08-31 at 16:59 -0500, Mike Bombich wrote:
> Regardless, rsync shouldn't be converting uuid to uid/gid for Mac OS  
> X, it's unnecessary.

This is really a question of whether Mac users expect users/groups to be
preserved by uid/gid or by uuid.  Are you saying it makes more sense to
preserve by uuid?  What would --numeric-ids do?

More broadly, I don't think it's a scalable approach to continue adding
ad-hoc workarounds to rsync for the quirks of various filesystems.  It
would be better to have a filesystem-specific component that exposes all
the metadata it knows about as named attributes (gvfs-info does
something like this) and let the core file-copy tool focus on
efficiently transferring and flexibly manipulating that representation.
But such extensible design seems to be uncharacteristic of the current
rsync codebase.  Maybe it would be better to pursue this idea in a new
tool along the lines of rZync and superlifter.

-- 
Matt

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 3 comments |
headers
Jignesh Shah | 1 Sep 2009 08:00
Picon

rsync and symlinks

Hi, I have one question regarding handling of symlinks in rsync. If I have /source directory in which I have 100s of sub directories of directories and each one has symlink to some directories out side the /source directory hierarchy. Does rsync follows all those symlinks and syncs the data if I specifies below rsync command?
 
rsync -avz /source/ remote.ky:/source/
 
source
   |
   | - source1 --> /projects/win
   | - source2 --> /projects/unix
   | - source3 --> /scripts/win
   | ....
 
Does rsync command syncs /project contents as well? What if I have some symlinks inside /projects?
 
Thanks,
Jignesh
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 3 comments |
headers
samba-bugs | 1 Sep 2009 08:11
Picon
Favicon

DO NOT REPLY [Bug 6633] Extended attributes under Solaris are not supported.

https://bugzilla.samba.org/show_bug.cgi?id=6633

------- Comment #7 from cavalli <at> cilea.it  2009-09-01 01:11 CST -------
I do not undestand you point. The last niglty snapshot and also the last git
commit show the same results. Actually I put this line in the code to do some
debugging:

 ssize_t cnt = read(attrfd, buf + bufpos, buflen - bufpos);
 rsyserr(FERROR_XFER, errno, "read %d bytes, buflen %d",cnt,buflen);

This clearly shows two reads 

rsync: read 13 bytes, buflen 255: Error 0 (0)
rsync: read 0 bytes, buflen 255: Error 0 (0)
rsync: failed to read xattr rsync.%stat for "/data/cavalli/test/.": Error 0 (0)

0 on the second read indicates EOF reached but not early EOF in this case I
think: what is wrong with this reasoning?

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 0 comments |
headers
Mike Bombich | 1 Sep 2009 16:09
Favicon
Gravatar

Re: unpack_smb_acl unknown error, + rsync maintainability

Rsync shouldn't be converting UUID to uid/gid *for ACL entries*  
(because Mac OS X stores those ACEs with a reference to a UUID, not a  
uid/gid).  For file ownership, etc., it should maintain its current  
behavior.

On Aug 31, 2009, at 10:08 PM, Matt McCutchen wrote:

> On Mon, 2009-08-31 at 16:59 -0500, Mike Bombich wrote:
>> Regardless, rsync shouldn't be converting uuid to uid/gid for Mac OS
>> X, it's unnecessary.
>
> This is really a question of whether Mac users expect users/groups  
> to be
> preserved by uid/gid or by uuid.  Are you saying it makes more sense  
> to
> preserve by uuid?  What would --numeric-ids do?
>
> More broadly, I don't think it's a scalable approach to continue  
> adding
> ad-hoc workarounds to rsync for the quirks of various filesystems.  It
> would be better to have a filesystem-specific component that exposes  
> all
> the metadata it knows about as named attributes (gvfs-info does
> something like this) and let the core file-copy tool focus on
> efficiently transferring and flexibly manipulating that  
> representation.
> But such extensible design seems to be uncharacteristic of the current
> rsync codebase.  Maybe it would be better to pursue this idea in a new
> tool along the lines of rZync and superlifter.
>
> -- 
> Matt
>

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 2 comments |
headers
Andrew Gideon | 1 Sep 2009 16:11

Re: rsyncd always compression

On Mon, 31 Aug 2009 13:37:16 -0700, Wayne Davison wrote:

>> Anyone knows a trick that the server only answer if the client is use
>> the compression?
> 
> This is not currently possible.

What if rsync-path is set to a little script that only accepts the 
connection (and exec()s the real rsync binary) if compression is set?

	- Andrew
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 1 comment |
headers
Carlos Carvalho | 1 Sep 2009 16:55
Picon

Re: rsync and symlinks

Jignesh Shah (jignesh.shah1980 <at> gmail.com) wrote on 1 September 2009 11:30:
 >Hi, I have one question regarding handling of symlinks in rsync. If I have
 >/source directory in which I have 100s of sub directories of directories and
 >each one has symlink to some directories out side the /source directory
 >hierarchy. Does rsync follows all those symlinks and syncs the data if I
 >specifies below rsync command?
 >
 >rsync -avz /source/ remote.ky:/source/

The -a option in this command will make rsync copy symlinks as
symlinks, to faithfully reproduce source on remote.ky.

 >source
 >   |
 >   | - source1 --> /projects/win
 >   | - source2 --> /projects/unix
 >   | - source3 --> /scripts/win
 >   | ....
 >
 >Does rsync command syncs /project contents as well?

Only if it's inside source.
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 2 comments |
headers
Jignesh Shah | 1 Sep 2009 18:47
Picon

Re: rsync and symlinks

Thanks Carlos.

... rsync copy symlinks as  symlinks
What about the contents pointed by simlinks?

Could you please also elaborate on "Only if it's inside source."

Thanks,
Jignesh



On Tue, Sep 1, 2009 at 8:25 PM, Carlos Carvalho <carlos <at> fisica.ufpr.br> wrote:
Jignesh Shah (jignesh.shah1980 <at> gmail.com) wrote on 1 September 2009 11:30:
 >Hi, I have one question regarding handling of symlinks in rsync. If I have
 >/source directory in which I have 100s of sub directories of directories and
 >each one has symlink to some directories out side the /source directory
 >hierarchy. Does rsync follows all those symlinks and syncs the data if I
 >specifies below rsync command?
 >
 >rsync -avz /source/ remote.ky:/source/

The -a option in this command will make rsync copy symlinks as
symlinks, to faithfully reproduce source on remote.ky.

 >source
 >   |
 >   | - source1 --> /projects/win
 >   | - source2 --> /projects/unix
 >   | - source3 --> /scripts/win
 >   | ....
 >
 >Does rsync command syncs /project contents as well?

Only if it's inside source.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 1 comment |
headers
Nathanael Jean-Francois | 1 Sep 2009 19:06

rsync 3.0.6 overflow question

Hello list,

I'm running rsync from a FreeBSD 6.3 server to another FreeBSD 6.3 
server. Both are running rsync 3.0.6. The transfer keeps dying with the 
following errors.

On the receiver I'm getting the following error

2009/09/01 11:27:58 [23670] overflow: xflags=0x546 l1=0 l2=10376 
lastname= [generator]
2009/09/01 11:27:58 [23670] ERROR: buffer overflow in recv_file_entry 
[generator]
2009/09/01 11:27:58 [23670] rsync error: error allocating core memory 
buffers (code 22) at util.c(123) [generator=3.0.6]

On the sender I get

2009/09/01 11:50:10 [13901] rsync: writefd_unbuffered failed to write 
803 bytes to socket [sender]: Broken pipe (32)
2009/09/01 11:50:10 [13901] rsync: read error: Connection reset by peer (54)
2009/09/01 11:50:10 [13901] _exit_cleanup(code=12, file=io.c, line=759): 
entered
2009/09/01 11:50:10 [13901] rsync error: error in rsync protocol data 
stream (code 12) at io.c(759) [sender=3.0.6]
2009/09/01 11:50:10 [13901] _exit_cleanup(code=12, file=io.c, line=759): 
about to call exit(12)

At first I thought it was a bad nic/rj45 issue that caused the 
connection to keep dying. I've replaced both already. I then thought it 
was the receiver that didn't have enough RAM so I added another 1G to 
bring it to a total of 2G. The sender also has 2G of RAM. I'm not sure 
what's causing the issue. It's not even that many files. As per df -i, 
/usr is only using 338871 inodes. Any help would be appreciated. Thanks.

--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 0 comments |
headers
samba-bugs | 1 Sep 2009 20:50
Picon
Favicon

DO NOT REPLY [Bug 6633] Extended attributes under Solaris are not supported.

https://bugzilla.samba.org/show_bug.cgi?id=6633

------- Comment #8 from wayned <at> samba.org  2009-09-01 13:50 CST -------
Aha.  The loop is being limited by buflen instead of sb.st_size.  Change this:

-               for (bufpos = 0; bufpos < buflen; ) {
-                       ssize_t cnt = read(attrfd, buf + bufpos, buflen -
bufpos);
+               for (bufpos = 0; bufpos < sb.st_size; ) {
+                       ssize_t cnt = read(attrfd, buf + bufpos, sb.st_size -
bufpos);

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 0 comments |
headers
Carlos Carvalho | 1 Sep 2009 20:57
Picon

Re: rsync and symlinks

Jignesh Shah (jignesh.shah1980 <at> gmail.com) wrote on 1 September 2009 22:17:
 >Thanks Carlos.
 >
 >... rsync copy symlinks as  symlinks
 >What about the contents pointed by simlinks?

If they exist on the destination at the same place the symlink will
point to them, otherwise they'll dangling there (at the destination).

 >Could you please also elaborate on "Only if it's inside source."

In you diagram below

 >>  >source
 >>  >   |
 >>  >   | - source1 --> /projects/win
 >>  >   | - source2 --> /projects/unix
 >>  >   | - source3 --> /scripts/win

If projects is inside source it'll be copied. However you said it's
outside, and your absolute paths above also indicate it, so projects
will not be copied and the symlinks at the destination will be
dangling.

rsync has several options to deal with symlinks; there's a section of
the manual just for this. If you want to have the contents pointed to
by the symlinks copied to the destination you might want to look at
these options.
--

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Permalink | Reply | 0 comments |

Gmane