Jason Cooper | 23 Feb 02:02 2015
Picon

LVM -and- ssh backups?

All,

Perhaps my $searchengine-fu is failing me, but I'm unable to see a way
to accomplish the following.  I'd like to snapshot an LVM on system A
and then store the backup on system B via ssh.

Unfortunately, the config nomenclature rsnapshot seems to make this
impossible.  eg: On my existing Xen box that has the backup drive:

  backup  lvm://data0/jason_home/                jason_home/

where data0 is a VG on system A backed by a large raid5.  jason_home/ is
on an external drive also attached to system A.

So, now on system B, I have a VG, no Xen, and a need to backup one of
the LVs to the backup drive on system A.  I'd like to do:

  backup  lvm://titan0/jason_home/	jason <at> systemA-rsnapshot:titan_home/

But configtest barfs on that...

Am I missing something obvious here?  Why, when I want to use ssh, does
everything say I must configure the first argument to 'backup'?  I'd
think I'd want that info in the destination...

Thanks for any insight,

Jason.

------------------------------------------------------------------------------
(Continue reading)

David Cantrell | 11 Feb 17:32 2015
Picon

Github repository moving

FYI the Github repository is moving from being under my personal Github
account to a Github organisation.

The only change you should see is that it's moving from here:
  https://github.com/DrHyde/rsnapshot
to here:
  https://github.com/rsnapshot/rsnapshot

Summarising the Github doco ... most stuff should continue working as
normal as Github will do webby and gitty redirects. However, this can be
somewhat confusing, so we strongly recommend updating any existing local
clones to point to the new repository URL.

See https://help.github.com/articles/transferring-a-repository/ for
details, especially if you've forked the repo.

--

-- 
David Cantrell

------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
Shair Ali | 11 Feb 05:43 2015
Picon

incremental backup not taking place instead whole new backup is taking place every day


------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Scott Hess | 29 Jan 21:57 2015

Re: Incremental suddenly not working

In my experience the best way to debug rsnapshot happenings is to read /var/log/rsnapshot.log (or run rsnapshot -t hourly), then run those commands yourself.  You might want to turn off the crontab while doing it, though you could also carefully edit the commands to put directories in a different location.  Modify the rsync command-lines to add --dry-run and --verbose or --itemize-changes to tell you what's being changed, then actually look at those files in the backup and on the original system to figure out why.  I suspect you'll find that something changed on the system being backed up.

Note that once you're in this state, it's somewhat likely that things won't just fix themselves, depending on the state of the intermediate snapshots.  Sometimes you can prune back to the last known-good snapshot, move that to hourly.0, and move forward.  But be VERY CAREFUL.  I always move the intermediates to a sub-directory and use cp -al good.N hourly.0, then circle back and remove the extraneous directories a few days or weeks later.

-scott


On Thu, Jan 29, 2015 at 10:31 AM, Rick Cohen <rick <at> teakdigital.com> wrote:
Hello,

Just within the last couple of days the incremental aspect of rsnapshot has stopped working. I made no changes to the .conf file during this time and the log file show the exact same command run last week when it worked as opposed to today when it does not. 

What is happening is that rsnapshot is running rsync and pulling everything to hourly.0 instead of just pulling the differences between hourly.1 and hourly.0. What could be causing this to happen?

Please let me know if more info is needed to assist me with this.

Thanks,
Rick

------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss


------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
David Keegel | 29 Jan 21:14 2015
Picon
Picon

Re: Incremental suddenly not working

On Thu, Jan 29, 2015 at 10:31:07AM -0800, Rick Cohen wrote:
>    Hello,
>    Just within the last couple of days the incremental aspect of rsnapshot
>    has stopped working. I made no changes to the .conf file during this
>    time and the log file show the exact same command run last week when it
>    worked as opposed to today when it does not.Â
>    What is happening is that rsnapshot is running rsync and pulling
>    everything to hourly.0 instead of just pulling the differences between
>    hourly.1 and hourly.0. What could be causing this to happen?
>    Please let me know if more info is needed to assist me with this.
>    Thanks,
>    Rick

More info is needed.

Start with your rsnapshot config (minus comments and blank lines) :-
	perl -ne 'print if /^[^#\n]/' /etc/rsnapshot.conf
(assuming you use /etc/rsnapshot.conf) and the output of :-
	rsnapshot du

Also check your rsnapshot log file to see what commands rsnapshot
is running (is there any difference within the last couple of days?)
and look for errors in rsnapshot output (this is usually emailed by
cron to root or whichever user is running the cron job).

How do you know that rsnapshot is "pulling everything to hourly.0 instead
of just pulling the differences between hourly.1 and hourly.0"?  If you
can demonstrate evidence of that, it might help us help you.

--

-- 
___________________________________________________________________________
  David Keegel <djk <at> cyber.com.au>        Cyber IT Solutions Pty. Ltd.
   http://www.cyber.com.au/~djk/     Linux & Unix Systems Administration

------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
Gordon Messmer | 29 Jan 20:19 2015
Picon

Re: Incremental suddenly not working

On 01/29/2015 10:31 AM, Rick Cohen wrote:
> What is happening is that rsnapshot is running rsync and pulling
> everything to hourly.0 instead of just pulling the differences between
> hourly.1 and hourly.0. What could be causing this to happen?

Could: Something updated the modification time on your files?

------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
Rick Cohen | 29 Jan 19:31 2015

Incremental suddenly not working

Hello,

Just within the last couple of days the incremental aspect of rsnapshot has stopped working. I made no changes to the .conf file during this time and the log file show the exact same command run last week when it worked as opposed to today when it does not. 

What is happening is that rsnapshot is running rsync and pulling everything to hourly.0 instead of just pulling the differences between hourly.1 and hourly.0. What could be causing this to happen?

Please let me know if more info is needed to assist me with this.

Thanks,
Rick
------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
Harry Putnam | 22 Jan 18:40 2015

Having trouble with cp'ing files in h.0 to h.1 as links

Setup: OS=openindiana (a branch of solaris very close to solaris 11)
  rsnapshot-1.3.1lk, rsync-3.1.2dev

I see this problem has come up many times, but the googling I did
seems to indicate that something different is happening here.

  This line is taken from an rsnapshot run on a Solaris HOST where
  several similar rsnapshot runs happen... none of the 8 or so others
  have this problem:

-------       -------       ---=---       -------       ------- 
  /usr/gnu/bin/cp: cannot create link
`/rmh/m2/ImagesMusic/hourly.1/m2-IandM/ImageDB/images/imageArch/00inc/can1/2005/052602/can1_0015.XMP':
Cross-device link
-------       -------       ---=---       -------       -------

The usual recommended thing is to suggest uncommenting cmd_cp, but as
you can see above, I'm already doing that... and using gnu cp.

I tried using solaris cp too, but it has no flag like -l in gnu/cp
so is a non-starter.

-------       -------       ---=---       -------       -------

Am I correct in thinking the actual cmd is cp -al??

-------       -------       ---=---       -------       ------- 

So I tried the cp operation still with gnu/cp,  by hand on those same
files and (no surprise) had the same failure.

OK, tried on some different files... not from that same source and it
works fine.

That seems to indicate the files themselves may be the source of the
problem.

These files are from Windows 7 OS.  But in this particular case,
already reside on my Solaris host for many months.  So the files are
from windows but now live on Solaris.

Once I get past cp'ing files already present on solaris, I'll be
working with files direct from windows.

So, any good guesses how to handle this problem?

------------------------------------------------------------------------------
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
Terry Barnum | 21 Jan 21:20 2015

space in snapshot_root path?

I'd like to use an existing disk in use for rsnapshot backups but the disk name has a space in it. Changing the
disk name would be disruptive because it's already being used for other tasks. I found discussion threads
where it sounds like using spaces isn't possible after 1.3.0. I'm running 1.3.1. I've tried:

snapshot_root   /Volumes/diskname\ backup/snapshots/
snapshot_root   "/Volumes/diskname backup/snapshots/"
snapshot_root   '/Volumes/diskname backup/snapshots/'
snapshot_root   /Volumes/diskname?backup/snapshots/

Thanks,
-Terry

Terry Barnum
digital OutPost
http://www.dop.com

------------------------------------------------------------------------------
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
alexandre | 21 Jan 19:03 2015
Picon

Option for rsnapshot recycle old backup directory

Hello

I love your scripts.

I was using the old script of backup you refer to ( the mikerubel one )

http://www.mikerubel.org/computers/rsync_snapshots/

i was using something like this one :

mv backup.3 backup.tmp
mv backup.2 backup.3
mv backup.1 backup.2
mv backup.0 backup.1
mv backup.tmp backup.0
cp -al backup.1/. backup.0
rsync -a --delete source_directory/ backup.0/

with the recycle the old backup directory, because the rm command was 
taking very very very long on my nas....  ( lots of small files )

Do you thing you can add on option so that rsnaphot can do the same.

Great jobs guys.

Alexandre

------------------------------------------------------------------------------
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
Harry Putnam | 21 Jan 18:41 2015

How to include existing directory hierarchy into rsnapshot bkups

I thought I'd try something I haven't really thought about before

I have 280 GB or so of image files from a windows host, backedup onto
a sorlaris host. I used rsync every once in a while to sync up the
pile of photos.

Now I've setup what is, to me, (I'm sure some hear will probably just
smile at the small amounts of data involved), a full fledged rsnapshot
server on a solaris hosts.

So, I thought I'd setup an rsnapshot run that I'd probably run by hand
periodically on that same dataset.

After studying the hierarchy rsnap creates, I wondered if I could create
the rsnapshot run in a way that puts that data in the slot where
`hourly.0' normally would appear.

Hopefully rsync would move it to `hourly.1' and proceed with the new
bits that have changed

Is trying this likely to result in a major mess? ( I do have all the
same data plus another 1-2GBs or so more on the windows box, so its
not the only copy of that data).

Or will rsync just laugh and say `yeah, right!' and throw errors?

------------------------------------------------------------------------------
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet

Gmane