Picon

Re: Status on new BackupPC v4


Personally, I have only one fundamental issue with BackuPC 3.x, that we rely upon to back up all of our linux
clients (including a 3000 core cluster). The problem is that it replaces modern rsync with some ancient
embedded version. If that one thing could be "patched" I would hardly care about any other changes. The
possibility of using modern rsync, and possibly "parsync" to do multi-threaded transfers is about the
only thing I currently have to work around. I have even looked at commercial alternatives, and so far none
of them make any economic sense to use.

Mark Moorcroft
AMA Corp.
650-604-4784
mailto:mark.moorcroft <at> nasa.gov

------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

terryls | 10 May 15:00 2016

Windows backups fail, Linux backups complete

What could cause Windows servers to suddenly fail backups while Linux servers continue to backup?
Windows servers have a mix of firewall off/on, have a mix of updates on/off...
I have restored the configuration files on the backup server from a date prior to the issue,
I can get different results by changing ClientNameAlias, etc, but never completes.
usually one of the following errors:
tar:712 Total bytes received: 537930050
No files dumped for share C$
Error logs usually indicate the following:
full backup started for share
2016-05-10 02:48:53 Got fatal error during xfer (tar:712  Total bytes received: 11365692394)
2016-05-10 02:48:58 Backup aborted (tar:712  Total bytes received: 11365692394)
Ubuntu 14.04
SMB backup method.

Thank you

+----------------------------------------------------------------------
|This was sent by tschmid4 <at> utk.edu via Backup Central.
|Forward SPAM to abuse <at> backupcentral.com.
+----------------------------------------------------------------------

------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
(Continue reading)

cardiganimpatience | 6 May 16:19 2016

Migrate local data into BackupPC pool for remote client

BackupPC is installed and working great for new hosts. Is there a way to take the hundreds of GB from old hosts
that exist on the backup server and import them into the BackupPC storage pool? 

The old backup system uses rsync to dump all files to a local disk on the same server where BackupPC is
installed, albeit with incorrect file ownership. I don't want to re-transfer that data over our narrow
bandwidth connection if I don't have to. I believe rsync will sort out permissions and timestamps on its own.

So far I've created a host in BackupPC and changed the transfer type to 'tar' and successfully imported one
of its mount points, but now the tar sharename is called "/home/backup/≤servername>/cur/≤share>/",
where the actual share on the host is simply called /<share>. 

My intention is to flip the Xfer method from 'tar' to 'rsync' after I get most of the larger shares imported
via local tar. Is it necessary to associate the imported files with a specific host or does hard-linking
take care of all that?

Thanks!

+----------------------------------------------------------------------
|This was sent by itismike <at> gmail.com via Backup Central.
|Forward SPAM to abuse <at> backupcentral.com.
+----------------------------------------------------------------------

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
(Continue reading)

Elias Pereira | 3 May 23:25 2016
Picon

Verify found differences in final status

Hello fellas,

This status "Verify found differences" is considered an error?

--
Elias Pereira
------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
gregor | 3 May 21:53 2016
Picon

Rename "new" to number failed after Backup

Hi,

since some days the automatically backup failed after the backup job
with the following line:

2016-05-03 21:29:24 Rename /var/lib/BackupPC//pc/srv01/new ->
/var/lib/BackupPC//pc/srv01/91 failed

When I trigger the backup from the webinterface full and incremental
backups finish. This happens only when automatically backups are
triggered. The problem started a week ago.

What is the difference between automatically and manually backups or how
can I resolve this problem?

cheers
gregor

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Dmitry Katsubo | 2 May 19:23 2016
Picon
Gravatar

Re: Wildcard support in BackupFilesOnly/BackupFilesExclude

On 2016-04-29 15:20, Bowie Bailey wrote:
> On 4/29/2016 7:04 AM, Dmitry Katsubo wrote:
>> Hello everyone,
>>
>> I wonder if there is any support for wildcards in
>> BackupFilesOnly/BackupFilesExclude
>> configuration options? This has been raised several times in this maillist
>> (see [1]-[5]) and seems to be a desired feature. However for me personally it
>> does not work. I am using BackupPC to backup files locally:
>>
>> Running: /usr/bin/sudo /bin/tar -c -v -f - -C /var --totals
>> --exclude=./proc ./lib/cacti ./lib/dpkg ./www/*.ini
>> full backup started for directory /var
>> Xfer PIDs are now 1662,1661
>> [ skipped 5680 lines ]
>> /bin/tar: ./www/*.ini: Cannot stat: No such file or directory
>>
>> BackupPC v3.3.1
>>
>> [1] https://sourceforge.net/p/backuppc/mailman/message/8072359/
>> [2] https://sourceforge.net/p/backuppc/mailman/message/8072369/
>> [3] https://sourceforge.net/p/backuppc/mailman/message/19273498/
>> [4] https://sourceforge.net/p/backuppc/mailman/message/19493568/
>> [5] https://sourceforge.net/p/backuppc/mailman/message/22116576/
> 
> Can you show us what your excludes look like in the backuppc config 
> file?  It looks like your exclude list is not being passed to tar 
> correctly.  Based on the syntax below, you are specifically backing up 
> /var/lib/cacti, /var/lib/dpkg, and /var/www/*.ini and only excluding 
> /var/proc.  The error is probably because there are no ini files in 
> /var/www.
> 
> I'm guessing that you have specified the excludes improperly in your 
> config file.

Actually I have cropped tar command line and removed almost all excludes.
They are inherited from /etc/backuppc/config.pl and are not overridden:

$Conf{BackupFilesExclude} = {
  '*' => [
    '/proc',
    '/sys',
    '/dev',
    '/tmp',
    '/media',
    '/lost+found',
    '/usr/src',
    '/var/lib/backuppc'
  ]
};

The .ini files are present, because if I "extend" the list they all
get into backup (I can browse and view them). The configuration that
works:

$Conf{BackupFilesOnly} = {
  '/var' => [
    'lib/cacti',
    'lib/dpkg',
    'www/users.ini',
    'www/files.ini'
  ]
};

This configuration does not work:

$Conf{BackupFilesOnly} = {
  '/var' => [
    'lib/cacti',
    'lib/dpkg',
    'www/*.ini'
  ]
};

Actually I have tried this one:

$Conf{BackupFilesOnly} = {
  '/var' => [
    'lib/cacti',
    'lib/dpkg',
    'www/*'
  ]
};

and it resulted the same error.
'www/*' resolves to many files for sure.

Thanks for looking into that.

--

-- 
With best regards,
Dmitry

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Picon

Not saving this as a partial backup since it has fewer files than the prior one

Good day!
What this error mean?

http://pastebin.com/EwaaYqM9

I copy the files named ncore-base.zip from different servers.
On some servers, the backup pass, on some is coming out this error. 


-- С Уважением, начальник отдела информатизации и обеспечения информационной безопаcности УФССП России по Республике Татарстан С.Х. Загидулин (843)221-38-80
------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Otto Wincrantz | 26 Apr 12:55 2016

SMB shares backup issue with smbclient 4.2.10

Just thought I'd share this, in case someone else comes across the same issue.

BackupPC-3.3.1-1.el7.x86_64 on CentOS 7.1

After a nightly yum update, which updated smbclient to 4.2.10, all SMB backups of my NetApp filers stopped working with the error below:
2016-04-20 15:00:04 full backup started for share backup1 2016-04-20 15:00:07 Got fatal error during xfer (session setup failed: NT code 0x80090302) 2016-04-20 15:00:16 Backup aborted (session setup failed: NT code 0x80090302)
The fix was to change the smb backup command, adding --option=clientusespnego=no, like so:
$smbClientPath --option=clientusespnego=no \\$host\$shareName $I_option -U $userName -E -d 1 -c tarmode\ full -Tc$X_option - $fileList

Cheers,

Otto

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Ariel Sanguinetti | 25 Apr 23:12 2016
Picon
Gravatar

Issues with SMB shares

Hi everyone,

I'm having issues doing backups on samba shares. I'm currently using Ubuntu Trusty and Backuppc 3.3.0 with smbclient 4.3.8.

I think this is happening since the update of samba to the latest version. Any clue on how to solve this?

Kind regards,
Ariel
------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Rob Owens | 25 Apr 22:28 2016
Picon

moving the pool disk to another computer -- file ownership

I had an issue with the root filesystem of my backuppc server (system A) which 
required a restore.  So I moved the pool disk to another computer (system B), 
installed backuppc on that computer, booted system A off of a live CD, and 
prepared for a restore.

However, system B assigned a different UID to the backuppc user than system A
did, so all of the files in the backuppc pool (now attached to system B) did 
not have the proper ownership.  As a result, backuppc would not start.  I got
the "test hardlink failed" message.

I considered changing the UID of the backuppc user (using the usermod command)
but the UID I needed to change it to was already in use.  So I did 
'chown -R backuppc.backuppc /var/lib/backuppc'.  This took several hours, as 
there were 59 million files (mostly hard links).  But it worked and I got my
restore done.  (Note:  I also chown'd my /etc/BackupPC files).

So I'm trying to figure out the best way to avoid this in the future.  Here
are some ideas I had.  I'm looking for critiques and advice.

1)  Choose a UID that hopefully won't be used on any future system I may 
install backuppc onto.  Maybe something in the 300-399 range.  usermod my
backuppc user on all systems to use that UID, and chown my pool today while 
I'm not in a hurry.  

2)  Try to convince Craig Barratt and all major distros to standardize on
a particular UID and GID for the backuppc user and group.  This is harder
for me to accomplish than #1, but would virtually guarantee that my pool 
disk could be dropped into any other server, regardless of distro.

3)  Run backuppc as root in an emergency.  I actually tried this, but the
web interface complained that it was not being run as the same user that
owned the pool files.  And apache refused to run as root, so I was unable
to make this work.

4)  Temporarily usermod my backuppc user to whatever UID is required to get 
things to work during an emergency, even if it does conflict with another 
user account.  Usermod has the '--non-unique' option which would allow this.  
What negative consequences might this have?

5)  Convince backuppc to disregard the "test hardlink failed", and start
anyway.  I suspect I would still run into file permission problems, though.

By the way, both systems in question are running Funtoo.  But my goal 
would be to make this work on any system.  In a disaster situation, I 
may need to install whatever distro I have easy access to, or even use a 
live cd or live usb.

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

karlis | 25 Apr 13:13 2016

smbclient tar problem with umlauts

I had similar problem. after Samba upgrade to 4.3.8. The main problem after upgrade was smb backups
crashing, so I downgraded Samba to version 4.1.6, and UTF-8 problem is gone also.
--
Karlis

+----------------------------------------------------------------------
|This was sent by karlis.irmejs <at> limbazi.lv via Backup Central.
|Forward SPAM to abuse <at> backupcentral.com.
+----------------------------------------------------------------------

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Gmane