martin f krafft | 27 Jan 11:20 2016
Picon

Identifying new files

Hello,

is there an easy way to identify which files were added to a backup?
The File Size/Count Reuse Summary table tells me about a number of
files and their size, but I wonder if there's an easy way to get
a file list, other than increasing the verbosity and parsing the
XferLog?

Thanks,

-- 
 <at> martinkrafft | http://madduck.net/ | http://two.sentenc.es/

"men who say it cannot be done should not interrupt men doing it."
                                              -- old chinese proverb

spamtraps: madduck.bogus <at> madduck.net
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
(Continue reading)

David Rotger | 26 Jan 09:07 2016
Picon

Problem backup smb through DNS name

Hi,

I've a bind9 server running and working. When I try to backup a smb
share from windows with host IP, the work fine. But if I put the dns
name of the machine, backkuppc get this error:

2016-01-26 09:00:08 full backup started for share copia
2016-01-26 09:00:10 Got fatal error during xfer (No files dumped for
share copia)

why?!?!

I can ping with IP and DNS name, and nslookup resolv the the host name and IP...

--

-- 
David Rotger

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

(Continue reading)

Gandalf Corvotempesta | 23 Jan 13:06 2016
Picon

Mail recipient

Hi,
i'm trying to send mail to a specific recipient with BPC 4

I've already set this:

$Conf{EMailFromUserName} = 'noc <at> mydomain.tld';
$Conf{EMailAdminUserName} = 'noc <at> mydomain.tld';
$Conf{EMailUserDestDomain} = ' <at> mydomain.tld';

as wrote in docs, EMailAdminUserName should be the recipient
of admin email. It could be a local user (for example "backuppc" or a
remote address, like mine)

But all email are still sent to backuppc <at> localdomain

Any advice ?

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

(Continue reading)

Merz, Christian | 22 Jan 14:43 2016
Picon

BPC 4 - Missing pool file

Hi all,

 

my BPC 4 Installation (on Debian 8, Pool on ZFS) has been running fine so far.

There are 91 hosts that have been backed up, for a total of:

 

    357 full backups of total size 21698.30GiB (prior to pooling and compression),

    1658 incr backups of total size 1605.12GiB (prior to pooling and compression).

 

But when I did an archive, I noticed quite some errors:

 

Excerpt from archive.log:

 

Writing tar archive for host n128, backup #39, split to output files /media/truecrypt1/n128.39.tar.gz.*

Unable to open file /data/BackupPC/pool/00/00/00000000000000000000000000000000

Unable to open file /data/BackupPC/pool/34/42/354244353641350000fdab86b305a483

Unable to open file /data/BackupPC/pool/0c/de/0cdf558543a65bcad328000000000000

Unable to open file /data/BackupPC/pool/00/00/00000000000000000000000000000000

Unable to open file /data/BackupPC/pool/46/30/46313339303036314432313432463700

Unable to open file /data/BackupPC/pool/00/00/00000000000000000000000000000000

Done: 166796 files, 54304422997 bytes, 4458 dirs, 0 specials, 6 errors

 

Also, when doing an incremental Backup of that host:

 

Running BackupPC_refCountUpdate -h n128 on n128

xferPids 26755

BackupPC_refCountUpdate: host n128 got 0 errors

BackupPC_refCountPrint: total errors: 0

xferPids

Finished BackupPC_refCountUpdate (running time: 1 sec)

Running BackupPC_refCountUpdate -h n128 -f -c on n128

xferPids 26759

Host n128 digest.0 00000000000000000000000000000000 count is 18, but should be 19

Host n128 digest.0 a399957ce1fcba591cc58367faabad93 count is 6, but should be 5

BackupPC_refCountUpdate: host n128 got 2 errors

BackupPC_refCountPrint: total errors: 2

xferPids

Finished BackupPC_refCountUpdate (running time: 11 sec)

 

 

 

I then had a look at the general BPC Logfile, and sure enough, the nightly jobs are reporting these files as missing too:

 

Contents of file /var/log/BackupPC/LOG, modified 2016-01-22 14:00:34

 

2016-01-21 21:00:00 Running 2 BackupPC_nightly jobs from 0..15 (out of 0..15)

2016-01-21 21:00:00 Running BackupPC_nightly -m -P 9 0 127 (pid=10496)

2016-01-21 21:00:00 Running BackupPC_nightly -P 9 128 255 (pid=10497)

2016-01-21 21:00:00 Next wakeup is 2016-01-21 21:30:00

2016-01-21 21:00:01 BackupPC_nightly now running BackupPC_refCountUpdate -m -s -c -P 9 -r 128-255

2016-01-21 21:00:01 BackupPC_nightly now running BackupPC_refCountUpdate -m -s -c -P 9 -r 0-127

2016-01-21 21:02:37  admin : Missing pool file 00000000000000000000000000000000 count 35

2016-01-21 21:02:37  admin : Missing pool file 001000001045283f904033e72800848e count 1

2016-01-21 21:02:37  admin : Missing pool file 01a995a601000010bda3f79705a48302 count 1

2016-01-21 21:02:37  admin : Missing pool file 0000c62cf2f281030000100000000000 count 2

2016-01-21 21:02:37  admin : Missing pool file 00f466f81d0000101000000000000000 count 1

2016-01-21 21:02:37  admin : Missing pool file 0010020000c702a9aa18000010190000 count 1

2016-01-21 21:02:37  admin : Missing pool file 0000100010330000f7b0b1aa05a48302 count 1

2016-01-21 21:02:37  admin : Missing pool file 0000d596bc9505a48302000080d007de count 1

2016-01-21 21:02:37  admin : Missing pool file 0000b5ce999705a48302000080fc0583 count 1

2016-01-21 21:02:38  admin1 : Missing pool file 80f8a701000010000010af95a7010000 count 1

2016-01-21 21:04:52  admin1 : Missing pool file 8800053438303139000085c5b4a505a4 count 1

2016-01-21 21:21:18  admin1 : BackupPC_refCountPrint: total errors: 25

2016-01-21 21:21:18  admin1 : xferPids

2016-01-21 21:21:18 Finished  admin1  (BackupPC_nightly -P 9 128 255)

2016-01-21 21:21:43  admin : BackupPC_refCountPrint: total errors: 39

2016-01-21 21:21:43  admin : xferPids

 

Is this something to be worried about? And what could cause it?

It’s running on server-grade hardware, ECC RAM etc., the ZFS Pool looks completely healthy, so I’d tend to rule out flaky hardware.

Is there a way to find out to which files these hashes belong to? Maybe there is something special about them.

 

Regards,
Christian

 

--

 

Christian Merz
IT Administration

hte GmbH
the high throughput experimentation company
Kurpfalzring 104, 69123 Heidelberg, Germany

T: +49 6221 7497 181
F: +49 6221 7497 137

www.hte-company.com

Registergericht: Amtsgericht Mannheim HRB 717943
Sitz der Gesellschaft: Heidelberg
Geschäftsführer: Dr. Wolfram Stichert

 

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Adam Goryachev | 21 Jan 23:11 2016
Picon

Re: BPC 4 very slow

On 22/01/16 04:43, Les Mikesell wrote:
> On Thu, Jan 21, 2016 at 10:13 AM, Gandalf Corvotempesta
> <gandalf.corvotempesta <at> gmail.com> wrote:
>> 2016-01-21 16:30 GMT+01:00 Les Mikesell <lesmikesell <at> gmail.com>:
>>> V4 does it backwards from v3.   The last backup is always filled and
>>> the older ones are changed to reverse deltas.  It must move/copy
>>> things around to arrange that.   And the full and incremental runs
>>> aren't tied to keeping filled/unfilled backups anymore.  But, I still
>>> don't see why any expired already.
>> Another this to know is why BPC is fsck every backups every time.
>> After each backup, it will run fsck. It should run just for the last
>> executed backup, as previously ones was alreday checked.
>>
>> But is running fsck every time for each backup that I have, taking
>> many many hours. Like now:
>> srv1 is fsck #1, then #2, then #4. after all, it will run a new backup
>> and start again the fsck
>>
> I see some earlier mail list messages saying that is normal:
> http://sourceforge.net/p/backuppc/mailman/message/34478542/
> I guess that's when it removes files that are not in any current
> backup.  Apparently it only takes a long time when you have a very
> large number of files.
>
Yes, it is "normal" but it doesn't seem to be ideal, and I don't think 
it should be required. I started looking at this, but then got side 
tracked with the more serious bug in rsync_bpc. Will eventually come 
back to this, but it means trying to understand the underlying 
principles of how BPC works on the pool and pc trees.

Regards,
Adam

--

-- 
Adam Goryachev Website Managers www.websitemanagers.com.au

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Gandalf Corvotempesta | 21 Jan 19:45 2016
Picon

Re: BPC 4 very slow

2016-01-21 18:43 GMT+01:00 Les Mikesell <lesmikesell <at> gmail.com>:
> I see some earlier mail list messages saying that is normal:
> http://sourceforge.net/p/backuppc/mailman/message/34478542/
> I guess that's when it removes files that are not in any current
> backup.  Apparently it only takes a long time when you have a very
> large number of files.

I understood what is happening by looking at the code. I need help to
debug more.

When BackupPC_dump is running, a temporary "needFsck.dump" is created
(line #985)
This will trigger an fsck on next run (lines #723-#730)

Temporary file is deleted at #1159 but in my case this is not
happening, thus, an fsck is always run.

So, in my case, the issue is between lines #985 and #1159

Probably, my backups are always detected as failed. A failed backup
will exit without removing the temporary fsck file (line #1152)

Somethimes I'm getting these errors:

2016-01-21 13:53:09 Got fatal error during xfer (rsync error: error in
rsync protocol data stream (code 12) at io.c(629) [generator=3.0.9.3])
2016-01-21 13:53:15 Backup aborted (rsync error: error in rsync
protocol data stream (code 12) at io.c(629) [generator=3.0.9.3])

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

olafkewl | 18 Jan 11:21 2016
Picon

unregister


------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Max Ricketts | 17 Jan 14:42 2016
Picon
Gravatar

Retentiona and Archive

I have installed Backuppc succesfully and all is working well.  I am having troubles understanding the retention policies for full and incremental.

I am looking at being able to restore one particular file from any day in the past year.

I have read about archiving off, but not sure how to set the retention time on this either. 

Some help or explanation would be great.  I have read the docs, and dont completely understand it.

Many thanks

Max
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Gandalf Corvotempesta | 15 Jan 15:01 2016
Picon

Strange issue with pc configs

Based on official docs:
http://backuppc.sourceforge.net/faq/BackupPC.html#Configuration-File

I can read this: "The BackupPC configuration file resides in
__CONFDIR__/config.pl. Optional per-PC configuration files reside in
__CONFDIR__/pc/$host.pl (or __TOPDIR__/pc/$host/config.pl in non-FHS
versions of BackupPC). This file can be used to override settings just
for a particular PC."

i've tried to use a config file placed in /etc/backuppc/pc/hostname.pl
, same path used with success by v4, but v3 doesn't read that.

By customizing config from web interface, the customized file is saved
in __CONFDIR__/$host.pl

Surely, i'm missing something. How can I use the /pc/ folder ?

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Nicola Scattolin | 15 Jan 14:41 2016

check backuppc file

Hi to all,
i got a problem about a week ago and i found that my backuppc drives was 
dying.
now i'm copying my old pools on the new drive but i got a lot of I/O 
errors on old drive, there is a way to force backuppc to check if the 
files are still ok? Because i know that if a file is alredy been copy by 
backuppc it will not copy it again, but i don't want to lose files when 
backuppc think a file is already in the pool, but it's corrupted.
If it's not possible i will erase the old backups and start new ones, 
but i got a 1.4 TB backup to do and it will take a lot

Thanks
  Nicola

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Bzzzz | 13 Jan 21:22 2016
Picon

Garbage into XferLog.z

Hi list,

First, I already have had this problem for this particular machine when
I wanted it to be a client (garbage into NewFileList).
It runs under a Debian sid 64bits, just like half of my park
(1/2: sid 64bits & 32bits, 2/2: jessie 32bits).

Today, it becomes the backuppc svr and I still have problems
(NewFileList is now empty).

The main problem is:
/usr/share/backuppc/bin/BackupPC_zcat pc/backuppcsvr.domain/XferLOG.z
only return garbage (a bit like if file had a different encoding,
which is not possible as all machines works with UTF-8); so,
no backup is made from the server itself:(

* Where could it come from?

* How to fix that?

Jean-Yves

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users <at> lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Gmane