Re: FYI: nilfs2 in Debian

Hi Daniel,

On Sat, 2008-04-26 at 15:15 +0200, Daniel Baumann wrote:
> Hi,
> 
> I've uploaded nilfs2 and nilfs2-tools to Debian. They are present in
> unstable, and soon migrate to testing, which means that nilfs2 will be
> present in the upcoming new stable release of Debian, called 5.0 "lenny".
> 
> Later, I'll add it to linux-modules-extra-2.6, so that pre-build module
> packages for all Debian default kernel images are available (see [0] for
> more information about kernel modules packaging in Debian).
> 
> Regards,
> Daniel
> 
> [0]
> http://blog.daniel-baumann.ch/2006/12/10#20061210_kernel-modules-packaging

Thank you for uploading nilfs2 and nilfs2-tools to Debian sid,
and thank you for letting us know about their nearest packaging plan.

We will revise our web page for Debian package, and would also like
to stop serving non-official packages for lenny to avoid overlap
when your packages will migrate to lenny.

If you have any problem in pursuing the plan, please let us know.

Best regards,
--

-- 

Re: FYI: nilfs2 in AUR

Hi,

On Mon, 2008-04-28 at 12:23 +0200, Geoffroy Carrier wrote:
> Hi,
> 
> AUR is Archlinux Users Repository. It works a lot like *BSD ports.
> I recently integrated nilfs and nilfs-utils.
> I hope I will be able to integrate them in binary form in Archlinux soon.
> 
> Regards,

Thanks for letting us know.

I found you have been offering build files since two years ago
on the following AUR page. thanks!

http://aur.archlinux.org/packages.php?ID=4225

I would like to describe your contribution for AUR in the table of
NILFS2 download page unless you prefer not to.

Best regards,
--

-- 
Ryusuke Konishi
NILFS team NTT
http://www.nilfs.org/

Re: FYI: nilfs2 in AUR

On 5/1/08, Ryusuke Konishi <ryusuke <at> osrg.net> wrote:
>  I found you have been offering build files since two years ago
>  on the following AUR page. thanks!
Actually, the package was orphaned, and based on version 1.
I adopted it a week ago, cleaned it and turned it into version 2
(actually a complete rewrite).

>  I would like to describe your contribution for AUR in the table of
>  NILFS2 download page unless you prefer not to.
I would be very pleased.
I'm working on an automated build dependencies checking system relying
on nilfs for fast fs rollbacks (using only one snapshot of a "base"
archlinux development system).
It may become widely used by Archlinux, as nothing similar exists
now... That may cause nilfs and nilfs-utils integration in main
repositories.

I'll keep you informed!

Thanks for your amazing fs,
Best regards,

--

-- 
Geoffroy Carrier

_______________________________________________
users mailing list
users@...
https://www.nilfs.org/mailman/listinfo/users

some questions

I am very interested in nilfs2 so I have some questions ?

1. If I understood well, nilfs is always appending to the end (is this 
true or is also other data modified, for example to update pointers ?). 
What is happening if I have deleted files and cleanerd deletes the 
snapshots ? Will this space be written by further write operations or 
will it be lost ?
2. I suppose that some fragmentation will build up, is there any 
defragmentation tool planned ?
3. How robust is nilfs to device errors like bad sectors ? For example 
if you have a disk image where bad sectors are replaced by zeros, will 
you still be able to recover data from other sectors ?

OOM while deleting very large files

Hi!
I had a large Nilfs2 (about 250 GB), and 2 files with about 100 GB in
it. When i tried to delete the file, either
rm bigfile1

or after it failed

echo '' >bigfile1

the pc worked a long time, and then nilfs2 used so much ram, that the
kernel killed all programs, and finally the pc was unusable. It was not
possible to delete the files, other than reformatting the partition.

At the moment, i can not do any further tests, because the partition is
now filled with useful files, and i do not want to fill the rest with
undeletable files. But maybe you can find the memleak(?) in the Source.

Alex

Re: some questions

Hi,

From: David Arendt <admin@...>
Subject: [NILFS users] some questions
Date: Sun, 04 May 2008 18:16:59 +0200
> I am very interested in nilfs2 so I have some questions ?

Sure.

> 1. If I understood well, nilfs is always appending to the end (is this 
> true or is also other data modified, for example to update pointers ?). 
> What is happening if I have deleted files and cleanerd deletes the 
> snapshots ?

If you deletes files, new directory blocks that doesn't have their
entries, are just written out.
When the cleanerd finds a block that is not referred to from any
snapshots, it is identified as removable and will not be copied
during reclamation.

> Will this space be written by further write operations or 
> will it be lost ?

Eventually the abandoned block will be overrode with a new block.

(To be more exact, NILFS manages disk space with units of segments;
 the cleanerd reclaims segments instead of disk blocks. )

> 2. I suppose that some fragmentation will build up, is there any 

Re: OOM while deleting very large files

Hi Alex,

Alexander Schier wrote
Date: Sun, 4 May 2008 18:54:26 +0200
> Hi!
> I had a large Nilfs2 (about 250 GB), and 2 files with about 100 GB in
> it. When i tried to delete the file, either
> rm bigfile1
> 
> or after it failed
> 
> echo '' >bigfile1
> 
> the pc worked a long time, and then nilfs2 used so much ram, that the
> kernel killed all programs, and finally the pc was unusable. It was not
> possible to delete the files, other than reformatting the partition.
> 
> At the moment, i can not do any further tests, because the partition is
> now filled with useful files, and i do not want to fill the rest with
> undeletable files. But maybe you can find the memleak(?) in the Source.
> 
> Alex

Thanks for reporting the above problem!
It seems to be a likely problem.

Unfortunately we are now in holiday periods in Japan (Golden Week
holidays).  So, I can't test it.
I'd like to look into the problem after the holidays, maybe on Wednesday
or Thursday.

Re: some questions

> > 3. How robust is nilfs to device errors like bad sectors ? For example 
> > if you have a disk image where bad sectors are replaced by zeros, will 
> > you still be able to recover data from other sectors ?
> 
> When NILFS detects an I/O error, it tries to mark the segment including
> the bad block erroneous. The errorneous segment will never be reused.

For the latter question, the current NILFS does not have this kind of data
integrity.

Of course there are various opinions or ideas in the team.
I think, I'd like to make use of HW support such as SCSI DIF if Linux bio
will support it.

Regards,
Ryusuke Konishi

Re: OOM while deleting very large files

Hi!
On Tue, May 06, 2008 at 01:18:37AM +0900, Ryusuke Konishi wrote:
It is not so important, as i do not need to use such big files further,
so you can have holydays ;).

For the fixing later:
PC: 
CPU: AMD Athlon XP 1,6+
RAM: 512 MB DDR RAM
Nilfs2 Version (Module and Tools): 2.0.2
Partition: 251 GB dmcrypt
Files: 2x approx. 100 GB created with dd if=/dev/zero of=bigfile, to
erase the old content on the cryptopartition (the zeros are written
encrypted to the real partition)

Problem while deleting them as described:
> > rm bigfile1
> > 
> > or after it failed
> > 
> > echo '' >bigfile1
> > 
> > the pc worked a long time, and then nilfs2 used so much ram, that the
> > kernel killed all programs, and finally the pc was unusable. It was not
> > possible to delete the files, other than reformatting the partition.

Now i'm using the same setup with a nilfs2 with "normal" files on it,
filled to 11 GB (df -h), without any further problems. 

I do not want to

Re: OOM while deleting very large files

Hi,

Alexander Schier wrote:
Date: Mon, 5 May 2008 18:53:31 +0200
> For the fixing later:
> PC: 
> CPU: AMD Athlon XP 1,6+
> RAM: 512 MB DDR RAM
> Nilfs2 Version (Module and Tools): 2.0.2
> Partition: 251 GB dmcrypt
> Files: 2x approx. 100 GB created with dd if=/dev/zero of=bigfile, to
> erase the old content on the cryptopartition (the zeros are written
> encrypted to the real partition)

Thanks!

NILFS on dm-crypted partition!  Interesting.

> It is not so important, as i do not need to use such big files further,
> so you can have holydays ;).

Yeah, I will!

Thanks,
Ryusuke Konishi.

> Problem while deleting them as described:
> > > rm bigfile1
> > > 
> > > or after it failed