headers
Abraham Aldaco | 26 Apr 18:06
Picon

NFS caching on the server-side

Hello,
I need help for configuring a NFS version 4 server for caching what clients read
from it. That is, the server has to cache locally (not the client) what any NFS
client reads from this server. The porpouse of this configuration if to relief
the work load of the server HDD.

Any suggestion or recommendation will be appreciated.
Abraham Aldaco
abraham.aldaco <at> gmail.com
Permalink | Reply | 0 comments |
headers
Sertaç Olgunsoylu | 26 Apr 05:10
Picon
Gravatar

nfs/fscache writeback cache

Hi,
First of all, I am not sure if this list is appropriate place to ask that
question but I think it is the most relevant one. I saw this project
proposal[1] on the Fedora Project's GSOC 2012 ideas page few weeks ago. It
proposes to add writeback caching support to NFS. I didn't apply to GSOC
since I am not a student but I want to spend my time working on that
project although this is not accepted by GSOC. I want to learn that is
there any ongoing effort on that side? If any, could you point me to that
so that i will not duplicate work and I can contribute to current project.

[1] -
http://fedoraproject.org/wiki/Summer_coding_ideas_for_2012#Linux_kernel_project

Thanks
Permalink | Reply | 0 comments |
headers
fanchaoting | 28 Mar 05:48
Favicon

oops when I mount nfs with -o fsc

Hi: in nfs(RHEL6.x), i do as following. 
#cat /etc/exports
    /nfsroot      *(rw,no_root_squash,fsid=0,insecure)
#mount –t nfs4 –o fsc localhost:/   /nfsmnt
#sh create_file.sh

wait a while, i find oops.

PID: 4196   TASK: ffff88012365b580  CPU: 0   COMMAND: "sh"
 #0 [ffff880139435750] machine_kexec at ffffffff810310db
 #1 [ffff8801394357b0] crash_kexec at ffffffff810b63b2
 #2 [ffff880139435880] oops_end at ffffffff814dec50
 #3 [ffff8801394358b0] die at ffffffff8100f2fb
 #4 [ffff8801394358e0] do_trap at ffffffff814de544
 #5 [ffff880139435940] do_invalid_op at ffffffff8100ceb5
 #6 [ffff8801394359e0] invalid_op at ffffffff8100bf5b
    [exception RIP: __nfs_fscache_invalidate_page+121]
 #7 [ffff880139435ab0] nfs_invalidate_page at ffffffffa06fff6e [nfs]
 #8 [ffff880139435ad0] do_invalidatepage at ffffffff811243d5
 #9 [ffff880139435ae0] truncate_inode_page at ffffffff811245f2
#10 [ffff880139435b00] truncate_inode_pages_range at ffffffff811248f0
#11 [ffff880139435bf0] truncate_inode_pages at ffffffff81124c05
#12 [ffff880139435c00] truncate_pagecache at ffffffff81124c57
#13 [ffff880139435c30] nfs_setattr_update_inode at ffffffffa07033ab [nfs]
#14 [ffff880139435c70] nfs4_proc_setattr at ffffffffa071bb45 [nfs]
#15 [ffff880139435cb0] nfs_setattr at ffffffffa07043e0 [nfs]
#16 [ffff880139435cf0] notify_change at ffffffff8118e0c8
#17 [ffff880139435d60] do_truncate at ffffffff81170a84
#18 [ffff880139435dd0] do_filp_open at ffffffff81182ba9
#19 [ffff880139435f20] do_sys_open at ffffffff8116f849
(Continue reading)

Permalink | Reply | 1 comment |
headers
fanchaoting | 29 Mar 03:53
Favicon

oops when I mount nfs with -o fsc

Hi: in nfs(RHEL6.x), i do as following. 
#cat /etc/exports
    /nfsroot      *(rw,no_root_squash,fsid=0,insecure)
#mount –t nfs4 –o fsc localhost:/   /nfsmnt
#sh create_file.sh

wait a while, i find oops.

PID: 4196   TASK: ffff88012365b580  CPU: 0   COMMAND: "sh"
 #0 [ffff880139435750] machine_kexec at ffffffff810310db
 #1 [ffff8801394357b0] crash_kexec at ffffffff810b63b2
 #2 [ffff880139435880] oops_end at ffffffff814dec50
 #3 [ffff8801394358b0] die at ffffffff8100f2fb
 #4 [ffff8801394358e0] do_trap at ffffffff814de544
 #5 [ffff880139435940] do_invalid_op at ffffffff8100ceb5
 #6 [ffff8801394359e0] invalid_op at ffffffff8100bf5b
    [exception RIP: __nfs_fscache_invalidate_page+121]
 #7 [ffff880139435ab0] nfs_invalidate_page at ffffffffa06fff6e [nfs]
 #8 [ffff880139435ad0] do_invalidatepage at ffffffff811243d5
 #9 [ffff880139435ae0] truncate_inode_page at ffffffff811245f2
#10 [ffff880139435b00] truncate_inode_pages_range at ffffffff811248f0
#11 [ffff880139435bf0] truncate_inode_pages at ffffffff81124c05
#12 [ffff880139435c00] truncate_pagecache at ffffffff81124c57
#13 [ffff880139435c30] nfs_setattr_update_inode at ffffffffa07033ab [nfs]
#14 [ffff880139435c70] nfs4_proc_setattr at ffffffffa071bb45 [nfs]
#15 [ffff880139435cb0] nfs_setattr at ffffffffa07043e0 [nfs]
#16 [ffff880139435cf0] notify_change at ffffffff8118e0c8
#17 [ffff880139435d60] do_truncate at ffffffff81170a84
#18 [ffff880139435dd0] do_filp_open at ffffffff81182ba9
#19 [ffff880139435f20] do_sys_open at ffffffff8116f849
(Continue reading)

Permalink | Reply | 0 comments |
headers
Orquidea Salt mas | 2 Mar 20:22
Picon

Rebélate by self-management, first project of free software by which we bet all / Rebélate por la autogestión, primer proyecto de software libre por el que apostamos todas

Inglés :

Many already we have contributed to the first project of free software
dedicated to self-management in this campaign of collective financing,
it collaborates and it spreads!/

Beginning campaign collective financing

http://www.goteo.org/project/rebelaos-publicacion-por-la-autogestion?lang=en

Login to enter with user of social networks and for would register in Goteo :

http://www.goteo.org/user/login?lang=en

Rebelaos! Publication by self-management A massive publication that
floods the public transport, the work centers, the parks, the
consumption centers, by means of distribution of 500,000 gratuitous
units, acting simultaneously in all sides and nowhere.

We announce the main tool of a vestibule Web for the management of
self-sustaining resources by means of Drupal, in addition in the
publication there will be an article dedicated to free software,
hardware, It is being prepared in inglès,  the machinery You can see
more details in the index of the
publication    https://n-1.cc/pg/file/read/1151902/indexresumen-de-los-contenidos-pdf

 . A computer system that allows us to share resources in all the
scopes of our life so that we do not have to generate means different
for each subject nor for each territory.
(Continue reading)

Permalink | Reply | 0 comments |
headers
Frank Murphy | 21 Feb 18:41
Picon
Gravatar

FS-Cache "Netfs" (nfs) Fedora 15/16/17

Hi,

Am trying to figure out why during bootup,
at the following point across real and virt boxes.

eb 19 11:22:07 frank01 kernel: [  482.640618] FS-Cache: Loaded
Feb 19 11:22:07 frank01 kernel: [  482.672487] FS-Cache: Netfs 'nfs' 
registered for caching

It sits there for about 10 seconds, with no indication as to what's 
happening.

nfs mount during bootup can be autofs or fstab depending on box.

Is this still relevant for debugging FS-Cache:
https://www.redhat.com/archives/linux-cachefs/2010-February/msg00022.html

" You can also turn on NFS debugging for FS-Cache to see what it's doing:

	echo $((0x800)) >/proc/sys/sunrpc/nfs_debug  "

kernels across boxes: 3.2* 3.3*

--

-- 
Regards,
Frank
"Jack of all, fubars"
Permalink | Reply | 1 comment |
headers
ralagarasan | 24 Jan 18:12
Picon

Re: Linux-cachefs Digest, Vol 87, Issue 1

Hi friends,

can u please help me to configure HP ILO3 for Redhat(5.6) HA cluster

Thanks & Regards
R.Alagarasan
Permalink | Reply | 0 comments |
headers
Brian Kroth | 24 Jan 18:06
Picon

hang on __fscache_wait_on_page_write and __nfs_fscache_invalidate_page

I thought I'd sent this in December, but I didn't see it in the 
archives, so I thought I'd take another crack at it.  

The problem seems to be spreading to clients mounting Linux server 
hosted NFS exports as well.

Any help would be appreciated.

Thanks,
Brian

----- Forwarded message from Brian Kroth <bpkroth <at> gmail.com> -----

Date: Fri, 16 Dec 2011 10:36:45 -0600
From: Brian Kroth <bpkroth <at> gmail.com>
To: linux-cachefs <at> redhat.com
Subject: hang on __fscache_wait_on_page_write and
	__nfs_fscache_invalidate_page
Reply-To: Brian Kroth <bpkroth <at> gmail.com>
User-Agent: Mutt/1.5.20 (2009-06-14)
X-Operating-System: Linux 2.6.32-bpo.3-amd64 x86_64

Hello all.  I hope this is the right place for this question.  If not 
please let me know where else it should go.

I've got some machines that from time to time will hang waiting on an 
umount.nfs command and eventually spit out a call trace referencing 
__fscache_wait_on_page_write and __nfs_fscache_invalidate_page.

The situation is as follows:
(Continue reading)

Permalink | Reply | 0 comments |
headers
Cam Mac | 24 Jan 17:19
Picon
Favicon

Bad Page states, kernel oopses

Hi,

 We are getting a number of 'bad page state' and kernel oopses which (I suspect) are related to fscache or
cachefilesd. At the time that these occur, the process that was running will go in to an uniterruptable state

 Sample bad page state:

 ----------------------------------------------------8<----------------------------------------------------

 Jan 22 19:10:30 rb031 kernel: BUG: Bad page state in process nuke pfn:9c509 
 Jan 22 19:10:30 rb031 kernel: page:ffffea0002714240 count:0 mapcount:0 mapping: (null) index:0x6e63
 Jan 22 19:10:30 rb031 kernel: page flags: 0x4000000000001000(private_2)
 Jan 22 19:10:30 rb031 kernel: Pid: 26646, comm: nuke Tainted: G B D 3.1.7 #2
 Jan 22 19:10:30 rb031 kernel: Call Trace:
 Jan 22 19:10:30 rb031 kernel: [<ffffffff810a99c5>] bad_page+0xe5/0xfb
 Jan 22 19:10:30 rb031 kernel: [<ffffffff810aaf3c>] get_page_from_freelist+0x2ff/0x433
 Jan 22 19:10:30 rb031 kernel: [<ffffffff810ab745>] __alloc_pages_nodemask+0x32a/0x6ac
 Jan 22 19:10:30 rb031 kernel: [<ffffffffa009caf3>] cachefiles_read_backing_file+0x12d/0x4b0 [cachefiles]
 Jan 22 19:10:30 rb031 kernel: [<ffffffffa009d108>] cachefiles_read_or_alloc_pages+0x292/0x2d1 [cachefiles]
 Jan 22 19:10:30 rb031 kernel: [<ffffffff81054da8>] ? bit_waitqueue+0x17/0x97
 Jan 22 19:10:30 rb031 kernel: [<ffffffff81054e80>] ? wake_up_bit+0x25/0x2a
 Jan 22 19:10:30 rb031 kernel: [<ffffffffa007947e>] ? fscache_run_op+0x2e/0x48 [fscache]
 Jan 22 19:10:30 rb031 kernel: [<ffffffffa0079e7a>] ? fscache_submit_op+0x202/0x422 [fscache]
 Jan 22 19:10:30 rb031 kernel: [<ffffffffa007b450>] __fscache_read_or_alloc_pages+0x21f/0x301 [fscache]
 Jan 22 19:10:30 rb031 kernel: [<ffffffffa0224fc1>] __nfs_readpages_from_fscache+0x80/0x14e [nfs]
 Jan 22 19:10:30 rb031 kernel: [<ffffffff810ab745>] ? __alloc_pages_nodemask+0x32a/0x6ac
 Jan 22 19:10:30 rb031 kernel: [<ffffffffa0202593>] nfs_readpages+0xf2/0x16f [nfs]
 Jan 22 19:10:30 rb031 kernel: [<ffffffff810ad879>] __do_page_cache_readahead+0x142/0x1c1
 Jan 22 19:10:30 rb031 kernel: [<ffffffff810ad919>] ra_submit+0x21/0x25
 Jan 22 19:10:30 rb031 kernel: [<ffffffff810adc8b>] ondemand_readahead+0x18e/0x1a1
(Continue reading)

Permalink | Reply | 0 comments |
headers
Raghuram Bondalapati | 16 Nov 05:00
Picon

Problem reading cached files

Hello,

I have been trying to get local caching  to work on a host running SuSE
SLES11 SP1 (cachefilesd is still unsupported). I  had no problems compiling
and inserting a cachefiles module in the kernel or starting the cachefsd
daemon (cachefilesd-0.10.1.tar.bz2). I also see files being cached to
/var/cache/fscache (ext3 partition mounted with user_xattr)

Nov 14 19:38:17  cachefilesd[6586]: About to bind cache
Nov 14 19:38:17  cachefilesd[6586]: Bound cache
Nov 14 19:38:17  cachefilesd[6589]: Daemon Started
Nov 14 19:38:17  kernel: [ 9667.331384] FS-Cache: Cache "mycache" added
(type cachefiles)
Nov 14 19:38:17  kernel: [ 9667.331394] CacheFiles: File cache on
cciss/c0d0p11 registered
Nov 14 19:38:17  cachefilesd[6589]: Scan complete
Nov 14 19:38:17  cachefilesd[6589]: Decant (all 213)

However when i try to cat a previously cached file ( after flushing the
kernel page cache using echo 3 >/proc/sys/vm/drop_caches) the process hangs
indefinitely. . It shows up with a status sync_p in process listing and a
trace on the PID shows that the process is  stuck on a read for device
/dev/cachefiles. I earlier though this might be because of the SELinux
function but it appears that SELinux functionality is not enabled on this
host.

Any help with debugging the hang issue is gretaly appreciated.

I
(Continue reading)

Permalink | Reply | 1 comment |
headers
Stefan Blanke | 4 Nov 17:10
Favicon

Possible page cache related bug

Hi,

I have encountered an issue when using fscache where the Linux page 
cache consumes memory on the system that then cannot be cleared. This 
eventually leaves the system in a crippled swapping state.

To outline what I am doing:

[With a data set of ~35GB in ~2000 files]

1. Start four processes that each read the entire contents of a file 
then move to the next etc.
2. After the first read from NFS we are constantly reading ~250MB/s from 
the cache.
3. Very high system CPU utilisation is observed on (kswapd0 & flush-0).
4. After ~30min we find that part of the page cache can't be cleared (by 
echo 3 > /proc/sys/vm/drop_caches)
5. Eventually all RAM becomes consumed and the system starts swapping 
heavily.
6. The four reading processes are terminated.
7. The page cache still will not clear, even after unmounting the NFS 
filesystem and restarting cachefilesd.

Many messages of this form are seen in /var/log/messages, but not sure 
if this is connected:

FS-Cache: Assertion failed
1 == 0 is false
FS-Cache: Assertion failed
0 >= 1 is false
(Continue reading)

Permalink | Reply | 1 comment |

Gmane