Skip Menu | Logged in as guest | Logout
 
The Basics
Id: 131976
Status: open
Priority: 0/
Queue: openafs-bugs

Dates
Created: Tue Dec 16 11:24:30 2014
Starts: Not set
Started: Not set
Last Contact: Thu Dec 18 19:44:47 2014
Due: Not set
Closed: Not set
Updated: Fri Dec 19 07:26:34 2014 by christof.hanke@rzg.mpg.de

History Brief headersFull headers
Subject: corrupted mmaped-files in linux
Date: Tue, 16 Dec 2014 17:24:05 +0100
To: openafs-bugs@openafs.org
From: Christof Hanke <christof.hanke@rzg.mpg.de>
Download (untitled)
text/plain 1.6k
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi all,

some users told me that sometimes files which are created and filled with mmap are corrupted.
(blocks are filled with zeros)
The exact conditions for this are unclear.

However, I could verify the problem on
openSUSE 13.2, SLES 11 SP3 and CentOS 7
using the attached program (sorry for the bad commandline-parsing).

So you create a eg. 257Mbyte large testfile with "a.out 257 testfile"
and check it with "a.out testfile 257 check"

I could created corrupted files with the
starting the afsd with "-blocks 262144"
memcache or diskcache is irrelevant.
You should see problems for file-sizes of 513M, 1029M 2049M...
But that may depend on the size of your main-memory.

My observations so far:

The problem is that one or more blocks are filled with zeros.
The size of this zero-filled blocks is a multiple of 512.

The position of these blocks is random (?)

This error only happened to me on physical machines
running the OSs mentioned above in a KVM-instance does not show the error.

Hope I provided all that's necessary to fix this.

Many thanks,

Christof
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBAgAGBQJUkFytAAoJEHOAkeR8FKk+qssH/0Kmw8Z7LXLgRHWuA6bTLA2M
B0+ZIDz3Mq42mivN07LSu5oFQxi839hjw4AjNUvvW2O8iUiczzeDcrp/NjZbQYXy
jHYKF9fns/pKkuCYSpYRFOdYTj/5qbne02Sfo7hB9E5V/vmHvbyyI9wqM+z7xjW0
ATCfoCNBrtPtE2VYUyRyHjzZIbiAUEPs7W8y5j4XzcNJIqSadkjy6lWVPGiQ0W/E
9FDBisu99RNl0UpHX9OM47aBgZFz0mMT7n9OirLPjqXwGycBkjTN0/iFuKXQXJF5
wL1OgZsivlKlHniExO2gAPUF2/5nsFyGu0dM6ok8RNLBdA/h7FK+YrObfJ/zZkA=
=pU6t
-----END PGP SIGNATURE-----
Download check_mmap_files.c
text/x-c++src 2.9k

Message body is not shown because sender requested not to inline it.

Download (untitled)
text/html 143b
Hi,

Could you compile and test a client with the attached path applied and see if it makes any difference?

Marc
Subject: patch_mmap
Download patch_mmap
application/octet-stream 844b

Message body not shown because it is not plain text.

Subject: Re: [rt.central.org #131976] corrupted mmaped-files in linux
Date: Fri, 19 Dec 2014 13:26:18 +0100
To: openafs-bugs@openafs.org
From: Christof Hanke <christof.hanke@rzg.mpg.de>
Download (untitled)
text/plain 918b
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Marc,

thanks, that did the trick!
All files I created now are correct.

Christof

On Thu, 18 Dec 2014 19:44:46 -0500
"Marc Dionne via RT" <openafs-bugs@openafs.org> wrote:
>
> Hi,
>
> Could you compile and test a client with the attached path applied and see if it makes any difference?
>
> Marc
>
>
> [patch_mmap application/octet-stream (1147 bytes)]

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBAgAGBQJUlBlvAAoJEHOAkeR8FKk+3w0IAL6Noroj8unDwy9uUTjdUVT5
QiKmezjZ9dnqyDIXflrIp9F44Pb/3QgV4q0hU6c847kb6WnW8KlXRHr3i3YdYBmd
t+0vOqzf/4mRmpHDEGhDrTdG01Q+2QxUgMpLZ7tKJY0igS4it5eDMVBGB8k4Vqif
F2eN+cve2LiA8rS/JigtjskOb22O29PYGfWqWayYhTUMp1Jaa0yHALHf4lCcUgFR
mxN9TcORvFwjSIG1Ek6AVEPmGPvvh9o8qsyu28MRb7id3aozO8enNQRvpV9i6xUe
ho2knc8ZKYsxQu7wheQsWqTHhNm0IbSxho0OEpkKdh20cWU9kF8mEaNlLlpVcko=
=mryI
-----END PGP SIGNATURE-----