Disk read corrupt on x64 exceeding 4 GiB RAM

Bug #675839 reported by Harald Rudell
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Invalid
Undecided
Unassigned

Bug Description

Since updating to 10.10 disk reading of large files is corrupt for high-memory 64-bit configurations

1. I had 16 GiB RAM organized as 4x4GIB simms, 4-core Intel CPU
2. It was noticed that when copying a 23 GiB folder on a usb-connected harddrive, diff would report differences
3. I could isolate it down to that read operations of 3 GiB or more data is corrupted if the 64-bit system has more than 4 GiB ram

I would use command:
md5sum asingle.avi asingleunzipped.avi notsparse.avi; (unzip -p asingle.zip | md5sum -)
- where files is the same avi video file about 700 MiB
- pass means printing out the identical hash four times
- fail means differing hash or corrupt archive
it was verified that the file is not sparse

64-bit system, more than 4 GiB (any two memory simms):
FAIL: external harddisk 1 using BLACX usb
FAIL: external harddisk 2 using usb enclosure
FAIL: external harddisk 1 using sata to motherboard
PASS: any SSD disk using sata to motherboard

PASS: 64-bit system, 4 GiB RAM (any one simm): any configuration works
PASS: 32-bit system: any configuration works

So, is this a kernel problem? do I have a bad 32-bit kernel module?
I have had serious 64-bit driver problems in the passed, so I suspect this is software related

ProblemType: Bug
DistroRelease: Ubuntu 10.04
Package: linux-image-2.6.32-26-generic 2.6.32-26.46
Regression: Yes
Reproducible: Yes
ProcVersionSignature: Ubuntu 2.6.32-26.46-generic 2.6.32.24+drm33.11
Uname: Linux 2.6.32-26-generic x86_64
NonfreeKernelModules: nvidia
AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.21.
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC0: foxyboy 2014 F.... pulseaudio
CRDA: Error: [Errno 2] No such file or directory
Card0.Amixer.info:
 Card hw:0 'Intel'/'HDA Intel at 0xf5ff4000 irq 22'
   Mixer name : 'Realtek ALC1200'
   Components : 'HDA:10ec0888,104382fe,00100101'
   Controls : 40
   Simple ctrls : 22
Date: Mon Nov 15 19:00:26 2010
HibernationDevice: RESUME=UUID=7d11cb5c-7334-4e37-bdf0-f19111625b4a
IwConfig:
 lo no wireless extensions.

 eth0 no wireless extensions.
MachineType: System manufacturer System Product Name
ProcCmdLine: root=UUID=6e418107-84af-4790-b047-0df1e3d0f0bf ro quiet splash
ProcEnviron:
 PATH=(custom, user)
 LANG=en_US.utf8
 SHELL=/bin/bash
RelatedPackageVersions: linux-firmware 1.34.1
RfKill:
 7: hci0: Bluetooth
  Soft blocked: yes
  Hard blocked: no
SourcePackage: linux
WpaSupplicantLog:

dmi.bios.date: 05/25/2010
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 1208
dmi.board.asset.tag: To Be Filled By O.E.M.
dmi.board.name: P5Q-EM DO
dmi.board.vendor: ASUSTeK Computer INC.
dmi.board.version: Rev 1.xx
dmi.chassis.asset.tag: Asset-1234567890
dmi.chassis.type: 3
dmi.chassis.vendor: Chassis Manufacture
dmi.chassis.version: Chassis Version
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr1208:bd05/25/2010:svnSystemmanufacturer:pnSystemProductName:pvrSystemVersion:rvnASUSTeKComputerINC.:rnP5Q-EMDO:rvrRev1.xx:cvnChassisManufacture:ct3:cvrChassisVersion:
dmi.product.name: System Product Name
dmi.product.version: System Version
dmi.sys.vendor: System manufacturer

Revision history for this message
Harald Rudell (harald-rudell) wrote :
Revision history for this message
Harald Rudell (harald-rudell) wrote :

I had a problem when upgrading to 10.10 b/c mysql upgrade hang due to some other bug. To fix: I upgraded in command window, then using update-manager, went through. Problem persist

then Booted from 10.10 x64 desktop cd: ISSUE PRESENT
(nVidia card wot work unless: when black screen with little man at bottom, press F4 get to menu press F6 select nomodeset then try ubuntu, otherwise wont gdm wont run)

So: this is definitely bug in the software provided on Ubuntu x64 10.10 desktop

Brad Figg (brad-figg)
Changed in linux (Ubuntu):
status: New → Confirmed
Revision history for this message
Harald Rudell (harald-rudell) wrote :

This appears fixed in Natty beta 2, x64 desktop run from cdrom:
(2x4 GiB ram)

ubuntu@ubuntu:~$ cd /media/a1dbea37-c813-42a2-9e11-1968bf4b1a87/foxyboy/Desktop/md5/files
$ ls -l asingle.avi asingleunzipped.avi anotsparse.avi asingle.zip
-rw-r--r-- 1 1000 1000 733906944 2010-11-15 00:11 anotsparse.avi
-rw-r--r-- 1 1000 1000 733906944 2010-11-15 00:08 asingle.avi
-rw-r--r-- 1 1000 1000 733906944 2010-11-15 00:10 asingleunzipped.avi
-rw-r--r-- 1 1000 1000 724419157 2010-11-15 00:13 asingle.zip
ubuntu@ubuntu:/media/a1dbea37-c813-42a2-9e11-1968bf4b1a87/foxyboy/Desktop/md5/files$ md5sum asingle.avi asingleunzipped.avi anotsparse.avi; (unzip -p asingle.zip | md5sum -)
37b1b5cc322cb3566f8fbd1c7ac46d9a asingle.avi
37b1b5cc322cb3566f8fbd1c7ac46d9a asingleunzipped.avi
37b1b5cc322cb3566f8fbd1c7ac46d9a anotsparse.avi
37b1b5cc322cb3566f8fbd1c7ac46d9a -
ubuntu@ubuntu:/media/a1dbea37-c813-42a2-9e11-1968bf4b1a87/foxyboy/Desktop/md5/files$ sudo mkdir /media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421
ubuntu@ubuntu:/media/a1dbea37-c813-42a2-9e11-1968bf4b1a87/foxyboy/Desktop/md5/files$ sudo cp -v asingle.avi asingleunzipped.avi anotsparse.avi asingle.zip /media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421/
`asingle.avi' -> `/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421/asingle.avi'
`asingleunzipped.avi' -> `/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421/asingleunzipped.avi'
`anotsparse.avi' -> `/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421/anotsparse.avi'
`asingle.zip' -> `/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421/asingle.zip'
ubuntu@ubuntu:/media/a1dbea37-c813-42a2-9e11-1968bf4b1a87/foxyboy/Desktop/md5/files$ cd /media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421/
ubuntu@ubuntu:/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421$ md5sum asingle.avi asingleunzipped.avi anotsparse.avi; (unzip -p asingle.zip | md5sum -)
37b1b5cc322cb3566f8fbd1c7ac46d9a asingle.avi
37b1b5cc322cb3566f8fbd1c7ac46d9a asingleunzipped.avi
37b1b5cc322cb3566f8fbd1c7ac46d9a anotsparse.avi
37b1b5cc322cb3566f8fbd1c7ac46d9a -
ubuntu@ubuntu:/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421$ date
Fri Apr 22 05:09:44 UTC 2011
ubuntu@ubuntu:/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421$ uname -a
Linux ubuntu 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
ubuntu@ubuntu:/media/de947ba3-08ad-4c21-b0a5-2c266fdb420b/test-110421$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu Natty (development branch)
Release: 11.04
Codename: natty

Revision history for this message
penalvch (penalvch) wrote :

Harald Rudell, this bug report is being closed due to your last comment regarding this being fixed in Natty. For future reference you can manage the status of your own bugs by clicking on the current status in the yellow line and then choosing a new status in the revealed drop down box. You can learn more about bug statuses at https://wiki.ubuntu.com/Bugs/Status. Thank you again for taking the time to report this bug and helping to make Ubuntu better. Please submit any future bugs you may find.

Changed in linux (Ubuntu):
status: Confirmed → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.