You are not logged in.

#1 2012-09-04 17:20:11

olivierk
Member
Registered: 2011-09-27
Posts: 19

upgrade → kernel warning → huge logs → full disk

Hi,

After some upgrades today (cf. list infra), my / was full, because of huge logs files.
I cannot read them, here are they:

Sep  4 17:07:15 iceworld kernel: [40179.786879] ------------[ cut here ]------------
Sep  4 17:07:15 iceworld kernel: [40179.786881] WARNING: at net/ipv4/tcp.c:1598 tcp_recvmsg+0x55a/0xd40()
Sep  4 17:07:15 iceworld kernel: [40179.786881] Hardware name: System Product Name
Sep  4 17:07:15 iceworld kernel: [40179.786882] recvmsg bug: copied B384992F seq B384CB46 rcvnxt B3855B48 fl 0
Sep  4 17:07:15 iceworld kernel: [40179.787439] recvmsg bug 2: copied B384992F seq B384992F rcvnxt B3855B48 fl 0
Sep  4 17:07:15 iceworld kernel: [40179.787439] Modules linked in: r8712u(C) fuse arc4 joydev snd_hda_codec_hdmi microcode aesni_intel aes_x86_64 aes_generic snd_hda_codec_realtek ghash_clmulni_intel ath9k ath9k_common ath9k_hw eeepc_wmi ath asus_wmi mac80211 cryptd pci_hotplug cfg80211 acpi_cpufreq sparse_keymap mperf snd_hda_intel rfkill atl1c 8139too mei snd_hda_codec kvm i2c_i801 usb_storage snd_hwdep snd_pcm snd_page_alloc snd_timer uas snd usblp processor wmi psmouse iTCO_wdt iTCO_vendor_support lpc_ich mfd_core pcspkr 8139cp serio_raw evdev mii soundcore coretemp crc32c_intel wacom ext4 crc16 jbd2 mbcache hid_generic usbhid hid sr_mod sd_mod cdrom pata_acpi pata_via ata_generic ahci libahci libata xhci_hcd ehci_hcd scsi_mod usbcore usb_common i915 video button i2c_algo_bit drm_kms_helper drm i2c_core intel_agp intel_gtt
Sep  4 17:07:15 iceworld kernel: [40179.787502] Pid: 30874, comm: thunderbird Tainted: G        WC   3.5.3-1-ARCH #1
Sep  4 17:07:15 iceworld kernel: [40179.787502] Call Trace:
Sep  4 17:07:15 iceworld kernel: [40179.787504]  [<ffffffff8105096f>] warn_slowpath_common+0x7f/0xc0
Sep  4 17:07:15 iceworld kernel: [40179.787505]  [<ffffffff81050a66>] warn_slowpath_fmt+0x46/0x50
Sep  4 17:07:15 iceworld kernel: [40179.787507]  [<ffffffff813c4548>] tcp_recvmsg+0xc48/0xd40
Sep  4 17:07:15 iceworld kernel: [40179.787509]  [<ffffffff813e5931>] inet_recvmsg+0x81/0xd0
Sep  4 17:07:15 iceworld kernel: [40179.787511]  [<ffffffff8136923d>] sock_recvmsg+0x11d/0x140
Sep  4 17:07:15 iceworld kernel: [40179.787513]  [<ffffffff81191941>] ? touch_atime+0x71/0x110
Sep  4 17:07:15 iceworld kernel: [40179.787514]  [<ffffffff81181467>] ? pipe_read+0x397/0x500
Sep  4 17:07:15 iceworld kernel: [40179.787516]  [<ffffffff811790d7>] ? fget_light+0x97/0x100
Sep  4 17:07:15 iceworld kernel: [40179.787517]  [<ffffffff8136b78f>] sys_recvfrom+0xef/0x170
Sep  4 17:07:15 iceworld kernel: [40179.787519]  [<ffffffff8117801c>] ? sys_read+0x7c/0xa0
Sep  4 17:07:15 iceworld kernel: [40179.787521]  [<ffffffff814830a9>] system_call_fastpath+0x16/0x1b
Sep  4 17:07:15 iceworld kernel: [40179.787522] ---[ end trace 597f6ff7f500fd27 ]---

The packages I upgraded were:

[2012-09-04 13:45] Running 'pacman -Sy'
[2012-09-04 13:45] synchronizing package lists
[2012-09-04 14:01] Running 'pacman -S -u'
[2012-09-04 14:01] starting full system upgrade
[2012-09-04 14:13] installed python2-netifaces (0.8-1)
[2012-09-04 14:13] upgraded calibre (0.8.66-1 -> 0.8.67-2)
[2012-09-04 14:13] upgraded libevent (2.0.19-1 -> 2.0.20-1)
[2012-09-04 14:13] upgraded chromium (21.0.1180.81-2 -> 21.0.1180.89-1)
[2012-09-04 14:13] upgraded fribidi (0.19.2-2 -> 0.19.4-1)
[2012-09-04 14:13] upgraded gnutls (3.1.0-1 -> 3.1.1-1)
[2012-09-04 14:13] upgraded gtkmm3 (3.4.0-1 -> 3.4.1-1)
[2012-09-04 14:13] upgraded inetutils (1.9.1-3 -> 1.9.1-4)
[2012-09-04 14:13] upgraded jre7-openjdk-headless (7.u5_2.2.1-1 -> 7.u7_2.3.2-1)
[2012-09-04 14:13] upgraded jre7-openjdk (7.u5_2.2.1-1 -> 7.u7_2.3.2-1)
[2012-09-04 14:13] upgraded jdk7-openjdk (7.u5_2.2.1-1 -> 7.u7_2.3.2-1)
[2012-09-04 14:13] upgraded josm (5356-1 -> 5485-1)
[2012-09-04 14:13] upgraded lib32-libdrm (2.4.38-1 -> 2.4.39-1)
[2012-09-04 14:13] upgraded libedit (20120311_3.0-1 -> 20120601_3.0-1)
[2012-09-04 14:13] upgraded mpfr (3.1.1-1 -> 3.1.1.p2-1)
[2012-09-04 14:13] upgraded netcfg (2.8.9-1 -> 2.8.10-1)
[2012-09-04 14:13] upgraded openssh (6.0p1-3 -> 6.1p1-1)
[2012-09-04 14:13] upgraded perl-image-exiftool (8.99-1 -> 9.01-1)
[2012-09-04 14:13] upgraded sdl (1.2.15-1 -> 1.2.15-2)
[2012-09-04 14:13] upgraded sdl_gfx (2.0.23-1 -> 2.0.24-1)
[2012-09-04 14:13] installed lib32-v4l-utils (0.8.8-1)
[2012-09-04 14:13] upgraded skype (4.0.0.8-1 -> 4.0.0.8-3)
[2012-09-04 14:13] upgraded sqlite (3.7.13-1 -> 3.7.14-1)
[2012-09-04 14:13] upgraded systemd (189-3 -> 189-4)
[2012-09-04 14:13] installed sysvinit-tools (2.88-7)
[2012-09-04 14:13] upgraded sysvinit (2.88-6 -> 2.88-7)
[2012-09-04 14:13] upgraded wine (1.5.11-1 -> 1.5.12-1)
[2012-09-04 14:13] upgraded xf86-video-intel (2.20.5-1 -> 2.20.6-1)

Thanks for your help!

Offline

#2 2012-09-04 17:47:08

roentgen
Member
Registered: 2011-03-15
Posts: 90

Re: upgrade → kernel warning → huge logs → full disk

And the problem is... ?

Offline

#3 2012-09-05 06:27:52

olivierk
Member
Registered: 2011-09-27
Posts: 19

Re: upgrade → kernel warning → huge logs → full disk

Well, the problem is twofold.

First, I had *something* that filled my hard drive with 10Gb of logs. Is this a normal log behavior? How to prevent it from happening again?
Second, what is this *something*? Is it important? Is it going to happen again?

Hope that's more clear.

Thanks,

Offline

#4 2012-09-05 07:02:44

hadrons123
Member
From: chennai
Registered: 2011-10-07
Posts: 1,249

Re: upgrade → kernel warning → huge logs → full disk

Did you by any chance have custom  kernel?


LENOVO Y 580 IVYBRIDGE 660M NVIDIA
Unix is user-friendly. It just isn't promiscuous about which users it's friendly with. - Steven King

Offline

#5 2012-09-05 07:06:27

olivierk
Member
Registered: 2011-09-27
Posts: 19

Re: upgrade → kernel warning → huge logs → full disk

No, 3.5.3-1-ARCH x86_64.

Offline

#6 2012-09-05 07:13:52

hadrons123
Member
From: chennai
Registered: 2011-10-07
Posts: 1,249

Re: upgrade → kernel warning → huge logs → full disk

Are you able to boot into your system?


LENOVO Y 580 IVYBRIDGE 660M NVIDIA
Unix is user-friendly. It just isn't promiscuous about which users it's friendly with. - Steven King

Offline

#7 2012-09-05 07:17:22

olivierk
Member
Registered: 2011-09-27
Posts: 19

Re: upgrade → kernel warning → huge logs → full disk

Now I am.

At first, booting was very long (mysql took like 5mn, I guess because of no more empty disk space), then KDE wasn't able to start.
After I deleter a few logs and thus cleaned a few Gb, I was able to boot as usual.

Now everything is working fine (it seems), I just don't want it to happen again randomly.

Offline

#8 2012-09-05 10:07:15

Lone_Wolf
Member
From: Netherlands, Europe
Registered: 2005-10-04
Posts: 4,404

Re: upgrade → kernel warning → huge logs → full disk

2 possible causes come to mind :

- You are not using logrotate or something similar to keep down logsize, so over time those logs grow in size and fill up the / ..

- your system has a problem that causes a lot of error messages to be logged.

Last edited by Lone_Wolf (2012-09-05 10:10:28)


Booting with apg Openrc, NOT systemd.
Automounting : not needed, i prefer pmount
Aur helpers : makepkg + my own local repo === rarely need them

Offline

#9 2012-09-28 13:14:44

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

Hi,

I'm experiencing the same problem on my Ubuntu 12.10 beta, that I've just updated to. I was googling the stacktrace to find the problem.

Any news with this one?

Edit, for completeness:

[ 9632.341103] ------------[ cut here ]------------
[ 9632.341105] WARNING: at /build/buildd/linux-3.5.0/net/ipv4/tcp.c:1612 tcp_recvmsg+0xbb5/0xce0()
[ 9632.341106] Hardware name: To Be Filled By O.E.M.
[ 9632.341107] recvmsg bug 2: copied A0A02E84 seq A0A02E84 rcvnxt A0A02EFE fl 0
[ 9632.341107] Modules linked in: ufs qnx4 hfsplus hfs minix ntfs msdos jfs xfs reiserfs ext2 sit tunnel4 xt_recent xt_tcpudp xt_LOG nf_conntrack_ipv6 nf_defrag_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack ip6table_filter ip6_tables iptable_filter ip_tables x_tables dm_crypt pci_stub vboxpci(O) vboxnetadp(O) vboxnetflt(O) vboxdrv(O) joydev snd_hda_codec_hdmi snd_hda_codec_via pl2303 kvm_amd usbserial r8712u(C) kvm hid_logitech_dj microcode snd_hda_intel snd_hda_codec snd_hwdep snd_pcm edac_core edac_mce_amd snd_seq_midi k10temp snd_rawmidi sp5100_tco snd_seq_midi_event i2c_piix4 psmouse snd_seq serio_raw snd_timer snd_seq_device rfcomm fglrx(PO) bnep mac_hid bluetooth snd parport_pc soundcore snd_page_alloc ppdev w83627ehf hwmon_vid nfsd nfs lp lockd parport fscache auth_rpcgss nfs_acl binfmt_misc sunrpc btrfs zlib_deflate libcrc32c usbhid hid uas usb_storage pata_atiixp r8169 wmi
[ 9632.341137] Pid: 28855, comm: Chrome_IOThread Tainted: P        WC O 3.5.0-15-generic #23-Ubuntu
[ 9632.341138] Call Trace:
[ 9632.341140]  [<ffffffff81051cbf>] warn_slowpath_common+0x7f/0xc0
[ 9632.341143]  [<ffffffff81051db6>] warn_slowpath_fmt+0x46/0x50
[ 9632.341145]  [<ffffffff815b5bb5>] tcp_recvmsg+0xbb5/0xce0
[ 9632.341147]  [<ffffffff81047f1f>] ? native_flush_tlb_others+0x12f/0x140
[ 9632.341149]  [<ffffffff815d98db>] inet_recvmsg+0x6b/0x80
[ 9632.341152]  [<ffffffff8155ae32>] sock_aio_read.part.8+0x142/0x170
[ 9632.341154]  [<ffffffff8155ae85>] sock_aio_read+0x25/0x40
[ 9632.341156]  [<ffffffff81181b96>] do_sync_read+0xe6/0x120
[ 9632.341158]  [<ffffffff812b3132>] ? security_file_permission+0x92/0xb0
[ 9632.341160]  [<ffffffff81182051>] ? rw_verify_area+0x61/0xf0
[ 9632.341162]  [<ffffffff8118259d>] vfs_read+0x15d/0x180
[ 9632.341163]  [<ffffffff8118260a>] sys_read+0x4a/0x90
[ 9632.341166]  [<ffffffff81689ced>] system_call_fastpath+0x1a/0x1f
[ 9632.341167] ---[ end trace c4575c8b9e16be8e ]---

Last edited by dpc.ucore.info (2012-09-28 13:19:48)

Offline

#10 2012-09-28 13:30:01

2ManyDogs
Member
Registered: 2012-01-15
Posts: 1,706

Re: upgrade → kernel warning → huge logs → full disk

dpc.ucore.info wrote:

I'm experiencing the same problem on my Ubuntu 12.10 beta, that I've just updated to. I was googling the stacktrace to find the problem.

You should ask on the Ubuntu forum.

Last edited by 2ManyDogs (2012-09-28 13:31:16)

Offline

#11 2012-09-28 13:32:32

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

I'm not opening a new thread to support Ubuntu on ArchLinux forum, merly looking for insight for somethat seems clearly a problem in the common source used by both distributions.

Offline

#12 2012-09-28 14:57:27

ewaller
Administrator
From: Pasadena, CA
Registered: 2009-07-13
Posts: 13,432

Re: upgrade → kernel warning → huge logs → full disk

dpc.ucore.info wrote:

I'm not opening a new thread to support Ubuntu on ArchLinux forum, merly looking for insight for somethat seems clearly a problem in the common source used by both distributions.

That does provide a good data point.  The concern, of course, is that the two distributions likely have different versions of libraries, and certainly have different kernel configurations.  More data are a good thing, and I hope this forum provides some insight as to what is going on on Ubuntu; but ...   the moderators will close this thread if it does turn into an Ubuntu support thread.


Nothing is too wonderful to be true, if it be consistent with the laws of nature -- Michael Faraday
You assume people are rational and influenced by evidence.  You must not work with the public much. -- Trilby
----
How to Ask Questions the Smart Way

Offline

#13 2012-09-28 15:08:10

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

Some observations: the problem does not seems to appear when I'm connected via ethernet cable. I tried two usb Pentagram usb wifi dongles (similar, but different models with different chipsets AFAIK), both experiencing the problem. When hit by the issue, the network data tends to get corrupted for me. I get cheksum errors in package files etc. The wifi signal is reported to get weaker (two "bars", instead of four when on full strenght) and at some point whole wifi connection drops entirely.

For now, the cable sticked into LAN port is a workaround I use. If OP can compare my findings, we could seek for more precise cause.

Offline

#14 2012-09-28 15:10:33

WonderWoofy
Member
From: Los Gatos, CA
Registered: 2012-05-19
Posts: 8,412

Re: upgrade → kernel warning → huge logs → full disk

dpc.ucore.info did you not read the post above yours?  It seems rude to 1) come here and jack a thread 2) come here looking for help w/ your ubuntu machine 3) ignore the fact that you have been asked not to seek ubuntu related help in this (or other) Arch Linux threads.

Offline

#15 2012-09-28 16:38:08

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

1) I'm not hijacking any thread. The original poster seem to experience the same issue as me so I want to consult with him/her the symptoms, to find a cause and possibly a solution for our mutual benefit. Especially, that it's the only report on the web that I've found so far. The fact that he/she uses ArchLinux and I'm using Ubuntu seems irrelevant.

2) What is so rude about using Ubuntu machine and posting on ArchLinux forum if the problem in question affects ArchLinux user as well?

3) I've answered the first post about me using Ubuntu machine, not ignored it.

Gosh, did the archforum community become so elitist and snobish, that non-Arch Linux users are not welcomed here per se?

Offline

#16 2012-09-28 16:55:07

olivierk
Member
Registered: 2011-09-27
Posts: 19

Re: upgrade → kernel warning → huge logs → full disk

I'm surprised as well…

Thanks for your reports. I'm experiencing some wifi issues as well, but haven't observed any correlations. I may have wifi troubles without the logs going crazy.

Offline

#17 2012-09-28 17:25:14

bgc1954
Member
From: Edmonton, AB, Canada
Registered: 2006-03-14
Posts: 1,122

Re: upgrade → kernel warning → huge logs → full disk

dpc.ucore.info wrote:

1) The fact that he/she uses ArchLinux and I'm using Ubuntu seems irrelevant.

Ummm, yeh not so irrelevant.  He's using many different modules than you are from a kernel that's several versions newer. Ubuntu 3.5.0-15 vs. Arch 3.5.3-1.  We all know that something can not work for one kernel and then the very next one, suddenly, your problem disappears and you are several steps behind with the Ubuntu kernel.

dpc.ucore.info wrote:

Gosh, did the archforum community become so elitist and snobish, that non-Arch Linux users are not welcomed here per se?

Just try running Arch linux and posting on the Ubuntu forum and see what happens. wink  Also, comments like that won't help you get any help here.

Last edited by bgc1954 (2012-09-28 17:38:02)


Time is a great teacher, but unfortunately it kills all its pupils ... - Louis Hector Berlioz

Offline

#18 2012-09-28 17:56:32

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

olivierk wrote:

I'm surprised as well…

Can you let me know what wifi card are you using?

Offline

#19 2012-09-28 18:41:31

olivierk
Member
Registered: 2011-09-27
Posts: 19

Re: upgrade → kernel warning → huge logs → full disk

dpc.ucore.info wrote:

Can you let me know what wifi card are you using?

Network controller: Atheros Communications Inc. AR9227 Wireless Network Adapter (rev 01)

Offline

#20 2012-10-03 18:26:35

Antti Alien
Member
From: Tampere
Registered: 2007-04-26
Posts: 6

Re: upgrade → kernel warning → huge logs → full disk

I just noticed same traceback on my kernel log.

[ 4899.872918] ------------[ cut here ]------------
[ 4899.872932] WARNING: at net/ipv4/tcp.c:1598 tcp_recvmsg+0x55a/0xd40()
[ 4899.872934] Hardware name: .
[ 4899.872936] recvmsg bug: copied 245A9248 seq 245A9295 rcvnxt 245A929C fl 2
[ 4899.872938] Modules linked in: fuse sha256_generic aes_x86_64 cryptd aes_generic xts gf128mul dm_crypt dm_mod joydev hid_generic nvidia(PO) usbhid hid r8712u(C) i2c_i801 snd_hda_codec_realtek iTCO_wdt iTCO_vendor_support 8139too r8169 8139cp i2c_core mii snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc snd_timer snd firewire_ohci firewire_core crc_itu_t soundcore fan lpc_ich mfd_core intel_agp intel_gtt acpi_cpufreq serio_raw mperf psmouse processor evdev microcode coretemp thermal button vboxnetflt(O) vboxdrv(O) ext4 crc16 jbd2 mbcache sr_mod cdrom sd_mod pata_acpi ata_generic ata_piix libata scsi_mod uhci_hcd ehci_hcd usbcore usb_common
[ 4899.872998] Pid: 1197, comm: firefox Tainted: P         C O 3.5.4-1-ARCH #1
[ 4899.873000] Call Trace:
[ 4899.873008]  [<ffffffff81051a3f>] warn_slowpath_common+0x7f/0xc0
[ 4899.873011]  [<ffffffff81051b36>] warn_slowpath_fmt+0x46/0x50
[ 4899.873014]  [<ffffffff813c61ba>] tcp_recvmsg+0x55a/0xd40
[ 4899.873018]  [<ffffffff813e7c91>] inet_recvmsg+0x81/0xd0
[ 4899.873023]  [<ffffffff8136b4cd>] sock_recvmsg+0x11d/0x140
[ 4899.873028]  [<ffffffff81083dec>] ? ttwu_do_wakeup+0x2c/0x120
[ 4899.873032]  [<ffffffff81086fc0>] ? wake_up_state+0x10/0x20
[ 4899.873036]  [<ffffffff810aaa7b>] ? wake_futex+0x3b/0x60
[ 4899.873040]  [<ffffffff8117a2e7>] ? fget_light+0x97/0x100
[ 4899.873043]  [<ffffffff8136da1f>] sys_recvfrom+0xef/0x170
[ 4899.873046]  [<ffffffff810adc92>] ? sys_futex+0x102/0x190
[ 4899.873051]  [<ffffffff811792cc>] ? sys_write+0x7c/0xa0
[ 4899.873056]  [<ffffffff814853ed>] system_call_fastpath+0x1a/0x1f
[ 4899.873058] ---[ end trace 4bece7f10e51f71f ]---

Firefox has been breaking on encrypted pages, telling me that "SSL received a record with an incorrect Message Authentication Code." I was trying to find a reason for this, and found the trace. This started after I upgraded. I hadn't upgraded in about half a year, so I can't really say which packages changed (~all of them).

I'm using A-Link WNU-AL usb stick with r8712u driver. Lspci identifies it as "Realtek Semiconductor Co., Ltd. RTL-8139/8139C/8139C+ (rev 10)".

Offline

#21 2012-10-03 18:59:43

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

r8712u here, too.

Offline

#22 2012-10-03 19:13:31

mcloaked
Member
From: Yorkshire, UK
Registered: 2012-02-02
Posts: 728

Re: upgrade → kernel warning → huge logs → full disk

Is the OP running initscripts or systemd?  If systemd then you can make the systemd journal have a limit in size - one possible answer to the large log file issue.

https://wiki.archlinux.org/index.php/Sy … size_limit

However the OP did not say which log files had grown large?  Knowing which file was the culprit could help! Checking on logrotate is another possible thing to check as someone has already said.


Mike C

Offline

#23 2012-10-03 21:08:16

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

As I've hit the same problem, I don't think logrotate is the problem. The log files are growing from normal size into > 10GB monsters in a matter of minute(s). It seems to me that some bug in r8712u is hitting some assert check in generic tcp code that is not protected with `printk_ratelimit` and logs are flooded with kernel messages.

Offline

#24 2012-10-07 18:43:19

Antti Alien
Member
From: Tampere
Registered: 2007-04-26
Posts: 6

Re: upgrade → kernel warning → huge logs → full disk

My search-fu was weak on my last post, but now I found two bug reports involving this issue: https://bugs.archlinux.org/task/31658 and https://bugzilla.kernel.org/show_bug.cgi?id=45071

This is fixed in Linux 3.5.5, which is in the core repository. I just updated and everything seems to be working.

Offline

#25 2012-10-07 19:44:58

dpc.ucore.info
Member
Registered: 2010-12-27
Posts: 14

Re: upgrade → kernel warning → huge logs → full disk

Thanks for the info!

Offline

Board footer

Powered by FluxBB