unofficial linux-ck repo with cpu optimized packages is ONLINE

knedlyk · 2011-04-29 19:56:11

Here:

# ARCHITECTURE, COMPILE FLAGS
#CFLAGS="-march=i686 -mtune=generic -O2 -pipe"
#CXXFLAGS="-march=i686 -mtune=generic -O2 -pipe"
CFLAGS="-march=native -O2 -pipe"
CXXFLAGS="-march=native -O2 -pipe"
LDFLAGS="-Wl,--hash-style=gnu -Wl,--as-needed"
#MAKEFLAGS="-j2"

and

The following options are target specific:
  -m128bit-long-double                [disabled]
  -m32                                [enabled]
  -m3dnow                             [disabled]
  -m3dnowa                            [disabled]
  -m64                                [disabled]
  -m80387                             [enabled]
  -m8bit-idiv                         [disabled]
  -m96bit-long-double                 [enabled]
  -mabi=                              
  -mabm                               [disabled]
  -maccumulate-outgoing-args          [disabled]
  -maes                               [disabled]
  -malign-double                      [disabled]
  -malign-functions=                  
  -malign-jumps=                      
  -malign-loops=                      
  -malign-stringops                   [enabled]
  -mandroid                           [disabled]
  -march=                             pentium4
  -masm=                              
  -mavx                               [disabled]
  -mbionic                            [disabled]
  -mbmi                               [disabled]
  -mbranch-cost=                      
  -mcld                               [disabled]
  -mcmodel=                           
  -mcpu=                              
  -mcrc32                             [disabled]
  -mcx16                              [disabled]
  -mdispatch-scheduler                [disabled]
  -mf16c                              [disabled]
  -mfancy-math-387                    [enabled]
  -mfentry                            [enabled]
  -mfma                               [disabled]
  -mfma4                              [disabled]
  -mforce-drap                        [disabled]
  -mfp-ret-in-387                     [enabled]
  -mfpmath=                           
  -mfsgsbase                          [disabled]
  -mfused-madd                        
  -mglibc                             [enabled]
  -mhard-float                        [enabled]
  -mieee-fp                           [enabled]
  -mincoming-stack-boundary=          
  -minline-all-stringops              [disabled]
  -minline-stringops-dynamically     [disabled]
  -mintel-syntax                      
  -mlarge-data-threshold=             
  -mlwp                               [disabled]
  -mmmx                               [disabled]
  -mmovbe                             [disabled]
  -mms-bitfields                      [disabled]
  -mno-align-stringops                [disabled]
  -mno-fancy-math-387                 [disabled]
  -mno-push-args                      [disabled]
  -mno-red-zone                       [disabled]
  -mno-sse4                           [enabled]
  -momit-leaf-frame-pointer           [disabled]
  -mpc                                
  -mpclmul                            [disabled]
  -mpopcnt                            [disabled]
  -mprefer-avx128                     [disabled]
  -mpreferred-stack-boundary=         
  -mpush-args                         [enabled]
  -mrdrnd                             [disabled]
  -mrecip                             [disabled]
  -mred-zone                          [enabled]
  -mregparm=                          
  -mrtd                               [disabled]
  -msahf                              [disabled]
  -msoft-float                        [disabled]
  -msse                               [disabled]
  -msse2                              [disabled]
  -msse2avx                           [disabled]
  -msse3                              [disabled]
  -msse4                              [disabled]
  -msse4.1                            [disabled]
  -msse4.2                            [disabled]
  -msse4a                             [disabled]
  -msse5                              
  -msseregparm                        [disabled]
  -mssse3                             [disabled]
  -mstack-arg-probe                   [disabled]
  -mstackrealign                      [enabled]
  -mstringop-strategy=                
  -mtbm                               [disabled]
  -mtls-dialect=                      
  -mtls-direct-seg-refs               [enabled]
  -mtune=                             pentium4
  -muclibc                            [disabled]
  -mveclibabi=                        
  -mvect8-ret-in-mem                  [disabled]
  -mvzeroupper                        [disabled]
  -mxop                               [disabled]

I didn't try generic i686, but I shall do it in a few minutes and will check it.

graysky · 2011-04-29 20:39:38

Everything looks normal there... please try the generic package and let me know

knedlyk · 2011-04-29 20:48:25

To my regret, the same result with the generic kerne26-ck from your repo.

graysky · 2011-04-29 21:22:54

Is rt73usb a standard module included with the kernel, or is it something you built (I make localmodconfig on my machine so I don't know)?

swanson · 2011-04-30 05:04:02

ck-k8 packages works great. A big difference actually! Thanks for the work!

knedlyk · 2011-04-30 07:20:36

graysky wrote:

Is rt73usb a standard module included with the kernel, or is it something you built (I make localmodconfig on my machine so I don't know)?

It is a standard kernel module http://cateee.net/lkddb/web-lkddb/RT73USB.html

graysky · 2011-04-30 10:37:42

Please post the output of:

# modprobe rt73usb

Also after you run that,

dmesg | tail

EDIT: I can modprobe it under kernel26-ck-core2 (from repo) or from my own compiled version with no errors.

$ dmesg | tail
[   48.395522] Disabling lock debugging due to kernel taint
[   48.957611] nvidia 0000:01:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[   48.957618] nvidia 0000:01:00.0: setting latency timer to 64
[   48.957621] vgaarb: device changed decodes: PCI:0000:01:00.0,olddecodes=io+mem,decodes=none:owns=io+mem
[   48.957740] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  270.41.06  Mon Apr 18 14:53:56 PDT 2011
[   50.753948] EXT4-fs (sdb1): re-mounted. Opts: discard,commit=0
[   50.807306] EXT4-fs (sdb2): re-mounted. Opts: discard,commit=0
[   51.340709] EXT4-fs (sda2): re-mounted. Opts: commit=0
[   74.223248] cfg80211: Calling CRDA to update world regulatory domain
[   74.245369] usbcore: registered new interface driver rt73usb

Last edited by graysky (2011-04-30 11:08:46)

falconindy · 2011-04-30 16:13:50

@graysky: Where are you setting KCFLAGS for these builds? I'm not seeing it in your buildscripts or any PKGBUILD I can find. I see you're modifying CFLAGS, don't those intentionally do not affect a kernel compile.

graysky · 2011-04-30 17:19:28

falconindy wrote:

@graysky: Where are you setting KCFLAGS for these builds? I'm not seeing it in your buildscripts or any PKGBUILD I can find. I see you're modifying CFLAGS, don't those intentionally do not affect a kernel compile.

I don't do anything with KCFLAGS... what are they?

For most CPU types, the CFLAGS and CXXFLAGS, they are set in the build.function file in the setup_arch function:

setup_arch() {
# arch specific parameters to override those in /etc/makepkg.conf
# fomit-frame-pointer is very likely redundant but it wont hurt
# see https://bbs.archlinux.org/viewtopic.php?id=117812
if [ $which_arch = "x86_64" ]; then
sed -i 's/build() {/build() {\nCFLAGS=\"-march=x86-64 -mtune=generic -O2 -pipe -fomit-frame-pointer\"\nCXXFLAGS=\"\${CFLAGS}\"'/ PKGBUILD
fi

if [ $which_arch = "i686" ]; then
sed -i 's/build() {/build() {\nCFLAGS=\"-march=i686 -mtune=generic -O2 -pipe -fomit-frame-pointer\"\nCXXFLAGS=\"\${CFLAGS}\"'/ PKGBUILD
fi
}

For those CPU types that use a specific set of CFLAGS/CXXFLAGS, that standard line gets modded. For example, see line 226.

falconindy · 2011-04-30 17:26:10

The kernel does not use the standard CFLAGS (compiler), CPPFLAGS (preprocessor), AFLAGS (assembler) that userland typically uses. From the toplevel Makefile in Kbuild...

# Add user supplied CPPFLAGS, AFLAGS and CFLAGS as the last assignments
# But warn user when we do so
warn-assign = \
$(warning "WARNING: Appending $$K$(1) ($(K$(1))) from $(origin K$(1)) to kernel $$$(1)")

ifneq ($(KCPPFLAGS),)
        $(call warn-assign,CPPFLAGS)
        KBUILD_CPPFLAGS += $(KCPPFLAGS)
endif
ifneq ($(KAFLAGS),)
        $(call warn-assign,AFLAGS)
        KBUILD_AFLAGS += $(KAFLAGS)
endif
ifneq ($(KCFLAGS),)
        $(call warn-assign,CFLAGS)
        KBUILD_CFLAGS += $(KCFLAGS)
endif

Sure enough, if I specify KCFLAGS, I get that lovely warning:

$ KCFLAGS='-msse4.2 -msahf' make
Makefile:630: "WARNING: Appending $KCFLAGS (-msse4.2 -msahf) from environment to kernel $CFLAGS"

demian · 2011-04-30 18:55:32

Thanks for providing this repo, graysky. I just wish i found it sooner .

Last edited by demian (2011-04-30 18:58:57)

JokerBoy · 2011-05-05 12:05:15

falconindy wrote:

The kernel does not use the standard CFLAGS (compiler), CPPFLAGS (preprocessor), AFLAGS (assembler) that userland typically uses. From the toplevel Makefile in Kbuild...

so we should use export KCFLAGS="${CFLAGS}"?

LeCrayonVert · 2011-05-06 17:15:18

Could you please update kernel from 2.6.38.4 to 2.6.38.5 (in order to solve this issue https://bugs.archlinux.org/task/23886) ?
Thx

graysky · 2011-05-06 20:24:21

LeCrayonVert wrote:

Could you please update kernel from 2.6.38.4 to 2.6.38.5 (in order to solve this issue https://bugs.archlinux.org/task/23886) ?
Thx

Updated on 03-May... repo is hosting 2.6.38.5 now. You can't see it?

falconindy · 2011-05-06 22:55:02

JokerBoy wrote:

falconindy wrote:
The kernel does not use the standard CFLAGS (compiler), CPPFLAGS (preprocessor), AFLAGS (assembler) that userland typically uses. From the toplevel Makefile in Kbuild...
so we should use export KCFLAGS="${CFLAGS}"?

If you want CFLAGS to take effect, then yes. Otherwise, KBuild does not honor them. I'll mention that the warning is there for a damn good reason...

graysky · 2011-05-06 23:41:16

falconindy wrote:

If you want CFLAGS to take effect, then yes. Otherwise, KBuild does not honor them. I'll mention that the warning is there for a damn good reason...

...what's the damn good reason? Just as a sanity check to warn the user to be damn sure the flags are correct?

Makefile:634: "WARNING: Appending $KCFLAGS (-march=native -O2 -pipe -fomit-frame-pointer) from environment to kernel $CFLAGS"

falconindy · 2011-05-06 23:45:43

Because kernel code is already micro optimized and written the way the developer wants it to behave in assembly. More often than not, you don't want this being mangled by a compiler. Linus has ranted about this topic with regard to gcc many times...

Last edited by falconindy (2011-05-06 23:45:55)

graysky · 2011-05-07 00:06:56

So adding the export line would be a disadvantage? I added prior to the " make bzImage modules" line and successfully complied/rebooted into it. No ill effects that I can see.

Grinch · 2011-05-07 01:54:18

Possibly, from what I've read the reason that changing the optimization flags may impact the kernel negatively is that in order to get the best possible performance/control the kernel devs rely heavily on gcc compiler extensions (afaik these extensions have pretty much solely been added to gcc at the request of said kernel devs) in time critical code which allows them a high level of control regarding branch prediction, cache usage etc. And from what I gather, using other optimization options other than those chosen by the devs can negatively impact this 'hand-optimization' that the kernel devs do with extensions such as __builtin_expect, __builtin_prefetch etc.

It was quite some time that I read about this though so I have no idea if this still holds true.

alessandro_ufms · 2011-05-10 19:20:12

Thanks for maintain this repository. I'm using here and it's working fine.

graysky · 2011-05-10 19:23:25

alessandro_ufms wrote:

Thanks for maintain this repository. I'm using here and it's working fine.

You're welcome. For general info: I think I squashed all the problems associated with incomplete xfers to/from my site by using lftp's mirror function.

#!/bin/bash

lftp -c "set ftp:list-options -a;
open ftp://USERNAME:PASSWORD@HOST;
lcd /media/data/repo/
mirror -a -c -R --delete --use-cache --verbose --parallel=1 --no-symlinks"

alessandro_ufms · 2011-05-10 19:45:42

Hmm... the recent update is causing the following error:
error: failed to commit transaction (invalid or corrupted package)
kernel26-ck-headers-2.6.38.6-1-x86_64.pkg.tar.xz is invalid or corrupted
Errors occurred, no packages were upgraded.

graysky · 2011-05-10 19:59:26

Odd... try to refresh via

pacman -Syy

then

pacman -Syu

mikkie · 2011-05-10 20:31:39

I am getting the same error as alessandro_ufms but for kernel26-ck-2.6.38.6-1-x86_64.pkg.tar.xz. Refreshing the repository didn't help...

graysky · 2011-05-10 23:14:24

@mikkie and alessandro - deleted the files on the ftp and reuploaded. Tested on my machine and all is well now.

This is pissing me off. Does anyone know of an ftp client like lftp that can mirror a dirtree using md5sums or something fail safe regarding file checks?

Arch Linux

#176 2011-04-29 19:56:11

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#177 2011-04-29 20:39:38

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#178 2011-04-29 20:48:25

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#179 2011-04-29 21:22:54

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#180 2011-04-30 05:04:02

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#181 2011-04-30 07:20:36

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#182 2011-04-30 10:37:42

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#183 2011-04-30 16:13:50

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#184 2011-04-30 17:19:28

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#185 2011-04-30 17:26:10

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#186 2011-04-30 18:55:32

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#187 2011-05-05 12:05:15

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#188 2011-05-06 17:15:18

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#189 2011-05-06 20:24:21

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#190 2011-05-06 22:55:02

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#191 2011-05-06 23:41:16

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#192 2011-05-06 23:45:43

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#193 2011-05-07 00:06:56

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#194 2011-05-07 01:54:18

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#195 2011-05-10 19:20:12

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#196 2011-05-10 19:23:25

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#197 2011-05-10 19:45:42

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#198 2011-05-10 19:59:26

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#199 2011-05-10 20:31:39

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

#200 2011-05-10 23:14:24

Re: unofficial linux-ck repo with cpu optimized packages is ONLINE

Board footer