You are not logged in.

#101 2009-01-18 06:54:39

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,931

Re: Getting ready for ext4

I'd like to thank everyone who contributed to this thread, dhave for getting rolling, and to pointone for the wiki entry. The conversion went well (aside my weirdness http://bbs.archlinux.org/viewtopic.php?id=63201 ). I successfully converted everything except for /boot, which I didn't even try. I did run into the kernel panic, but the instructions both here and in the wiki were simple and effective.

The CK defrag script takes a very long time to run, so I can't really report on that yet. Until it hit the directories owned by root in /home (.texmf*, which I forgot about), it seemed to have worked perfectly. Although, I'm not sure how I ended up with 68667 file in /home. I do know that the .texmf stuff exists around 38000 files into it. smile

I used the Ubuntu 9.04 Alpha 3 for the conversion. I never thought that I'd have a use for one of their discs until today. I'm glad I did.

Offline

#102 2009-01-18 08:36:54

Heema
Member
From: Egypt
Registered: 2008-08-12
Posts: 62

Re: Getting ready for ext4

skottish wrote:

I successfully converted everything except for /boot, which I didn't even try.

is there a problem with /boot ? as i am planning also to convert to ext4 but i have just one partition /

and did you notice any speed improvements ?

Offline

#103 2009-01-18 10:00:56

grndrush
Member
From: Hamilton, Ontario, Canada
Registered: 2003-12-28
Posts: 136
Website

Re: Getting ready for ext4

I just converted my / fs to ext4 (but with a separate, untouched, ext2 /boot fs). I still got a kernel panic. Solution was the same: boot into fallback and run mkinitcpio.

Offline

#104 2009-01-18 14:52:01

tetonedge
Member
From: Fort Collins, CO
Registered: 2008-08-22
Posts: 71
Website

Re: Getting ready for ext4

looked at the wiki entry and it looks good, thanks for doing that.

Offline

#105 2009-01-18 16:42:02

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,931

Re: Getting ready for ext4

Heema wrote:
skottish wrote:

I successfully converted everything except for /boot, which I didn't even try.

is there a problem with /boot ? as i am planning also to convert to ext4 but i have just one partition /

and did you notice any speed improvements ?

I don't know if there's a problem with /boot or not. I decided to get everything else up and running first. As mentioned earlier in this thread, /boot may not benefit from the new FS because of it's small size. Can we get some more opinions on this?

As far as performance goes, I'd say that I can see some improvement. We have 50MPH winds here right now and the power is sketchy. It seems like the file system checks are quicker. Other than that, I'll need a day or two. It took hours to run the defrag stuff and I'm not done yet.

Offline

#106 2009-01-18 17:07:21

pointone
Wiki Admin
From: Waterloo, ON
Registered: 2008-02-21
Posts: 379

Re: Getting ready for ext4

Where'd you find the defrag goodness? I thought she wasn't released yet?

And there is no problem with converting /boot as long as you've installed the lastest version of GRUB with ext4 patch. I didn't split /boot from my root, so I converted everything. However, with a split /boot, there really is no need to convert. None of the benefits of ext4 would apply, unless you're storing documents in /boot... :S


M*cr*s*ft: Who needs quality when you have marketing?

Offline

#107 2009-01-18 17:13:20

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,931

Re: Getting ready for ext4

pointone wrote:

Where'd you find the defrag goodness? I thought she wasn't released yet?

Post #82 of this thread of course!

http://ck.kolivas.org/apps/defrag/defrag-0.06/defrag

It's a brute force thing that takes a few hours if you have a lot of files. Permissions are a factor, and it will do one partition at a time.

Thanks for the opinion on /boot. Mine is split. Arch is my only OS (hurray), so it made sense.

Offline

#108 2009-01-18 17:20:14

dhave
Arch Linux f@h Team Member
From: Outside the matrix.
Registered: 2005-05-15
Posts: 1,110

Re: Getting ready for ext4

@pointone: Thanks for doing the wiki entry. It looks good. Nice and compact, too.

@skottish: I've played around a little with Con K.'s defrag script, but I haven't run it on more than a few isolated directories. It does seem to take a while, but, then, so do all the Windows defrag utilities I've used in the past. You say "permissions are a factor". I'm guessing this means I need to run the defrag script as root if I want it to defrag any file that it encounters, right?

Any other caveats to using the defrag script?


Donate to Arch!

Tired? There's a nap for that. --anonymous

Offline

#109 2009-01-18 17:32:45

pointone
Wiki Admin
From: Waterloo, ON
Registered: 2008-02-21
Posts: 379

Re: Getting ready for ext4

Ah! I thought you were talking of the 'official' e4defrag.

Also, I figured this would be a good place to ask:

Apparently the 'flex_bg' option is enabled by default on new ext4 partitions, but the instructions posted for converting from ext3 do not use this option. Any idea what it does? Are we missing something big here? Anyone willing to 'test' enabling 'flex_bg' on a converted ext3 partition?

From some quick Googling, all I know is that it has something to do with preventing fragmentation...


M*cr*s*ft: Who needs quality when you have marketing?

Offline

#110 2009-01-18 17:41:10

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,931

Re: Getting ready for ext4

dhave wrote:

@skottish: I've played around a little with Con K.'s defrag script, but I haven't run it on more than a few isolated directories. It does seem to take a while, but, then, so do all the Windows defrag utilities I've used in the past. You say "permissions are a factor". I'm guessing this means I need to run the defrag script as root if I want it to defrag any file that it encounters, right?

Any other caveats to using the defrag script?

As I mentioned above, I had some files owned by root in my home directory, and the script failed when it got to them. Of course I was running as a regular user then. I'm currently doing my /backup directory as root. Since everything there is replaceable, I thought that it would be a good place to start.

I can't see anything wrong with the script. The only strangeness that I've come across so far is a couple of my Firefox extensions decided that they weren't compatible with Firefox anymore. This may (probably?) have nothing to do with the other. Using your web browser while defragging the hard drive that holds it's configuration files may not be the best idea anyway.

Offline

#111 2009-01-18 19:11:55

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,931

Re: Getting ready for ext4

Bump to update.

Running the script as root in a directory with files owned by multiple users works fine.

--EDIT--

I now finished /{etc,lib,usr,var,opt} with no known problems. I'm calling this a success.

Offline

#112 2009-01-18 19:29:56

LTSmash
Member
From: Aguascalientes - Mexico
Registered: 2008-01-02
Posts: 348
Website

Re: Getting ready for ext4

Guys, any idea on this?

http://bbs.archlinux.org/viewtopic.php?id=63291

My system was rendered unusable because of that... and I can't even use to Arch liveCD to recover since it doesn't yet supports ext4 :s


Proud Ex-Arch user.
Still an ArchLinux lover though.

Currently on Kubuntu 9.10

Offline

#113 2009-01-19 15:38:27

jelly
Trusted User (TU)
From: /dev/null
Registered: 2008-06-10
Posts: 711

Re: Getting ready for ext4

skottish wrote:

I'd like to thank everyone who contributed to this thread, dhave for getting rolling, and to pointone for the wiki entry. The conversion went well (aside my weirdness http://bbs.archlinux.org/viewtopic.php?id=63201 ). I successfully converted everything except for /boot, which I didn't even try. I did run into the kernel panic, but the instructions both here and in the wiki were simple and effective.

The CK defrag script takes a very long time to run, so I can't really report on that yet. Until it hit the directories owned by root in /home (.texmf*, which I forgot about), it seemed to have worked perfectly. Although, I'm not sure how I ended up with 68667 file in /home. I do know that the .texmf stuff exists around 38000 files into it. smile

I used the Ubuntu 9.04 Alpha 3 for the conversion. I never thought that I'd have a use for one of their discs until today. I'm glad I did.

I also used the ubuntu live cd, but i think it failed big time, got a nice kernel panic while mounting my / . But then i thought reinstalling is better because then you have all your files created in ext4, so i am waiting for the new iso wink

Offline

#114 2009-01-19 16:43:20

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,931

Re: Getting ready for ext4

jelly wrote:

I also used the ubuntu live cd, but i think it failed big time, got a nice kernel panic while mounting my / . But then i thought reinstalling is better because then you have all your files created in ext4, so i am waiting for the new iso wink

A possible solution for the kernel panic is listed both in this thread as well as in the wiki article that pointone made. Did you try it before you reinstalled?

Offline

#115 2009-01-19 17:04:34

dhave
Arch Linux f@h Team Member
From: Outside the matrix.
Registered: 2005-05-15
Posts: 1,110

Re: Getting ready for ext4

I was about to ask how I could easily check to see if extents was turned on for a particular file, but then I tried "lsattr filename", and I see that a cute little "e" shows up for defragged ext4 files previously converted from ext3.

EDIT: ... as toofishes had already pointed out here, it turns out.

I was wanting to make sure that my time investment in defragging my ext4 partitions has paid off.

Last edited by dhave (2009-01-19 17:13:41)


Donate to Arch!

Tired? There's a nap for that. --anonymous

Offline

#116 2009-01-19 17:24:30

zhuqin
Member
Registered: 2008-01-31
Posts: 61

Re: Getting ready for ext4

Wrong post

Last edited by zhuqin (2009-01-19 17:25:19)

Offline

#117 2009-01-19 18:05:51

lucke
Member
From: Poland
Registered: 2004-11-30
Posts: 4,018

Re: Getting ready for ext4

I love the flexibility of Linux, I managed to convert the root partition from ext3 to ext4 on one of my PCs without using a live medium \o/

Last edited by lucke (2009-01-19 18:07:20)

Offline

#118 2009-01-19 18:18:01

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,931

Re: Getting ready for ext4

lucke wrote:

I love the flexibility of Linux, I managed to convert the root partition from ext3 to ext4 on one of my PCs without using a live medium \o/

I was too scared. sad

Offline

#119 2009-02-01 05:50:22

tinhtruong
Member
From: Việt Nam
Registered: 2008-12-18
Posts: 109

Re: Getting ready for ext4

After converting all my ext3 partition to ext4, my boot time increased 2 seconds! My /boot partition is still ext2.
What a huge performance gain! big_smile

Offline

#120 2009-02-01 09:46:10

Dieter@be
Forum Fellow
From: Belgium
Registered: 2006-11-05
Posts: 1,959
Website

Re: Getting ready for ext4

tinhtruong wrote:

After converting all my ext3 partition to ext4, my boot time increased 2 seconds! My /boot partition is still ext2.
What a huge performance gain! big_smile

do you mean decreased?


< Daenyth> and he works prolifically
4 8 15 16 23 42

Offline

#121 2009-02-02 06:55:13

tinhtruong
Member
From: Việt Nam
Registered: 2008-12-18
Posts: 109

Re: Getting ready for ext4

Dieter@be wrote:
tinhtruong wrote:

After converting all my ext3 partition to ext4, my boot time increased 2 seconds! My /boot partition is still ext2.
What a huge performance gain! big_smile

do you mean decreased?

No, my boot time with / ext3 is 22 seconds, with / ext4 is 24 seconds.
Do I have to defrag to increase the performance of ext4?

Offline

#122 2009-02-09 11:41:42

TheGrudge
Member
Registered: 2006-06-15
Posts: 206
Website

Re: Getting ready for ext4

I also get weird access times wit ext4.
I'm one of the digiKam devs and right now I'm trying to optimize speed of moving / copying files inside of digiKam. But it is incredibly slow with my ext4 media partition.
Moving only 4 images takes 10 seconds. Moving my images and database onto a ext3 or reiserfs partition makes digiKam fast again. Moving those 4 images takes like 1 second.
Do you know a filesystem option that could slow down the performance so much? I also reformatted my media partition with reiserfs (to make sure the partition itself is not broken), it is fast. Putting ext4 on it makes it incredibly slow again.
Any suggestions?


digiKam developer - www.digikam.org

Offline

#123 2009-02-13 23:24:50

Bogart
Member
From: Madrid, Spain
Registered: 2005-06-22
Posts: 263

Re: Getting ready for ext4

About Ext4's performance:

Ext3 had support for barriers, but they were off by default. Barriers give an extra safety to the filesystem, but they are performance hogs.

Ext4 has barriers on by default.

I did some sysbench random write runs* to see the impact of barriers:

JFS:                             958 Kb/s
Ext3:                           898 Kb/s
Ext4:                           195 Kb/s
Ext4 (without barriers): 925 Kb/s

You get the idea, right?

Now, the problem I have is that I can't boot my / filesystem with barriers disabled. I have on my /etc/fstab the following line:

UUID=96acef42-d165-45a5-a034-e6450f4b9476   /   ext4   noatime,barrier=0    0   1

But my dmesg says:

EXT4-fs: barriers enabled

If I mount a partition with something like:

mount -t ext4 -o barrier=0 /dev/sda3 /mnt/sda3

dmesg says:

EXT4-fs: barriers disabled

But using barrier=0 in /etc/fstab does not seem to have any effect.

Any suggestions?

*The commands used for testing in case anyone wants to try are:

sysbench --test=fileio --file-block-size=4K --file-total-size=100M --file-test-mode=rndwr prepare
sysbench --test=fileio --file-block-size=4K --file-total-size=100M --file-test-mode=rndwr run
sysbench --test=fileio --file-block-size=4K --file-total-size=100M --file-test-mode=rndwr cleanup

Offline

#124 2009-02-14 00:26:58

TheGrudge
Member
Registered: 2006-06-15
Posts: 206
Website

Re: Getting ready for ext4

You are right, turning off barriers fixed the speed issue in digiKam... thanks for the tip...


digiKam developer - www.digikam.org

Offline

#125 2009-02-14 02:42:20

Xi0N
Member
From: Bilbao - Spain
Registered: 2007-11-29
Posts: 784
Website

Re: Getting ready for ext4

What, more or less, is this barriers thing about? Is it safe to disable it?
Thanks

Offline

Board footer

Powered by FluxBB