ext3 with dir_index - holy cow!

Dusty · 2005-11-23 17:56:54

Gullible Jones wrote:

No, but it's annoying as hell when you're copying stuff around. I'll stick with metadata journalling, thank you. May be slightly riskier if something bad happens, but my data is not incredibly important.

That's quite obvious....

deficite · 2005-11-24 04:10:28

Gullible Jones wrote:

No, but it's annoying as hell when you're copying stuff around. I'll stick with metadata journalling, thank you. May be slightly riskier if something bad happens, but my data is not incredibly important.

WHAT? My bank isn't FDIC insured? Oh, never the bother, if something bad happens it's just my money, not anything incredibly important.

nightfrost · 2005-11-24 17:48:01

Here's the wiki entry. Some of you guys should take a look at it and make sure I didn't do any silly mistakes.

codergeek42 · 2005-11-24 17:58:03

nightfrost wrote:

Here's the wiki entry. Some of you guys should take a look at it and make sure I didn't do any silly mistakes.

Excuse me, but since you do not have my copyright notice there you're committing copyright violation. That must be added.

Edit: Added

nightfrost · 2005-11-24 18:05:32

codergeek42 wrote:

nightfrost wrote:
Here's the wiki entry. Some of you guys should take a look at it and make sure I didn't do any silly mistakes.
Excuse me, but since you do not have my copyright notice there you're committing copyright violation. That must be added.
Edit: Added

Sorry about that. I thought everything under the wiki was automatically published under GNU v1.2. (It says so at the bottom of the page), and I didn't want to commit a tautology. Anyway, that's why I asked you guys to take a look at it.

codergeek42 · 2005-11-24 18:14:49

Not a problem.

Komodo · 2006-05-13 14:53:35

lilsirecho wrote:

Entered the dir_index code in two kernels, 2.6.13 and 2.6.14.
In each case, used the shutdown -F -r now ... procedure.
In each case, I had to reboot twice in order to complete the fsck of the partition.
Just a note on how it went for my system.
The system is up and running on either kernel.

I don't understand why you'd have to do anything twice if you have two kernels installed... explain

BTW, the tune2fs part of doing it on a live system should only take like.. a second, right?

codergeek42 · 2006-05-13 19:53:59

Komodo wrote:

BTW, the tune2fs part of doing it on a live system should only take like.. a second, right?

Yeah. The tune2fs call should be pretty speedy generally.

EAD · 2006-05-13 19:58:46

I have done tune2fs -O dir_index /dev/hdb5
then I have done
e2fsck -D -f /dev/hdb5
and then
tune2fs -O has_journal -o journal_data /dev/hdb5
and then
tune2fs -J size= /dev/hdXY

Now I have some questions, 1) How can I know if it works good?
where can I see all the info needed?
2) I have many hdXY, wich is what? what program in the shell give me this info? (yes I know its a newbie question 8) )

Komodo · 2006-05-13 20:09:34

1) I need the answer to this myself

2) Use cfdisk /dev/hdXY to view the partitions within that drive; that should enable you to identify which it is. Also, you can immediately eliminate some options by looking at /etc/fstab, as this will show you what drives are automounted where.

kakabaratruskia · 2006-07-06 21:50:41

shadowhand wrote:

Oh hey... I didn't notice the e2fsck line. Shutdown after using tune2fs with
shutdown -F -r
to force a fsck on reboot.

Does that optimize directories???, like e2fsck -D does?

T-Dawg · 2006-07-06 23:09:41

kakabaratruskia wrote:

shadowhand wrote:
Oh hey... I didn't notice the e2fsck line. Shutdown after using tune2fs with
shutdown -F -r
to force a fsck on reboot.
Does that optimize directories???, like e2fsck -D does?

If it just force checks the filesystem then no. I had to force and use the -D switch to commit the dir_index changes using e2fsck in the install cd.

patroclo7 · 2006-07-07 13:15:44

lucke wrote:

As the codergeek's howto points out, just boot into some live cd and execute
tune2fs -O dir_index /dev/hdXY
e2fsck -D /dev/hdXY

No. With that command you can just skip the second point in the above suggestion. You need anyway to run tune2fs on the unmounted partition.

T-Dawg · 2006-07-07 19:07:55

patroclo7 wrote:

lucke wrote:
As the codergeek's howto points out, just boot into some live cd and execute
tune2fs -O dir_index /dev/hdXY
e2fsck -D /dev/hdXY
No. With that command you can just skip the second point in the above suggestion. You need anyway to run tune2fs on the unmounted partition.

No. if you run tune2fs -O dir_index all inodes created after that point will use dir_index. To rearrange the entire filesystem with dir_index you must run e2fsck -D -f /dev/hdxy. -D is what tells e2fsck to reoraganize them and -f forces a complete filesystem check --without -f and the filesystem is marked clean, it will skip doing anything at all.

djpharoah · 2006-07-18 18:36:26

OMG....this is awesome..

I used to use reiserfs religiously and seeing this thread and CoderGeeks thread made me install arch with ext3 and then later optimized it.

It runs noticably faster. Also this could be also because i went from a 4200rpm hdd in my laptop to a 7200rpm...

no worries tho, Im sticking with ext3.

whoop whoop

TheGrudge · 2006-07-23 23:38:33

Penguin wrote:

No. if you run tune2fs -O dir_index all inodes created after that point will use dir_index. To rearrange the entire filesystem with dir_index you must run e2fsck -D -f /dev/hdxy. -D is what tells e2fsck to reoraganize them and -f forces a complete filesystem check --without -f and the filesystem is marked clean, it will skip doing anything at all.

So for my root partition I need to use Knoppix or something like that? Because if

shutdown -F -r now

doesn't reindex my directories, it is impossible to unmount the root partition... I will give it a try later...

T-Dawg · 2006-07-23 23:50:57

correct. I used the arch install disk which worked fine.

brain0 · 2006-07-24 06:20:45

I didn't need a live cd. I mounted my / partition ro (I think I booted into single user mode) and did it from there. Then rebooted. Worked great.

TheGrudge · 2006-07-30 14:39:30

I'm playing around with Suspend to MEM and all that stuff, but it doesn't work right for my Acer Aspire 1362LC... but one good thing is that because of full journaling I'm keeping all my data!
My laptop battery is wrecked, it has a bad memory effect so it will only charge for 5 minutes... last time I forgot to plug in the power cable and after nearly 10 minutes my laptop turned off. This was the time I was using XFS...
after the reboot my whole home-folder was gone! So metadata journaling seems not to be the best solution...
sure copying many files is slower now with my EXT3 in full journaling mode, but it is so much safer... I LOVE IT!!!

Mikos · 2006-07-31 14:00:00

TheGrudge wrote:

last time I forgot to plug in the power cable and after nearly 10 minutes my laptop turned off. This was the time I was using XFS...
after the reboot my whole home-folder was gone! So metadata journaling seems not to be the best solution...

This is not a problem with metadata journaling, but with XFS. XFS is really sensitive to power loss and will cause data loss nearly everytime after hard restart. XFS is usable only with UPS.

But with reiserfs I haven't got _any_ data loss after many hard restarts or power losses. And I suppose it is similar with ext3 (but for me reiserfs is much more stable than ext3 - I have unrecoverable filesystem crashes caused by bad sectors with ext3, but reiserfs has never failed me).

djpharoah · 2006-08-01 19:34:15

Dont know if its been posted but

# tune2fs -m 1 /dev/hdxY

Changes ext3 from taking default 5% of your partition as a reserve to 1%.
Might not be much but for those with large drives you get a bit more.

Arch Linux

#26 2005-11-23 17:56:54

Re: ext3 with dir_index - holy cow!

#27 2005-11-24 04:10:28

Re: ext3 with dir_index - holy cow!

#28 2005-11-24 17:48:01

Re: ext3 with dir_index - holy cow!

#29 2005-11-24 17:58:03

Re: ext3 with dir_index - holy cow!

#30 2005-11-24 18:05:32

Re: ext3 with dir_index - holy cow!

#31 2005-11-24 18:14:49

Re: ext3 with dir_index - holy cow!

#32 2006-05-13 14:53:35

Re: ext3 with dir_index - holy cow!

#33 2006-05-13 19:53:59

Re: ext3 with dir_index - holy cow!

#34 2006-05-13 19:58:46

Re: ext3 with dir_index - holy cow!

#35 2006-05-13 20:09:34

Re: ext3 with dir_index - holy cow!

#36 2006-07-06 21:50:41

Re: ext3 with dir_index - holy cow!

#37 2006-07-06 23:09:41

Re: ext3 with dir_index - holy cow!

#38 2006-07-07 13:15:44

Re: ext3 with dir_index - holy cow!

#39 2006-07-07 19:07:55

Re: ext3 with dir_index - holy cow!

#40 2006-07-18 18:36:26

Re: ext3 with dir_index - holy cow!

#41 2006-07-23 23:38:33

Re: ext3 with dir_index - holy cow!

#42 2006-07-23 23:50:57

Re: ext3 with dir_index - holy cow!

#43 2006-07-24 06:20:45

Re: ext3 with dir_index - holy cow!

#44 2006-07-30 14:39:30

Re: ext3 with dir_index - holy cow!

#45 2006-07-31 14:00:00

Re: ext3 with dir_index - holy cow!

#46 2006-08-01 19:34:15

Re: ext3 with dir_index - holy cow!

Board footer