live Arch CD construction kit (larch)

lilsirecho · 2006-07-15 14:14:45

I do indeed mean the Live data n /home/tmp directory.

The procedure seems to follow the pattern of loading the kernel and base packages followed by the added packages. Then it performs.....squash.sqf.....which ends with about 3-4 minutes of time-related activity . The end result is an ending statement regarding the .iso size.

My file of programs to install in the CD is called .../Livelarch. It has 1.3GB in.... properties.

The size of /home/tmp/live data is 1.8GB in properties. The .iso is 2.0GB, too large for a CD.

Obviously, the squashing hasn't occured as you described it as being included in Live Data.

I assume my LiveLarch file is added packages, base packages are 102MB and the added packages were 437MB.

I must have an error in ...config_larch..........
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
#! /bin/bash
# This is the config file for the scripts mkarch and mklive.

# WARNING! Relative paths (those not starting with /) are relative
# to the directory containing this file, and should be processed
# with 'readlink -f' in order to make them absolute, e.g.:
# VAR1=$( readlink -f ../dir/file )

# Allows customizing of the cache for downloaded packages, default:
#PKGCACHE=/var/cache/pacman/pkg
PKGCACHE=/var/cache/pacman/pkg

# directory to contain the freshly installed Arch Linux
DESTDIR=/Livelarch

# choose method for acquiring list of base packages
#getbasepacks=basepacks_cvs
getbasepacks=basepacks_ftp
#getbasepacks=basepacks_abs

# directory to use for ABS hierarchy (Arch default is /var/abs)
# (only needed if using base package method 'basepacks_abs')
#ABSROOT=/var/abs/local1

# list of base packages which should NOT be installed
# e.g. BASEVETO="pkga pkgb"
BASEVETO="devfsd lshwd"
# devfsd is deprecated, but apparently still in base
# lshwd is buggy, I have a patched version in custompacks

# path to folder containing additional packages for the live system.
# These may be special versions, or non-standard software.
#CUSTOMPACKS=$( readlink -f ../custompacks )

# This is where the mylivecd.iso file will end up
# Make sure the directory exists ...
ISODIR=/home/tmp

# This is where the CD structure will be built up
# By using $$ (process ID) we get a (fairly) unique directory name
# BUT at the moment I don't want one!
CDDATA=/home/tmp/live_data

# path to folder containing additional packages for the installation.
# These are not included in the live system.
# In particular, a kernel should be there!
PACKAGES=$( readlink -f ../packages )

echo " ... Config file done"

gradgrind · 2006-07-15 16:02:04

The config file looks fine to me. I reckon you must have something unexpected in /Livelarch or in /home/tmp/live_data. Have a look and see exactly what is taking up all the space in /home/tmp/live_data.

lilsirecho · 2006-07-15 17:38:34

Gradgrind;
Appreciate your responses.

I examined /live_data file and it has two large files...packages 1.3GB and system.sqf of 515 MB.

Total is in 1.8GB range.
It contains ..boot,config,bild scripts,inittab,isolinux config,livecd.sgn,make_iso.sh mods.sqf,rc.sysinit and system.sqf.
My /Livelarch file contains 1.3GB of packages.

I hope this info is helpful....

lilsirecho · 2006-07-15 19:51:50

Found my error :oops:

Wrong ID for line 85 in mklive.....

Many thanks for your aid and comfort!!!!

lilsirecho · 2006-07-16 01:21:38

Generated nice sized DVD in .iso 748MB and it performed well. Took 130 seconds to reach Kde desktop.

Again, loading a 1GB file bumped tmpfs to 1.2GB. I have 2GB in ram.

It is hot here today, pushing 100 degs......

Keep 8)

gradgrind · 2006-07-16 07:18:48

Oh dear, it looks like fsphost.com is not going to be much use. It's lost my files and I can't upload them again, so I'll have to get a new host. That could take a while as I am not free for much of the next few weeks. Maybe someone else could put the files (well, actually larch_all.tar.gz has everything in it) somewhere accessible for a while? The latest version is 0.9.10. Send me your email address and I'll send you the file as soon as I can.

gradgrind · 2006-07-16 07:51:59

For the moment, the latest version, packaged as larch_all.tar.gz is available for download at http://www.savefile.com/files/5968615

Everything is in this package, including the docs, and my little utilities gen_repo.py and xkbset.py (though these are hidden in the subdirectory larch-0.9.10/mklive/overlay/root/bin).

Sigi · 2006-07-16 13:59:08

The file is now also available here.

Cheers Sigi

grail · 2006-07-17 04:47:38

Thanks for the file I'm starting to have a look at it now. One question (which I had a quick look for in the docs, so sorry if it's there and I missed it) is I want to use this to build a live DVD based on my current installed arch system. But after running this it seems to want to download all the pkg's instead of use the ones in /var/cache/pacman/pkg/. How can I tell it to use the pkgs' on my local system instead of downloading new copies?

gradgrind · 2006-07-17 05:25:45

That's very odd, it should use the cached packages by default (setting in config_larch) - it works for me.

Check that the packages in question are indeed in the cache, and that PKGCACHE in config_larch is ok. Then you could start 'mkarch', and when it starts downloading the packages, kill it and look at the symlink var/cache/pacman/pkg in the destination tree, to check that it is pointing at the correct location (i.e. /var/cache/pacman/pkg).

Good luck!

grail · 2006-07-17 05:49:53

larch-0.9.10 # > cat config_larch | grep PKGCACHE
PKGCACHE=/var/cache/pacman/pkg

larch-0.9.10 # > mkarch/mkarch
Getting live CD configuration details
... Config file done
Changing current directory to /tmp/larch_all/larch-0.9.10/mkarch

Downloaded packages will be cached at /var/cache/pacman/pkg

OK? [y/N]: y

*********** Getting base package list from cvs.archlinux.org ***********

--15:47:03-- http://cvs.archlinux.org/cgi-bin/viewcvs.cgi/base/
=> `index.html'

************** Synchronising package dbs **************

:: Synchronizing package databases...
custom [/tmp/larch_all/custompacks/] 100% LOCAL
current [################] 100% 67K 15.8K/s 00:00:04
extra [################] 100% 253K 13.2K/s 00:00:19

************** Installing base package set **************

Installing following packages:
autoconf automake bash etc....

Total Package Size: 102.8 MB

Beginning upgrade process...

:: Retrieving packages from current...
diffutils-2.8.1-2 [########## ] 68% 88K 17.5K/s 00:00:02

Package installation from basepacks FAILED.

ArchImage]# ls -ltr /export/ArchImage/var/cache/pacman/
total 0
lrwxrwxrwx 1 root root 21 2006-07-17 15:47 pkg -> /var/cache/pacman/pkg

Sigi · 2006-07-17 10:09:49

gradgrind wrote:

That's very odd, it should use the cached packages by default (setting in config_larch) - it works for me.

So does it for me.
One thing to keep in mind: If you use [testing] on your system don't clean your pkg-cache with "pacman -Sc" if you want to build a LiveDVD using the [current] and [extra] Repo.

lilsirecho · 2006-07-17 16:34:57

Gradgrind;

I find that the performance of the Larch CD/DVD is similar whether the squashfs is used or not, based on the results produced by my original error, included in the 3.577GB DVD without .gz compression.

I have two without squash and two with squash and all perform well, one CD and three DVD's.
Certainly, squash provides for greater package installs, and DVD provides enough space for around 9GB...a horrendous amount of packages!

Whereas, in normal arch I cannot "scan" a 1GB .vob, it is a normal function possible in the Larch boots.

I have a Sony 530 DRU DVDrom, athlon1900+ with 2GB ram.

Loaded wine into the 3.577GB DVD and ran irfanview in Linux-Larch.

I feel that install-to-ram (slower boot perhaps) will make the Livelarch perform faster.

I have thoughts of trying an eight times DVD.

The pacman install performs very nicely and looks and acts like a normal install.

Install in ram should open up new ways to utilize Larch via the cdrom input.

Good show

grail · 2006-07-18 03:30:44

Well I guess it's good that it's not just me But I'll await for Gradgrind's feedback.

Sigi · 2006-07-18 06:52:14

I also enjoy the discussion about larch and I really appreciate gradgrinds work on larch. The good feedback in this thread shows me that I'm not the only one that prefers larch over the Archie skripts. I'm sure a little competition doesn't hurt ;-)

lilsirecho · 2006-07-18 18:48:59

Made a recount of packages listed in ...pacman -Q...for my 3.577GB DVD disc.

The actual count of installed packages with their dependencies is 614.

I am using it at the present time. It indeed shows nearly full burn on the disc.

This disc seems to have been made without compression although I don't understand how it could run through .iso mkisofs at that GB level...

So goes linux

lilsirecho · 2006-07-19 03:28:32

The 3.5GB uncompressed Live_data, when re-run through mklive with line 85 restored, produces a 930MB .iso which boots and runs as LiveDVD.

I haven't used it very much yet.....seems slower..also doesn't use much of the media..seems that 2.x 930MB is possible on a disc if .iso is limited to 2GB in mkisofs.

The file size limit of 4GB limits the alternate LiveDVD setup which I encountered.

Maybe there is a way to work around that such as to permit dual-layer DVD for the whole of arch!

grail · 2006-07-19 12:15:35

lilsirecho; Did it tru and download all the packages when you ran the script or did it use packages you already had on your HDD?

lilsirecho · 2006-07-19 16:00:54

grail;

Yes, it downloaded the added packages and placed them in my folder in /root called Livelarch.

I included that directory name in ..config_larch...as the $DESTDIR.....

My ...config_larch is shown in a previous post.

I originally was unable to run the mklive section wiith an error at line 85 of ..mklive...

I had to define the path for config_larch at that step.

I ran all Larch scripts as /root.

Your post shows the correct sequence but fails to download into the file. Perhaps you have to run...pacman -Sy pacman before running Larch to verify the latest pacman pkg.

Also, a reminder that kernel26beyond is prepped for unionfs and squashfs and any other kernel has to have those pkgs installed.

You may be missing a script in the downloaded Larch 0.9.9 which causes the problem. Watch the syntax in your entries...

I chose ftp source for my base pack download as shown in the previous post.

One aspect of the Livelarch operation is that the primary boot (secondary too) HDD's power can be unplugged and the system will boot and run from the Livelarch disc. A really power saving result, say for a laptop!!!

I am looking forward to a install-to-ram format which should speed-up the operation of the Livelarchcd and free-up the CDrom for other entries, say, more pacman pkgs in overlay mode! This would customize each boot-up with different added CD packages.

I also think that original ro pkgs should respond to a new download through unionfs as rw packages in the overlay mode to enable them to be rw.

I have played with DVD sized boots for a few years and was pleased to see Knoppix generate their very large DVD. I had concluded that two "cloop" devices were needed to permit the full sized DVD and shortly thereafter their DVD was issued with two cloop devices.
LiveLarch has permitted me an uncompressed 3.577GB Live DVD at this writing. I believe it can do a 3.6-3.9GB compressed DVD if one has the patience to load into the added packages with no typos!!

You may have to try other download options......

Best to you

lilsirecho · 2006-07-19 16:49:03

Grail;

In review of my Larch scripts I find in ...pacman conf .... that I commented out the line referring to CUSTOM PACKS. If it is not commented out, no download will occur unless you have CUSTOM PACKS specified elsewhere in Larch.

This is possibly the cause for your lack of download.....

======================================================================

Edit: Nero fiddles while rom burns..............................

grail · 2006-07-20 05:30:49

lilsirecho; I do not want this script to download any packages but rather use the packages I already have on my HDD in /var/cache/pacman/pkg/

So any suggestions on if this is possible or how to do this would be appreciated.

lilsirecho · 2006-07-20 14:39:04

I suggest that you cange the pacman.conf to refer to your own repository as the first item in pacman.conf and that should do the trick.

grail · 2006-07-21 01:47:10

hmm tried that but it still wanted to download about 700mb worth of packages?

DOING: arch
Connected to cvs.archlinux.org
Updating collection arch/cvs
Finished successfully

************** Synchronising package dbs **************

:: Synchronizing package databases...
custom [/export/larch_all/custompacks/] 100% LOCAL
archie [/var/cache/pacman/pkg/] 100% LOCAL
current [################] 100% 67K 5.3K/s 00:00:12
extra [################] 100% 253K 12.9K/s 00:00:19
community [################] 100% 114K 13.7K/s 00:00:08

************** Installing base package set **************

<CUT>
Total Package Size: 102.8 MB

<CUT>
************** Generating locales **************

Generating locales...
en_US.ISO-8859-1... done
en_US.UTF-8... done
de_DE.ISO-8859-1... done
de_DE.ISO-8859-15@euro... done
de_DE.UTF-8... done
Generation complete.

************** Additional packages **************

Installing following packages:

<CUT>
Total Package Size: 532.2 MB

Beginning upgrade process...

---

Now I'm not sure if it's going to use the packages in my Local repo (archie) or try download all 532.2 MB worth of packages. Looking at some of the packages it listed a lot were in my local repo, but some were not.

lilsirecho · 2006-07-21 02:28:22

Grail; I believe that those packages not within your local repo will be downloaded...all others will be obtained from your repo...I think that the first action is to download pkgs not in the repo and that may be happening but you interpret it to mean all of your list will be downloaded as it begins to do so.

Keep trying!

Sigi · 2006-07-21 09:28:01

grail wrote:

hmm tried that but it still wanted to download about 700mb worth of packages?
<cut>
Now I'm not sure if it's going to use the packages in my Local repo (archie) or try download all 532.2 MB worth of packages. Looking at some of the packages it listed a lot were in my local repo, but some were not.

In my case, the script/pacman displays a similiarly large package size which will be downloaded. In fact it later only loads the one which have been updated - as intented.

But anyway - keep trying!

Arch Linux

#51 2006-07-15 14:14:45

Re: live Arch CD construction kit (larch)

#52 2006-07-15 16:02:04

Re: live Arch CD construction kit (larch)

#53 2006-07-15 17:38:34

Re: live Arch CD construction kit (larch)

#54 2006-07-15 19:51:50

Re: live Arch CD construction kit (larch)

#55 2006-07-16 01:21:38

Re: live Arch CD construction kit (larch)

#56 2006-07-16 07:18:48

Re: live Arch CD construction kit (larch)

#57 2006-07-16 07:51:59

Re: live Arch CD construction kit (larch)

#58 2006-07-16 13:59:08

Re: live Arch CD construction kit (larch)

#59 2006-07-17 04:47:38

Re: live Arch CD construction kit (larch)

#60 2006-07-17 05:25:45

Re: live Arch CD construction kit (larch)

#61 2006-07-17 05:49:53

Re: live Arch CD construction kit (larch)

#62 2006-07-17 10:09:49

Re: live Arch CD construction kit (larch)

#63 2006-07-17 16:34:57

Re: live Arch CD construction kit (larch)

#64 2006-07-18 03:30:44

Re: live Arch CD construction kit (larch)

#65 2006-07-18 06:52:14

Re: live Arch CD construction kit (larch)

#66 2006-07-18 18:48:59

Re: live Arch CD construction kit (larch)

#67 2006-07-19 03:28:32

Re: live Arch CD construction kit (larch)

#68 2006-07-19 12:15:35

Re: live Arch CD construction kit (larch)

#69 2006-07-19 16:00:54

Re: live Arch CD construction kit (larch)

#70 2006-07-19 16:49:03

Re: live Arch CD construction kit (larch)

#71 2006-07-20 05:30:49

Re: live Arch CD construction kit (larch)

#72 2006-07-20 14:39:04

Re: live Arch CD construction kit (larch)

#73 2006-07-21 01:47:10

Re: live Arch CD construction kit (larch)

#74 2006-07-21 02:28:22

Re: live Arch CD construction kit (larch)

#75 2006-07-21 09:28:01

Re: live Arch CD construction kit (larch)

Board footer