[PATCH 0/2] Add a how-to for deploying Troves to wiki.baserock.org
by Adam Coldrick
This patch series adds a page to wiki.baserock.org with instructions on how to
build, deploy and configure a Trove system.
Repo: git://baserock.branchable.org
Ref: adamcoldrick/how-to-deploy-trove
SHA1: 70dc7419de416be37b5251974a802f4c4f1e47d2
Target: master
Adam Coldrick (2):
Add a page detailing how to build, deploy and configure a Trove
Add a link to the Trove deployment instructions to the how-tos page
deploying-a-trove.mdwn | 291 ++++++++++++++++++++++++++++++++++++++++++++++++
how-tos.mdwn | 6 +
2 files changed, 297 insertions(+)
create mode 100644 deploying-a-trove.mdwn
--
1.7.10.4
9 years, 6 months
[PATCH 0/3] NFS deploy fixes helpful for distbuild
by Sam Thursfield
Repository: git://git.baserock.org/baserock/baserock/morph
Ref: sam/nfs-deploy-fixes
Sha1: 4581d2ed753dc6e7e63cdefd5fcc68b7a4c4e3c9
Patch 1 is cleanup from the upgrades work, which rendered the /etc/fstab
hack unnecessary.
Patch 3 is to ease the pain of NFS deployment by making `morph deploy`
fail earlier when you mess something up.
NFS deployments are still a bit ugly. We structure the systems as if they
are upgradable, mirroring what we do on BTRFS systems, but we don't actually
allow upgrading them and I'm not sure whether it's useful to do so, since
(a) we might not want to assume the NFS server uses BTRFS, which would mean
we can't rely on copy-on-write snapshotting being available.
(b) distbuild nodes are stateless, so there's no reason we can't redeploy
them from scratch each time.
We need to make a decision and either make the NFS root file system
layout simpler (with no /systems/factory/orig snapshot) or allow upgrades,
and take a decision on whether we require either BTRFS or a huge hard disk
on the NFS server.
Whatever we decide on the above doesn't really affect this patch series,
I think.
Sam Thursfield (3):
Remove fstab hack from nfsboot.configure
Improve comment in nfsboot.configure
Make sanity checks for nfsboot deployments run earlier
morphlib/exts/nfsboot.check | 66 +++++++++++++++++++++++++++++++++++++++++
morphlib/exts/nfsboot.configure | 9 +++---
morphlib/exts/nfsboot.write | 59 +++---------------------------------
3 files changed, 74 insertions(+), 60 deletions(-)
--
1.8.5.3
9 years, 6 months
Bug in "morph <subcommand.> --help"
by Pedro Alvarez
Hi all,
I have found the following bug in the help output this morning:
# morph build --help
Usage: %prog [options] build SYSTEM
Build a system image in the current system branch
Command line arguments:
* `SYSTEM` is the name of the system to build.
This builds a system image, and any of its components that
need building. The system name is the basename of the system
. . . .
The bug, as you can see, is in the Usage line: %prog shouldn't be
there.
Mark Doffman: Can you please, since you have been doing the
improvements of the help output, take a look at it?
Thanks!
9 years, 6 months
[PATCH 0/2] Add the ability of including system integration commands.
by Pedro Alvarez
Repo: baserock:morph
Ref: baserock/pedroalvarez/system-integration3
Sha1: 20d6028c8bc62ca00a9af52ae5fada736ce673dc
Card: S10680
Please, ignore the previous thread of this patch. This is the valid one.
Thanks and sorry about that.
The purpose of this patch is to add the ability of including system
integration commands in the chunk morphologies.
An example of how to add system integration commands would be:
name: linux
kind: chunk
build-commands:
...
install-commands:
...
system-integration-commands:
linux-libs: |
depmod -a
touch /baserock/FILE
for FOLDER in $(ls /)
do
touch "$FOLDER"/.somefile
done
Pedro Alvarez (2):
Generate scripts with the system-integration-commands of chunk
morphologies.
Run the system integration commands when building.
morphlib/builder2.py | 84 ++++++++++++++++++++++++++++++++++++++++++++++++--
1 file changed, 81 insertions(+), 3 deletions(-)
--
1.7.10.4
9 years, 6 months
[PATCH 0/4] Implement morph add-binary and make morph use git-fat
by Adam Coldrick
This patch makes existing morph commands use git-fat when necessary and
also implements a command `morph add-binary` which is used to add a large
file to a git repository using git-fat. Files added in this manner can
be pushed to a Trove using `morph push` (rather than git push) and are
stored in "<trovehost>/path/to/repo/rsync".
A command `morph pull` is also implemented, which is a wrapper around git
pull that also uses git-fat, in a similar way to `morph push`.
Repo: git://git.baserock.org/baserock/baserock/morph
Ref: adamcoldrick/ingest-binaries
SHA1: 3592a1dfccd704c463e25907ab8c22b2119df303
Target: master
Adam Coldrick (4):
Add functionality for doing git commands in a directory
Make existing morph commands use git-fat
Implement morph add-binary using git-fat to store large files
Implement morph push and morph pull
morphlib/gitdir.py | 27 ++++++++
morphlib/plugins/add_binary_plugin.py | 83 +++++++++++++++++++++++
morphlib/plugins/branch_and_merge_new_plugin.py | 10 +++
morphlib/plugins/push_pull_plugin.py | 81 ++++++++++++++++++++++
4 files changed, 201 insertions(+)
create mode 100644 morphlib/plugins/add_binary_plugin.py
create mode 100644 morphlib/plugins/push_pull_plugin.py
--
1.7.10.4
9 years, 6 months
[PATCH V2 0/2] Add python2 symlink.
by mark.doffman＠codethink.co.uk
From: Mark Doffman <mark.doffman(a)codethink.co.uk>
Some python scripts needed for virt-manager use the
#! /usr/bin/python2 shebang.
As this is not available there is a file not found error.
PEP 394 http://legacy.python.org/dev/peps/pep-0394/ seems
to indicate that it should be available.
Repo: ssh://git@git.baserock.org/delta/cpython.git
Branch: baserock/markdoffman/py2-symlink-v2
SHA: 7bcc7fd48752b88502f (HEAD)
Changes since V1:
* Symlink is now to python2.7 directly.
* Morph file now no-longer references $BINDIR
Points of discussion:
I chose to symlink python2 to python2.7 rather than
python. This was for consistency reasons. Ubuntu
makes this link and its what is described in PEP 394.
Mark Doffman (2):
Translate morph file to yaml.
Add python2 symlink after install.
cpython.morph | 15 +++++++--------
1 file changed, 7 insertions(+), 8 deletions(-)
--
1.8.4
9 years, 6 months
[PATCH 00/11] Definitions for Baserock distributed build network
by Sam Thursfield
Repository: git://git.baserock.org/baserock/baserock/definitions
Ref: baserock/sam/distbuild-with-setup
Sha1: 44213f63cfcbffb167cdb73c85c562ac1fed2c0a
Here is all of the stuff required for distributed building outside of the
changes to Morph. The Morph changes are still in progress. If you want to
test distbuild out now, you can build from this branch but with the 'morph'
chunk's ref set to 'baserock/richardipsum/distbuild4'.
Although there is still work to be done to make the distributed build code
usable and robust, it is possible to deploy a distributed build network
that is capable of building systems with this branch.
This patch series could be squashed further, but because it is based off
existing code I thought it would be better to preserve the history of the
fixes that we have made.
Richard Ipsum (3):
Add distbuild stratum
Add distbuild config extension
Add armv7lhf distbuild system
Sam Thursfield (8):
Import distbuild configuration files into definitions.git
distbuild: Add a little documentation to configuration extension
distbuild: Add mechanism for providing SSH key in workers
distbuild: Add example cluster for deployment
distbuild: Fix error when ARTIFACT_CACHE_SERVER not set
distbuild: Don't hardcode repo-alias
distbuild: Set log file size limit
distbuild: Make systemd units require local-fs.target
distbuild-system-armv7lhf-highbank.morph | 20 +++
distbuild.configure | 159 +++++++++++++++++++++
distbuild.morph | 20 +++
.../system-generators/ccache-nfs-mount-generator | 16 +++
distbuild/manifest | 25 ++++
.../lib/systemd/system/morph-cache-server.service | 10 ++
.../systemd/system/morph-controller-helper.service | 10 ++
.../lib/systemd/system/morph-controller.service | 9 ++
.../lib/systemd/system/morph-worker-helper.service | 10 ++
.../usr/lib/systemd/system/morph-worker.service | 10 ++
.../morph-cache-server.service | 1 +
.../morph-controller-helper.service | 1 +
.../morph-controller.service | 1 +
.../morph-worker-helper.service | 1 +
.../multi-user.target.wants/morph-worker.service | 1 +
example-distbuild-cluster.morph | 37 +++++
16 files changed, 331 insertions(+)
create mode 100644 distbuild-system-armv7lhf-highbank.morph
create mode 100644 distbuild.configure
create mode 100644 distbuild.morph
create mode 100755 distbuild/lib/systemd/system-generators/ccache-nfs-mount-generator
create mode 100644 distbuild/manifest
create mode 100644 distbuild/usr/lib/systemd/system/morph-cache-server.service
create mode 100644 distbuild/usr/lib/systemd/system/morph-controller-helper.service
create mode 100644 distbuild/usr/lib/systemd/system/morph-controller.service
create mode 100644 distbuild/usr/lib/systemd/system/morph-worker-helper.service
create mode 100644 distbuild/usr/lib/systemd/system/morph-worker.service
create mode 120000 distbuild/usr/lib/systemd/system/multi-user.target.wants/morph-cache-server.service
create mode 120000 distbuild/usr/lib/systemd/system/multi-user.target.wants/morph-controller-helper.service
create mode 120000 distbuild/usr/lib/systemd/system/multi-user.target.wants/morph-controller.service
create mode 120000 distbuild/usr/lib/systemd/system/multi-user.target.wants/morph-worker-helper.service
create mode 120000 distbuild/usr/lib/systemd/system/multi-user.target.wants/morph-worker.service
create mode 100644 example-distbuild-cluster.morph
--
1.8.5.3
9 years, 6 months
A shot at (partial) baserock workflow diagram
by Paul Sherwood
Hi folks,
following discussion on IRC today I knocked this up ... but maybe it
would be better done in plantuml?
Please let me know if it's worth fixing, prettifying, and/or sticking on
the wiki somewhere
br
Paul
--
Paul Sherwood Codethink Ltd.
Tel: +44 788 798 4900 302 Ducie House, Ducie Street,
http://www.codethink.co.uk/ Manchester, M1 2JW, United Kingdom.
Codethink provides advanced software design, development, integration &
test services: from embedded systems to high performance apps to cloud.
9 years, 6 months
[PATCH 0/2] Add python2 symlink
by mark.doffman＠codethink.co.uk
From: Mark Doffman <mark.doffman(a)codethink.co.uk>
Some python scripts needed for virt-manager use the
#! /usr/bin/python2 shebang.
As this is not available there is a file not found error.
PEP 394 http://legacy.python.org/dev/peps/pep-0394/ seems
to indicate that it should be available.
Repo: ssh://git@git.baserock.org/delta/cpython.git
Branch: baserock/markdoffman/py2-symlink-v2
SHA: 1cbfb9266fbaa1edd1 (HEAD)
Mark Doffman (2):
Translate morph file to yaml.
Add python2 symlink after install.
cpython.morph | 15 +++++++--------
1 file changed, 7 insertions(+), 8 deletions(-)
--
1.8.4
9 years, 6 months
