Using XtreemOS
From Xtreemos
Contents |
Getting familiar with XtreemOS
If you are new to XtreemOS, you might want to take a look at the user guide. The latest version is here: XOS_UserGuide_20091014.pdf
Even if you are familiar with XtreemOS, it is recommended to look at the user guide, as it describes recent XtreemOS 2.0 features. What you should read from the guide:
- Chapter 2 (Overview)
- Section 4.3 (Application Execution Management)
- Section 4.5 (XOSAGA)
Unfortunately this is a draft version of the user guide and some sections are still missing.
The VU Testbed
Currently the testbed consists of 3 machines:
- core.xtreemos.cs.vu.nl (core node + resource)
- node01.xtreemos.cs.vu.nl (resource + client node)
- node02.xtreemos.cs.vu.nl (resource + client node)
Note: These machine names are aliases for the following names (in order): node004.das2.cs.vu.nl, node006.das2.cs.vu.nl, node007.das2.cs.vu.nl.
Creating a user account
In order to use XtreemOS you have to be registered in a virtual organization (VO). There is a web interface through which you can request to be included in a VO – here are the steps to do this:
1. Go to the VOLifeCycle portal and make yourself a new account: [1]
2. Log in using this account and go to Generate new keypair. Press the Generate button and then press the Download button - this way you will get a private key (a user.key file).
3. Go to Join a VO and choose to join VU_XOS20_new (this is the virtual organization that we are currently using for tests). Write an e-mail to cstratan at cs.vu.nl and I will add you to the VO and make accounts for you on the machines.
4. After you were added to the VO, log in again to the portal and go to Get an XOS-Cert. Download the new certificate and you will have a user.crt file. With this certificate you can prove that you are in the VU-XOS20_new virtual organization.
Setting up the certificates
In order to execute jobs in XtreemOS, you have to log into one of the client machines (node01, node02). You will need to put your key and your certificate on that machine, in the $HOME/.xos/truststore/private and $HOME/.xos/truststore/certs directories (you have to create these directories first). There are more details about certificates in Section 4.1 from the user guide (but the section about VOLife is not complete).
Setting up XtreemFS automount
When you submit a job, you need to set up XtreemFS in order to be able to get the output files that the job generates; XtreemOS does not do any file stage-out and the output files will just remain on the machine where the job was executed if XtreemFS is not set up (and you probably will not be able to access them). XtreemOS can mount a home volume for you (almost) automatically; then you can make your jobs write the output files in that home volume. In order to enable the auto-mounting, you have to write another e-mail to cstratan at cs.vu.nl, AFTER you have put your certificate in $HOME/.xos/truststore/certs. I will create your home volume and after that it can be automounted automatically.
Using ssh-xos
After XtreemFS automount was enabled for you, you will be able to access your home volume by using ssh-xos. Your home volume will be automatically mounted when you log in with ssh-xos, in the /home/<GUID> directory, where GUID is your global user ID. You can see your global user ID by looking at your user certificate, with the following command:
view-xos-cert $HOME/.xos/truststore/certs/user.crt
(search for “GlobalUserID:”; or search for “Subject:” and remove the “CN=” prefix). For example, for the user owner1, this ID is: 40c8a3d9-533a-409e-810d-d0ea3c06393c. You can see a directory with this name in /home/. Your directory should already exist on the client node where you have the user account, after the root has configured the automount for you. You need to create a configuration file for ssh-xos: $HOME/.ssh/config-xos. This file should look like this: Host node00*
XosProxyFile /home/<your_user_name>/.xos/truststore/certs/user.crt
XosVoName VU-xtreemos
You will be able to ssh-xos to all the nodes (core, node01, node02).
You can connect to any node, including the one on which you are already logged in. You shouldn't be asked for a password. When you connect, the XtreemFS volume will be automatically mounted and you will be able to read/write files from it. When you disconnect (Ctrl-D), the volume will be unmounted.
Here the user guide for the old VU testbed (the one with XtreemOS 1.0):
Xtreemos user howto VU.pdf
