Skip to content

Latest commit

 

History

History
288 lines (204 loc) · 8.35 KB

Installation.rst

File metadata and controls

288 lines (204 loc) · 8.35 KB

CREAM installation

Requirements

The requirements for a basic installation of a CREAM site are:

  • Scientific Linux 6, Cent OS version 7 or compatibile distributions.
  • The UMD4 extension as described in the UMD guide

Installation

The basic installation of a CREAM site consists on the following mandatory packages:

  • canl-java-tomcat
  • cleanup-grid-accounts
  • bdii
  • dynsched-generic
  • glite-ce-cream
  • glite-info-provider-service
  • globus-gridftp-server-progs
  • globus-proxy-utils
  • glue-schema
  • kill-stale-ftp
  • lcg-expiregridmapdir
  • mariadb
  • sudo

If the authorization framework used is based on glexec the following packages are mandatory:

  • glexec
  • lcas-lcmaps-gt4-interface
  • lcas-plugins-basic
  • lcas-plugins-check-executable
  • lcas-plugins-voms
  • lcmaps-plugins-basic
  • lcmaps-plugins-verify-proxy
  • lcmaps-plugins-voms

if the authorization framework used is based on Argus the following package is mandatory:

  • argus-gsi-pep-callout

The following packages are optional:

  • apel-parsers : if the support for APEL accounting is enabled
  • glite-lb-logger : if the support for the Logging and Bookkeping is enabled
  • info-dynamic-scheduler-lsf : if the batch system used is LSF
  • info-dynamic-scheduler-lsf-btools : if the batch system used is LSF
  • info-dynamic-scheduler-slurm : if the batch system used is SLURM
  • lcg-info-dynamic-scheduler-condor : if the batch system used is HTCondor
  • lcg-info-dynamic-scheduler-pbs : if the batch system used is TORQUE

The standard procedure for the installation and configuration of a CREAM site makes use of the puppet framework. The puppet module checks for the presence of the packages described above, and in case they're not available on the system it installs them.

Example

This section illustrate an example of installation of a CREAM site by means of a standalone execution of puppet. In the following examples the FQDN of the CREAM CE is myhost.mydomain.

The required steps are:

  • Installation of the packages for puppet:

    yum -y install puppet

  • Verification of the puppet environment:

    facter | grep -E 'hostname|fqdn'

    If the FQDN of the host is not correctly resolved it is necessary to specify the parameter creamce::host

  • Installation of the CREAM CE module for puppet:

    puppet module install infnpd-creamce

  • Creation of the required directories:

    mkdir -p /etc/puppet/manifests /var/lib/hiera/node /etc/grid-security

  • Creation of the file /etc/puppet/manifests/site.pp with the following definition

    node 'myhost.mydomain' {
  require creamce
}

  • Creation of the file /etc/hiera.yaml with the following definitions:

    ---
:backends:
  - yaml
:hierarchy:
  - "node/%{fqdn}"
:yaml:
  :datadir: /var/lib/hiera

  • Creation of the symbolic link

    ln -s /etc/hiera.yaml /etc/puppet/hiera.yaml

  • Creation of the CREAM CE description file /var/lib/hiera/node/myhost.mydomain.yaml, an example of minimal configuration is:

    ---
creamce::mysql::root_password :      mysqlp@$$w0rd
creamce::creamdb::password :         creamp@$$w0rd
creamce::creamdb::minpriv_password : minp@$$w0rd
apel::db::pass :                     apelp@$$w0rd
creamce::batch_system :              pbs
creamce::use_argus :                 false
creamce::default_pool_size :         10

gridftp::params::certificate :       "/etc/grid-security/hostcert.pem"
gridftp::params::key :               "/etc/grid-security/hostkey.pem"
gridftp::params::port :              2811

creamce::queues :
    long :  { groups : [ dteam, dteamprod ] }
    short : { groups : [ dteamsgm ] }

creamce::vo_table :
    dteam : {
        vo_app_dir : /afs/dteam,
        vo_default_se : storage.pd.infn.it,
        servers : [
                      {
                          server : voms.hellasgrid.gr,
                          port : 15004,
                          dn : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr,
                          ca_dn : "/C=GR/O=HellasGrid/OU=Certification Authorities/CN=HellasGrid CA 2016"
                      },
                      {
                          server : voms2.hellasgrid.gr,
                          port : 15004,
                          dn : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr,
                          ca_dn : "/C=GR/O=HellasGrid/OU=Certification Authorities/CN=HellasGrid CA 2016"
                      }
        ],
        groups : {
            dteam : { fqan : [ "/dteam" ], gid : 9000 },

            dteamsgm : { fqan : [ "/dteam/sgm/ROLE=developer" ], gid : 9001, pub_admin : true },

            dteamprod : { fqan : [ "/dteam/prod/ROLE=developer" ], gid : 9002 }
        },
        users : {
            dteamusr : { first_uid : 6000, fqan : [ "/dteam" ],
                         name_pattern : "%<prefix>s%03<index>d" },

            dteamsgmusr : { first_uid : 6100, fqan : [ "/dteam/sgm/ROLE=developer", "/dteam" ],
                            pool_size : 5, name_pattern : "%<prefix>s%02<index>d" },

            dteamprodusr : { first_uid : 6200, fqan : [ "/dteam/prod/ROLE=developer", "/dteam" ],
                             pool_size : 5, name_pattern : "%<prefix>s%02<index>d" }
        }
    }

creamce::hardware_table :
    subcluster001 : {
        ce_cpu_model : XEON,
        ce_cpu_speed : 2500,
        ce_cpu_vendor : Intel,
        ce_cpu_version : 5.1,
        ce_physcpu : 2,
        ce_logcpu : 2,
        ce_minphysmem : 2048,
        ce_minvirtmem : 4096,
        ce_os_family : "linux",
        ce_os_name : "CentOS",
        ce_os_arch : "x86_64",
        ce_os_release : "7.0.1406",
        ce_outboundip : true,
        ce_inboundip : false,
        ce_runtimeenv : [ "tomcat_6_0", "mysql_5_1" ],
        subcluster_tmpdir : /var/tmp/subcluster001,
        subcluster_wntmdir : /var/glite/subcluster001,
        ce_benchmarks : { specfp2000 : 420, specint2000 : 380, hep-spec06 : 780 },
        nodes : [ "node-01.mydomain", "node-02.mydomain", "node-03.mydomain" ]
        # Experimental support to GPUs
        accelerators : {
            acc_device_001 : {
                type : GPU,
                log_acc : 4,
                phys_acc : 2,
                vendor : NVidia,
                model : "Tesla k80",
                version : 4.0,
                clock_speed : 3000,
                memory : 4000
            }
        }
    }

creamce::software_table :
    tomcat_6_0 : {
        name : "tomcat",
        version : "6.0.24",
        license : "ASL 2.0",
        description : "Tomcat is the servlet container"
    }
    mysql_5_1 : {
        name : "mysql",
        version : "5.1.73",
        license : "GPLv2 with exceptions",
        description : "MySQL is a multi-user, multi-threaded SQL database server"
    }

creamce::vo_software_dir : /afs

creamce::se_table :
    storage.pd.infn.it : { mount_dir : "/data/mount", export_dir : "/storage/export",
                           type : Storm, default : true }
    cloud.pd.infn.it : { mount_dir : "/data/mount", export_dir : "/storage/export",
                         type : Dcache }

    The permissions of the file /var/lib/hiera/node/myhost.mydomain.yaml must be set to 600.

  • Deployment of the host private key in /etc/grid-security/hostkey.pem

  • Deployment of the host certificate in /etc/grid-security/hostcert.pem

  • Execution of puppet

    puppet apply /etc/puppet/manifests/site.pp