Skip to content

Commit 4b5f728

Browse files
authored
Merge pull request DIRACGrid#7896 from fstagni/90_setup_removals
[9.0] More setup removals
2 parents bc5b5fb + 37b1d7a commit 4b5f728

File tree

55 files changed

+70
-577
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

55 files changed

+70
-577
lines changed

dirac.cfg

Lines changed: 0 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -5,10 +5,6 @@ DIRAC
55
# The option is defined in a single VO installation.
66
#VirtualOrganization = myVO
77

8-
# The name of the DIRAC installation Setup. This option is defined in the client
9-
# installations to define which subset of DIRAC Systems the client will work with.
10-
Setup = mySetup
11-
128
# The list of extensions to the Core DIRAC software used by the given installation
139
#Extensions = WebApp
1410

@@ -101,31 +97,8 @@ DIRAC
10197
# grant_types = refresh_token,
10298
#}
10399
}
104-
105100
}
106-
107101
}
108-
109-
# The subsection defines the names of different DIRAC Setups.
110-
Setups
111-
{
112-
113-
# For each Setup known to the installation, there must be a subsection with the appropriate name.
114-
# In each subsection of the Setup section the names of corresponding system instances are defined.
115-
# In the example below "Production" instances of the Configuration
116-
# and Framework systems are defined as part of the "Dirac-Production" setup.
117-
Dirac-Production
118-
{
119-
# Each option represents a DIRAC System available in the Setup
120-
# and the Value is the instance of System that is used in that setup.
121-
# For instance, since the Configuration is unique for the whole installation,
122-
# all setups should have the same instance for the Configuration systems.
123-
Configuration = Production
124-
Framework = Production
125-
}
126-
127-
}
128-
129102
}
130103
# This part contains anything related to DiracX
131104
DiracX

docs/docs.conf

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -95,7 +95,7 @@ sectionPath = source/AdministratorGuide/CommandReference
9595
title = General information
9696

9797
# [mandatory] pattern to match in the full path of the command names.
98-
pattern = dirac-admin-service-ports, dirac-platform
98+
pattern = dirac-platform
9999

100100
# this list of patterns will reject scripts that are matched by the patterns above
101101
# exclude = user

docs/source/AdministratorGuide/Configuration/ConfReference/Operations/VOs/index.rst

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,16 @@
11
Operations / VOs - Subsections
22
==============================
33

4-
<VO_NAME> subsections allows to define pilot jobs versions for each setup defined for each VO supported by the server.
4+
<VO_NAME> subsections allows to define pilot jobs DIRAC versions for each VO supported by the server.
55

66
+-----------------------------------------------+----------------------------------------------+---------------------------+
77
| **Name** | **Description** | **Example** |
88
+-----------------------------------------------+----------------------------------------------+---------------------------+
99
| *<VO_NAME>* | Subsection: Virtual organization name | vo.formation.idgrilles.fr |
1010
+-----------------------------------------------+----------------------------------------------+---------------------------+
11-
| *<VO_NAME>/<SETUP_NAME>/* | Subsection: VO Setup name | Dirac-Production |
12-
+-----------------------------------------------+----------------------------------------------+---------------------------+
1311

1412
This section will progressively incorporate most of the other sections under /Operations in such a way
15-
that different values can be defined for each [VO] (in multi-VO installations) and [Setup]. A helper
13+
that different values can be defined for each [VO] (in multi-VO installations). A helper
1614
class is provided to access to these new structure.
1715

1816
::

docs/source/AdministratorGuide/Configuration/ConfReference/Operations/index.rst

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,6 @@ This section allows to configure options concerning to:
1313
- Virtual Organization special parameters
1414
- Component Monitoring
1515

16-
In the short term, most of this schema will be moved into [vo]/[setup] dependent sections in order to allow better support for multi-VO installations.
17-
1816
.. toctree::
1917
:maxdepth: 2
2018

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/Accounting/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
Accounting System configuration
22
==================================
33

4-
In this subsection are described the databases, services and URLs related with Accounting framework for each setup.
4+
In this subsection are described the databases, services and URLs related with Accounting framework.
55

66
.. toctree::
77
:maxdepth: 2

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/Configuration/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
Configuration System configuration
22
==================================
33

4-
In this subsection are described the databases, services and URLs related with Accounting framework for each setup.
4+
In this subsection are described the databases, services and URLs related with Accounting framework.
55

66
.. toctree::
77
:maxdepth: 2

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/DataManagement/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
DataManagement System configuration
22
======================================
33

4-
In this subsection are described the databases, services and URLs related with the DataManagement system for each setup.
4+
In this subsection are described the databases, services and URLs related with the DataManagement system.
55

66
.. toctree::
77
:maxdepth: 2

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/Framework/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
Framework System configuration
22
==================================
33

4-
In this subsection are described the databases, services and URLs related with Framework System for each setup.
4+
In this subsection are described the databases, services and URLs related with Framework System.
55

66
.. toctree::
77
:maxdepth: 2

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/StorageManagement/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
StorageManagement System configuration
22
=========================================
33

4-
In this subsection are described the databases, services and URLs related with RequestManagement System for each setup.
4+
In this subsection are described the databases, services and URLs related with RequestManagement System.
55

66
.. toctree::
77
:maxdepth: 2

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/Transformation/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ Transformation System configuration
22
=========================================
33

44
In this subsection are described the databases, services, agents, and URLs related to
5-
Transformation System for each setup.
5+
Transformation System.
66

77
.. toctree::
88
:maxdepth: 2

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/WorkloadManagement/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
WorkloadManagement System configuration
22
========================================
33

4-
In this subsection are described the databases, services and URLs related with WorkloadManagement System for each setup.
4+
In this subsection are described the databases, services and URLs related with WorkloadManagement System.
55

66
.. toctree::
77
:maxdepth: 2

docs/source/AdministratorGuide/Configuration/ConfReference/Systems/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ Each DIRAC system has its corresponding section in the Configuration namespace.
2525
Default structure
2626
-----------------
2727

28-
In each system, per setup, you normally find the following sections:
28+
In each system you normally find the following sections:
2929

3030
* Agents: definition of each agent
3131
* Services: definition of each service

docs/source/AdministratorGuide/Configuration/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ DIRAC Configuration
55
===================
66

77
The Configuration Service is providing the necessary information for the operations
8-
of a whole DIRAC Installation (which might include several *Setups*). In this section,
8+
of a whole DIRAC Installation. In this section,
99
the structure of the DIRAC Configuration and its contents are described.
1010
The procedure to add new configuration data and to update the existing settings is explained.
1111

docs/source/AdministratorGuide/HowTo/authentication.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ All procedure have a list of required :mod:`~DIRAC.Core.Security.Properties` and
3939
There are two main ways to define required properties:
4040

4141
- "Hardcoded" way: Directly in the code, in your request handler you can write ```auth_yourMethodName = listOfProperties```. It can be useful for development or to provide default values.
42-
- Via the configuration system at ```/DIRAC/Systems/(SystemName)/(InstanceName)/Services/(ServiceName)/Authorization/(methodName)```, if you have also define hardcoded properties, hardcoded properties will be ignored.
42+
- Via the configuration system at ```/DIRAC/Systems/(SystemName)/Services/(ServiceName)/Authorization/(methodName)```, if you have also define hardcoded properties, hardcoded properties will be ignored.
4343

4444
A complete list of properties is available in :ref:`systemAuthorization`.
4545
If you don't want to define specific properties you can use "authenticated", "any" and "all".

docs/source/AdministratorGuide/HowTo/dedicateddfc.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ Prepare the CS for the new Database
1414
------------------------------------
1515

1616
First the information for the new database is added to the Configuration System. All the parameters in the
17-
``Systems/DataManagement/<SETUP>/Databases/NFCDB`` section can be copied from the ``FileCatalogDB`` section, except that
17+
``Systems/DataManagement/Databases/NFCDB`` section can be copied from the ``FileCatalogDB`` section, except that
1818
the ``DBName`` has to be pointing to the soon to be created database::
1919

2020
DBName = NFCDB

docs/source/AdministratorGuide/Introduction/diraccomponents.rst

Lines changed: 2 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -32,22 +32,8 @@ And then there are databases, which keep the persistent state of a *System*.
3232
They are accessed by Services and Agents as a kind of shared memory.
3333

3434
To achieve a functional DIRAC installation, cooperation of different *Systems* is required.
35-
A set of *Systems* providing a complete functionality to the end user form a DIRAC *Setup*.
36-
All DIRAC client installations will point to a particular DIRAC *Setup*. *Setups* can span
37-
multiple server installations. Each server installation belongs to a DIRAC *Instance* that can
38-
be shared by multiple *Setups*.
39-
40-
A *Setup* is the highest level of the DIRAC component hierarchy. *Setups* are combining
41-
together instances of *Systems*. Within a given installation there may be several *Setups*.
42-
For example, there can be "Production" *Setup* together with "Test" or "Certification"
43-
*Setups* used for development and testing of the new functionality. An instance of a *System*
44-
can belong to one or more *Setups*, in other words, different *Setups* can share some *System*
45-
instances. Multiple *Setups* for the given community share the same Configuration information
46-
which allows them to access the same computing resources.
47-
48-
Each *System* and *Setup* instance has a distinct name. The mapping of *Systems* to
49-
*Setups* is described in the Configuration of the DIRAC installation in the "/DIRAC/Setups"
50-
section.
35+
A set of *Systems* provide a complete functionality to the end user.
36+
Each *System* instance has a distinct name.
5137

5238
.. image:: ../../_static/setup_structure.png
5339
:alt: DIRAC setup structure illustration (source https://github.com/TaykYoku/DIRACIMGS/raw/main/DIRAC_Setup_structure.ai)

docs/source/AdministratorGuide/Resources/supercomputers.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ Solutions seen in the previous section cannot work in an environment without ext
115115
The well-known Pilot-Job paradigm on which the DIRAC WMS is based does not apply in these circumstances: the Pilot-Jobs cannot fetch jobs from DIRAC.
116116
Thus, such supercomputers require slightly changes in the WMS: we reintroduced the push model.
117117

118-
To leverage the Push model, one has to add the :mod:`~DIRAC.WorkloadManagementSystem.Agent.PushJobAgent` to the ``Systems/WorkloadManagement/<Setup>/Agents`` CS section, such as::
118+
To leverage the Push model, one has to add the :mod:`~DIRAC.WorkloadManagementSystem.Agent.PushJobAgent` to the ``Systems/WorkloadManagement/Agents`` CS section, such as::
119119

120120
Systems
121121
PushJobAgent_<Name>

docs/source/AdministratorGuide/ServerInstallations/HTTPSServices.rst

Lines changed: 0 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -30,15 +30,6 @@ All other services can follow the standard procedure described below.
3030

3131
First, the following configuration subsections have to be added to CS::
3232

33-
# "Main" section
34-
DIRAC
35-
{
36-
Setups
37-
{
38-
...
39-
Tornado = Production # "Production" is common here, for your setup what follow what's already there for the other systems
40-
}
41-
}
4233

4334
# Add Tornado to Systems section
4435
Systems

docs/source/AdministratorGuide/ServerInstallations/InstallingDiracServer.rst

Lines changed: 1 addition & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -256,10 +256,7 @@ be taken based on the Python version you wish to install.
256256
VirtualOrganization = Name of your VO
257257
# Site name
258258
SiteName = DIRAC.HostName.ch
259-
# Setup name
260-
Setup = MyDIRAC-Production
261-
# Default name of system instances
262-
InstanceName = Production
259+
263260
# Flag to skip download of CAs, on the first Server of your installation you need to get CAs
264261
# installed by some external means
265262
SkipCADownload = yes
@@ -428,10 +425,6 @@ operation is the registration of the new host in the already functional Configur
428425
VirtualOrganization = Name of your VO
429426
# Site name
430427
SiteName = DIRAC.HostName2.ch
431-
# Setup name
432-
Setup = MyDIRAC-Production
433-
# Default name of system instances
434-
InstanceName = Production
435428
# Flag to use the server certificates
436429
UseServerCertificate = yes
437430
# Configuration Server URL (This should point to the URL of at least one valid Configuration

docs/source/AdministratorGuide/ServerInstallations/InstallingWebAppDIRAC.rst

Lines changed: 0 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,6 @@ Installation configuration::
5252
Services = Framework/SystemAdministrator
5353
UseServerCertificate = yes
5454
SkipCADownload = yes
55-
Setup = your setup # for example: LHCb-Certification
5655
ConfigurationMaster = no
5756
ConfigurationServer = your configuration service
5857
}
@@ -111,7 +110,6 @@ Make sure that the configuration /opt/dirac/pro/etc/dirac.cfg file is correct. I
111110

112111
DIRAC
113112
{
114-
Setup = LHCb-Certification
115113
Configuration
116114
{
117115
Servers =
@@ -120,14 +118,6 @@ Make sure that the configuration /opt/dirac/pro/etc/dirac.cfg file is correct. I
120118
{
121119
}
122120
Extensions = WebApp
123-
Setups
124-
{
125-
LHCb-Certification
126-
{
127-
Configuration = LHCb-Certification
128-
Framework = LHCb-Certification
129-
}
130-
}
131121
}
132122

133123
Update using :ref:`dirac-admin-sysadmin-cli <dirac-admin-sysadmin-cli>`.

docs/source/AdministratorGuide/Systems/Framework/ComponentMonitoring/index.rst

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,8 +20,6 @@ Installation
2020
The service constitutes of one database (InstalledComponentsDB) and one service (Framework/ComponentMonitoring).
2121
These service and DB may have been installed already when DIRAC was installed the first time.
2222

23-
The script ``dirac-populate-component-db`` should then be used to populate the DB tables with the necessary information.
24-
2523

2624
Interacting with the static component monitoring
2725
------------------------------------------------

docs/source/AdministratorGuide/Systems/MonitoringSystem/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@ For example::
5555
}
5656

5757

58-
The following option can be set in `Systems/Monitoring/<Setup>/Databases/MonitoringDB`:
58+
The following option can be set in `Systems/Monitoring/Databases/MonitoringDB`:
5959

6060
*IndexPrefix*: Prefix used to prepend to indexes created in the ES instance. If this
6161
is not present in the CS, the indices are prefixed with the setup name.

docs/source/AdministratorGuide/Systems/WorkloadManagement/JobsMatching.rst

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,6 @@ The JobAgent running on the Worker Node and started by the pilot presents capabi
2828
Platform: x86_64_glibc-2.21
2929
ReleaseProject: VO
3030
ReleaseVersion: 7.2.13
31-
Setup: VO-Certification
3231
Site: DIRAC.somewhere.org
3332
Tag: GPU
3433
}
@@ -42,7 +41,6 @@ An example of requirements include the following::
4241
[
4342
Owner = "user_x";
4443
VirtualOrganization = "VO";
45-
Setup = "VO-Certification";
4644
CPUTime = 17800;
4745
OwnerGroup = "user";
4846
UserPriority = 1;

docs/source/AdministratorGuide/Tutorials/basicTutoSetup.rst

Lines changed: 0 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -239,14 +239,6 @@ The installation created the file ``/opt/dirac/etc/dirac.cfg``. The content is t
239239
Security
240240
{
241241
}
242-
Setups
243-
{
244-
MyDIRAC-Production
245-
{
246-
Configuration = Production
247-
Framework = Production
248-
}
249-
}
250242
Configuration
251243
{
252244
Master = yes

docs/source/AdministratorGuide/Tutorials/basicTutoSetup.sh

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -118,8 +118,6 @@ LocalInstallation
118118
SiteName = dirac-tuto
119119
# Setup name
120120
Setup = MyDIRAC-Production
121-
# Default name of system instances
122-
InstanceName = Production
123121
# Flag to skip download of CAs
124122
SkipCADownload = yes
125123
# Flag to use the server certificates

docs/source/DeveloperGuide/AddingNewComponents/DevelopingDatabases/index.rst

Lines changed: 11 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ The *DB* class includes all the methods necessary to access, query, modify... th
3636
The first line in the ``__init__`` method should be the initialization of the parent (*DB*) class. That initialization requires 2 or 3 parameters:
3737

3838
1. Logging name of the database. This name will be used in all the logging messages generated by this class.
39-
2. Full name of the database. With *System/Name*. So it can know where in the CS look for the initialization parameters. In this case it would be */Systems/Test/<instance name>/Databases/AtomDB*.
39+
2. Full name of the database. With *System/Name*. So it can know where in the CS look for the initialization parameters. In this case it would be */Systems/Test/Databases/AtomDB*.
4040
3. Boolean for the debug flag
4141

4242
After the initialization of the *DB* parent class we call our own ``__initializeDB`` method.
@@ -50,34 +50,29 @@ The *addStuff* method simply inserts into the created table the argument value.
5050
Configure the database access
5151
==============================
5252

53-
The last step is to configure the database credentials for DIRAC to be able to connect. In our previous example the CS path was */Systems/Test/<instance name>/Databases/AtomDB*. That section should contain::
53+
The last step is to configure the database credentials for DIRAC to be able to connect. In our previous example the CS path was */Systems/Test/Databases/AtomDB*. That section should contain::
5454

5555
Systems
5656
{
5757
Test
5858
{
59-
<instance name>
59+
Databases
6060
{
61-
Databases
61+
AtomDB
6262
{
63-
AtomDB
64-
{
65-
Host = localhost
66-
User = yourusername
67-
Password = yourpasswd
68-
DBName = yourdbname
69-
}
70-
}
71-
}
63+
Host = localhost
64+
User = yourusername
65+
Password = yourpasswd
66+
DBName = yourdbname
67+
}
68+
}
7269
}
7370

7471

7572
In a production environment, the "Password" should be defined in a non-accessible file,
7673
while the rest of the configuration can go in the central Configuration Service.
7774

78-
If you encounter any problem with sockets, you should replace "localhost" (DIRAC/Systems/Test/<instance name>/AtomDB/Host) by 127.0.0.1.
79-
80-
Keep in mind that <instance name> is the name of the instance defined under */DIRAC/Setups/<your setup>/Test* and <your setup> is defined under */DIRAC/Setup*.
75+
If you encounter any problem with sockets, you should replace "localhost" (DIRAC/Systems/<instance name>/AtomDB/Host) by 127.0.0.1.
8176

8277
Once that is defined you're ready to go.
8378

0 commit comments

Comments
 (0)