Debian Codegraph @

doc/INSTALL_WITH_WORKSPACE_SERVICE

raw
1 The combined installation of (glite-)gatekeeper+LCAS+LCMAPS and the workspace service
2 _____________________________________________________________________________________
3
4 These instructions are due to change.
5
6 The end result of this installation on the CE will be:
7 1. The workspace management system, which provides a management interface to the local
8 user accounts on the CE
9 2. The (gsi-free) LCMAPS flavour that will be used as the backend to the workspace
10 service.
11 3. The (glite-)gatekeeper. This is essentially the gt2.4 gatekeeper, modified to call
12 out to LCAS and LCMAPS.
13 4. LCAS and gsi-flavour of LCMAPS that are used by the gatekeeper.
14
15
16
17 Prerequisites:
18 0) Start from a clean RHE3 (or binary compatible, e.g. SL3, SLC3, CentOS) machine.
19 1) Install the host certificate and key in /etc/grid-security
20 2) Install the CA certificates in /etc/grid-security/certificates
21 The CA rpms can be found in
22 http://www.eugridpma.org/distribution/current/accredited/RPMS/
23 (wget --no-directories -r -l1 --no-parent -A "noarch.rpm" http://www.eugridpma.org/distribution/current/accredited/RPMS/
24 wget --no-directories -r -l1 --no-parent -A "noarch.rpm" http://www.eugridpma.org/distribution/current/)
25 3) Update the CRLs using, e.g. the edg-fetch-crl script
26 Look in http://glite.web.cern.ch/glite/packages/externals/bin/rhel30/RPMS/ for the
27 relevant rpms.
28
29
30 I. Installation and configuration of LCMAPS (both flavours)
31 ____________________________________________________________
32
33 1) Install globus 2.4.3 from vdt, available from:
34 http://egee-jra1-integration.web.cern.ch/egee-jra1-integration/repository/globus/2.4.3-VDT-1.2.0/rhel30_gcc32/RPMS/
35 Needed package for LCMAPS:
36 vdt_globus_essentials-VDT1.2.0rh9-1.i386.rpm
37
38 2) Set up the gridmapdir in /etc/grid-security.
39 You can use this script (on RedHat), but please have a look at it and edit it first!:
40 http://www-unix.mcs.anl.gov/~tfreeman/local/pooled/admin/addpoolusers.sh
41 In order to use it you have to do the following first:
42 [root@kvasir root]# mkdir -p /etc/grid-security/gridmapdir
43 [root@kvasir root]# mkdir /home/gpool
44
45 NOTE: In a later stage, we make the gridmapdir directory owned by the globus user (now
46 this user does not exist yet)
47
48 3) Install the voms C-api library. Unfortunately this is not packaged separatately from the
49 rest of the voms-core package, so install everything from:
50 http://glite.web.cern.ch/glite/packages/N20041215/bin/rhel30/i386/RPMS/glite-security-voms-1.2.26-22_N20041215.i386.rpm
51
52 The certificates of the voms servers you trust should be stored in
53 /etc/grid-security/vomsdir.
54
55 4) Install the lcmaps framework and plugins from org.glite.
56 You need version 1.2.0 or higher, so you could take Nightly Build N20041215:
57 http://glite.web.cern.ch/glite/packages/N20041215/bin/rhel30/i386/RPMS/
58 You need the following packages:
59 glite-security-lcmaps-1.2.0-1_N20041215.i386.rpm
60 glite-security-lcmaps-interface-1.2.0-1_N20041215.i386.rpm
61 glite-security-lcmaps-plugins-basic-1.2.0-1_N20041215.i386.rpm
62 glite-security-lcmaps-plugins-voms-1.2.0-1_N20041215.i386.rpm
63 Of course "N20041215" should be replaced by the relevant nightly-build/integration-build number.
64
65 5) Unfortunately, the gsi-free version of LCMAPS that is needed for the workspace
66 service is not packaged yet. It has to be built by hand from CVS, for which you
67 can run this script:
68
69 root@kvasir root]# cat build_lcmaps_gsifree.sh
70 #!/bin/sh
71 #
72 mkdir -p /tmp/build_lcmaps_gsifree/EGEE
73 cd /tmp/build_lcmaps_gsifree/EGEE
74 export CVSROOT=":pserver:[email protected]:/cvs/jra1mw"
75 cvs co -r glite_branch_1_0_0_RC1 org.glite
76 cvs co -r glite-security_branch_1_0_0_RC1 org.glite.security
77 cvs co -r glite-security-lcmaps_branch_1_2_0_RC1 org.glite.security.lcmaps
78 cvs co -r glite-security-lcmaps-interface_branch_1_2_0_RC1 org.glite.security.lcmaps-interface
79 cvs co -r glite-security-lcmaps-plugins-basic_branch_1_2_0_RC1 org.glite.security.lcmaps-plugins-basic
80 cvs co -r glite-security-lcmaps-plugins-voms_branch_1_2_0_RC1 org.glite.security.lcmaps-plugins-voms
81 for i in lcmaps lcmaps-interface lcmaps-plugins-basic lcmaps-plugins-voms ; do \
82 cp org.glite.security/project/lcmaps.m4 org.glite.security.$i/project; \
83 cp org.glite/project/*m4 org.glite.security.$i/project; \
84 done
85 mkdir stage
86 for i in lcmaps lcmaps-interface lcmaps-plugins-basic lcmaps-plugins-voms ; do \
87 (cd org.glite.security.$i; \
88 make distclean; \
89 ./bootstrap; \
90 ./configure --prefix=/opt/glite --without-gsi-mode; \
91 make install); \
92 done
93 [root@kvasir root]#
94
95 This will checkout the lcmaps modules from the gLite RC1 (Release Candidate1)
96 branch, build and install in /opt/glite
97
98 6) Configure the lcmaps.db files:
99 We need to configure two lcmaps.db files. One for the lcmaps instance used by the
100 gatekeeper and one for the instance used by the workspace system.
101
102 For the gatekeeper:
103 ------------------------------------------------------------------
104 root@kvasir root]# cat /opt/glite/etc/lcmaps/lcmaps.db
105 # LCMAPS policy file/plugin definition
106 #
107 # default path
108 path = /opt/glite/lib/modules
109
110 # Plugin definitions:
111 good = "lcmaps_dummy_good.mod"
112 bad = "lcmaps_dummy_bad.mod"
113 localaccount = "lcmaps_localaccount.mod"
114 "-gridmapfile /etc/grid-security/grid-mapfile"
115 vomslocalgroup = "lcmaps_voms_localgroup.mod"
116 "-groupmapfile /etc/grid-security/groupmapfile"
117 "-mapmin 0"
118 vomspoolaccount = "lcmaps_voms_poolaccount.mod"
119 "-gridmapfile /etc/grid-security/grid-mapfile"
120 "-gridmapdir /etc/grid-security/gridmapdir"
121 "-do_not_use_secondary_gids"
122 posix_enf = "lcmaps_posix_enf.mod"
123 "-maxuid 1"
124 "-maxpgid 1"
125 "-maxsgid 32"
126
127 # Policies:
128 voms:
129 localaccount -> posix_enf | vomslocalgroup
130 vomslocalgroup -> vomspoolaccount
131 vomspoolaccount -> posix_enf
132 [root@kvasir root]#
133 ------------------------------------------------------------------
134
135 For the Workspace service:
136 ------------------------------------------------------------------
137 [root@kvasir root]# cat /opt/glite/etc/lcmaps/lcmaps.db.without_gsi
138 # LCMAPS policy file/plugin definition
139 #
140 # default path
141 path = /opt/glite/lib/modules
142
143 # Plugin definitions:
144 good = "lcmaps_dummy_good.mod"
145 bad = "lcmaps_dummy_bad.mod"
146 localaccount = "lcmaps_localaccount.mod"
147 "-gridmapfile /etc/grid-security/grid-mapfile"
148 vomslocalgroup = "lcmaps_voms_localgroup_without_gsi.mod"
149 "-groupmapfile /etc/grid-security/groupmapfile"
150 "-mapmin 0"
151 vomspoolaccount = "lcmaps_voms_poolaccount_without_gsi.mod"
152 "-gridmapfile /etc/grid-security/grid-mapfile"
153 "-gridmapdir /etc/grid-security/gridmapdir"
154 "-do_not_use_secondary_gids"
155
156 # Policies:
157 das_voms:
158 localaccount -> good | vomslocalgroup
159 vomslocalgroup -> vomspoolaccount
160 [root@kvasir root]#
161 ------------------------------------------------------------------
162 We don't need two lcmaps.db files anymore as soon as I have made some minor
163 modificiations to the way the gatekeeper calls out to LCMAPS.
164
165 More complex configurations are possible that enable the use of poolgroups (in a
166 similar fassion to poolaccounts), AFS token acquisition and adding users to
167 unix groups in a distributed authorization information db, such as ldap (an
168 distributed alternative to /etc/passwd and /etc/group).
169 Configuration examples will apear at: http://www.nikhef.nl/grid/lcaslcmaps/
170
171 6) Configure the grid-mapfile.
172 To the grid-mapfile (/etc/grid-security/grid-mapfile) VO-triplet lines have to be
173 added for the supported VOMS VOs. To support the "EGEE" VO add the following
174 line (FQAN format):
175 "/EGEE/*" .gpool
176
177 As soon as finer grained VOMS attributes are used, these can be used for finer
178 grained mapping as well.
179
180 7) Configure the groupmapfile
181 To the groupmapfile (/etc/grid-security/groupmapfile) lines have to be added
182 for the supported VOMS VOs. To support the "EGEE" VO add the following
183 line (FQAN format):
184 "/EGEE/*" egee
185
186 This means all users with an attribute "/EGEE/*" will be mapped to the group name
187 "egee". This group has to exist before LCMAPS is run, so do a
188 [root@kvasir root]# groupadd egee
189
190 As in the case of the grid-mapfile: As soon as finer grained VOMS attributes are
191 used, these can be used for finer grained mapping as well.
192
193 ---> IMPORTANT <---: The format of the VO triplets in the groupmapfile and
194 grid-mapfile has changed from version 1.2.x for LCMAPS. From version 1.2 and
195 higher standard FQANs are used instead of our own format, as illustrated by this
196 example:
197 Old: "VO=Atlas/GROUP=/Atlas/MonteCarlo/ROLE=admin/CAPABILITY=none"
198 New: "/Atlas/MonteCarlo/Role=admin/Capability=none"
199
200 End of LCMAPS installation and configuration.
201
202
203 II. Installation and configuration of LCAS
204 __________________________________________
205
206 1) Install the globus and VOMS libraries as described for the LCMAPS installation
207
208 2) Install gridsite for the GACL libraries needed by the LCAS VOMS plugin. Take for example:
209 http://glite.web.cern.ch/glite/packages/externals/bin/rhel30/RPMS/gridsite-1.1.3-1.i386.rpm
210
211 3) Install the lcas framework and plugins from org.glite.
212 You need version 1.2.2 or higher (not yet available from a nightly build)
213 You need the following packages:
214 glite-security-lcas-1.2.2-1_<buildrelease>.i386.rpm
215 glite-security-lcas-interface-1.2.2-1_<buildrelease>.i386.rpm
216 glite-security-lcas-plugins-basic-1.2.2-1_<buildrelease>.i386.rpm
217 glite-security-lcas-plugins-voms-1.2.2-1_<buildrelease>.i386.rpm
218 The <buildrelease> tag should be replaced by the relevant nightly-build/integration-build number.
219
220 4) Configuration of lcas.db
221 In /opt/glite/etc/lcas/lcas.db the plug-ins are listed that lcas should call.
222 It could look like:
223
224 (version A)
225 [root@kvasir glite]# cat /opt/glite/etc/lcas/lcas.db
226 # LCAS database/plugin list
227 #
228 # Format of each line:
229 # pluginname="<name/path of plugin>", pluginargs="<arguments>"
230 #
231 #
232 pluginname="lcas_userban.mod",pluginargs="ban_users.db"
233 pluginname="lcas_voms.mod",pluginargs="-vomsdir /etc/grid-security/vomsdir -certdir /etc/grid-security/certificates -authfile /etc/grid-security/grid-mapfile -authformat simple"
234 [root@kvasir glite]#
235
236 or:
237
238 (version B)
239 [root@kvasir glite]# cat /opt/glite/etc/lcas/lcas.db
240 # LCAS database/plugin list
241 #
242 # Format of each line:
243 # pluginname="<name/path of plugin>", pluginargs="<arguments>"
244 #
245 #
246 pluginname="lcas_userban.mod",pluginargs="ban_users.db"
247 pluginname="lcas_voms.mod",pluginargs="-vomsdir /etc/grid-security/vomsdir -certdir /etc/grid-security/certificates -authfile /opt/glite/etc/lcas/lcas_voms.gacl -authformat gacl -use_user_dn -gacl_use_voms_dn yes"
248 [root@kvasir glite]#
249
250 NOTE: Each plug-in definition can only occupy one line!
251
252
253 5) Configuration of ban_users.db
254 The file /opt/glite/etc/lcas/ban_users.db contains a list of the DNs of those users that
255 the sysadmin wants to ban from his fabric. If the plugin is used in lcas.db this file has
256 to exist:
257
258 [root@kvasir glite]# cat /opt/glite/etc/lcas/ban_users.db
259 #
260 # This file contains the globus user ids that are BANNED from this fabric
261 #
262 "/O=GetRID/O=abusers/CN=Endless Job"
263 [root@kvasir glite]#
264
265 6) Configuration of grid-mapfile or lcas_voms.gacl
266 - If site access is controlled by the grid-mapfile (lcas.db version A) nothing has to be
267 done, since the grid-mapfile has aready been configured for LCMAPS.
268
269 - If site access is controlled by a Grid ACL (GACL) the GACL file
270 /opt/glite/etc/lcas/lcas_voms.gacl has to be created:
271 [root@kvasir glite]# cat /opt/glite/etc/lcas/lcas_voms.gacl
272 <?xml version="1.0"?>
273 <gacl version="0.0.1">
274 <entry>
275 <voms-cred>
276 <voms>/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl</voms>
277 <vo>EGEE</vo>
278 <group>/EGEE</group>
279 </voms-cred>
280 <allow><read/><write/></allow>
281 <deny><admin/></deny>
282 </entry>
283 <entry>
284 <voms-cred>
285 <voms>/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl</voms>
286 <vo>egtest</vo>
287 <group>/egtest</group>
288 </voms-cred>
289 <allow><read/><write/></allow>
290 <deny><admin/></deny>
291 </entry>
292 </gacl>
293 [root@kvasir glite]#
294
295 End of LCAS installation and configuration
296
297
298 III.Installation and configuration of the gatekeeper
299 ____________________________________________________
300
301 1) Install globus 2.4.3 from vdt, available from:
302 http://egee-jra1-integration.web.cern.ch/egee-jra1-integration/repository/globus/2.4.3-VDT-1.2.0/rhel30_gcc32/RPMS/
303 Needed packages for the glite- and globus-gatekeeper:
304 vdt_globus_essentials-VDT1.2.0rh9-1.i386.rpm
305 vdt_globus_rm_essentials-VDT1.2.0rh9-1.i386.rpm
306 vdt_globus_rm_server-VDT1.2.0rh9-1.i386.rpm
307 vdt_globus_rm_client-VDT1.2.0rh9-1.i386.rpm (if client is needed)
308
309 2) Create the file /opt/glite/etc/
310 root@kvasir glite]# cat /opt/glite/etc/gatekeeper.conf
311 -x509_cert_dir /etc/grid-security/certificates
312 -x509_user_cert /etc/grid-security/hostcert.pem
313 -x509_user_key /etc/grid-security/hostkey.pem
314 -gridmap "/etc/grid-security/grid-mapfile"
315 -home /opt/globus
316 -e libexec
317 -port 2119
318 -grid_services /opt/globus/etc/grid-services
319 -logfile "/var/log/globus-gatekeeper.log"
320
321 -acctfile /var/log/accountingtest.log
322 -lcas_etc_dir "/opt/glite/etc/lcas/"
323 -lcas_debug_level 0
324 -lcas_db_file lcas.db
325 -lcmaps_etc_dir "/opt/glite/etc/lcmaps/"
326 -lcmaps_debug_level 0
327 -lcmaps_db_file lcmaps.db
328 root@kvasir glite]#
329
330 3) For the rest of the gatekeeper and jobmanager configuration procedure, please follow:
331 http://egee-jra1-wm.mi.infn.it/egee-jra1-wm/lsfnode_install.shtml
332
333 4) Finally start the gatekeeper with:
334
335 [root@kvasir glite]# /opt/glite/sbin/glite-gatekeeper -conf /opt/glite/etc/gatekeeper.conf.lcas
336 GRAM contact: kvasir.nikhef.nl:2119:/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kvasir.nikhef.nl
337
338 5) To create a VOMS proxy first on the client create the file
339 /opt/glite/etc/vomses/EGEE-kuiken.nikhef.nl, such that:
340
341 [martijn@kvasir martijn]$ cat /opt/glite/etc/vomses/EGEE-kuiken.nikhef.nl
342 "EGEE" "kuiken.nikhef.nl" "15001" "/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl" "EGEE" "1"
343
344 Furthermore you need to have the hostcert (.pem format) of this VO in
345 /etc/grid-security/vomsdir.
346 [root@kvasir glite]# cat /etc/grid-security/vomsdir/kuiken.nikhef.nl.pem
347 -----BEGIN CERTIFICATE-----
348 MIIE+jCCA+KgAwIBAgICAjwwDQYJKoZIhvcNAQEFBQAwUjELMAkGA1UEBhMCTkwx
349 DzANBgNVBAoTBk5JS0hFRjEyMDAGA1UEAxMpTklLSEVGIG1lZGl1bS1zZWN1cml0
350 eSBjZXJ0aWZpY2F0aW9uIGF1dGgwHhcNMDQxMjE1MDkwODQyWhcNMDUxMjE1MDkw
351 ODQyWjBTMRIwEAYDVQQKEwlkdXRjaGdyaWQxDjAMBgNVBAoTBWhvc3RzMRIwEAYD
352 VQQLEwluaWtoZWYubmwxGTAXBgNVBAMTEGt1aWtlbi5uaWtoZWYubmwwgZ8wDQYJ
353 KoZIhvcNAQEBBQADgY0AMIGJAoGBANE7qRVIBoazrFoVBeVnSZVz3Wf9m7wdoi97
354 YvbR4bPYQnrpYgdFNSSr5L5KMh0j3TQOKs3H5sUxtwMcAMYY9MTzKie94gm07ESp
355 RPuR68Jg7nCRjKlqmww31wG4LSlFtORlNIltiqFkffsD64wti1jvcfKfabx3UNjA
356 R1h4k+G7AgMBAAGjggJbMIICVzAJBgNVHRMEAjAAMAsGA1UdDwQEAwIE8DA+BgNV
357 HR8ENzA1MDOgMaAvhi1odHRwOi8vY2VydGlmaWNhdGUubmlraGVmLm5sL21lZGl1
358 bS9jYWNybC5wZW0wGgYDVR0gBBMwETAPBg0rBgEEAdFCBAICAQIBMHoGA1UdIwRz
359 MHGAFFsFOpnG1SK9/ZSA/BGo0PFx1kukoVakVDBSMQswCQYDVQQGEwJOTDEPMA0G
360 A1UEChMGTklLSEVGMTIwMAYDVQQDEylOSUtIRUYgbWVkaXVtLXNlY3VyaXR5IGNl
361 cnRpZmljYXRpb24gYXV0aIIBADAdBgNVHQ4EFgQURRT6uiZ52z0HQOsvbHVGGFS/
362 UJEwEQYJYIZIAYb4QgEBBAQDAgXgMDoGCWCGSAGG+EIBCAQtFitodHRwOi8vY2Vy
363 dGlmaWNhdGUubmlraGVmLm5sL21lZGl1bS9wb2xpY3kvMIHZBglghkgBhvhCAQ0E
364 gcsWgchDZXJ0aWZpY2F0ZSBpc3N1ZWQgdW5kZXIgRHV0Y2hHcmlkIGFuZCBOSUtI
365 RUYgbWVkaXVtLXNlY3VyaXR5IHBvbGljeSB2ZXJzaW9uIDIuMTtsaW1pdGVkIGxp
366 YWJpbGl0aWVzIGFwcGx5LCBzZWUgaHR0cDovL2NlcnRpZmljYXRlLm5pa2hlZi5u
367 bC9tZWRpdW0vcG9saWN5LyBmb3IgZGV0YWlscztDZXJ0aWZpY2F0ZSBUYWc6IDQw
368 OWJkN2E2LWQxM2JhOTAbBgNVHREEFDASghBrdWlrZW4ubmlraGVmLm5sMA0GCSqG
369 SIb3DQEBBQUAA4IBAQCMcJtWXjTEYiQJfxc9S51bU9yNDOImWdwltxd/hPkLel5y
370 hv3RHB3h1lo1WVffg10uxsvI1AQ8FCcJidl/eTfonFEV2JvC4ZnF1GS12jSWwPsb
371 wlDEuBM8cB7zn/B1RFT2SKSUmxhnkBpW/r00ztNsJMe3fspoeEhxdPNfothno6du
372 lVSJKyGVrA5zyLQh38HADOYoyhFTjzlJKcVhDc3zQJiYwxgO8BKAGqrVDyZIMcWR
373 O1Bd93GfpmzgRk1XpwY0p46AEpwvXC+C1zS6J4kRxJ4Er2FPbwaSIu0E+aO4MG+q
374 eZOUcAEz5WQDk0/FxdBWH5WyM0OzRXfP6a9jUzZ+
375 -----END CERTIFICATE-----
376 [root@kvasir glite]#
377
378 Then create the proxy:
379
380 [martijn@kvasir martijn]$ /opt/glite/bin/voms-proxy-init -voms EGEE
381 Your identity: /O=dutchgrid/O=users/O=nikhef/CN=Martijn Steenbakkers
382 Enter GRID pass phrase for this identity:
383 Creating temporary proxy ........................................ Done
384 /O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl
385 /C=NL/O=NIKHEF/CN=NIKHEF medium-security certification auth
386 Creating proxy .............................................. Done
387 Your proxy is valid until Fri Dec 17 05:35:07 2004
388
389 martijn@kvasir martijn]$ /opt/globus/bin/globus-job-run kvasir /usr/bin/id -a
390 uid=9000(gpool000) gid=503(egee)
391
392 Yes, the mapping based on VOMS attributes has worked!
393
394
395 IV. Installation and configuration of the workspace service
396 ___________________________________________________________
397
398 1) See http://www-unix.mcs.anl.gov/~tfreeman/workspace_service/ for the installation of the
399 Workspace service.
400
401 2) NOTE:
402 - It is advised to start with a fresh gt3.9.3 installation.
403 - Before building the lcmaps backend fill in the right LCMAPS configuration values in
404 the config.h file:
405 #define LCMAPS_LOG_FILE "/opt/glite/var/log/lcmaps_workspace.log"
406 #define LCMAPS_DB_FILE "/opt/glite/etc/lcmaps/lcmaps.db.without_gsi"
407 #define LCMAPS_GRIDMAPDIR "/etc/grid-security/gridmapdir"
408 #define LCMAPS_DEBUG_LEVEL "0"
409 #define LCMAPS_POLICY_NAME "das_voms"
410 #define LCMAPS_LOG_STRING "DAS poolindex"
411 - The Makefile should use the right compilation flags:
412 -I/opt/glite/include/glite/security/lcmaps/
413 -L/opt/glite/lib
414
415
416 Links
417 _____
418
419 gLite:
420 http://glite.web.cern.ch/glite/
421
422 LCAS and LCMAPS:
423 http://www.nikhef.nl/grid/lcaslcmaps/
424
425 Workspace service:
426 http://www-unix.mcs.anl.gov/~tfreeman/workspace_service/
427
428
429 $Id: INSTALL_WITH_WORKSPACE_SERVICE 11755 2010-12-16 15:29:48Z dennisvd $