-
Notifications
You must be signed in to change notification settings - Fork 1
/
13.3rmextensions.html
278 lines (175 loc) · 9.7 KB
/
13.3rmextensions.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta name="generator" content="HTML Tidy for Linux (vers 25 March 2009), see www.w3.org">
<title></title>
</head>
<body>
<div class="sright">
<div class="sub-content-head">
Maui Scheduler
</div>
<div id="sub-content-rpt" class="sub-content-rpt">
<div class="tab-container docs" id="tab-container">
<div class="topNav">
<div class="docsSearch"></div>
<div class="navIcons topIcons">
<a href="index.html"><img src="home.png" title="Home" alt="Home" border="0"></a> <a href="13.0rmandinterfaces.html"><img src="upArrow.png" title="Up" alt="Up" border="0"></a> <a href="13.2rmconfiguration.html"><img src="prevArrow.png" title="Previous" alt="Previous" border="0"></a> <a href="13.4addingrminterfaces.html"><img src="nextArrow.png" title="Next" alt="Next" border="0"></a>
</div>
<h1>13.3 Resource Manager Extensions</h1>
<p>All resource managers are not created equal. There is a wide range in what capabilities are available from system to system. Additionally, there is a large body of functionality which many if not all resource managers have no concept of. A good example of this is job QoS. Since most resource managers do not have a concept of quality of service, they do not provide a mechanism for users to specify this information. In many cases, Maui is able to add capabilities at a global level. However, a number of features require a 'per job' specification. Resource manager extensions allow this information to be associated with the job.</p>
<p>How this is done varies with the resource manager. Both Loadleveler and Wiki allow the specification of a <i>comment</i> field. (In Loadleveler, specified as '<tt>#@comment="<X>"</tt>`) PBS does not support this ability by default but is extensible via the '<b>-W</b> ' flag. (see the <a href="13.3.1pbsrmextensions.html">PBS Resource Manager Extension Overview</a> )</p>
<p>Using the resource manager specific method, the following job extensions are currently available:<br></p>
<table border="1" width="100%" nosave="">
<tbody>
<tr>
<td><b>Name</b></td>
<td><b>Format</b></td>
<td><b>Default Value</b></td>
<td><b>Description</b></td>
<td><b>Example</b></td>
</tr>
<tr>
<td><b>ADVRES</b></td>
<td>[<RESID>]</td>
<td>[NONE]<br></td>
<td>specifies that reserved resources are required to run the job. If <RESID> is specified, then only resources within the specified reservation may be allocated</td>
<td>ADVRES:meta.3<br></td>
</tr>
<tr>
<td><b>DMEM</b></td>
<td><INTEGER></td>
<td>0</td>
<td>dedicated memory per task in MB</td>
<td><tt>DMEM:512</tt></td>
</tr>
<tr>
<td><b>FLAGS</b></td>
<td>one or more of the following comma separated keywords<br>
<b>ADVRES[:RESID]</b>, <b>RESTARTABLE</b>, <b>PREEMPTEE</b>, <b>PREEMPTOR</b>, <b>NOQUEUE</b></td>
<td>[NONE]</td>
<td>associates various flags with the job</td>
<td><tt>FLAGS:ADVRES</tt></td>
</tr>
<tr>
<td><b>GRES</b></td>
<td>comma delimited list of generic resources where each resource is specified using the format <RESTYPE>[@<COUNT>]</td>
<td>[NONE]</td>
<td>indicates generic resources required by the job on a <i>per task</i> basis. If a <COUNT> is not specified, the resource count defaults to 1.</td>
<td><tt>GRES:tape,matlab@2</tt></td>
</tr>
<tr>
<td><b>HOSTLIST</b></td>
<td>comma delimited list of hostnames</td>
<td>[NONE]</td>
<td>indicates a exact set, superset, or subset of nodes on which the job must run</td>
<td><tt>HOSTLIST:nodeA,nodeB,nodeE</tt></td>
</tr>
<tr>
<td valign="top"><b><a name="NACCESSPOLICY" id="NACCESSPOLICY"></a> NACCESSPOLICY</b><br></td>
<td valign="top">one of <b>SHARED</b>, <b>SINGLEJOB</b>, <b>SINGLETASK</b> , or <b>SINGLEUSER</b><br></td>
<td valign="top">[NONE]<br></td>
<td valign="top">specifies how node resources should be accessed<br></td>
<td valign="top">NACCESSPOLICY:SINGLEUSER<br></td>
</tr>
<tr>
<td valign="top"><b><a name="NALLOCPOLICY" id="NALLOCPOLICY"></a> NALLOCPOLICY</b><br></td>
<td valign="top">one of the valid settings for the parameter <a href="a.fparameters.html#nodeallocationpolicy">NODEALLOCATIONPOLICY</a><br></td>
<td valign="top">[NONE]<br></td>
<td valign="top">specifies how node resources should be selected and allocated to the job<br></td>
<td valign="top">NALLOCPOLICY:MINRESOURCE<br></td>
</tr>
<tr>
<td><b>NODESET</b></td>
<td><SETTYPE>:<SETATTR>[:<SETLIST>]</td>
<td>[NONE]</td>
<td>specifies nodeset constraints for job resource allocation. (See the NodeSet Overview for more information)</td>
<td><tt>NODESET:ONEOF:PROCSPEED:350,400,450</tt></td>
</tr>
<tr>
<td><b>PARTITION</b></td>
<td><STRING>[:<STRING>]...</td>
<td>[NONE]</td>
<td>specifies the partition (or partitions) in which the job must run. <b>NOTE</b>: the job must have access to this partition based on system wide or credential based partition access lists.</td>
<td>
<tt>PARTITION:math:geology</tt>
<p>(The job must only run in the <tt>math</tt> partition or the <tt>geology</tt> partition)</p>
</td>
</tr>
<tr>
<td><b>QOS</b></td>
<td><STRING></td>
<td>[NONE]</td>
<td></td>
<td><tt>QOS:highprio</tt></td>
</tr>
<tr>
<td><b>QUEUEJOB</b></td>
<td>
<p>one of <tt>TRUE or FALSE</tt></p>
</td>
<td><tt>TRUE</tt></td>
<td>Indicates whether or not the scheduler should queue the job if resources are not available to run the job immediately</td>
<td><tt>QUEUEJOB:FALSE</tt></td>
</tr>
<tr>
<td><b>SGE</b></td>
<td><WINDOWCOUNT>:<DISPLAYNAME></td>
<td>[NONE]</td>
<td></td>
<td><tt>SGE:8:pinky</tt></td>
</tr>
<tr>
<td><b>SID</b></td>
<td><STRING></td>
<td>[NONE]</td>
<td></td>
<td><tt>SID:silverA</tt></td>
</tr>
<tr>
<td><b>TPN</b></td>
<td><INTEGER></td>
<td>0</td>
<td></td>
<td><tt>TPN:4</tt></td>
</tr>
<tr>
<td><b>TRL</b></td>
<td><INTEGER>[,<INTEGER>]...</td>
<td>0</td>
<td></td>
<td><tt>TRL:2,4,8,16</tt></td>
</tr>
</tbody>
</table>
<p>If more than one extension is required in a given job, extensions can be concatenated with a semicolon separator using the format '<tt><ATTR>:<VALUE>[;<ATTR>:<VALUE>]...</tt>'</p>
<p>See the following examples:</p>
<p><b>Example 1</b><br>
----<br>
<tt># Loadleveler command file</tt><br>
<tt>#@comment="HOSTLIST:node1,node2;QOS:special;SID:silverA"</tt><br>
----</p>
<p>Job must run on nodes <tt>node1</tt> and <tt>node2</tt> using the QoS <tt>special</tt>. The job is also associated with the system id <tt>silverA</tt> allowing the silver daemon to monitor and control the job.</p>
<p><b>Example 2</b><br>
----<br>
<tt># PBS command file</tt><br>
<tt># PBS -W x=\"NODESET:ONEOF:NETWORK;DMEM:64\"</tt><br>
----</p>
<p>Job will have resources allocated subject to network based nodeset constraints. Further, each task will dedicate 64 MB of memory.</p>
<p><b>Example 3</b></p>
<p>----<br>
# qsub -l nodes=4,walltime=1:00:00 -W x="FLAGS:ADVRES:john.1"<br>
-----</p>
<p>Job will be forced to run within the <tt>john.1</tt> reservation.</p>
<p><b>See Also:</b></p>
<p><a href="13.1rmoverview.html">Resource Manager Overview</a></p>
<div class="navIcons bottomIcons">
<a href="index.html"><img src="home.png" title="Home" alt="Home" border="0"></a> <a href="13.0rmandinterfaces.html"><img src="upArrow.png" title="Up" alt="Up" border="0"></a> <a href="13.2rmconfiguration.html"><img src="prevArrow.png" title="Previous" alt="Previous" border="0"></a> <a href="13.4addingrminterfaces.html"><img src="nextArrow.png" title="Next" alt="Next" border="0"></a>
</div>
</div>
</div>
</div>
<div class="sub-content-btm"></div>
</div>
</body>
</html>