forked from DIRACGrid/DIRAC
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathrelease.notes
4215 lines (3060 loc) · 144 KB
/
release.notes
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
[v6r12p53]
*DMS
CHANGE: FileCatalogClientCLI - ls order by size, human readable size value
FIX: DirectoryMetadata - enhanced error message in getDirectoryMetadata
*WMS
BUGFIX: JobAgent - bug when rescheduling job due to glexec failure
*TS
NEW: TransformationCLI - added getOutputFiles, getAllByUser commands
NEW: Transformation - added getAuthorDNfromProxy, getTransformationsByUser methods
*Resources
CHANGE: GlobusComputingElement - simplify creating of pilotStamp
[v6r12p52]
*DMS
NEW: dirac-dms-directory-sync - new command to synchronize the contents of a
local and remote directories
FIX: DataManager - in removeFile() return successfully if empty input file list
*TS
NEW: TransformationCLI - getInputDataQuery command returning inputDataQuery
of a given transformation
[v6r12p51]
*Core
FIX: dirac-install - fix to work with python version prior to 2.5
*DMS
CHANGE: FileCatalogClientCLI - possibility to set multiple metadata with one command
*Resources
FIX: HTCondorComputingElement - multiple improvements
[v6r12p50]
*Core
FIX: dirac-install - define TERMINFO variable to include local sources as well
*Framework
FIX: SystemAdministratorHandler - show also executors in the log overview
*DMS
FIX: FileCatalogClientCLI - use getPath utility systematically to normalize the
paths passed by users
*WMS
FIX: PilotStatusAgent - split dynamic and static parts in the log error message
*Resources
NEW: HTCondorCEComputingElement class
[v6r12p49]
*Resources
FIX: GlobusComputingElement - in killJob added -f switch to globus-job-clean command
FIX: ARCComputingElement - create working directory if it does not exist
*DMS
CHANGE: DataManager - added XROOTD to registration protocols
*TMS
FIX: TransformationCLI - doc string
[v6r12p48]
*DMS
FIX: DirectoryTreeBase - fix in changeDirectoryXXX methods to properly interpret input
[v6r12p47]
*DMS
BUGFIX: FileCatalogClientCLI - wrong signature in the removeMetadata() service call
[v6r12p46]
*Core
FIX: GraphData - check for missing keys in parsed_data in initialize()
*WMS
CHANGE: PilotStatusAgent - kill pilots being deleted; do not delete pilots still
running jobs
*RSS
CHANGE: Instantiate RequestManagementDB/Client taking into account possible extensions
*Resources
FIX: GlobusComputingElement - evaluate WaitingJobs in getCEStatus()
FIX: SRM2Storage - error 16 of exists call is interpreted as existing file
FIX: XROOTStorage - added Lost, Cached, Unavailable in the output of getSingleMetadata()
*WMS
FIX: pilotCommands - removed unnecessary doOSG() function
[v6r12p45]
*Resources
FIX: SRM2Storage - error 22 of exists call is interpreted as existing file
( backport from v6r13 )
[v6r12p44]
*WMS
FIX: SiteDirector - consider also pilots in Waiting status when evaluating
queue slots available
*Resources
NEW: SRM2Storage - makes use of /Resources/StorageElements/SRMBusyFilesExist option
to set up the mode of interpreting the 22 error code as existing file
[v6r12p43]
*DMS:
FIX: DirectoryTreeBase - avoid double definition of FC_DirectoryUsage table
in _rebuildDirectoryUsage()
[v6r12p42]
FIX: added fixes from v6r11p34 patch release
[v6r12p41]
*WMS
CHANGE: dirac-wms-job-submit - "-r" switch to enable job repo
[v6r12p40]
*DMS
FIX: DirectoryTreeBase.py - set database engine to InnoDB
[v6r12p39]
FIX: imported fixes from rel-v6r11
[v6r12p38]
*DMS
CHANGE: DataManager - enhanced real SE name resolution
*RMS
FIX: Request - fixed bug in the optimization of requests with failover operations
*Resources
CHANGE: StorageFactory - allow for BaseSE option in the SE definition
[v6r12p37]
*Core
FIX: InstallTools - force $HOME/.my.cnf to be the only defaults file
[v6r12p36]
*Configuration
FIX: Utilities.py - bug fix getSiteUpdates()
[v6r12p35]
*Core
CHANGE: VOMSService - add URL for the method to get certificates
*DMS
FIX: DataManager - in __replicate() set do not pass file size to the SE if no
third party transfer
FIX: RemoveFile, ReplicateAndRegister - regular expression for "no replicas"
common for both DFC and LFC
*WMS
FIX: WMSHistoryCorrector - make explicit error if no data returned from WMSHistory
accounting query
[v6r12p34]
*DMS
BUGFIX: FileCatalogWithFkAndPsDB - fix storage usage calculation
[v6r12p33]
*Core
NEW: VOMSService - added method admListCertificates()
*DMS
BUGFIX: dirac-dms-put-and-register-request - missing Operation in the request
*Resources
FIX: sshce - better interpretation of the "ps" command output
[v6r12p32]
*RMS
FIX: ReqManager - in getRequest() possibility to accept None type
argument for any request
[v6r12p31]
*WMS
FIX: pilotCommands - import json module only in case it is needed
[v6r12p30]
*Core
FIX: InstallTools - 't' file is deployed for agents installation only
FIX: GOCDBClient - creates unique DowntimeID using the ENDPOINT
*Framework
FIX: SystemAdministratorHandler - use WebAppDIRAC extension, not just WebApp
*DMS:
FIX: FileCatalogComponents.Utilities - do not allow empty LFN names in
checkArgumentDict()
[v6r12p29]
*CS
CHANGE: CSCLI - use readline to store and resurrect command history
*WMS
FIX: JobWrapper - bug fixed in the failoverTransfer() call
CHANGE: dirac-wms-job-submit - added -f flag to store ids
*DMS
FIX: DataManager - make successful removeReplica if missing replica
in one catalog
*RMS
FIX: Operation, Request - limit the length of the error message
[v6r12p28]
*RMS
FIX: Request - do not optimize requests already in the DB
[v6r12p27]
*Core
CHANGE: InstallTools - install "t" script to gracefully stop agents
*DMS
FIX: FileCatalog - return GUID in DirectoryParameters
*Resource
CHANGE: DFC/LFC clients - added setReplicaProblematic()
[v6r12p26]
*DMS
BUGFIX: FileCatalog - getDirectoryMetadata was wrongly in ro_meta_methods list
*RMS
FIX: Operation - temporary fix in catalog names evaluation to smooth
LFC->DFC migration - not to forget to remove afterwards !
*WMS
CHANGE: JobWrapper - added MasterCatalogOnlyFlag configuration option
[v6r12p25]
*DMS
BUGFIX: PutAndRegister, RegitserFile, RegisterReplica, ReplicateAndRegister - do not
evaluate the catalog list if None
[v6r12p24]
*DMS:
FIX: DataManager - retry RSS call 5 times - to be reviewed
[v6r12p23]
*DMS
FIX: pass a catalog list to the DataManager methods
FIX: FileCatalog - bug fixed in the catalog list evaluation
[v6r12p22]
*DMS
FIX: RegisterFile, PutAndRegister - pass a list of catalogs to the DataManager instead of a comma separated string
FIX: FTSJob - log when a job is not found in FTS
CHANGE: dropped commands dirac-admin-allow(ban)-catalog
*Interfaces
CHANGE: Dirac, JobMonitoringHandler,dirac-wms-job-get-jdl - possibility to retrieve original JDL
*WMS
CHANGE: JobManifest - make MaxInputData a configurable option
[v6r12p21]
*RMS
BUGFIX: File,Operation,RequestDB - bug making that the request would always show
the current time for LastUpdate
*WMS
FIX: JobAgent - storing on disk retrieved job JDL as required by VMDIRAC
( to be reviewed )
[v6r12p20]
*DMS
FIX: DataManager - more informative log messages, checking return structure
FIX: FileCatalog - make exists() behave like LFC file catalog client by checking
the unicity of supplied GUID if any
FIX: StorageElementProxyHandler - do not remove the cache directory
*Framework
FIX: SystemAdministratorClient - increase the timeout to 300 for the software update
*RMS
FIX: Operation.py - set Operation Scheduled if one file is Scheduled
CHANGE: Request - group ReplicateAndRegister operations together for failover
requests: it allows to launch all FTS jobs at once
*Resources
FIX: LcgFileCatalogClient - fix longstanding problem in LFC when several files
were not available (only one was returned)
*TS
BUGFIX: TransformationCleaning,ValidateOutputDataAgent - interpret correctly
the result of getTransformationParameters() call
FIX: TaskManager - fix exception in RequestTaskAgent
[v6r12p19]
*Core
FIX: Core.py - check return value of getRecursive() call
*DMS
FIX: FileCatalog - directory removal is successful if does not exist
special treatment of Delete operation
*WMS
FIX: InputDataByProtocol - fix interpretation of return values
[v6r12p18]
*DMS
FIX: FTSStrategy - config option name
FIX: DataManager - removing dirac_directory flag file only of it is there
in __cleanDirectory()
*RMS
FIX: Operation - MAX_FILES limit set to 10000
FIX: ReqClient - enhanced log messages
*TMS
FIX: TaskManager - enhanced log messages
*RSS
FIX: DowntimeCommand - fixed mix of SRM.NEARLINE and SRM
*WMS
FIX: InputDataByProtocol - fixed return structure
[v6r12p16]
*DMS
FIX: IRODSStorageElement more complete implementation
FIX: FileCatalogHandler(DB) - make removeMetadata bulk method
*Resources
FIX: FileCatalog - make a special option CatalogList (Operations) to specify catalogs used by a given VO
[v6r12p15]
*Core
FIX: ProcessPool - kill the working process in case of the task timeout
FIX: FileHelper - count transfered bytes in DataSourceToNetwork()
*DMS
BUGFIX: FileCatalogCLI - changed interface in changePathXXX() methods
NEW: IRODSStorageElementHandler class
CHANGE: FileCatalog - separate metadata and file catalog methods,
apply metadata methods only to Metadata Catalogs
*Resources
FIX: SSHTorqueComputingElement - check the status of the ssh call for qstat
*WMS
FIX: WatchdogLinux - fixed typo
[v6r12p14]
*TS
FIX: TaskManagerAgentBase: avoid race conditions when submitting to WMS
*DMS
NEW: FileCatalog - added new components ( directory tree, file manager )
making use of foreign keys and stored procedures
FIX: DataManager returns properly the FileCatalog errors
[v6r12p13]
*TS
BUGFIX: TransformationAgent - data member not defined
*WMS
FIX: InputData(Resolution,ByProtocol) - possibility to define RemoteProtocol
[v6r12p12]
*WMS
BUGFIX: pilotTools - missing comma
[v6r12p11]
*WMS
FIX: CPUNormalization - dealing with the case when the maxCPUTime is not set in the queue
definition
FIX: pilotTools - added option pilotCFGFile
[v6r12p10]
*DMS
FIX: StorageElementProxy - BASE_PATH should be a full path
*Resources
FIX: SRM2Storage - return specific error in putFile
*TS
FIX: TransformationAgent - fix to avoid an exception in finalize and double printing
when terminating the agent
BUGFIX: TransformationDB - fix return value in setTransformationParameter()
[v6r12p9]
*Core
CHANGE: SiteCEMapping - getSiteForCE can take site argu
ment to avoid confusion
*Interfaces
FIX: Job - provide optional site name in setDestinationCE()
*WMS
FIX: pilotCommands - check properly the presence of extra cfg files
when starting job agent
FIX: JobAgent - can pick up local cfg file if extraOptions are specified
[v6r12p8]
*Core
FIX: dirac-configure - correctly deleting useServerCertificate flag
BUGFIX: InstallTools - in fixMySQLScript()
*DMS
BUGFIX: DatasetManager - bug fixes
CHANGE: StorageElementProxy - internal SE object created with the VO of the requester
*TS
FIX: dirac-transformation-xxx commands - do not check the transformation status
CHANGE: Agents - do not use shifter proxy
FIX: TransformationAgent - correct handling of replica cache for transformations
when there were more files in the transformation than accepted to be executed
FIX: TransformationAgent - do not get replicas for the Removal transformations
*RMS
NEW: new SetFileStatus Operation
[v6r12p7]
*Core
FIX: dirac-configure - always removing the UseServerCertificate flag before leaving
FIX: ProcessPool - one more check for the executing task ending properly
*Interfaces
FIX: Dirac.py - use printTable in loggingInfo()
[v6r12p6]
FIX: fixes from v6r11p26 patch release
[v6r12p5]
*Core
FIX: VOMS.py - do not use obsoleted -dont-verify-ac flag with voms-proxy-info
*TS
FIX: TransformationManager - no status checked at level service
[v6r12p4]
FIX: fixes from v6r11p23 patch release
[v6r12p3]
*Configuration
CHANGE: dirac-admin-add-resources - define VOPath/ option when adding new SE
*Resources
NEW: StorageFactory - modify protocol Path for VO specific value
*DMS
FIX: FileCatalog - check for empty input in checkArgumentFormat utility
FIX: DataManager - protect against FC queries with empty input
[v6r12p2]
*Core
FIX: dirac-install - svn.cern.ch rather than svnweb.cern.ch is now needed for direct
HTTP access to files in SVN
*WMS
FIX: dirac-wms-cpu-normalization - when re-configuring, do not try to dump in the
diracConfigFilePath
[v6r12p1]
*Configuration
FIX: Core.Utilities.Grid, dirac-admin-add-resources - fix to make a best effort to
guess the proper VO specific path of a new SE
*WMS
FIX: dirac-configure, pilotCommands, pilotTools - fixes to use server certificate
[v6r12]
*Core
CHANGE: ProcessPool - do not stop working processes by default
NEW: ReturnValue - added returnSingleResult() utility
FIX: MySQL - correctly parse BooleanType
FIX: dirac-install - use python 2.7 by default
FIX: dirac-install-xxx commands - complement installation with the component setup
in runit
NEW: dirac-configure - added --SkipVOMSDownload switch, added --Output switch
to define output configuration file
CHANGE: ProcessPool - exit from the working process if a task execution timed out
NEW: ProcessMonitor - added evaluation of the memory consumed by a process and its children
NEW: InstallTools - added flag to require MySQL installation
FIX: InstallTools - correctly installing DBs extended (with sql to be sourced)
FIX: InstallTools - run MySQL commands one by one when creating a new database
FIX: InstallTools - fixMySQLScripts() fixes the mysql start script to ognore /etc/my.cnf file
CHANGE: Os.py - the use of "which" is replaced by distutils.spawn.find_executable
NEW: Grid.py - ldapSA replaced by ldapSE, added getBdiiSE(CE)Info() methods
CHANGE: CFG.py - only lines starting with ^\s*# will be treated as comments
CHANGE: Shifter - Agents will now have longer proxies cached to prevent errors
for heavy duty agents, closes #2110
NEW: Bdii2CSAgent - reworked to apply also for SEs and use the same utilities for the
corresponding command line tool
NEW: dirac-admin-add-resources - an interactive tool to add and update sites, CEs, SEs
to the DIRAC CS
CHANGE: dirac-proxy-init - added message in case of impossibility to add VOMS extension
FIX: GOCDBClient - handle correctly the case of multiple elements in the same DT
*Accounting
NEW: Allow to have more than one DB for accounting
CHANGE: Accounting - use TypeLoader to load plotters
*Framework
FIX: Logger - fix FileBackend implementation
*WMS
NEW: Refactored pilots ( dirac-pilot-2 ) to become modular following RFC #18,
added pilotCommands.py, SiteDirector modified accordingly
CHANGE: InputData(Executor) - use VO specific catalogs
NEW: JobWrapper, Watchdog - monitor memory consumption by the job ( in a Warning mode )
FIX: SandboxStoreHandler - treat the case of exception while cleaning sandboxes
CHANGE: JobCleaningAgent - the delays of job removals become CS parameters
BUGFIX: JobDB - %j placeholder not replaced after rescheduling
FIX: JobDB - in the SQL schema description reorder tables to allow foreign keys
BUGFIX: JobAgent, Matcher - logical bug in using PilotInfoReported flag
FIX: OptimizerExecutor - when a job fails the optimization chain set the minor status
to the optimiser name and the app status to the fail error
*Resources
NEW: StorageElement - added a cache of already created SE objects
CHANGE: SSHTorqueComputingElement - mv getCEStatus to remote script
*ResourceStatus
NEW: ResourceManagementClient/DB, DowntimeCommand - distinguish Disk and Tape storage
FIX: GODDBClient - downTimeXMLParsing() can now handle the "service type" parameter properly
CHANGE: dirac-rss-xxx commands use the printTable standard utility
FIX: dirac-dms-ftsdb-summary - bug fix for #2096
*DMS
NEW: DataManager - add masterCatalogOnly flag in the constructor
FIX: DataManager - fix to protect against non valid SE
CHANGE: FC.DirectoryLevelTree - use SELECT ... FOR UPDATE lock in makeDir()
FIX: FileCatalog - fixes in using file and replica status
CHANGE: DataManager - added a new argument to the constructor - vo
CHANGE: DataManager - removed removeCatalogFile() and dirac-dms-remove-catalog-file adjusted
CHANGE: Several components - field/parameter CheckSumType all changed to ChecksumType
CHANGE: PoolXMLCatalog - add the SE by default in the xml dump and use the XML library
for dumping the XML
FIX: XROOTStorageElement - fixes to comply with the interface formalism
*SMS
FIX: StorageManagementDB - small bugfix to avoid SQL errors
*RMS
NEW: Added 'since' and 'until' parameters for getting requests
NEW: Request - added optimize() method to merge similar operations when
first inserting the request
NEW: ReqClient, RequestDB - added getBulkRequest() interface. RequestExecutingAgent
can use it controlled by a special flag
FIX: Operation, Request - set LastUpdate time stamp when reaching final state
FIX: OperationHandlerBase - don't erase the original message when reaching the max attempts
FIX: removed some deprecated codes
FIX: RequestTask - always set useServerCerificate flag to tru in case of executing inside
an agent
CHANGE: gRequestValidator removed to avoid object instantiation at import
NEW: dirac-rms-cancel-request command and related additions to the db and service classes
*TMS
NEW: WorkflowTaskAgent is now multi-threaded
NEW: Better use of threads in Transformation Agents
CHANGE: TransformationDB - modified such that the body in a transformation can be updated
FIX: TransformationCleaningAgent - removed non-ASCII characters in a comment
[v6r11p34]
*Resources
NEW: GlobusComputingElement class
[v6r11p33]
*Configuration
FIX: Resources - avoid white spaces in OSCompatibility
[v6r11p32]
*Core
CHANGE: BaseClient, SSLSocketFactory, SocketInfo - enable TLSv1 for outgoing
connections via suds, possibility to configure SSL connection details
per host/IP
[v6r11p31]
*Core
FIX: CFG - bug fixed in loadFromBuffer() resulting in a loss of comments
*Resources
FIX: SSHTorqueComputingElement - check the status of ssh call for qstat
*DMS
FIX: FileCatalog - return LFN name instead of True from exists() call if LFN
already in the catalog
[v6r11p30]
*DMS
CHANGE: FileCatalogCLI - add new -D flag for find to print only directories
[v6r11p29]
*DMS
FIX: FTS(Agent,Startegy,Gragh) - make use of MaxActiveJobs parameter, bug fixes
*TMS
FIX: Transformation(Agent,Client) - Operations CS parameters can be defined for each plugin: MaxFiles, SortedBy, NoUnusedDelay. Fixes to facilitate work with large numbers of files.
[v6r11p28]
*Core
FIX: InstallTools - check properly the module availability before installation
*WMS
FIX: JobScheduling - protection against missing dict field RescheduleCounter
*TMS
FIX: TransformationCleaningAgent - execute DM operations with the shifter proxy
[v6r11p27]
*Core
BUGFIX: InstallTools - bug fix in installNewPortal()
*WMS
FIX: Watchdog - disallow cputime and wallclock to be negative
*TS
FIX: TransformationAgent - correct handling of replica caches when more than 5000 files
BUGFIX: ModuleBase - bug fix in execute()
BUGFIX: Workflow - bug fix in createStepInstance()
*DMS
BUGFIX: DiractoryTreeBase - bug fix in getDirectoryPhysicalSizeFromUsage()
*Resources
FIX: XROOTStorage - back ported fixes from #2126: putFile would place file in
the wrong location on eos
[v6r11p26]
*Framework
FIX: UserProfileDB.py - add PublishAccess field to the UserProfileDB
*RSS
FIX: Synchronizer.py - fix deletion of old resources
*DMS
FIX: DataManager - allow that permissions are OK for part of a list of LFNs ( __verifyWritePermission() )
(when testing write access to parent directory). Allows removal of replicas
even if one cannot be removed
FIX: DataManager - test SE validity before removing replica
*RMS
FIX: RequestTask - fail requests for users who are no longer in the system
FIX: RequestExecutingAgent - fix request timeout computation
[v6r11p25]
*Interfaces
FIX: Job.py - bring back different logfile names if they have not been specified by the user
[v6r11p24]
*DMS
BUGFIX: SEManagerDB - bug fixed in getting connection in __add/__removeSE
[v6r11p23]
*DMS
CHANGE: FTSRequest is left only to support dirac-dms-fts-XXX commands
[v6r11p22]
*DMS
FIX: FTSJob - fixes in the glite-transfer-status command outpu parsing
FIX: TransformationClient - allow single lfn in setFileStatusForTransformation()
*WMS
FIX: StatesMonitoringAgent - install pika on the fly as a temporary solution
[v6r11p21]
*DMS
BUGFIX: dirac-dms-remove-replicas - continue in case of single replica failure
FIX: dirac-rms-xxx scripts - use Script.getPositionalArgs() instead of sys.argv
*Workflow
FIX: Test_Modules.py - fix in mocking functions, less verbose logging
[v6r11p20]
*DMS
BUGFIX: DataManager - in __SEActive() use resolved SE name to deal with aliases
BUGFIX: FileMetadata - multiple bugs in __buildUserMetaQuery()
[v6r11p19]
*DMS
FIX: FTSJob - fix FTS job monitoring a la FTS2
*RMS
CHANGE: ReqClient - added setServer() method
FIX: File,Operation,Request - call the getters to fetch the up-to-date information
from the parent
[v6r11p18]
*DMS
FIX: FTSAgent(Job) - fixes for transfers requiring staging (bringOnline) and adaptation
to the FTS3 interface
*WMS
FIX: StatesMonitoringAgent - resend the records in case of failure
[v6r11p17]
*DMS
FIX: FileCatalog - in multi-VO case get common catalogs if even VO is not specified
*Resources
FIX: ComputintgElement - bugfix in available() method
*WMS
FIX: SiteDirector - if not pilots registered in the DB, pass empty list to the ce.available()
[v6r11p16]
*RMS
BUGFIX: Request,Operation,File - do not cast to str None values
[v6r11p15]
*DMS
FIX: ReplicateAndRegister - do not create FTSClient if no FTSMode requested
CHANGE: FTSAgent(Job,File) - allow to define the FTS2 submission command;
added --copy-pin-lifetime only for a tape backend
parse output of both commands (FTS2, FTS3)
consider additional state for FTS retry (Canceled)
*RMS
FIX: Operation, Request - treat updates specially for Error fields
*TMS
FIX: TransformationAgent - fixes in preparing json serialization of requests
*WMS
NEW: StateMonitoringAgent - sends WMS history data through MQ messages
[v6r11p14]
*WMS
CHANGE: JobDB - removed unused tables and methods
CHANGE: removed obsoleted tests
*DMS
FIX: FTSAgent - recover case when a target is not in FTSDB
CHANGE: FTSAgent(Job) - give possibility to specify a pin life time in CS
*RMS
FIX: Make RMS objects comply with Python Data Model by adding __nonzero__ methods
[v6r11p13]
*DMS
BUGFIX: SEManager - in SEManagerDB.__addSE() bad _getConnection call, closes #2062
[v6r11p12]
*Resources
CHANGE: ARCComputingElement - accomodate changes in the ARC job reported states
*Configuration
CHANGE: Resources - define a default FTS server in the CS (only for v6r11 and v6r12)
*DMS
FIX: FTSStrategy - allow to use a given channel more than once in a tree
FIX: FTSAgent - remove request from cache if not found
FIX: FTSAgent - recover deadlock situations when FTS Files had not been correctly
updated or were not in the DB
*RMS
FIX: RequestExecutingAgent - fix a race condition (cache was cleared after the request was put)
FIX: RequestValidator - check that the Operation handlers are defined when inserting a request
[v6r11p11]
*Core
FIX: TransportPool - fixed exception due to uninitialized variable
FIX: HTTPDISETSocket - readline() takes optional argument size ( = 0 )
*DMS
FIX: FTSAgent - check the type of the Operation object ( can be None ) and
some other protections
FIX: FTSClient - avoid duplicates in the file list
*RMS
FIX: ReqClient - modified log message
CHANGE: dirac-dms-fts-monitor - allow multiple comma separated LFNs in the arguments
[v6r11p10]
*RSS
FIX: DowntimeCommand, Test_RSS_Command_GOCDBStatusCommand - correctly interpreting list of downtimes
*RMS
FIX: ReplicateAndRegister - Create a RegisterReplica (not RegisterFile) if ReplicateAndRegister
fails to register
FIX: OperationHandlerBase - handle correctly Attempt counters when SEs are banned
FIX: ReplicateAndRegister - use FC checksum in case of mismatch request/PFN
FIX: FTSAgent - in case a file is Submitted but the FTSJob is unknown, resubmit
FIX: FTSAgent - log exceptions and put request to DB in case of exception
FIX: FTSAgent - handle FTS error "Unknown transfer state NOT_USED", due to same file
registered twice (to be fixed in RMS, not clear origin)
*WMS
FIX: JobStateUpdateHandler - status not updated while jobLogging is, due to time skew between
WN and DB service
FIX: JobStateUpdateHandler - stager callback not getting the correct status Staging
(retry for 10 seconds)
[v6r11p9]
*Core
NEW: AgentModule - set AGENT_WORKDIRECTORY env variable with the workDirectory
NEW: InstallTools - added methods for the new web portal installation
*DMS
FIX: ReplicateAndRegister - apply same error logic for DM replication as for FTS
*Resources:
FIX: SRM2Storage - fix log message level
FIX: SRM2Storage - avoid useless existence checks
*RMS
FIX: ForwardDISET - a temporary fix for a special LHCb case, to be removed asap
FIX: ReqClient - prettyPrint is even prettier
FIX: RequestTask - always use server certificates when executed within an agent
[v6r11p8]
*TMS
FIX: TransformationDB - fix default value within ON DUPLICATE KEY UPDATE mysql statement
[v6r11p7]
*Framework
BUGFIX: ProxyDB.py - bug in a MySQL table definition
*DMS
FIX: ReplicateAndRegister.py - FTS client is not instantiated in the c'tor as it
might not be used,
*WMS
FIX: JobWrapper - don't delete the sandbox tar file if upload fails
FIX: JobWrapper - fix in setting the failover request
*RMS
FIX: RequestDB - add protections when trying to get a non existing request
[v6r11p6]
*WMS
FIX: InpudDataResolution - fix the case when some files only have a local replica
FIX: DownloadInputData, InputDataByProtocol - fix the return structure of the
execute() method
*Resources
NEW: LocalComputingElement, CondorComputingElement
[v6r11p5]
FIX: Incorporated changes from v6r10p25 patch
*Framework
NEW: Added getUserProfileNames() interface
*WMS
NEW: WMSAdministrator - added getPilotStatistics() interface
BUGFIX: JobWrapperTemplate - use sendJobAccounting() instead of sendWMSAccounting()
FIX: JobCleaningAgent - skip if no jobs to remove
*DMS
BUGFIX: FileCatalogClientCLI - bug fix in the metaquery construction
*Resources
CHANGE: StorageElement - enable Storage Element proxy configuration by protocol name
*TMS
NEW: TransformationManager - add Scheduled to task state for monitoring
[v6r11p4]
*Framework
NEW: ProxyDB - added primary key to ProxyDB_Log table
CHANGE: ProxyManagerHandler - purge logs once in 6 hours
*DMS
FIX: DataManager - fix in the accounting report for deletion operation
CHANGE: FTSRequest - print FTS GUID when submitting request
FIX: dirac-dms-fts-monitor - fix for using the new FTS structure
FIX: DataLoggingDB - fix type of the StatusTimeOrder field
FIX: DataLoggingDB - take into account empty date argument in addFileRecord()
FIX: ReplicateAndRegister - use active replicas
FIX: FTS related modules - multiple fixes
*WMS
NEW: SiteDirector - pass the list of already registered pilots to the CE.available() query
FIX: JobCleaningAgent - do not attempt job removal if no eligible jobs
*Resources
FIX: LcgFileCatalogClient - if replica already exists while registration, reregister
NEW: CREAM, SSH, ComputingElement - consider only registered pilots to evaluate queue occupancy
[v6r11p3]
FIX: import gMonitor from it is original location
*Core
FIX: FC.Utilities - treat properly the LFN names starting with /grid ( /gridpp case )
*Configuration
FIX: LocalConfiguration - added exitCode optional argument to showHelp(), closes #1821
*WMS
FIX: StalledJobAgent - extra checks when failing Completed jobs, closes #1944
FIX: JobState - added protection against absent job in getStatus(), closes #1853
[v6r11p2]
*Core
FIX: dirac-install - skip expectedBytes check if Content-Length not returned by server
FIX: AgentModule - demote message "Cycle had an error:" to warning
*Accounting
FIX: BaseReporter - protect against division by zero
*DMS
CHANGE: FileCatalogClientCLI - quite "-q" option in find command
FIX: DataManager - bug fix in __initializeReplication()
FIX: DataManager - less verbose log message
FIX: DataManager - report the size of removed files only for successfully removed ones
FIX: File, FTSFile, FTSJob - SQL tables schema change: Size filed INTEGER -> BIGINT
*RMS
FIX: dirac-rms-reset-request, dirac-rms-show-request - fixes
FIX: ForwardDISET - execute with trusted host certificate
*Resources
FIX: SSHComputingElement - SSHOptions are parsed at the wrong place
NEW: ComputingElement - evaluate the number of available cores if relevant
*WMS
NEW: JobMonitoringHander - added export_getOwnerGroup() interface