forked from pftool/pftool
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathREADME
135 lines (96 loc) · 3.88 KB
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
###############################################################################
PFTool: Parallel File Tool
###############################################################################
PFTool (Parallel File Tool) can stat, copy, and compare files in parallel.
It's optimized for an HPC workload and uses MPI for message passing.
A threaded version is available and can be configured at build time.
Additional info:
Available under LANL LACC-2012-072.
see COPYRIGHT file
***************************************************************************
Dependencies
***************************************************************************
autoconf
automake
m4
libtool
mpi
***************************************************************************
Installing PFTool
***************************************************************************
From the top-level directory
./autogen
#To configure the base version:
./configure
#To configure the threaded version:
#./configure --enable-threads
#Other options:
#./configure --help
./make clean
./make all
./make install
Note that pftool.cfg is created and installed into {install_prefix}/etc
during the "make install". Setting in this file should be reviewed and
modified based on the configuration of the cluster the software is
running on.
***************************************************************************
PFTool RPM
***************************************************************************
To build an RPM, from the top-level directory:
cd package
make rpm
Rpmbuild is used by this make file to generate the RPM. It is assumed that
the directory/tree $HOME/rpmbuild exists and has the subdirectories SOURCES,
BUILD, and RPMS. The resulting RPM is written to $HOME/rpmbuild/RPMS.
***************************************************************************
Configuration
***************************************************************************
{install_prefix}/etc/pftool.cfg is read by the pftool scripts pfls, pfcm, pfcp
example config files located in ./etc/ for threaded and mpi modes.
NOTE:
if you build with --enable-threads you MUST specify:
[environment]
threaded: True
otherwise specify:
[environment]
threaded: False
this cannot be changed at runtime
***************************************************************************
Versioning
***************************************************************************
In order to change the version number for this project, modify the following
line in ./configure.ac:
AC_INIT([pftool], [2.0.5], [[email protected]])
Then rerun
./configure
Note that the maintainer information can be changed as well.
***************************************************************************
Using PFtool
***************************************************************************
PFTool can be invoked directly, but the preferred method is through helper
scripts located in {install_prefix}/scripts/
-----------
Usage: pfls [options] sourcePath
pfls -- list file(s) based on sourcePath in parallel
Options:
-h, --help show this help message and exit
-R list directories recursively
-v verbose result output
-i INPUT_LIST input file list
-----------
Usage: pfcm [options] sourcePath destinationPath
pfcm -- compare file(s) from sourcePath to destinationPath in parallel
Options:
-h, --help show this help message and exit
-R copy directories recursively
-M changes to Block-by-Block vs Metadata only
-v verbose result output
-----------
Usage: pfcp [options] sourcePath destinationPath
pfcp -- copy file(s) from sourcePath to destinationPath in parallel
Options:
-h, --help show this help message and exit
-R copy directories recursively
-v verbose result output
-n only copy files that have a different date or file size than the
same files at the destination or not in the destination