MBTAR(1) | User Commands | MBTAR(1) |
NAME¶
mbtar - Archive files in parallel with MPI-Bash
SYNOPSIS¶
mbtar -c [-C dir] [-T list_file] [-v] -f output.tar input_file...
DESCRIPTION¶
mbtar is a parallel version of the standard tar command, designed to archive large files or large numbers of files—or even large numbers of large files—by distributing the work across a set of computers that share a filesystem.
mbtar is a bash script that uses MPI-Bash functions for communication. It should therefore be run like any other MPI program (typically with mpirun or mpiexec).
OPTIONS¶
mbtar accepts only a subset of tar's options:
- -c
- Create a new archive.
- -C dir
- Change to directory dir.
- -T file
- Get names to extract or create from file.
- -v
- Verbosely list files processed.
- -f archive
- Use archive file archive.
In addition, at least one source file or directory must be specified on the command line.
Apart from supporting many fewer options, mbtar differs from tar in that it can only create an archive and that this archive must be an ordinary disk files. (Writing to standard output, for example, does not work.) Consequently, the -c and -f options are mandatory in mbtar.
EXAMPLES¶
Use 128 processes to archive a large directory into a single file:
BUGS¶
I sometimes see segmentation faults when MPI-Bash programs exit. I don't know why.
NOTES¶
mbtar requires Circle-Bash (MPI-Bash with Libcircle extensions) to operate.
AUTHOR¶
Scott Pakin, pakin@lanl.gov
COPYRIGHT¶
Copyright © 2015 Los Alamos National Security, LLC
SEE ALSO¶
tar(1), mpirun(1), MPI-Bash <https://github.com/losalamos/MPI-Bash>
2017-05-11 | LANL |