table of contents
MAKEDUMPFILE(8) | Linux System Administrator's Manual | MAKEDUMPFILE(8) |
NAME¶
makedumpfile - make a small dumpfile of kdump
SYNOPSIS¶
makedumpfile [OPTION] [-x VMLINUX|-i
VMCOREINFO] VMCORE DUMPFILE
makedumpfile -F [OPTION] [-x VMLINUX|-i
VMCOREINFO] VMCORE
makedumpfile [OPTION] -x VMLINUX [--config
FILTERCONFIGFILE] [--eppic EPPICMACRO] VMCORE
DUMPFILE
makedumpfile -R DUMPFILE
makedumpfile --split [OPTION] [-x VMLINUX|-i
VMCOREINFO] VMCORE DUMPFILE1 DUMPFILE2
[DUMPFILE3 ..]
makedumpfile [OPTION] [-x VMLINUX|-i VMCOREINFO]
--num-threads THREADNUM VMCORE DUMPFILE
makedumpfile --reassemble DUMPFILE1 DUMPFILE2
[DUMPFILE3 ..] DUMPFILE
makedumpfile -g VMCOREINFO -x VMLINUX
makedumpfile [OPTION] [--xen-syms
XEN-SYMS|--xen-vmcoreinfo VMCOREINFO] VMCORE
DUMPFILE
makedumpfile --dump-dmesg [--partial-dmesg] [-x VMLINUX|-i
VMCOREINFO] VMCORE LOGFILE
makedumpfile [OPTION] -x VMLINUX --diskset=VMCORE1
--diskset=VMCORE2 [--diskset=VMCORE3 ..] DUMPFILE
makedumpfile -h
makedumpfile -v
DESCRIPTION¶
With kdump, the memory image of the first kernel (called "panicked kernel") can be taken as /proc/vmcore while the second kernel (called "kdump kernel" or "capture kernel") is running. This document represents /proc/vmcore as VMCORE. makedumpfile makes a small DUMPFILE by compressing dump data or by excluding unnecessary pages for analysis, or both. makedumpfile needs the first kernel's debug information, so that it can distinguish unnecessary pages by analyzing how the first kernel uses the memory. The information can be taken from VMLINUX or VMCOREINFO.
makedumpfile can exclude the following types of pages while
copying VMCORE to DUMPFILE, and a user can choose which type
of pages will be excluded.
- Pages filled with zero
- Cache pages without private flag (non-private cache)
- Cache pages with private flag (private cache)
- User process data pages
- Free pages
makedumpfile provides two DUMPFILE formats (the ELF format and the kdump-compressed format). By default, makedumpfile makes a DUMPFILE in the kdump-compressed format. The kdump-compressed format is readable only with the crash utility, and it can be smaller than the ELF format because of the compression support. The ELF format is readable with GDB and the crash utility. If a user wants to use GDB, DUMPFILE format has to be explicitly specified to be the ELF format.
Apart from the exclusion of unnecessary pages mentioned above, makedumpfile allows user to filter out targeted kernel data. The filter config file can be used to specify kernel/module symbols and its members that need to be filtered out through the erase command syntax. makedumpfile reads the filter config and builds the list of memory addresses and its sizes after processing filter commands. The memory locations that require to be filtered out are then poisoned with character 'X' (58 in Hex). Refer to makedumpfile.conf(5) for file format.
Eppic macros can also be used to specify kernel symbols and its members that need to be filtered. Eppic provides C semantics including language constructs such as conditional statements, logical and arithmetic operators, functions, nested loops to traverse and erase kernel data. --eppic requires eppic_makedumpfile.so and eppic library. eppic_makedumpfile.so can be built from makedumpfile source. Refer to http://code.google.com/p/eppic/ to build eppic library libeppic.a and for more information on writing eppic macros.
To analyze the first kernel's memory usage, makedumpfile can refer
to VMCOREINFO instead of VMLINUX. VMCOREINFO contains
the first kernel's information (structure size, field offset, etc.), and
VMCOREINFO is small enough to be included into the second kernel's
initrd.
If the second kernel is running on its initrd without mounting a root file
system, makedumpfile cannot refer to VMLINUX because the second
kernel's initrd cannot include a large file like VMLINUX. To solve
the problem, makedumpfile makes VMCOREINFO beforehand, and it refers
to VMCOREINFO instead of VMLINUX while the second kernel is
running.
VMCORE has contained VMCOREINFO since linux-2.6.24, and a user
does not need to specify neither -x nor -i option.
If the second kernel is running on its initrd without mounting any file system, a user needs to transport the dump data to a remote host. To transport the dump data by SSH, makedumpfile outputs the dump data in the intermediate format (the flattened format) to the standard output. By piping the output data to SSH, a user can transport the dump data to a remote host. Note that analysis tools (crash utility before version 5.1.2 or GDB) cannot read the flattened format directly, so on a remote host the received data in the flattened format needs to be rearranged to a readable DUMPFILE format by makedumpfile (or makedumpfile-R.pl).
makedumpfile can read a DUMPFILE in the kdump-compressed
format instead of VMCORE and re-filter it. This feature is useful in
situation that users need to reduce the file size of DUMPFILE for
sending it somewhere by ftp/scp/etc. (If all of the page types, which are
specified by a new dump_level, are excluded from an original DUMPFILE
already, a new DUMPFILE is the same as an original DUMPFILE.)
For example, makedumpfile can create a DUMPFILE of dump_level 31 from
the one of dump_level 3 like the following:
Example:
# makedumpfile -c -d 3 /proc/vmcore dumpfile.1
# makedumpfile -c -d 31 dumpfile.1 dumpfile.2
makedumpfile can read VMCORE(s) in three kinds of sadump formats: single partition format, diskset format and media backup format, and can convert each of them into kdump-compressed format with filtering and compression processing. Note that for VMCORE(s) created by sadump, you always need to pass VMLINUX with -x option. Also, to pass multiple VMCOREs created on diskset configuration, you need to use --diskset option.
OPTIONS¶
- -c,-l,-p,-z
- Compress dump data by the page using the following compression library
respectively:
-c : zlib
-l : lzo
-p : snappy
-z : zstd
(-l, -p and -z option need USELZO=on, USESNAPPY=on and USEZSTD=on respectively when building makedumpfile)
A user cannot specify this option with -E option, because the ELF format does not support compressed data.
Example:
# makedumpfile -c -d 31 -x vmlinux /proc/vmcore dumpfile - -d dump_level
- Specify the type of unnecessary page for analysis.
Pages of the specified type are not copied to DUMPFILE. The page type marked in the following table is excluded. A user can specify multiple page types by setting the sum of each page type for dump_level. The maximum of dump_level is 31. Note that a dump_level for Xen dump filtering is 0 or 1 on a machine other than x86_64. On a x86_64 machine, even 2 or bigger dump level will be effective if you specify domain-0's vmlinux with -x option. Then the pages are excluded only from domain-0.
If specifying multiple dump_levels with the delimiter ',', makedumpfile retries to create DUMPFILE using the next dump_level when the size of a dumpfile exceeds the limit specified with '-L' or when a "No space on device" error happens. For example, if dump_level is "11,31" and makedumpfile fails with dump_level 11, makedumpfile retries with dump_level 31.
Example:
# makedumpfile -d 11 -x vmlinux /proc/vmcore dumpfile
# makedumpfile -d 11,31 -x vmlinux /proc/vmcore dumpfile
Base level:
dump_level consists of five bits, so there are five base levels to specify the type of unnecessary page.
1 : Exclude the pages filled with zero.
2 : Exclude the non-private cache pages.
4 : Exclude all cache pages.
8 : Exclude the user process data pages.
16 : Exclude the free pages.Here is the all combinations of the bits.
| |non- | | |
dump | zero |private|private| user | free
level | page |cache |cache | data | page
-------+------+-------+-------+------+------
0 | | | | |
1 | X | | | |
2 | | X | | |
3 | X | X | | |
4 | | X | X | |
5 | X | X | X | |
6 | | X | X | |
7 | X | X | X | |
8 | | | | X |
9 | X | | | X |
10 | | X | | X |
11 | X | X | | X |
12 | | X | X | X |
13 | X | X | X | X |
14 | | X | X | X |
15 | X | X | X | X |
16 | | | | | X
17 | X | | | | X
18 | | X | | | X
19 | X | X | | | X
20 | | X | X | | X
21 | X | X | X | | X
22 | | X | X | | X
23 | X | X | X | | X
24 | | | | X | X
25 | X | | | X | X
26 | | X | | X | X
27 | X | X | | X | X
28 | | X | X | X | X
29 | X | X | X | X | X
30 | | X | X | X | X
31 | X | X | X | X | X - -L SIZE
- Limit the size of the output file to SIZE bytes. An incomplete DUMPFILE or LOGFILE is written if the size would otherwise exceed SIZE.
- -E
- Create DUMPFILE in the ELF format.
This option cannot be specified with the -c, -l or -p options, because the ELF format does not support compressed data.
Example:
# makedumpfile -E -d 31 -x vmlinux /proc/vmcore dumpfile - -f
- Force existing DUMPFILE to be overwritten and mem-usage to work with older
kernel as well.
Example:
# makedumpfile -f -d 31 -x vmlinux /proc/vmcore dumpfile
This command overwrites DUMPFILE even if it already exists.
# makedumpfile -f --mem-usage /proc/kcore
Kernel version lesser than v4.11 will not work with --mem-usage functionality until it has been patched with upstream commit 464920104bf7. Therefore if you have patched your older kernel then use -f. - -x VMLINUX
- Specify the first kernel's VMLINUX with debug information to
analyze the first kernel's memory usage.
This option is necessary if VMCORE does not contain VMCOREINFO, [-i VMCOREINFO] is not specified, and dump_level is 2 or more.
The page size of the first kernel and the second kernel should match.
Example:
# makedumpfile -d 31 -x vmlinux /proc/vmcore dumpfile - -i VMCOREINFO
- Specify VMCOREINFO instead of VMLINUX for analyzing the
first kernel's memory usage.
VMCOREINFO should be made beforehand by makedumpfile with -g option, and it contains the first kernel's information.
This option is necessary if VMCORE does not contain VMCOREINFO, [-x VMLINUX] is not specified, and dump_level is 2 or more.
Example:
# makedumpfile -d 31 -i vmcoreinfo /proc/vmcore dumpfile - -g VMCOREINFO
- Generate VMCOREINFO from the first kernel's VMLINUX with
debug information.
VMCOREINFO must be generated on the system that is running the first kernel. With -i option, a user can specify VMCOREINFO generated on the other system that is running the same first kernel. [-x VMLINUX] must be specified.
Example:
# makedumpfile -g vmcoreinfo -x vmlinux - --config FILTERCONFIGFILE
- Used in conjunction with -x VMLINUX option, to specify the filter config file FILTERCONFIGFILE that contains erase commands to filter out desired kernel data from vmcore while creating DUMPFILE. For filter command syntax please refer to makedumpfile.conf(5).
- --eppic EPPICMACRO
- Used in conjunction with -x VMLINUX option, to specify the eppic macro file that contains filter rules or directory that contains eppic macro files to filter out desired kernel data from vmcore while creating DUMPFILE. When directory is specified, all the eppic macros in the directory are processed.
- -F
- Output the dump data in the flattened format to the standard output for
transporting the dump data by SSH.
Analysis tools (crash utility before version 5.1.2 or GDB) cannot read the flattened format directly. For analysis, the dump data in the flattened format should be rearranged to a normal DUMPFILE (readable with analysis tools) by -R option. By which option is specified with -F option, the format of the rearranged DUMPFILE is fixed. In other words, it is impossible to specify the DUMPFILE format when the dump data is rearranged with -R option. If specifying -E option with -F option, the format of the rearranged DUMPFILE is the ELF format. Otherwise, it is the kdump-compressed format. All the messages are output to standard error output by -F option because standard output is used for the dump data.
Example:
# makedumpfile -F -c -d 31 -x vmlinux /proc/vmcore \
| ssh user@host "cat > dumpfile.tmp"
# makedumpfile -F -c -d 31 -x vmlinux /proc/vmcore \
| ssh user@host "makedumpfile -R dumpfile"
# makedumpfile -F -E -d 31 -i vmcoreinfo /proc/vmcore \
| ssh user@host "makedumpfile -R dumpfile"
# makedumpfile -F -E --xen-vmcoreinfo VMCOREINFO /proc/vmcore \
| ssh user@host "makedumpfile -R dumpfile" - -R
- Rearrange the dump data in the flattened format from the standard input to
a normal DUMPFILE (readable with analysis tools).
Example:
# makedumpfile -R dumpfile < dumpfile.tmp
# makedumpfile -F -d 31 -x vmlinux /proc/vmcore \
| ssh user@host "makedumpfile -R dumpfile"Instead of using -R option, a perl script "makedumpfile-R.pl" rearranges the dump data in the flattened format to a normal DUMPFILE, too. The perl script does not depend on architecture, and most systems have perl command. Even if a remote host does not have makedumpfile, it is possible to rearrange the dump data in the flattened format to a readable DUMPFILE on a remote host by running this script.
Example:
# makedumpfile -F -d 31 -x vmlinux /proc/vmcore \
| ssh user@host "makedumpfile-R.pl dumpfile" - --split
- Split the dump data to multiple DUMPFILEs in parallel. If
specifying DUMPFILEs on different storage devices, a device can
share I/O load with other devices and it reduces time for saving the dump
data. The file size of each DUMPFILE is smaller than the system
memory size which is divided by the number of DUMPFILEs. This
feature supports only the kdump-compressed format.
Example:
# makedumpfile --split -d 31 -x vmlinux /proc/vmcore dumpfile1 dumpfile2 - --num-threads THREADNUM
- Using multiple threads to read and compress data of each page in parallel.
And it will reduces time for saving DUMPFILE. Note that if the
usable cpu number is less than the thread number, it may lead to great
performance degradation. This feature only supports creating
DUMPFILE in kdump-comressed format from VMCORE in
kdump-compressed format or elf format.
Example:
# makedumpfile -d 31 --num-threads 4 /proc/vmcore dumpfile - --reassemble
- Reassemble multiple DUMPFILEs, which are created by --split option,
into one DUMPFILE. dumpfile1 and dumpfile2 are reassembled into
dumpfile on the following example.
Example:
# makedumpfile --reassemble dumpfile1 dumpfile2 dumpfile - -b <order>
- Cache 2^order pages in ram when generating DUMPFILE before writing to output. The default value is 4.
- --cyclic-buffer buffer_size
- Specify the buffer size in kilo bytes for bitmap data. Filtering
processing will be divided into multi cycles to fix the memory
consumption, the number of cycles is represented as:
num_of_cycles = system_memory / (buffer_size * 1024 * bit_per_bytes * page_size )The lesser number of cycles, the faster working speed is expected. By default, buffer_size will be calculated automatically depending on system memory size, so ordinary users don't need to specify this option.
Example:
# makedumpfile --cyclic-buffer 1024 -d 31 -x vmlinux /proc/vmcore dumpfile - --splitblock-size splitblock_size
- Specify the splitblock size in kilo bytes for analysis with --split. If
--splitblock N is specified, difference of each splitted dumpfile size is
at most N kilo bytes.
Example:
# makedumpfile --splitblock-size 1024 -d 31 -x vmlinux --split /proc/vmcore dumpfile1 dumpfile2 - --work-dir
- Specify the working directory for the temporary bitmap file. If this
option isn't specified, the bitmap will be saved on memory. Filtering
processing has to do 2 pass scanning to fix the memory consumption, but it
can be avoided by using working directory on file system. So if you
specify this option, the filtering speed may be bit faster.
Example:
# makedumpfile --work-dir /tmp -d 31 -x vmlinux /proc/vmcore dumpfile - --non-mmap
- Never use mmap(2) to read VMCORE even if it supports
mmap(2). Generally, reading VMCORE with mmap(2) is
faster than without it, so ordinary users don't need to specify this
option. This option is mainly for debugging.
Example:
# makedumpfile --non-mmap -d 31 -x vmlinux /proc/vmcore dumpfile - --xen-syms XEN-SYMS
- Specify the XEN-SYMS with debug information to analyze the xen's
memory usage. This option extracts the part of xen and domain-0.
Example:
# makedumpfile -E --xen-syms xen-syms /proc/vmcore dumpfile - --xen-vmcoreinfo VMCOREINFO
- Specify VMCOREINFO instead of XEN-SYMS for analyzing the
xen's memory usage.
VMCOREINFO should be made beforehand by makedumpfile with -g option, and it contains the xen's information.
Example:
# makedumpfile -E --xen-vmcoreinfo VMCOREINFO /proc/vmcore dumpfile - -X
- Exclude all the user domain pages from Xen kdump's VMCORE, and
extracts the part of xen and domain-0. If VMCORE contains
VMCOREINFO for Xen, it is not necessary to specify
--xen-syms and --xen-vmcoreinfo.
Example:
# makedumpfile -E -X /proc/vmcore dumpfile - --xen_phys_start xen_phys_start_address
- This option is only for x86_64. Specify the xen_phys_start_address,
if the xen code/data is relocatable and VMCORE does not contain
xen_phys_start_address in the CRASHINFO.
xen_phys_start_address can be taken from the line of
"Hypervisor code and data" in /proc/iomem. For example, specify
0xcee00000 as xen_phys_start_address if /proc/iomem is the
following:
-------------------------------------------------------
# cat /proc/iomem
...
cee00000-cfd99999 : Hypervisor code and data
...
-------------------------------------------------------Example:
# makedumpfile -E -X --xen_phys_start 0xcee00000 /proc/vmcore dumpfile - --message-level message_level
- Specify the message types.
Users can restrict outputs printed by specifying message_level with this option. The message type marked with an X in the following table is printed. For example, according to the table, specifying 7 as message_level means progress indicator, common message, and error message are printed, and this is a default value. Note that the maximum value of message_level is 31.
message | progress | common | error | debug | report
level | indicator| message | message | message | message
---------+----------+---------+---------+---------+---------
0 | | | | |
1 | X | | | |
2 | | X | | |
3 | X | X | | |
4 | | | X | |
5 | X | | X | |
6 | | X | X | |
* 7 | X | X | X | |
8 | | | | X |
9 | X | | | X |
10 | | X | | X |
11 | X | X | | X |
12 | | | X | X |
13 | X | | X | X |
14 | | X | X | X |
15 | X | X | X | X |
16 | | | | | X
17 | X | | | | X
18 | | X | | | X
19 | X | X | | | X
20 | | | X | | X
21 | X | | X | | X
22 | | X | X | | X
23 | X | X | X | | X
24 | | | | X | X
25 | X | | | X | X
26 | | X | | X | X
27 | X | X | | X | X
28 | | | X | X | X
29 | X | | X | X | X
30 | | X | X | X | X
31 | X | X | X | X | X - --vtop virtual_address
- This option is useful, when user debugs the translation problem of virtual address. If specifing virtual_address, its physical address is printed. It makes debugging easy by comparing the output of this option with the one of "vtop" subcommand of the crash utility. "--vtop" option only prints the translation output, and it does not affect the dumpfile creation.
- --dump-dmesg
- This option overrides the normal behavior of makedumpfile. Instead of
compressing and filtering a VMCORE to make it smaller, it simply
extracts the dmesg log from a VMCORE and writes it to the specified
LOGFILE. If a VMCORE does not contain VMCOREINFO for
dmesg, it is necessary to specfiy [-x VMLINUX] or [-i
VMCOREINFO].
Example:
# makedumpfile --dump-dmesg /proc/vmcore dmesgfile
# makedumpfile --dump-dmesg -x vmlinux /proc/vmcore dmesgfile - --partial-dmesg
- This option will make --dump-dmesg extract only dmesg logs since that buffer was last cleared on the crashed kernel, through "dmesg --clear" for example.
- --mem-usage
- This option is currently supported on x86_64, arm64, ppc64 and s390x. This
option is used to show the page numbers of current system in different
use. It should be executed in 1st kernel. By the help of this, user can
know how many pages is dumpable when different dump_level is specified. It
analyzes the 'System Ram' and 'kernel text' program segment of /proc/kcore
excluding the crashkernel range, then calculates the page number of
different kind per vmcoreinfo. So currently /proc/kcore need be specified
explicitly.
Example:
# makedumpfile --mem-usage /proc/kcore - --diskset=VMCORE
- Specify multiple VMCOREs created on sadump diskset configuration
the same number of times as the number of VMCOREs in increasing
order from left to right. VMCOREs are assembled into a single
DUMPFILE.
Example:
# makedumpfile -x vmlinux --diskset=vmcore1 --diskset=vmcore2 dumpfile - -D
- Print debugging message.
- -h (--help)
- Show help message and LZO/snappy support status (enabled/disabled).
- -v
- Show the version of makedumpfile.
- --check-params
- Only check whether the command-line parameters are valid or not, and exit. Preferable to be given as the first parameter.
- --dry-run
- Do not write the output dump file while still performing operations specified by other options. This option cannot be used with the --dump-dmesg, --reassemble and -g options.
- --show-stats
- Display report messages. This is an alternative to enabling bit 4 in the level provided to --message-level.
ENVIRONMENT VARIABLES¶
- TMPDIR
- This environment variable is used in 1st kernel environment for a temporary memory bitmap file. If your machine has a lots of memory and you use small tmpfs on /tmp, makedumpfile can fail for a little memory because makedumpfile makes a very large temporary memory bitmap file in this case. To avoid this failure, you should specify --work-dir option to use file system on storage for the bitmap file.
DIAGNOSTICS¶
makedumpfile exits with the following value.
- 0 : makedumpfile succeeded.
- 1 : makedumpfile failed without the following reasons.
- 2 : makedumpfile failed due to the different version between VMLINUX and VMCORE.
AUTHORS¶
Written by Masaki Tachibana, and Ken'ichi Ohmichi.
SEE ALSO¶
12 Apr 2024 | makedumpfile v1.7.5 |