Linux Notes
Linux Notes
Linux Notes
Kernel
o The core of the UNIX system. Loaded at system start up (boot). Memory-resident control
program.
o Manages the entire resources of the system, presenting them to you and every other user
as a coherent system. Provides service to user applications such as device management,
process scheduling, etc.
o Example functions performed by the kernel are:
Managing the machine's memory and allocating it to each process.
Scheduling the work done by the CPU so that the work of each user is carried out
as efficiently as is possible.
Accomplishing the transfer of data from one part of the machine to another
Interpreting and executing instructions from the shell
Enforcing file access permissions
o You do not need to know anything about the kernel in order to use a UNIX system. These
details are provided for your information only.
Shell
o Whenever you login to a Unix system you are placed in a shell program. The shell's
prompt is usually visible at the cursor's position on your screen. To get your work done,
you enter commands at this prompt.
o The shell is a command interpreter; it takes each command and passes it to the operating
system kernel to be acted upon. It then displays the results of this operation on your
screen.
o Several shells are usually available on any UNIX system, each with its own strengths and
weaknesses.
o Different users may use different shells. Initially, your system adminstrator will supply a
default shell, which can be overridden or changed. The most commonly available shells
are:
Bourne shell (sh)
C shell (csh)
Korn shell (ksh)
TC Shell (tcsh)
Bourne Again Shell (bash)
o Each shell also includes its own programming language. Command files, called "shell
scripts" are used to accomplish a series of tasks.
Utilities
An operating system or OS is a software program that enables the computer hardware to communicate
and operate with the computer software. Without a computer operating system, a computer and software
programs would be useless.
An operating system (sometimes abbreviated as "OS") is the program that, after being initially loaded into
the computer by a boot program, manages all the other programs in a computer. The other programs are
called applications or application programs. The application programs make use of the operating system
by making requests for services through a defined application program interface (API). In addition, users
can interact directly with the operating system through a user interface such as a command language or a
graphical user interface (GUI).
UNIX and 'UNIX-like' operating systems (such as Linux) consist of a kernel and some system programs.
There are also some application programs for doing work. The kernel is the heart of the operating system.
In fact, it is often mistakenly considered to be the operating system itself, but it is not. An operating
system provides many more services than a plain kernel.
It keeps track of files on the disk, starts programs and runs them concurrently, assigns memory and other
resources to various processes, receives packets from and sends packets to the network, and so on. The
kernel does very little by itself, but it provides tools with which all services can be built. It also prevents
anyone from accessing the hardware directly, forcing everyone to use the tools it provides. This way the
kernel provides some protection for users from each other. The tools provided by the kernel are used via
system calls.
The system programs use the tools provided by the kernel to implement the various services required
from an operating system. System programs, and all other programs, run `on top of the kernel', in what is
called the user mode. The difference between system and application programs is one of intent:
applications are intended for getting useful things done (or for playing, if it happens to be a game),
whereas system programs are needed to get the system working. A word processor is an application;
mount is a system program. The difference is often somewhat blurry, however, and is important only to
compulsive categorizers.
An operating system can also contain compilers and their corresponding libraries (GCC and the C library
in particular under Linux), although not all programming languages need be part of the operating
system. Documentation, and sometimes even games, can also be part of it.
Process management
Memory management
Hardware device drivers
Filesystem drivers
Network management
Various other bits and pieces
The following figure shows some of the more important parts of the Linux kernel
Probably the most important parts of the kernel (nothing else works without them) are memory
management and process management. Memory management takes care of assigning memory areas and
swap space areas to processes, parts of the kernel, and for the buffer cache. Process management creates
processes, and implements multitasking by switching the active process on the processor.
At the lowest level, the kernel contains a hardware device driver for each kind of hardware it supports.
Since the world is full of different kinds of hardware, the number of hardware device drivers is large.
There are often many otherwise similar pieces of hardware that differ in how they are controlled by
software. The similarities make it possible to have general classes of drivers that support similar
operations; each member of the class has the same interface to the rest of the kernel but differs in what it
needs to do to implement them. For example, all disk drivers look alike to the rest of the kernel, i.e., they
all have operations like `initialize the drive', `read sector N', and `write sector N'.
What is virtual memory?
Linux supports virtual memory, that is, using a disk as an extension of RAM so that the effective size of
usable memory grows correspondingly. The kernel will write the contents of a currently unused block of
memory to the hard disk so that the memory can be used for another purpose. When the original contents
are needed again, they are read back into memory. This is all made completely transparent to the user;
programs running under Linux only see the larger amount of memory available and don't notice that
parts of them reside on the disk from time to time. Of course, reading and writing the hard disk is slower
(on the order of a thousand times slower) than using real memory, so the programs don't run as fast. The
part of the hard disk that is used as virtual memory is called the swap space.
Linux can use either a normal file in the filesystem or a separate partition for swap space. A swap
partition is faster, but it is easier to change the size of a swap file (there's no need to repartition the whole
hard disk, and possibly install everything from scratch). When you know how much swap space you
need, you should go for a swap partition, but if you are uncertain, you can use a swap file first, use the
system for a while so that you can get a feel for how much swap you need, and then make a swap
partition when you're confident about its size.
You should also know that Linux allows one to use several swap partitions and/or swap files at the same
time. This means that if you only occasionally need an unusual amount of swap space, you can set up an
extra swap file at such times, instead of keeping the whole amount allocated all the time.
A note on operating system terminology: computer science usually distinguishes between swapping
(writing the whole process out to swap space) and paging (writing only fixed size parts, usually a few
kilobytes, at a time). Paging is usually more efficient, and that's what Linux does, but traditional Linux
terminology talks about swapping anyway.
Linux Structure
Linux is a layered operating system. The innermost layer is the hardware that provides the services for
the OS. The operating system, referred to in Linux as the kernel, interacts directly with the hardware and
provides the services to the user programs. These user programs don’t need to know anything about the
hardware. They just need to know how to interact with the kernel and it’s up to the kernel to provide the
desired service. One of the big appeals of Linux to programmers has been that most well written user
programs are independent of the underlying hardware, making them readily portable to new systems.
User programs interact with the kernel through a set of standard system calls. These system calls request
services to be provided by the kernel. Such services would include accessing a file: open close, read,
write, link, or execute a file; starting or updating accounting records; changing ownership of a file or
directory; changing to a new directory; creating, suspending, or killing a process; enabling access to
hardware devices; and setting limits on system resources.
Linux is a multi-user, multi-tasking operating system. You can have many users logged into a system
simultaneously, each running many programs. It’s the kernel’s job to keep each process and user separate
and to regulate access to system hardware, including cpu, memory, disk and other I/O devices.
Linux vs. Windows
Linux and Windows. Each has its own set of unique features, advantages and disadvantages. While it is
difficult to say which one is the better choice, it is not as difficult to answer which is the better choice
given your needs.
Note: The operating system that you use on your desktop computer (the vast majority of people use some flavor of
Windows) has absolutely nothing to do with the one that your host needs to serve your web site. Most personal sites
are created with MS FrontPage and even although that is a Microsoft product, it can be hosted perfectly on a
LINUX web server with FrontPage Extensions installed.
Stability:
LINUX systems (we actually use Linux but for comparison purposes they are identical) are hands-down
the winner in this category. There are many factors here but to name just a couple big ones: in our
experience LINUX handles high server loads better than Windows and LINUX machines seldom require
reboots while Windows is constantly needing them. Servers running on LINUX enjoy extremely high up-
time and high availability/reliability.
Performance:
While there is some debate about which operating system performs better, in our experience both
perform comparably in low-stress conditions however LINUX servers under high load (which is what is
important) are superior to Windows.
Scalability:
Web sites usually change over time. They start off small and grow as the needs of the person or
organization running them grow. While both platforms can often adapt to your growing needs, Windows
hosting is more easily made compatible with LINUX-based programming features like PHP and MySQL.
LINUX-based web software is not always 100% compatible with Microsoft technologies like .NET and VB
development. Therefore if you wish to use these, you should choose Windows web hosting.
Compatibility:
Web sites designed and programmed to be served under a LINUX-based web server can easily be hosted
on a Windows server, whereas the reverse is not always true. This makes programming for LINUX the
better choice.
Price:
Servers hosting your web site require operating systems and licenses just like everyone else. Windows
2003 and other related applications like SQL Server each cost a significant amount of money; on the other
hand, Linux is a free operating system to download, install and operate. Windows hosting results in
being a more expensive platform.
Conclusion:
To sum it up, LINUX-based hosting is more stable, performs faster and more compatible than Windows-
based hosting. You only need Windows hosting if you are going to developing in .NET or Visual Basic, or
some other application that limits your choices
Logging On To System
Before you can begin to use the system you will need to have a valid username and a password.
Assignment of usernames and initial passwords is typically handled by the System
Administrator
Your username, also called a userid, should be unique and should not change. Initial passwords
can be anything and should be changed after your first login.
Type your username at the login prompt, initial of your first name followed by last name (e.g
iafzal). LINUX is case sensitive - if your username is kellyk do not type KellyK . Press the
RETURN or ENTER key after typing your username.
When the password prompt appears, type in your password. Your password is never displayed
on the screen as a security measure. It also is case sensitive. Press the RETURN or ENTER key
after entering your password.
What happens after you successfully login depends upon your system, many LINUX systems
will display a login banner or "message of the day". Make a habit of reading this since it may
contain important information about the system.
Other LINUX systems will automatically configure your environment and open one or more
windows for you to do work in.
You should see a prompt - usually a percent sign (%) or dollar sign ($). This is called the "shell
prompt" (the shell is discussed in detail later). It indicates that the system is ready to accept
commands from you.
If your login attempt was unsuccessful, there are several possible reasons:
login: kellyk
kellyk's Password:
************************************************************
* Welcome to the Linux Systems Training Class
************************************************************
*
* Hello! (Greetings)
*
* System maintenance is scheduled today from 2:00
* until 4:00 pm EST
*
* (Thank you very much)
*
************************************************************
A file system is a logical collection of files on a partition or disk. A partition is a container for information
and can span an entire hard drive if desired.
Your hard drive can have various partitions which usually contains only one file system, such as one file
system housing the / file system or another containing the /home file system.
One file system per partition allows for the logical maintenance and management of differing file
systems.
Everything in Linux is considered to be a file, including physical devices such as DVD-ROMs, USB
devices, floppy drives, and so forth.
Directory Structure:
Linux uses a hierarchical file system structure, much like an upside-down tree, with root (/) at the base of
the file system and all other directories spreading from there.
A LINUX filesystem is a collection of files and directories that has the following properties:
It has a root directory (/) that contains other files and directories.
Each file or directory is uniquely identified by its name, the directory in which it resides, and a unique
identifier, typically called an inode.
By convention, the root directory has an inode number of 2 and the lost+found directory has an inode
number of 3. Inode numbers 0 and 1 are not used. File inode numbers can be seen by specifying the -i
option to ls command.
It is self contained. There are no dependencies between one filesystem and any other.
File System:
The difference between a disk or partition and the filesystem it contains is important. A few programs
(including, reasonably enough, programs that create filesystems) operate directly on the raw sectors of a
disk or partition; if there is an existing file system there it will be destroyed or seriously corrupted. Most
programs operate on a filesystem, and therefore won't work on a partition that doesn't contain one (or
that contains one of the wrong types).
Before a partition or disk can be used as a filesystem, it needs to be initialized, and the bookkeeping data
structures need to be written to the disk. This process is called making a filesystem.
Most LINUX filesystem types have a similar general structure, although the exact details vary quite a bit.
The central concepts are superblock, inode , data block, directory block , and indirection block. The
superblock contains information about the filesystem as a whole, such as its size (the exact information
here depends on the filesystem). An inode contains all information about a file, except its name. The
name is stored in the directory, together with the number of the inode. A directory entry consists of a
filename and the number of the inode which represents the file. The inode contains the numbers of
several data blocks, which are used to store the data in the file. There is space only for a few data block
numbers in the inode, however, and if more are needed, more space for pointers to the data blocks is
allocated dynamically. These dynamically allocated blocks are indirect blocks; the name indicates that in
order to find the data block, one has to find its number in the indirect block first.
LINUX filesystems usually allow one to create a hole in a file (this is done with the lseek() system call;
check the manual page), which means that the filesystem just pretends that at a particular place in the file
there is just zero bytes, but no actual disk sectors are reserved for that place in the file (this means that the
file will use a bit less disk space). This happens especially often for small binaries, Linux shared libraries,
some databases, and a few other special cases. (Holes are implemented by storing a special value as the
address of the data block in the indirect block or inode. This special address means that no data block is
allocated for that part of the file, ergo, there is a hole in the file.)
This topic is loosely based on the Filesystems Hierarchy Standard (FHS), which attempts to set a standard
for how the directory tree in a Linux system should be organized. Such a standard has the advantage
that it will be easier to write or port software for Linux, and to administer Linux machines, since
everything should be in standardized places. There is no authority behind the standard that forces
anyone to comply with it, but it has gained the support of many Linux distributions. It is not a good idea
to break with the FHS without very compelling reasons. The FHS attempts to follow Linux tradition and
current trends, making Linux systems familiar to those with experience with other Linux systems, and
vice versa.
The full directory tree is intended to be breakable into smaller parts, each capable of being on its own disk
or partition, to accommodate to disk size limits and to ease backup and other system administration
tasks. The major parts are the root (/ ), /usr , /var , and /home filesystems (see the following figure). Each
part has a different purpose. The directory tree has been designed so that it works well in a network of
Linux machines which may share some parts of the filesystems over a read-only device (e.g., a CD-ROM),
or over the network with NFS.
The roles of the different parts of the directory tree are described below
The root filesystem is specific for each machine (it is generally stored on a local disk, although it could be
a ramdisk or network drive as well) and contains the files that are necessary for booting the system up,
and to bring it up to such a state that the other filesystems may be mounted. The contents of the root
filesystem will therefore be sufficient for the single user state. It will also contain tools for fixing a broken
system, and for recovering lost files from backups.
The /usr filesystem contains all commands, libraries, manual pages, and other unchanging files needed
during normal operation. No files in /usr should be specific for any given machine, nor should they be
modified during normal use. This allows the files to be shared over the network, which can be cost-
effective since it saves disk space (there can easily be hundreds of megabytes, increasingly multiple
gigabytes in /usr). It can make administration easier (only the master /usr needs to be changed when
updating an application, not each machine separately) to have /usr network mounted. Even if the
filesystem is on a local disk, it could be mounted read-only, to lessen the chance of filesystem corruption
during a crash.
The /var filesystem contains files that change, such as spool directories (for mail, news, printers, etc), log
files, formatted manual pages, and temporary files. Traditionally everything in /var has been somewhere
below /usr , but that made it impossible to mount /usr read-only.
The /home filesystem contains the users' home directories, i.e., all the real data on the system. Separating
home directories to their own directory tree or filesystem makes backups easier; the other parts often do
not have to be backed up, or at least not as often as they seldom change. A big /home might have to be
broken across several filesystems, which requires adding an extra naming level below /home, for example
/home/students and /home/staff.
Although the different parts have been called filesystems above, there is no requirement that they
actually be on separate filesystems. They could easily be kept in a single one if the system is a small
single-user system and the user wants to keep things simple. The directory tree might also be divided
into filesystems differently, depending on how large the disks are, and how space is allocated for various
purposes. The important part, though, is that all the standard names work; even if, say, /var and /usr are
actually on the same partition, the names /usr/lib/libc.a and /var/log/messages must work, for example by
moving files below /var into /usr/var, and making /var a symlink to /usr/var.
The Linux filesystem structure groups files according to purpose, i.e., all commands are in one place, all
data files in another, documentation in a third, and so on. An alternative would be to group files
according to the program they belong to, i.e., all Emacs files would be in one directory, all TeX in another,
and so on. The problem with the latter approach is that it makes it difficult to share files (the program
directory often contains both static and sharable and changing and non-sharable files), and sometimes to
even find the files (e.g., manual pages in a huge number of places, and making the manual page
programs find all of them is a maintenance nightmare).
The root filesystem should generally be small, since it contains very critical files and a small, infrequently
modified filesystem has a better chance of not getting corrupted. A corrupted root filesystem will
generally mean that the system becomes unbootable except with special measures (e.g., from a floppy), so
you don't want to risk it.
The root directory generally doesn't contain any files, except perhaps on older systems where the
standard boot image for the system, usually called /vmlinuz was kept there. (Most distributions have
moved those files the the /boot directory.
1. / – Root
Every single file and directory starts from the root directory.
Only root user has write privilege under this directory.
Please note that /root is root user’s home directory, which is not same as /.
Contains binaries, libraries, documentation, and source-code for second level programs.
/usr/bin contains binary files for user programs. If you can’t find a user binary under /bin,
look under /usr/bin. For example: at, awk, cc, less, scp
/usr/sbin contains binary files for system administrators. If you can’t find a system binary
under /sbin, look under /usr/sbin. For example: atd, cron, sshd, useradd, userdel
/usr/lib contains libraries for /usr/bin and /usr/sbin
/usr/local contains users programs that you install from source. For example, when you
install apache from source, it goes under /usr/local/apache2
Contains library files that supports the binaries located under /bin and /sbin
Library filenames are either ld* or lib*.so.*
For example: ld-2.11.1.so, libncurses.so.5.7
LINUX permits file names to use most characters, but avoid spaces, tabs and characters that have
a special meaning to the shell, such as:
Case Sensitivity: uppercase and lowercase are not the same! These are three different files:
Hidden Files: have names that begin with a dot (.) For example:
.cshrc .login .mailrc .mwmrc
Uniqueness: as children in a family, no two files with the same parent directory can have the
same name. Files located in separate directories can have identical names.
Reserved Filenames:
/ - the root directory (slash)
. - current directory (period)
.. - parent directory (double period)
~ - your home directory (tilde)
Passwords Standards
When your account is issued, you will be given an initial password. It is important for system and
personal security that the password for your account be changed to something of your choosing. The
command for changing a password is "passwd". You will be asked both for your old password and to
type your new selected password twice. If you mistype your old password or do not type your new
password the same way twice, the system will indicate that the password has not been changed.
Some system administrators have installed programs that check for appropriateness of password (is it
cryptic enough for reasonable system security). A password change may be rejected by this program.
When choosing a password, it is important that it be something that could not be guessed -- either by
somebody unknown to you trying to break in, or by an acquaintance who knows you. Suggestions for
choosing and using a password follow:
Don't
use a word (or words) in any language
use a proper name
use information that can be found in your wallet
use information commonly known about you (car license, pet name, etc)
use control characters. Some systems can't handle them
write your password anywhere
ever give your password to *anybody*
Do
use a mixture of character types (alphabetic, numeric, special)
use a mixture of upper case and lower case
use at least 6 characters
choose a password you can remember
change your password often
make sure nobody is looking over your shoulder when you are entering your password
Change Password in LINUX
To modify a user's password or your own password in LINUX use the passwd command. Open the
terminal and then type the passwd command entering the new password, the characters entered do not
display on screen, in order to avoid the password being seen by a passer-by. The passwd command
prompts for the new password twice in order to detect any typing errors. The encrypted password is
stored in /etc/shadow file.
Sample outputs:
Enter new LINUX password:
Retype new LINUX password:
passwd: password updated successfully
Sample outputs:
(current) LINUX password:
Enter new LINUX password:
Retype new LINUX password:
passwd: password updated successfully
Difference between locate and find command in Linux
Two popular commands for locating files on Linux are find and locate. Depending on the size of your
file system and the depth of your search, the find command can sometime take a long time to scan all of
the data. For example, if you search your entire filesystem for the files named data.txt:
More likely than not, this will take on the order of minutes, if not longer to return. A quicker method is
to use the locate command:
# locate data.txt
However, this efficiency comes at a cost, the data reported in the output of locate isn’t as fresh as the
data reported by the find command. By default, the system will run updatedb which takes a snapshot of
the system files once a day, locate uses this snapshot to quickly report what files are where. However,
recent file additions or removals (within 24 hours) are not recorded in the snapshot and are unknown
to locate.
The find command has a number of options and is very configurable. There are many ways to reduce
the depth and breadth of your search and make it more efficient.
locate uses a previously built database, If database is not updated then locate command will not show
the output. to sync the database it is must to execute updatedb command.
# updatedb
How to Use Wildcards
A wildcard is a character that can be used as a substitute for any of a class of characters in a search,
thereby greatly increasing the flexibility and efficiency of searches.
Wildcards are commonly used in shell commands in Linux and other Unix-like operating systems. A
shell is a program that provides a text-only user interface and whose main function is to execute
commands typed in by users and display their results.
Wildcards are also used in regular expressions and programming languages. Regular expressions are a
pattern matching system that uses strings (i.e., sequences of characters) constructed according to pre-
defined syntax rules to find desired strings in text.
The term wildcard or wild card was originally used in card games to describe a card that can be assigned
any value that its holder desires. However, its usage has spread so that it is now used to describe an
unknown or unpredictable factor in a variety of fields.
Star Wildcard
Three types of wildcards are used with Linux commands. The most frequently employed and usually the
most useful is the star wildcard, which is the same as an asterisk (*). The star wildcard has the broadest
meaning of any of the wildcards, as it can represent zero characters, all single characters or any string.
As an example, the file command provides information about any filesystem object (i.e., file, directory or
link) that is provided to it as an argument (i.e., input). Because the star wildcard represents every string,
it can be used as the argument for file to return information about every object in the specified directory.
Thus, the following would display information about every object in the current directory (i.e., the
directory in which the user is currently working):
file *
If there are no matches, an error message is returned, such as *: can't stat `*' (No such file or directory).. In
the case of this example, the only way that there would be no matches is if the directory were empty.
Wildcards can be combined with other characters to represent parts of strings. For example, to represent
any filesystem object that has a .jpg filename extension, *.jpg would be used. Likewise, a* would
represent all objects that begin with a lower case (i.e., small) letter a.
As another example, the following would tell the ls command (which is used to list files) to provide the
names of all files in the current directory that have an .html or a .txt extension:
ls *.html *.txt
Likewise, the following would tell the rm command (which is used to remove files and directories) to
delete all files in the current directory that have the string xxx in their name:
rm *xxx*
Question Mark Wildcard
The question mark (?) is used as a wildcard character in shell commands to represent exactly one
character, which can be any single character. Thus, two question marks in succession would represent
any two characters in succession, and three question marks in succession would represent any string
consisting of three characters.
Thus, for example, the following would return data on all objects in the current directory whose names,
inclusive of any extensions, are exactly three characters in length:
file ???
And the following would provide data on all objects whose names are one, two or three characters in
length:
file ? ?? ???
As is the case with the star wildcard, the question mark wildcard can be used in combination with other
characters. For example, the following would provide information about all objects in the current
directory that begin with the letter a and are five characters in length:
file a????
The question mark wildcard can also be used in combination with other wildcards when separated by
some other character. For example, the following would return a list of all files in the current directory
that have a three-character filename extension:
ls *.???
The third type of wildcard in shell commands is a pair of square brackets, which can represent any of the
characters enclosed in the brackets. Thus, for example, the following would provide information about all
objects in the current directory that have an x, y and/or z in them:
file *[xyz]*
And the following would list all files that had an extension that begins with x, y or z:
ls *.[xyz]*
The same results can be achieved by merely using the star and question mark wildcards. However, it is
clearly more efficient to use the bracket wildcard.
When a hyphen is used between two characters in the square brackets wildcard, it indicates a range
inclusive of those two characters. For example, the following would provide information about all of the
objects in the current directory that begin with any letter from a through f:
file [a-f]*
And the following would provide information about every object in the current directory whose name
includes at least one numeral:
file *[0-9]*
The use of the square brackets to indicate a range can be combined with its use to indicate a list. Thus, for
example, the following would provide information about all filesystem objects whose names begin with
any letter from a through c or begin with s or t:
file [a-cst]*
Likewise, multiple sets of ranges can be specified. Thus, for instance, the following would return
information about all objects whose names begin with the first three or the final three lower case letters of
the alphabet:
file [a-cx-z]*
Sometimes it can be useful to have a succession of square bracket wildcards. For example, the following
would display all filenames in the current directory that consist of jones followed by a three-digit
number:
ls jones[0-9][0-9][0-9]
\ (backslash) = is used as an "escape" character, i.e. to protect a subsequent special character. Thus, "\\"
searches for a backslash. Note you may need to use quotation marks and backslash(es).
^ (caret) = means "the beginning of the line". So "^a" means find a line starting with an "a".
$ (dollar sign) = means "the end of the line". So "a$" means find a line ending with an "a".
For example, this command searches the file myfile for lines starting with an "s" and ending with an "n",
and prints them to the standard output (screen):
Example:
Create two files:
$ touch blah1
$ touch blah2
And as expected:
$ ln blah1 blah1-hard
$ ln -s blah2 blah2-soft
$ ls -l
blah1
blah1-hard
blah2
blah2-soft -> blah2
$ mv blah1 blah1-new
$ cat blah1-hard
Cat
blah1-hard points to the inode, the contents, of the file - that wasn't changed.
$ mv blah2 blah2-new
$ ls blah2-soft
blah2-soft
$ cat blah2-soft
cat: blah2-soft: No such file or directory
The contents of the file could not be found because the soft link points to the name, that was changed,
and not to the contents.
Similarly, If blah1 is deleted, blah1-hard still holds the contents; if blah2 is deleted, blah2-soft is just a link
to a non-existing file.
List folders and files in a directory The command: Information Commands:
Written By: Alexandros Mavridis ls - list directory contents ls --version
ls --help
info ls
Contents man ls
Listing Folders
Options Used In This Document
Non Hidden Folders Page 1
-r, --reverse
reverse order while sorting
Hidden Folders Page 3
-l use a long listing format
Non Hidden And Hidden Folders Page 4
-t sort by modification time, newest
Listing Files
first
Non Hidden Files Page 5
-i, --inode
print the index number of each file
Hidden Files Page 7
-a, --all
Non Hidden And Hidden Files Page 8
do not ignore entries starting with .
Listing Folders and Files
-d, --directory
list directories themselves, not their
Non Hidden Folders and Files Page 9
contents
Hidden Folders And Files Page 13
-p, --indicator-style=slash
append / indicator to directories
Non Hidden And Hidden Folders And Files Page 20
--group-directories-first
Sources Page 23
group directories before files
ls -d */ | wc -l
A. Listing Folders
Command Output
Command Output
Command Output
B. Listing Files
Command Output
ls -pltr | grep -v / Prints in detail all non hidden files in the current
ls -ltr | grep -v ^d working directory in reverse chronological
ls -lt | grep '^\-' order, going from oldest to newest.
ls -pi | grep -v / Prints all non hidden files in the current working
directory, including inode numbers, in
alphabetical order.
ls -pri | grep -v / Prints all non hidden files in the current working
directory, including inode numbers, in reverse
alphabetical order.
ls -pli | grep -v / Prints in detail all non hidden files in the current
working directory, including inode numbers, in
ls -li | grep -v ^d alphabetical order.
ls -plri | grep -v / Prints in detail all non hidden files in the current
working directory, including inode numbers, in
ls -lri | grep -v ^d reverse alphabetical order.
Prints all non hidden files in the current working
ls -pti | grep -v / directory, including inode numbers, in
chronological order, going from newest to oldest.
Prints all non hidden files in the current working
directory, including inode numbers, in reverse
ls -ptri | grep -v /
chronological order, going from oldest to
newest.
ls -plti | grep -v / Prints in detail all non hidden files in the current
working directory, including inode numbers, in
ls -lti | grep -v ^d chronological order, going from newest to oldest.
ls -pltri | grep -v / Prints in detail all non hidden files in the current
working directory, including inode numbers, in
reverse chronological order, going from oldest to
ls -ltri | grep -v ^d
newest.
Hidden Files
Command Output
Command Output
ls -pa | grep -v / Prints all non hidden and hidden files in the
current working directory in alphabetical order.
ls -pra | grep -v / Prints all non hidden and hidden files in the
current working directory in reverse alphabetical
order.
ls -pla | grep -v / Prints in detail all non hidden and hidden files
ls -la | grep -v ^d in the current working directory in alphabetical
ls -la | grep '^\-' order.
ls -prla | grep -v / Prints in detail all non hidden and hidden files in
ls -rla | grep -v ^d the current working directory in reverse
ls -lra | grep '^\-' alphabetical order.
ls -pltra | grep -v / Prints in detail all non hidden and hidden files in
ls -ltra | grep -v ^d the current working directory in reverse
chronological order, going from oldest to
ls -ltra | grep '^\-' newest.
Prints all non hidden and hidden files in the
ls -pai | grep -v / current working directory, including inode
numbers, in alphabetical order.
Prints all non hidden and hidden files in the
ls -prai | grep -v / current working directory, including inode
numbers, in reverse alphabetical order.
ls -plai | grep -v / Prints in detail all non hidden and hidden files in
the current working directory, including inode
numbers, in alphabetical order.
ls -prlai | grep -v / Prints in detail all non hidden and hidden files in
the current working directory, including inode
numbers, in reverse alphabetical order.
ls -ptia | grep -v / Prints all non hidden and hidden files in the
current working directory, including inode
numbers, in chronological order, going from
newest to oldest.
ls -ptrai | grep -v / Prints all non hidden and hidden files in the
current working directory, including inode
numbers, in reverse chronological order, going
from oldest to newest.
ls -pltai | grep -v / Prints in detail all non hidden and hidden files in
the current working directory, including inode
numbers, in chronological order, going from
newest to oldest.
ls -pltrai | grep -v / Prints in detail all non hidden and hidden files in
the current working directory, including inode
numbers, in reverse chronological order, going
from oldest to newest.
Command Output
Command Output
Command Output
_____________________
Sources:
https://stackoverflow.com/questions/14352290/listing-only-directories-using-ls-in-bash-an-examination
https://serverfault.com/questions/368370/how-do-i-exclude-directories-when-listing-files
https://www.cyberciti.biz/faq/bash-shell-display-only-hidden-dot-files/
https://askubuntu.com/questions/468901/how-to-show-only-hidden-files-in-terminal
A command is a program that tells the Linux system to do something. It has the form:
command [options] [arguments]
where an argument indicates on what the command is to perform its action, usually a file or series of
files. An option modifies the command, changing the way it performs. Commands are case sensitive.
command and Commands are not the same.
Options are generally preceded by a hyphen (-), and for most commands, more than one option can be
strung together, in the form:
command -[option][option][option]
e.g.:
ls –alR = will perform a long list on all files in the current directory and recursively
perform the list through all sub-directories.
For most commands you can separate the options, preceding each with a hyphen, e.g.:
command -option1 -option2 -option3
as in: ls -a -l -R
Some commands have options that require parameters. Options requiring parameters are usually
specified separately, e.g.:
lpr -Pprinter3 -# 2 file
will send 2 copies of file to printer3.
These are the standard conventions for commands. However, not all Linux commands will follow the
standard. Some don’t require the hyphen before options and some won’t let you group options
together, i.e. they may require that each option be preceded by a hyphen and separated by whitespace
from other options and arguments.
Options and syntax for a command are listed in the man page for the command.
File Permissions
• UNIX is a multi-user system. Every file and directory in your account can be protected from or
made accessible to other users by changing its access permissions. Every user has responsibility
for controlling access to their files.
Example:
A permission of 4 or r would specify read permissions. If the permissions desired are read and write,
the 4 (representing read) and the 2 (representing write) are added together to make a permission of 6.
Therefore, a permission setting of 6 would allow read and write permissions.
Common Options
-f force (no error message is generated if the change is unsuccessful)
-R recursively descend through the directory structure and change the modes
Examples
If the permission desired for file1 is user: read, write, execute, group: read, execute, other: read,
execute, the command to use would be
Reminder: When giving permissions to group and other to use a file, it is necessary to allow at least
execute permission to the directories for the path in which the file is located. The easiest way to do
this is to be in the directory for which permissions need to be granted:
File Ownership
Syntax
chown [options] user[:group] file (SVR4)
chown [options] user[.group] file (BSD)
Common Options
-R recursively descend through the directory structure
-f force, and don’t report any errors
Examples
# chown new_owner file
Syntax
chgrp [options] group file
Common Options
-R recursively descend through the directory structure
-f force, and don’t report any errors
Examples
% chgrp
Getting Help
o The "man" command man gives you access to an on-line manual which potentially contains a
complete description of every command available on the system. In practice, the manual
usually contains a subset of all commands.
o man can also provide you with one line descriptions of commands which match a specified
keyword
o The online manual is divided into sections:
Section Description
------- -----------
1 User Commands
2 System Commands
3 Subroutines
4 Devices
5 File Formats
6 Games
7 Miscellaneous
8 System Administration
l Local Commands
n New Commands
By default, the man page in section 1 is displayed if multiple sections exist. You can access a
different section by specifying the section. For example:
man 8 telnetd
Keyword searching: use the -k option followed by the keyword. Two examples appear below.
man -k mail
man -k 'copy files'
The following example shows how command-line completion works in Bash. Other command line shells
may perform slightly differently.
fir
Then we press Tab ↹ and because the only command in our system that starts with "fir" is "firefox", it
will be completed to:
firefox
firefox i
But this time introduction-to-command-line-completion.html is not the only file in the current directory
that starts with "i". The directory also contains files introduction-to-bash.html and introduction-to-
firefox.html. The system can't decide which of these filenames we wanted to type, but it does know that
the file must begin with "introduction-to-", so the command will be completed to:
firefox introduction-to-
firefox introduction-to-c
firefox introduction-to-command-line-completion.html
In short we typed:
This is just eight keystrokes, which is considerably less than 52 keystrokes we would have needed to type
without using command-line completion.
Rotating completion
The following example shows how command-line completion works with rotating completion, such as
Windows's CMD uses.
firefox i
firefox introduction-to-bash.html
firefox introduction-to-command-line-completion.html
In short we typed:
echo command
echo “Your text goes here” > filename (To add text and create a new file)
echo “Additional text” >> filename (To append to an existing file)
cp command
cp exisiting-file new-filename (To copy an existing file to new file)
cat existing-file > new-filename (cat the content of an existing file and add to new file. This
command does the same as above)
vi command
vi filename (Create a new file and enter text using vi insert mode)
Pipes
A pipe is used by the shell to connect the stdout of one command directly to the stdin of another
command.
The symbol for a pipe is the vertical bar ( | ). The command syntax is:
Pipes accomplish with one command what otherwise would take intermediate files and multiple
commands. For example, operation 1 and operation 2 are equivalent:
Operation 1
who > temp
sort temp
Operation 2
who | sort
ls -al | more
who | more
ps ug | grep myuserid
who | grep kelly
File Maintenance Commands
cp
Copies files. Will overwrite unless otherwise specified. Must also have write permission in the
destination directory.
Example:
cp sample.f sample2.f - copies sample.f to sample2.f
cp -R dir1 dir2 - copies contents of directory dir1 to dir2
cp -i file.1 file.new - prompts if file.new will be overwritten
cp *.txt chapt1 - copies all files with .txt suffix to directory
chapt1
cp /usr/doc/README ~ - copies file to your home directory
cp ~betty/index . - copies the file "index" from user betty's
home directory to current directory
rm
Deletes/removes files or directories if file permissions permit
Example:
rm sample.f - deletes sample.f
rm chap?.txt - deletes all files with chap as the first four
characters of their name and with .txt as the last
four characters of their name
rm -i * - deletes all files in current directory but asks
first for each file
rm -r /olddir - recursively removes all files in the directory
olddir, including the directory itself
mv
Moves files. It will overwrite unless otherwise specified. Must also have write permission in the
destination directory.
Example:
mv sample.f sample2.f - moves sample.f to sample2.f
mv dir1 newdir/dir2 - moves contents of directory dir1 to
newdir/dir2
mv -i file.1 file.new - prompts if file.new will be overwritten
mv *.txt chapt1 - moves all files with .txt suffix to
directory chapt1
mkdir
Make directory. Will create the new directory in your working directory by default.
Example:
mkdir /u/training/data
mkdir data2
rmdir
Remove directory. Directories must be empty before you remove them.
rmdir project1
To recursively remove nested directories, use the rm command with the -r option:
rm -r dirctory_name
chgrp
Changes the group ownership of a file or directory.
Syntax
chgrp [ -f ] [ -h ] [-R ] Group { File ... | Directory ... }
chgrp -R [ -f ] [ -H | -L | -P ] Group { File... | Directory... }
Description
The chgrp command changes the group of the file or directory specified by the File or Directory parameter
to the group specified by the Group parameter. The value of the Group parameter can be a group name
from the group database or a numeric group ID. When a symbolic link is encountered and you have not
specified the -h or -P flags, the chgrp command changes the group ownership of the file or directory
pointed to by the link and not the group ownership of the link itself.
chown
The chown command is used to change the owner and group of files, directories and links. By default,
the owner of a filesystem object is the user that created it. The group is a set of users that share the same
access permissions (i.e., read, write and execute) for that object. The basic syntax for using chown to
change owners is
new_owner is the user name or the numeric user ID (UID) of the new owner, and object is the name of
the target file, directory or link. The ownership of any number of objects can be changed simultaneously.
For example, the following would transfer the ownership of a file named file1 and a directory named dir1
to a new owner named alice:
chown alice file1 dir1
In order to perform the above command, most systems are configured by default to require access to the
root (i.e., system administrator) account, which can be obtained on a personal computer by using the su
(i.e., substitute user) command. An error message will be returned in the event that the user does not
have the proper permissions or that the specified new owner or target(s) does not exist (or is spelled
incorrectly).
The ownership and group of a filesystem object can be confirmed by using the ls command with its -l (i.e.,
long) option. The owner is shown in the third column and the group in the fourth. Thus, for example, the
owner and group of file1 can be seen by using the following:
ls -l file1
or
The only difference between the two versions is that the name or numeric ID of the new group is
preceded directly by a colon in the former and by a dot in the latter; there is no functional difference. In
this case, chown performs the same function as the chgrp (i.e., change group) command.
The owner and group can be changed simultaneously by combining the syntaxes for changing owner and
group. That is, the name or UID of the new owner is followed directly (i.e., with no intervening spaces)
by a period or colon, which is followed directly by the name or numeric ID of the new group, which, in
turn, is followed by a space and then by the names of the target files, directories and/or links.
Thus, for example, the following would change the owner of a file named file2 to the user with the user
name bob and change its group to group2:
If a user name or UID is followed directly by a colon or dot but no group name is provided, then the
group is changed to that user's login group. Thus, for example, the following would change the
ownership of file3 to cathy and would also change that file's group to the login group of the new owner
(which by default is usually the same as the new owner):
chown cathy: file3
Among chown's few options is -R, which operates on filesystem objects recursively. That is, when used
on a directory, it can change the ownership and/or group of all objects within the directory tree beginning
with that directory rather than just the ownership of the directory itself.
The -v (verbose) option provides information about every object processed. The -c is similar, but reports
only when a change is made. The --help option displays the documentation found in the man online
manual, and the --version option outputs version information
chmod
Change access permissions, change mode.
Syntax
chmod [Options]... Mode [,Mode]... file...
chmod [Options]... Numeric_Mode file...
chmod [Options]... --reference=RFile file...
Options
-f, --silent, --quiet suppress most error messages
-v, --verbose output a diagnostic for every file processed
-c, --changes like verbose but report only when a change is made
--reference=RFile use RFile's mode instead of MODE values
-R, --recursive change files and directories recursively
--help display help and exit
--version output version information and exit
chmod changes the permissions of each given file according to mode, where mode describes the
permissions to modify. Mode can be specified with octal numbers or with letters. Using letters is easier to
understand for most people.
Permissions:
Numeric mode:
From one to four octal digits
Any omitted digits are assumed to be leading zeros.
The first digit = selects attributes for the set user ID (4) and set group ID (2) and save text image (1)S
The second digit = permissions for the user who owns the file: read (4), write (2), and execute (1)
The third digit = permissions for other users in the file's group: read (4), write (2), and execute (1)
The fourth digit = permissions for other users NOT in the file's group: read (4), write (2), and execute (1)
The octal (0-7) value is calculated by adding up the values for each digit
User (rwx) = 4+2+1 = 7
Group(rx) = 4+1 = 5
World (rx) = 4+1 = 5
chmode mode = 0755
Examples
chmod 400 file - Read by owner
chmod 040 file - Read by group
chmod 004 file - Read by world
Symbolic Mode
The format of a symbolic mode is a combination of the letters +-= rwxXstugoa
Multiple symbolic operations can be given, separated by commas.
The full syntax is [ugoa...][[+-=][rwxXstugo...]...][,...] but this is explained below.
A combination of the letters ugoa controls which users' access to the file will be changed:
User letter
The user who owns it u
Other users in the file's Group g
Other users not in the file's group o
All users a
If none of these are given, the effect is as if was given, but bits that are set in the umask are not affected.
All users a is effectively user + group + others
The operator '+' causes the permissions selected to be added to the existing permissions of each file; '-'
causes them to be removed; and '=' causes them to be the only permissions that the file has.
The letters 'rwxXstugo' select the new permissions for the affected users:
Permission letter
Read r
Write w
Execute (or access for directories) x
Execute only if the file is a directory
(or already has execute permission for some user) X
Set user or group ID on execution s
Save program text on swap device t
Examples
Deny execute permission to everyone:
chmod a-x file
Allow everyone to read, write, and execute the file and turn on the set group-ID:
chmod =rwx,g+s file
Notes:
When chmod is applied to a directory:
read = list files in the directory
write = add new files to the directory
execute = access files in the directory
chmod never changes the permissions of symbolic links. This is not a problem since the permissions of
symbolic links are never used. However, for each symbolic link listed on the command line, chmod
changes the permissions of the pointed-to file. In contrast, chmod ignores symbolic links encountered
during recursive directory traversals
Syntax
cat [options] [file]
Common Options
-n precede each line with a line number
-v display non-printing characters, except tabs, new-lines, and form-feeds
-e display $ at the end of each line (prior to new-line) (when used with -v option)
Examples
% cat filename
You can list a series of files on the command line, and cat will concatenate them, starting each in turn,
immediately after completing the previous one, e.g.:
% cat file1 file2 file3
Syntax
more [options] [+/pattern] [filename]
less [options] [+/pattern] [filename]
pg [options] [+/pattern] [filename]
Options
more less pg Action
-c -c -c clear display before displaying
-i ignore case
-w default default don’t exit at end of input, but prompt and wait
-lines -lines # of lines/screenful
+/pattern +/pattern +/pattern search for the pattern
Internal Controls
more displays (one screen at a time) the file requested
<space bar> to view next screen
<return> or <CR> to view one more line
q to quit viewing the file
h help
b go back up one screenful
/word search for word in the remainder of the file
See the man page for additional options
less similar to more; see the man page for options
pg the SVR4 equivalent of more (page)
-------------------------------------------------------------------------------
Syntax
echo [string]
Common Options
-n don’t print <new-line> (BSD, shell built-in)
\c don’t print <new-line> (SVR4)
\0n where n is the 8-bit ASCII character code (SVR4)
\t tab (SVR4)
\f form-feed (SVR4)
\n new-line (SVR4)
\v vertical tab (SVR4)
Examples
% echo Hello Class or echo "Hello Class"
To prevent the line feed:
% echo -n Hello Class or echo "Hello Class \c"
where the style to use in the last example depends on the echo command in use.
The \x options must be within pairs of single or double quotes, with or without other string characters.
-------------------------------------------------------------------------------
Syntax
head [options] file
Common Options
-n number number of lines to display, counting from the top of the file
-number same as above
Examples
By default head displays the first 10 lines. You can display more with the "-n number", or
"-number" options, e.g., to display the first 40 lines:
% head -40 filename or head -n 40 filename
-------------------------------------------------------------------------------
more
Browses/displays files one screen at a time.
Example:
more sample.f
-------------------------------------------------------------------------------
Syntax
tail [options] file
Common Options
-number number of lines to display, counting from the bottom of the file
Examples
The default is to display the last 10 lines, but you can specify different line or byte numbers, or a
different starting point within the file. To display the last 30 lines of a file use the -number style:
% tail -30 filename
Filter / Text Processing Commands
grep
The grep utility is used to search for generalized regular expressions occurring in Linux files. Regular
expressions, such as those shown above, are best specified in apostrophes (or single quotes) when
specified in the grep utility. The egrep utility provides searching capability using an extended set of
meta-characters. The syntax of the grep utility, some of the available options, and a few examples are
shown below.
Syntax
grep [options] regexp [file[s]]
Common Options
-i ignore case
-c report only a count of the number of lines containing matches, not the matches
themselves
-v invert the search, displaying only lines that do not match
-n display the line number along with the line on which a match was found
-s work silently, reporting only the final status:
0, for match(es) found
1, for no matches
2, for errors
-l list filenames, but not lines, in which matches were found
Examples
Consider the following file:
cat num.list
1 15 fifteen
2 14 fourteen
3 13 thirteen
4 12 twelve
5 11 eleven
6 10 ten
8 8 eight
9 7 seven
10 6 six
11 5 five
14 2 two
15 1 one
Here are some grep examples using this file. In the first we’ll search for the number 15:
> grep '15' num.list
1 15 fifteen
15 1 one
Now we’ll use the "-c" option to count the number of lines matching the search criterion:
> grep -c '15' num.list
2
Here we’ll be a little more general in our search, selecting for all lines containing the character 1
followed by either of 1, 2 or 5:
> grep '1[125]' num.list
1 15 fifteen
4 12 twelve
5 11 eleven
11 5 five
12 4 four
15 1 one
Now we’ll search for all lines that begin with a space:
> grep '^ ' num.list
1 15 fifteen
2 14 fourteen
3 13 thirteen
4 12 twelve
5 11 eleven
6 10 ten
7 9 nine
8 8 eight
9 7 seven
The latter could also be done by using the -v option with the original search string, e.g.:
> grep -v '^ ' num.list
10 6 six
11 5 five
12 4 four
13 3 three
14 2 two
15 1 one
Here we search for all lines that begin with the characters 1 through 9:
> grep '^[1-9]' num.list
10 6 six
11 5 five
12 4 four
13 3 three
14 2 two
15 1 one
This example will search for any instances of t followed by zero or more occurrences of e:
> grep 'te*' num.list
1 15 fifteen
2 14 fourteen
3 13 thirteen
4 12 twelve
6 10 ten
8 8 eight
13 3 three
14 2 two
This example will search for any instances of t followed by one or more occurrences of e:
> grep 'tee*' num.list
1 15 fifteen
2 14 fourteen
3 13 thirteen
6 10 ten
We can also take our input from a program, rather than a file. Here we report on any lines output by
the who program that begin with the letter l.
> who | grep '^l'
lcondron ttyp0 Dec 1 02:41 (lcondron-pc.acs.)
sed
The non-interactive, stream editor, sed, edits the input stream, line by line, making the specified
changes, and sends the result to standard output.
Syntax
sed [options] edit_command [file]
The format for the editing commands are:
[address1[,address2]][function][arguments]
where the addresses are optional and can be separated from the function by spaces or tabs. The
function is required. The arguments may be optional or required, depending on the function in use.
Line-number Addresses are decimal line numbers, starting from the first input line and incremented
by one for each. If multiple input files are given the counter continues cumulatively through the files.
The last input line can be specified with the "$" character.
Context Addresses are the regular expression patterns enclosed in slashes (/).
and should be quoted with single quotes (’) if additional options or functions are specified. These
patterns are identical to context addresses, except that while they are normally enclosed in slashes (/),
any normal character is allowed to function as the delimiter, other than <space> and <newline>.
The replacement string is not a regular expression pattern; characters do not have special meanings
here, except:
These special characters can be escaped with a backslash (\) to remove their special meaning
Common Options
-e script edit script
-n don’t print the default output, but only those lines specified by p or s///p functions
-f script_file take the edit scripts from the file, script_file
Examples
This example changes all incidents of a comma (,) into a comma followed by a space (, ) when doing
output:
% cat filey | sed s/,/,\ /g
The following example removes all incidents of Jr preceded by a space ( Jr) in filey:
% cat filey | sed s/\ Jr//g
To perform multiple operations on the input precede each operation with the -e (edit) option and
quote the strings. For example, to filter for lines containing "Date: " and "From: " and replace these
without the colon (:), try:
sed -e ’s/Date: /Date /’ -e ’s/From: /From /’
To print only those lines of the file from the one beginning with "Date:" up to, and including, the one
beginning with "Name:" try:
sed -n ’/^Date:/,/^Name:/p’
To print only the first 10 lines of the input (a replacement for head):
sed -n 1,10p
awk searches its input for patterns and performs the specified operation on each line, or fields of the
line, that contain those patterns. You can specify the pattern matching statements for awk either on
the command line, or by putting them in a file and using the -f program_file option.
Syntax
awk program [file]
where program is composed of one or more:
pattern { action }
fields. Each input line is checked for a pattern match with the indicated action being taken on a
match. This continues through the full sequence of patterns, then the next line of input is checked.
Input is divided into records and fields. The default record separator is <newline>, and the variable
NR keeps the record count. The default field separator is whitespace, spaces and tabs, and the
variable NF keeps the field count. Input field, FS, and record, RS, separators can be set at any time to
match any single character. Output field, OFS, and record, ORS, separators can also be changed to
any single character, as desired. $n, where n is an integer, is used to represent the nth field of the
input record, while $0 represents the entire input record.
BEGIN and END are special patterns matching the beginning of input, before the first field is read,
and the end of input, after the last field is read, respectively.
Printing is allowed through the print, and formatted print, printf, statements.
Comma separated patterns define the range for which the pattern is applicable, e.g.:
/first/,/last/
selects all lines starting with the one containing first, and continuing inclusively, through the one
containing last.
Regular expressions must be enclosed with slashes (/) and meta-characters can be escaped with the
backslash (\). Regular expressions can be grouped with the operators:
| or, to separate alternatives
+ one or more
? zero or one
So the program:
$1 ~ /[Ff]rank/
is true if the first field, $1, contains "Frank" or "frank" anywhere within the field. To match a field
identical to "Frank" or "frank" use:
$1 ~ /^[Ff]rank$/
Offhand you don’t know if variables are strings or numbers. If neither operand is known to be
numeric, than string comparisons are performed. Otherwise, a numeric comparison is done. In the
absence of any information to the contrary, a string comparison is done, so that:
$1 > $2
will compare the string values. To ensure a numerical comparison do something similar to:
( $1 + 0 ) > $2
The mathematical functions: exp, log and sqrt are built-in
Flow control statements using if-else, while, and for are allowed with C type syntax:
for (i=1; i <= NF; i++) {actions}
while (i<=NF) {actions}
if (i<NF) {actions}
Common Options
-f program_file read the commands from program_file
-Fc use character c as the field separator character
Examples
% cat filex | tr a-z A-Z | awk -F: '{printf ("7R %-6s %-9s %-24s \n",$1,$2,$3)}'>upload.file
The cut command allows a portion of a file to be extracted for another use.
Syntax
Common Options
-c character_list character positions to select (first character is 1)
-d delimiter field delimiter (defaults to <TAB>)
-f field_list fields to select (first field is 1)
Both the character and field lists may contain comma-separated or blank-character-separated
numbers (in increasing order), and may contain a hyphen (-) to indicate a range. Any numbers
missing at either before (e.g. -5) or after (e.g. 5-) the hyphen indicates the full range starting with the first,
or ending with the last character or field, respectively. Blank-character-separated lists must be enclosed in
quotes. The field delimiter should be enclosed in quotes if it has special meaning to the shell, e.g. when
specifying a <space> or <TAB> character.
Examples
In these examples we will use the file users:
If you only wanted the username and the user's real name, the cut command could be used to get only
that information:
The cut command can also be used with other options. The -c option allows characters to be the
selected cut. To select the first 4 characters:
The paste command allows two files to be combined side-by-side. The default delimiter between the
columns in a paste is a tab, but options allow other delimiters to be used.
Syntax
paste [options] file1 file2
Common Options
-d list list of delimiting characters
-s concatenate lines
The list of delimiters may include a single character such as a comma; a quoted string, such as a
space; or any of the following escape sequences:
\n <newline> character
\t <tab> character
\\ backslash character
\0 empty string (non-null character)
Examples
Given the file users:
jdoe John Doe 4/15/96
lsmith Laura Smith 3/12/96
pchen Paul Chen 1/5/96
jhsu Jake Hsu 4/17/96
sphilip Sue Phillip 4/2/96
and the file phone:
John Doe 555-6634
Laura Smith 555-3382
Paul Chen 555-0987
Jake Hsu 555-1235
Sue Phillip 555-7623
the paste command can be used in conjunction with the cut command to create a new file, listing, that
includes the username, real name, last login, and phone number of all the users. First, extract the phone
numbers into a temporary file, temp.file:
% cut -f2 phone > temp.file
555-6634
555-3382
555-0987
555-1235
555-7623
The result can then be pasted to the end of each line in users and directed to the new file, listing:
% paste users temp.file > listing
jdoe John Doe 4/15/96 237-6634
lsmith Laura Smith 3/12/96 878-3382
pchen Paul Chen 1/5/96 888-0987
jhsu Jake Hsu 4/17/96 545-1235
sphilip Sue Phillip 4/2/96 656-7623
This could also have been done on one line without the temporary file as:
% cut -f2 phone | paste users - > listing
with the same results. In this case the hyphen (-) is acting as a placeholder for an input field (namely,
the output of the cut command).
The sort command is used to order the lines of a file. Various options can be used to choose the order as
well as the field on which a file is sorted. Without any options, the sort compares entire lines in the file
and outputs them in ASCII order (numbers first, upper case letters, then lower case letters).
Syntax
sort [options] [+pos1 [ -pos2 ]] file
Common Options
-b ignore leading blanks (<space> & <tab>) when determining starting and
ending characters for the sort key
-d dictionary order, only letters, digits, <space> and <tab> are significant
-f fold upper case to lower case
-k keydef sort on the defined keys (not available on all systems)
-i ignore non-printable characters
-n numeric sort
-o outfile output file
-r reverse the sort
-t char use char as the field separator character
-u unique; omit multiple copies of the same line (after the sort)
+pos1 [-pos2] (old style) provides functionality similar to the "-k keydef" option.
For the +/-position entries pos1 is the starting word number, beginning with 0 and pos2 is the ending
word number. When -pos2 is omitted the sort field continues through the end of the line. Both pos1 and
pos2 can be written in the form w.c, where w is the word number and c is the character within the word.
For c 0 specifies the delimiter preceding the first character, and 1 is the first character of the word. These
entries can be followed by type modifiers, e.g. n for numeric, b to skip blanks, etc.
where:
start_field, end_field define the keys to restrict the sort to a portion of the line
type modifies the sort, valid modifiers are given the single characters (bdfiMnr)
from the similar sort options, e.g. a type b is equivalent to "-b", but applies
only to the specified field
Examples
In the file users:
jdoe John Doe 4/15/96
lsmith Laura Smith 3/12/96
pchen Paul Chen 1/5/96
jhsu Jake Hsu 4/17/96
sphilip Sue Phillip 4/2/96
sort users yields the following:
jdoe John Doe 4/15/96
jhsu Jake Hsu 4/17/96
lsmith Laura Smith 3/12/96
pchen Paul Chen 1/5/96
sphilip Sue Phillip 4/2/96
If, however, a listing sorted by last name is desired, use the option to specify which field to sort on (fields
are numbered starting at 0):
% sort +2 users:
pchen Paul Chen 1/5/96
jdoe John Doe 4/15/96
jhsu Jake Hsu 4/17/96
sphilip Sue Phillip 4/2/96
lsmith Laura Smith 3/12/96
A particularly useful sort option is the -u option, which eliminates any duplicate entries in a file while
ordering the file. For example, the file todays.logins:
sphillip
jchen
jdoe
lkeres
jmarsch
ageorge
lkeres
proy
jchen
shows a listing of each username that logged into the system today. If we want to know how many
unique users logged into the system today, using sort with the -u option will list each user only once.
(The command can then be piped into "wc -l" to get a number):
% sort -u todays.logins
ageorge
jchen
jdoe
jmarsch
lkeres
proy
sphillip
Syntax
uniq [options] [+|-n] file [file.new]
Common Options
-d one copy of only the repeated lines
-u select only the lines not repeated
+n ignore the first n characters
-s n same as above (SVR4 only)
-n skip the first n fields, including any blanks (<space> & <tab>)
-f fields same as above (SVR4 only)
Examples
Consider the following file and example, in which uniq removes the 4th line from file and places the
result in a file called file.new.
$ cat file
1 2 3 6
4 5 3 6
7 8 9 0
7 8 9 0
$ cat file.new
1 2 3 6
4 5 3 6
7 8 9 0
Below, the -n option of the uniq command is used to skip the first 2 fields in file, and filter out lines
which are duplicates from the 3rd field onward.
$ uniq -2 file
1 2 3 6
7 8 9 0
Syntax
tee [options] [file[s]]
Common Options
-a append the output to the files
-i ignore interrupts
Examples
In this first example the output of who is displayed on the screen and stored in the file users.file:
> who | tee users.file
condron ttyp0 Apr 22 14:10 (lcondron-pc.acs.)
frank ttyp1 Apr 22 16:19 (nyssa)
condron ttyp9 Apr 22 15:52 (lcondron-mac.acs)
In this next example the output of who is sent to the files users.a and users.b. It is also piped to the
wc command, which reports the line count.
> who | tee users.a users.b | wc -l
3
In the following example a long directory listing is sent to the file files.long. It is also piped to the
grep command which reports which files were last modified in August.
> ls -l | tee files.long |grep Aug
1 drwxr-sr-x 2 condron 512 Aug 8 1995 News/
2 -rw-r--r-- 1 condron 1076 Aug 8 1995 magnus.cshrc
2 -rw-r--r-- 1 condron 1252 Aug 8 1995 magnus.login
uname –a
cat /etc/redhat-release
dmidecode
uname:
Sometimes it is required to quickly determine details like kernel name, version, hostname, etc of the
Linux box you are using.
Even though you can find all these details in respective files present under the proc filesystem, it is easier
to use uname utility to get these information quickly.
uname [OPTION]...
Now lets look at some examples that demonstrate the usage of ‘uname’ command.
uname without any option
When the ‘uname’ command is run without any option then it prints just the kernel name. So the output
below shows that its the ‘Linux’ kernel that is used by this system.
$ uname
Linux
You can also use uname -s, which also displays the kernel name.
$ uname -s
Linux
Use uname -n option to fetch the network node host name of your Linux box.
$ uname -n
dev-server
The output above will be the same as the output of the hostname command.
Get kernel release using -r option
uname command can also be used to fetch the kernel release information. The option -r can be used for
this purpose.
$ uname -r
2.6.32-100.28.5.el6.x86_64
uname command can also be used to fetch the kernel version information. The option -v can be used for
this purpose.
$ uname -v
#1 SMP Wed Feb 2 18:40:23 EST 2011
uname command can also be used to fetch the machine hardware name. The option -m can be used for
this purpose. This indicates that it is a 64-bit system.
$ uname -m
x86_64
uname command can also be used to fetch the processor type information. The option -p can be used for
this purpose. If the uname command is not able to fetch the processor type information then it produces
‘unknown’ in the output.
$ uname -p
x86_64
Sometimes you might see ‘unknown’ as the output of this command, if uname was not able to fetch the
information on processor type.
Get the hardware platform using -i option
uname command can also be used to fetch the hardware platform information. The option -i can be used
for this purpose. If the uname command is not able to fetch the hardware platform information then it
produces ‘unknown’ in the output.
$ uname -i
x86_64
Sometimes you might see ‘unknown’ as the output of this command, if uname was not able to fetch the
information about the platform.
Get the operating system name using the -o option
uname command can also be used to fetch the operating system name. The option -o can be used for this
purpose.
For example :
$ uname -o
GNU/Linux
cat /etc/redhat-release:
This file provides information about your system distribution and its version
You can also run /etc/*rel* for systems that are not on CentOS or Redhat
Dmidecode:
dmidecode is a tool for dumping a computer's DMI (some say SMBIOS) table contents in a human-
readable format. This table contains a description of the system's hardware components, as well as other
useful pieces of information such as serial numbers and BIOS revision. Thanks to this table, you can
retrieve this information without having to probe for the actual hardware.
Take a look at
man dmidecode
to find out all options. The most common option is the --type switch which takes one or more of the
following keywords:
Type Information
----------------------------------------
0 BIOS
1 System
2 Base Board
3 Chassis
4 Processor
5 Memory Controller
6 Memory Module
7 Cache
8 Port Connector
9 System Slots
10 On Board Devices
11 OEM Strings
12 System Configuration Options
13 BIOS Language
14 Group Associations
15 System Event Log
16 Physical Memory Array
17 Memory Device
18 32-bit Memory Error
19 Memory Array Mapped Address
20 Memory Device Mapped Address
21 Built-in Pointing Device
22 Portable Battery
23 System Reset
24 Hardware Security
25 System Power Controls
26 Voltage Probe
27 Cooling Device
28 Temperature Probe
29 Electrical Current Probe
30 Out-of-band Remote Access
31 Boot Integrity Services
32 System Boot
33 64-bit Memory Error
34 Management Device
35 Management Device Component
36 Management Device Threshold Data
37 Memory Channel
38 IPMI Device
39 Power Supply
Keyword Types
------------------------------
bios 0, 13
system 1, 12, 15, 23, 32
baseboard 2, 10
chassis 3
processor 4
memory 5, 6, 16, 17
cache 7
connector 8
slot 9
server1:/home/admin#
server1:/home/admin#
server1:/home/admin#
server1:/home/admin#
server1:/home/admin#
server1:/home/admin#
server1:/home/admin#
server1:/home/admin#
dmidecode --type slot
Permissions
Permissions on Unix and other systems like it are split into three classes:
User
Group
Other
If a user is not the owner, nor a member of the group, then they are classified as other.
Changing permissions
In order to change permissions, we need to first understand the two notations of permissions.
1. Symbolic notation
2. Octal notation
Symbolic notation
Symbolic notation is what you'd see on the left-hand side if you ran a command like ls -l in a terminal.
The first character in symbolic notation indicates the file type and isn't related to permissions in any way. The
remaining characters are in sets of three, each representing a class of permissions.
The first class is the user class. The second class is the group class. The third class is the other class.
Each of the three characters for a class represents the read, write and execute permissions.
Octal notation
Octal (base-8) notation consists of at least 3 digits (sometimes 4, the left-most digit, which represents the setuid
bit, the setgid bit, and the sticky bit).
Each of the three right-most digits are the sum of its component bits in the binary numeral system.
For example:
So what number would you use if you wanted to set a permission to read and write? 4 + 2 = 6.
Symbolic
Octal notation Plain English
notation
-rwxr--r-- 0744 user class can read/write/execute; group class can read; other class can read
-rw-rw-r-- 0664 user class can read/write; group class can read/write; other class can read
Let's use the examples from the symbolic notation section and show how it'd convert to octal notation
CHMOD commands
Now that we have a better understanding of permissions and what all of these letters and numbers mean, let's take
Permission
(symbolic CHMOD command Description
nocation)
-rwxrwxrwx chmod 0777 filename; chmod -R 0777 dir All classes can read/write/execute
-rw-r--r-- chmod 0644 filename; chmod -R 0644 dir user class can read/write; all others can read
-rw-rw-rw- chmod 0666 filename' chmod -R 0666 dir All classes can read/write
a look at how we can use the chmod command in our terminal to change permissions to anything we'd like!
These are just some examples. Using your new-found knowledge, you can set any permissions you'd like! Just be
careful and make sure you don't break your system.
Access Control Lists(ACL) in Linux
What is ACL ?
Access control list (ACL) provides an additional, more flexible permission mechanism for file systems. It
is designed to assist with UNIX file permissions. ACL allows you to give permissions for any user or
group to any disc resource
Use of ACL :
Think of a scenario in which a particular user is not a member of group created by you but still you
want to give some read or write access, how can you do it without making user a member of group,
here comes in picture Access Control Lists, ACL helps us to do this trick.
setfacl and getfacl are used for setting up ACL and showing ACL respectively.
For example :
getfacl test/seinfeld.txt
Output:
# file: test/seinfeld.txt
# owner: iafzal
# group: iafzal
user::rw-
group::rw-
other::r--
3) To allow all files or directories to inherit ACL entries from the directory it is within
setfacl -dm "entry" /path/to/dir
To add permissions for a group (group is either the group name or ID):
# setfacl -m "g:group:permissions"
To allow all files or directories to inherit ACL entries from the directory it is within:
# setfacl -dm "entry"
Example :
View ACL :
To show permissions :
# getfacl filename
Observe the difference between output of getfacl command before and after setting up ACL permissions
using setfacl command.
Remove ACL :
If you want to remove the set ACL permissions, use setfacl command with -b option.
For example :
You can also check if there are any extra permissions set through ACL using ls command.
Observe the first command output in image, there is extra “+” sign after the permissions like -rw-rwxr–
+, this indicates there are extra ACL permissions set which you can check by getfacl command
vi Commands
Entering vi
Exiting vi
By character
left arrow - left one character
right arrow - right one character
backspace - left one character
space - right one character
h - left one character
l - right one character
By word
w - beginning of next word
nw - beginning of nth next word
b - back to previous word
nb - back to nth previous word
e - end of next word
ne - end of nth next word
By line
down arrow - down one line
up arrow - up one line
j - down one line
k - up one line
+ - beginning of next line down
- - beginning of previous line up
0 - first column of current line (zero)
^ - first character of current line
$ - last character of current line
By block
( - beginning of sentence
) - end of sentence
{ - beginning of paragraph
} - end of paragraph
By screen
CTRL-f - forward 1 screen
CTRL-b - backward 1 screen
CTRL-d - down 1/2 screen
CTRL-u - up 1/2 screen
H - top line on screen
M - mid-screen
L - last line on screen
Within file
nG - line n within file
1G - first line in file
G - last line in file
Inserting text
Deleting text
Changing text
Searching / Substituting
Miscellaneous commands
--------------------------------------------------------------------------------
vi Options
You can change the way vi operates by changing the value of certain options which control
specific parts of the vi environment.
To set an option during a vi session, use one of the commands below as required by the option:
:set option_name
:set option_name=value
Options can be set permanently by putting them in a file called .exrc in your home directory. A
sample .exrc file appears below. Note that you do not need the colon (:) as part of the option
specification when you put the commands in a .exrc file. Also note that you can put them all on
one line.
useradd
To create a new user in Linux. A different options can be used to modify userId, home directory
etc.
userdel
This command is used to delete the user. Please note this command alone will not delete the user
home directory. You will have to use option –r to delete user home directory
groupadd
Creates a new group
groupdel
Removes an existing group
usermod
Modify user attributes such as user home directory, user group, user ID etc.
User Files
/etc/passwd = This file has all user’s attributes
/etc/shadow = This file contains encrypted user password and password policy
/etc/group = All group and user group information
Creating User Accounts in Linux:
When we run ‘useradd‘ command in Linux terminal, it performs following major things:
It edits /etc/passwd, /etc/shadow, /etc/group and /etc/gshadow files for the newly created User account.
Creates and populate a home directory for the new user.
Sets permissions and ownerships to home directory.
In this article we will show you the most used 15 useradd commands with their practical examples in
Linux. We have divided the section into two parts from Basic to Advance usage of command.
To add/create a new user, all you’ve to follow the command ‘useradd‘ or ‘adduser‘ with ‘username’. The
‘username’ is a user login name, that is used by user to login into the system.
Only one user can be added and that username must be unique (different from other username already
exists on the system).
For example, to add a new user called ‘solider‘, use the following command.
When we add a new user in Linux with ‘useradd‘ command it gets created in locked state and to unlock
that user account, we need to set a password for that account with ‘passwd‘ command.
solider:x:504:504:solider:/home/solider:/bin/bash
The above entry contains a set of seven colon-separated fields, each field has it’s own meaning. Let’s see
what are these fields:
Username: User login name used to login into system. It should be between 1 to 32 charcters long.
Password: User password (or x character) stored in /etc/shadow file in encrypted format.
User ID (UID): Every user must have a User ID (UID) User Identification Number. By default UID 0 is
reserved for root user and UID’s ranging from 1-99 are reserved for other predefined accounts. Further
UID’s ranging from 100-999 are reserved for system accounts and groups.
Group ID (GID): The primary Group ID (GID) Group Identification Number stored in /etc/group file.
User Info: This field is optional and allow you to define extra information about the user. For example,
user full name. This field is filled by ‘finger’ command.
Home Directory: The absolute location of user’s home directory.
Shell: The absolute location of a user’s shell i.e. /bin/bash.
By default ‘useradd‘ command creates a user’s home directory under /home directory with username.
Thus, for example, we’ve seen above the default home directory for the user ‘solider‘ is ‘/home/solider‘.
However, this action can be changed by using ‘-d‘ option along with the location of new home directory
(i.e. /home/newusers). For example, the following command will create a user ‘solider‘ with a home
directory ‘/home/newusers‘.
You can see the user home directory and other user related information like user id, group id, shell and
comments.
In Linux, every user has its own UID (Unique Identification Number). By default, whenever we create a
new user accounts in Linux, it assigns userid 500, 501, 502 and so on…
But, we can create user’s with custom userid with ‘-u‘ option. For example, the following command will
create a user ‘navin‘ with custom userid ‘999‘.
Now, let’s verify that the user created with a defined userid (999) using following command.
NOTE: Make sure the value of a user ID must be unique from any other already created users on the
system.
4. Create a User with Specific Group ID
Similarly, every user has its own GID (Group Identification Number). We can create users with specific
group ID’s as well with -g option.
Here in this example, we will add a user ‘tarunika‘ with a specific UID and GID simultaneously with the
help of ‘-u‘ and ‘-g‘ options.
The ‘-G‘ option is used to add a user to additional groups. Each group name is separated by a comma,
with no intervening spaces.
Here in this example, we are adding a user ‘solider‘ into multiple groups like admins, webadmin and
developer.
Next, verify that the multiple groups assigned to the user with id command.
In some situations, where we don’t want to assign a home directories for a user’s, due to some security
reasons. In such situation, when a user logs into a system that has just restarted, its home directory will
be root. When such user uses su command, its login directory will be the previous user home directory.
To create user’s without their home directories, ‘-M‘ is used. For example, the following command will
create a user ‘shilpi‘ without a home directory.
Now, let’s verify that the user is created without home directory, using ls command.
By default, when we add user’s with ‘useradd‘ command user account never get expires i.e their expiry
date is set to 0 (means never expired).
However, we can set the expiry date using ‘-e‘ option, that sets date in YYYY-MM-DD format. This is
helpful for creating temporary accounts for a specific period of time.
Here in this example, we create a user ‘aparna‘ with account expiry date i.e. 27th April 2014 in YYYY-
MM-DD format.
Next, verify the age of account and password with ‘chage‘ command for user ‘aparna‘ after setting
account expiry date.
Here in this example, we will set a account password expiry date i.e. 45 days on a user ‘solider’ using ‘-e‘
and ‘-f‘ options.
The ‘-c‘ option allows you to add custom comments, such as user’s full name, phone number, etc to
/etc/passwd file. The comment can be added as a single line without any spaces.
For example, the following command will add a user ‘mansi‘ and would insert that user’s full name,
Manis Khurana, into the comment field.
Sometimes, we add users which has nothing to do with login shell or sometimes we require to assign
different shells to our users. We can assign different login shells to a each user with ‘-s‘ option.
Here in this example, will add a user ‘solider‘ without login shell i.e. ‘/sbin/nologin‘ shell.
The following command will create a user ‘ravi‘ with home directory ‘/var/www/solider‘, default shell
/bin/bash and adds extra information about user.
[root@localhost ~]# useradd -m -d /var/www/ravi -s /bin/bash -c "Solider Owner" -U ravi
In the above command ‘-m -d‘ option creates a user with specified home directory and the ‘-s‘ option set
the user’s default shell i.e. /bin/bash. The ‘-c‘ option adds the extra information about user and ‘-U‘
argument create/adds a group with the same name as the user.
12. Add a User with Home Directory, Custom Shell, Custom Comment and UID/GID
The command is very similar to above, but here we defining shell as ‘/bin/zsh‘ and custom UID and GID
to a user ‘tarunika‘. Where ‘-u‘ defines new user’s UID (i.e. 1000) and whereas ‘-g‘ defines GID (i.e. 1000).
13. Add a User with Home Directory, No Shell, Custom Comment and User ID
The following command is very much similar to above two commands, the only difference is here, that
we disabling login shell to a user called ‘avishek‘ with custom User ID (i.e. 1019).
Here ‘-s‘ option adds the default shell /bin/bash, but in this case we set login to ‘/usr/sbin/nologin‘. That
means user ‘avishek‘ will not able to login into the system.
14. Add a User with Home Directory, Shell, Custom Skell/Comment and User ID
The only change in this command is, we used ‘-k‘ option to set custom skeleton directory i.e.
/etc/custom.skell, not the default one /etc/skel. We also used ‘-s‘ option to define different shell i.e.
/bin/tcsh to user ‘navin‘.
15. Add a User without Home Directory, No Shell, No Group and Custom Comment
This following command is very different than the other commands explained above. Here we used ‘-M‘
option to create user without user’s home directory and ‘-N‘ argument is used that tells the system to
only create username (without group). The ‘-r‘ arguments is for creating a system user.
For more information and options about useradd, run ‘useradd‘ command on the terminal to see
available options.
Read Also: 15 usermod Command Examples
Share
+
0
0
0
Ask Anything
If You Appreciate What We Do Here On Solider, You Should Consider:
Ravi Saive
I am Ravi Saive, creator of Solider. A Computer Geek and Linux Guru who loves to share tricks and tips
on Internet. Most Of My Servers runs on Open Source Platform called Linux. Follow Me: Twitter,
Facebook and Google+
Your name can also be listed here. Got a tip? Submit it here to become an Solider author.
RedHat RHCE and RHCSA Certification Book
Linux Foundation LFCS and LFCE Certification Preparation Guide
Next story
Fun in Linux Terminal – Play with Word and Character Counts
Previous story
nSnake: A Clone of Old Classic Snake Game – Play in Linux Terminal
17 Jan, 2017
Display Command File Contents in Column Format
0
Display Command Output or File Contents in Column Format
6 Feb, 2018
Convert RPM to DEB and DEB to RPM
8
How to Convert From RPM to DEB and DEB to RPM Package Using Alien
26 Aug, 2015
88 Responses
Comments4
Pingbacks0
Decontee K Sawyer
October 26, 2017 at 6:29 pm
Hi Ravi. Your suggestion to go directly to the source documentation to understand the requirements
and details is an exceedingly excellent one. You have obviously done so, and translated the English it is
written in, into whatever your native language is. A link to your interpretation, in your native language
would be more helpful than the confusing broken English found here.
Reply
Anuj
October 16, 2017 at 4:01 pm
Hi Ravi,
I have one problem, from client side I have a request to add a new user with username having space, I
mean username of two words.
For example,
Reply
Ravi Saive
October 25, 2017 at 11:52 am
@Anuj,
Hi Ravi, I have a question, If use: su “user” type the password and the system say: su: System Error,
why is this message?
Reply
« Older Comments
Got something to say? Join the discussion.
Comment
Name *
Email *
Website
Notify me of followup comments via e-mail. You can also subscribe without commenting.
Switch Users and Sudo Access:
Switch Users:
Following is the user switch command that can be used to switch from one user to another
su - username
su - invokes a login shell after switching the user. A login shell resets most environment variables,
providing a clean base.
su username
just switches the user, providing a normal shell with an environment nearly the same as with the old user
Sudo Access:
sudo command-name
The above command “sudo command-name” will run any command owned and authorized by root account
as long as that user is authorized to run it in /etc/sudoers file
# useradd USERNAME
3. Set a password for the new user using the passwd command.
4. # passwd USERNAME
5. Changing password for user USERNAME.
6. New password:
7. Retype new password:
passwd: all authentication tokens updated successfully.
8. Run the visudo to edit the /etc/sudoers file. This file defines the policies applied by
the sudo command.
# visudo
9. Find the lines in the file that grant sudo access to users in the group wheel when enabled.
10. ## Allows people in group wheel to run all commands
# %wheel ALL=(ALL) ALL
11. Remove the comment character (#) at the start of the second line. This enables the
configuration option.
12. Save your changes and exit the editor.
13. Add the user you created to the wheel group using the usermod command.
# usermod -aG wheel USERNAME
14. Test that the updated configuration allows the user you created to run commands using
sudo.
1. Use the su to switch to the new user account that you created.
# su USERNAME -
2. Use the groups to verify that the user is in the wheel group.
3. $ groups
USERNAME wheel
4. Use the sudo command to run the whoami command. As this is the first time you
have run a command using sudo from this user account the banner message will
be displayed. You will be also be prompted to enter the password for the user
account.
5. $ sudo whoami
6. We trust you have received the usual lecture from the local
System
7. Administrator. It usually boils down to these three things:
8.
9. #1) Respect the privacy of others.
10. #2) Think before you type.
11. #3) With great power comes great responsibility.
12.
13. [sudo] password for USERNAME:
root
The last line of the output is the user name returned by the whoami command. If
sudo is configured correctly this value will be root.
You have successfully configured a user with sudo access. You can now log in to this user
account and use sudo to run commands as if you were logged in to the account of the root user.
Linux Editors
who
last
w
id
who
As a Linux user, sometimes it is required to know some basic information like :
Though this type of information can be obtained from various files in the Linux system but there
is a command line utility 'who' that does exactly the same for you. In this article, we will discuss
the capabilities and features provided by the 'who' command.
This is done by simply running the 'who' command (without any options). Consider the
following example:
$ who
iafzal tty7 2012-08-07 05:33 (:0)
iafzal pts/0 2012-08-07 06:47 (:0.0)
iafzal pts/1 2012-08-07 07:58 (:0.0)
last command:
To find out when a particular user last logged in to the Linux or Unix server.
Syntax
last
last [userNameHere]
last [tty]
last [options] [userNameHere]
If no options provided last command displays a list of all users logged in (and out). You can
filter out results by supplying names of users or terminal to show only those entries matching the
username/tty.
To find out who has recently logged in and out on your server, type:
$ last
Sample outputs:
last command searches back through the file /var/log/wtmp file and the output may go back to
several months. Just use the less command or more command as follows to display output one
screen at a time:
$ last | more
last | less
Sample outputs:
Hide hostnames (Linux only)
By default year is now displayed by last command. You can force last command to display full
login and logout times and dates by passing -F option:
$ last -F
Sample outputs:
Display full user/domain names
$ last -w
The user reboot logs in each time the system is rebooted. Thus following command will show a
log of all reboots since the log file was created:
$ last reboot
$ last -x reboot
Find out the system shutdown entries and run level changes:
$ last -x
$ last -x shutdown
The syntax is as follows to see the state of logins as of the specified time:
$ last -t YYYYMMDDHHMMSS
$ last -t YYYYMMDDHHMMSS userNameHere
w command:
Options:
-h, --no-header do not print header
-u, --no-current ignore current process username
-s, --short short format
-f, --from show remote hostname field
-o, --old-style old style output
-i, --ip-addr display IP address instead of hostname (if possible)
id command:
Print user and group information for the specified USER,
or (when USER omitted) for the current user.
-a ignore, for compatibility with other versions
-Z, --context print only the security context of the current user
-g, --group print only the effective group ID
-G, --groups print all group IDs
-n, --name print a name instead of a number, for -ugG
-r, --real print the real ID instead of the effective ID, with -ugG
-u, --user print only the effective user ID
-z, --zero delimit entries with NUL characters, not whitespace;
not permitted in default format
--help display this help and exit
--version output version information and exit
System Utility Commands:
date
uptime
hostname
uname
which
cal
bc
date
Print or set the system date and time
Mandatory arguments to long options are mandatory for short options too.
-d, --date=STRING display time described by STRING, not 'now'
-f, --file=DATEFILE like --date once for each line of DATEFILE
-I[TIMESPEC], --iso-8601[=TIMESPEC] output date/time in ISO 8601 format.
TIMESPEC='date' for date only (the default),
'hours', 'minutes', 'seconds', or 'ns' for date
and time to the indicated precision.
-r, --reference=FILE display the last modification time of FILE
-R, --rfc-2822 output date and time in RFC 2822 format.
Example: Mon, 07 Aug 2006 12:34:56 -0600
--rfc-3339=TIMESPEC output date and time in RFC 3339 format.
TIMESPEC='date', 'seconds', or 'ns' for
date and time to the indicated precision.
Date and time components are separated by
a single space: 2006-08-07 12:34:56-06:00
-s, --set=STRING set time described by STRING
-u, --utc, --universal print or set Coordinated Universal Time (UTC)
--help display this help and exit
--version output version information and exit
uptime:
Tell how long the system has been running
uptime gives a one line display of the following information. The current time, how long the system has
been running, how many users are currently logged on, and the system load averages for the past 1, 5,
and 15 minutes
Options:
-p, --pretty show uptime in pretty format
-h, --help display this help and exit
-s, --since system up since
-V, --version output version information and exit
hostname
Show or set the system's host name
Program options:
-a, --alias alias names
-A, --all-fqdns all long host names (FQDNs)
-b, --boot set default hostname if none available
-d, --domain DNS domain name
-f, --fqdn, --long long host name (FQDN)
-F, --file read host name or NIS domain name from given file
-i, --ip-address addresses for the host name
-I, --all-ip-addresses all addresses for the host
-s, --short short host name
-y, --yp, --nis NIS/YP domain name
Description:
This command can get or set the host name or the NIS domain name. You can
also get the DNS domain or the FQDN (fully qualified domain name).
Unless you are using bind or NIS for host lookups you can change the
FQDN (Fully Qualified Domain Name) and the DNS domain name (which is
part of the FQDN) in the /etc/hosts file
uname
This command will give you system information. It is one of the important command that should be
used every time you login to a Linux/Unix machine.
which
Shows the full path of (shell) commands
cal and bc
cal command is simply for calendar and bc is for calculator
Processes
Whenever you enter a command at the shell prompt, it invokes a program. While this
program is running it is called a process. Your login shell is also a process, created for
you upon logging in and existing until you logout.
LINUX is a multi-tasking operating system. Any user can have multiple processes
running simultaneously, including multiple login sessions. As you do your work within
the login shell, each command creates at least one new process while it executes.
Process id: every process in a LINUX system has a unique PID - process identifier.
ps - displays information about processes. Note that the ps command differs between
different LINUX systems - see the local ps man page for details.
To see your current shell's processes:
% ps
PID TTY TIME CMD
26450 pts/9 0:00 ps
66801 pts/9 0:00 -csh
To see a detailed list of all of your processes on a machine (current shell and all other
shells):
% ps uc
USER PID %CPU %MEM SZ RSS TTY STAT STIME TIME COMMAND
jsmith 26451 0.0 0.0 120 232 pts/9 R 21:01:14 0:00 ps
jsmith 43520 0.0 1.0 300 660 pts/76 S 19:18:31 0:00 elm
jsmith 66801 0.0 1.0 348 640 pts/9 S 20:49:20 0:00 csh
jsmith 112453 0.0 0.0 340 432 pts/76 S Mar 03 0:00 csh
% ps ug
USER PID %CPU %MEM SZ RSS TTY STAT STIME TIME COMMAND
root 0 0.0 0.0 8 8 - S Feb 08 32:57 swapper
root 1 0.1 0.0 252 188 - S Feb 08 39:16 /etc/init
root 514 72.6 0.0 12 8 - R Feb 08 28984:05 kproc
root 771 0.2 0.0 16 16 - S Feb 08 65:14 kproc
root 1028 0.0 0.0 16 16 - S Feb 08 0:00 kproc
{ lines deleted }
root 60010 0.0 0.0 1296 536 - S Mar 07 0:00 -ncd19:0
kdr 60647 0.0 0.0 288 392 pts/87 S Mar 06 0:00 -ksh
manfield 60968 0.0 0.0 268 200 - S 10:12:52 0:00 mwm
kelly 61334 0.0 0.0 424 640 - S 08:18:10 0:00 twm
sjw 61925 0.0 0.0 552 376 - S Mar 06 0:00 rlogin kanaha
mkm 62357 0.0 0.0 460 240 - S Feb 08 0:00 xterm
ishley 62637 0.0 0.0 324 152 pts/106 S Mar 06 0:00 xedit march2
tusciora 62998 0.0 0.0 340 448 - S Mar 06 0:05 xterm -e
dilfeath 63564 0.0 0.0 200 268 - S 07:32:45 0:00 xclock
tusciora 63878 0.0 0.0 548 412 - S Mar 06 0:41 twm
kill - use the kill command to send a signal to a process. In most cases, this will be a kill
signal, hence the command name. However, other types of signals are usually
supported. Note that you can only kill processes which you own. The command syntax
is:
kill [-signal] process_identifier(PID)
Examples:
You can also use CTRL-C to kill the currently running process.
Suspend a process: Use CTRL-Z.
Background a process: Normally, commands operate in the foreground - you can not do
additional work until the command completes. Backgrounding a command allows you
to continue working at the shell prompt.
To start a job in the background, use an ampersand (&) when you invoke the command:
myprog &
To put an already running job in the background, first suspend it with CRTL-Z and then
use the "bg" command:
Foreground a process: To move a background job to the foreground, find its "job"
number and then use the "fg" command. In this example, the jobs command shows that
two processes are running in the background. The fg command is used to bring the
second job (%2) to the foreground.
jobs
[1] + Running xcalc
[2] Running find / -name core -print
fg %2
Stop a job running in the background: Use the jobs command to find its job number, and
then use the stop command. You can then bring it to the foreground or restart execution
later.
jobs
[1] + Running xcalc
[2] Running find / -name core -print
stop %2
Kill a job running in the background, use the jobs command to find its job number, and
then use the kill command. Note that you can also use the ps and kill commands to
accomplish the same task.
jobs
[1] + Running xcalc
[2] Running find / -name core -print
kill %2
A program, or command, interacts with the kernel to provide the environment and perform the
functions called for by the user. A program can be: an executable shell file, known as a shell script; a
built-in shell command; or a source compiled, object code file.
The shell is a command line interpreter. The user interacts with the kernel through the shell. You can
write ASCII (text) scripts to be acted upon by a shell.
System programs are usually binary, having been compiled from C source code. These are located in
places like /bin, /usr/bin, /usr/local/bin, /usr/ucb, etc. They provide the functions that you normally
think of when you think of Linux. Some of these are sh, csh, date, who, more, and there are many
others.
crontab – Quick Reference
crontab is used to schedule task/jobs
cron meaning – There is no definitive explanation but most accepted answers is reportedly from
Ken Thompson ( author of unix cron ), name cron comes from chron ,the Greek prefix for
‘time.’.
What is cron ? – Cron is a daemon which runs at the times of system boot from /etc/init.d
scripts. If needed it can be stopped/started/restart using init script or with command service crond
start in Linux systems.
This document covers following aspects of Unix, Linux cron jobs to help you understand
and implement cronjobs successfully
1. What is crontab?
2. What is a cron job or cron schedule?
3. Crontab Restrictions
4. Crontab Commands
5. Crontab file – syntax
6. Crontab Example
7. Crontab Environment
8. Disable Email
9. Generate log file for crontab activity
10. Crontab file location
1. What is crontab?
Crontab (CRON TABle) is a file which contains the schedule of cron entries to be run and at
specified times. File location varies by operating systems, See Crontab file location at the end of
this document.
Cron job or cron schedule is a specific set of execution instructions specifing day, time and
command to execute. crontab can have multiple execution statments.
3. Crontab Restrictions
You can execute crontab if your name appears in the file /usr/lib/cron/cron.allow. If that file does
not exist, you can use
crontab if your name does not appear in the file /usr/lib/cron/cron.deny.
If only cron.deny exists and is empty, all users can use crontab. If neither file exists, only the root
user can use crontab. The allow/deny files consist of one user name per line.
4. Crontab Commands
5. Crontab file
Crontab syntax :
A crontab file has five fields for specifying day , date and time followed by the command to be
run at that interval.
* * * * * command to be executed
- - - - -
| | | | |
| | | | +----- day of week (0 - 6)
(Sunday=0)
| | | +------- month (1 - 12)
| | +--------- day of month (1 - 31)
| +----------- hour (0 - 23)
+------------- min (0 - 59)
* in the value field above means all legal values as in braces for that column.
The value column can have a * or a list of elements separated by commas. An element is either a
number in the ranges shown above or two numbers in the range separated by a hyphen (meaning
an inclusive range).
Notes
A. ) Repeat pattern like /2 for every 2 minutes or /10 for every 10 minutes is not supported by all
operating systems. If you try to use it and crontab complains it is probably not supported.
B.) The specification of days can be made in two fields: month day and weekday. If both are
specified in an entry, they are cumulative meaning both of the entries will get executed .
6. Crontab Examples
A line in crontab file like below removes the tmp files from /home/someuser/tmp each day at
6:30 PM.
30 18 * * * rm /home/someuser/tmp/*
Changing the parameter values as below will cause this command to run at different time
schedule below :
Note : If you inadvertently enter the crontab command with no argument(s), do not attempt to
get out with Control-d. This removes all entries in your crontab file. Instead, exit with Control-c.
7. Crontab Environment
cron invokes the command from the user’s HOME directory with the shell, (/usr/bin/sh).
cron supplies a default environment for every shell, defining:
HOME=user’s-home-directory
LOGNAME=user’s-login-id
PATH=/usr/bin:/usr/sbin:.
SHELL=/usr/bin/sh
Users who desire to have their .profile executed must explicitly do so in the crontab entry or in a
script called by the entry.
8. Disable Email
By default cron jobs sends a email to the user account executing the cronjob. If this is not needed
put the following command At the end of the cron job line .
>/dev/null 2>&1
Mac OS X
/usr/lib/cron/tabs/
BSD Unix
/var/cron/tabs/
Solaris, HP-UX, Debian, Ubuntu
/var/spool/cron/crontabs/
AIX, Red Hat Linux, CentOS, Ferdora
/var/spool/cron/
System Resources Commands:
Syntax
df [options] [resource]
Common Options
-l local file systems only (SVR4)
-k report in kilobytes (SVR4)
Syntax
du [options] [directory or file]
Common Options
-a display disk usage for each file, not just subdirectories
-s display a summary total only
-k report in kilobytes (SVR4)
Syntax
who [am i]
Examples
> who
wmtell ttyp1 Apr 21 20:15 (apple.acs.ohio-s)
fbwalk ttyp2 Apr 21 23:21 (worf.acs.ohio-st)
stwang ttyp3 Apr 21 23:22 (127.99.25.8)
Syntax
whereis [options] command(s)
Common Options
-b report binary files only
-m report manual sections only
-s report source files only
Examples
> whereis Mail
Mail: /usr/ucb/Mail /usr/lib/Mail.help /usr/lib/Mail.rc /usr/man/man1/Mail.1
> whereis -b Mail
Mail: /usr/ucb/Mail /usr/lib/Mail.help /usr/lib/Mail.rc
> whereis -m Mail
Mail: /usr/man/man1/Mail.1
Syntax
which command(s)
example--
> which Mail
/usr/ucb/Mail
uname has additional options to print information about system hardware type and software version.
date - current date and time
date displays the current data and time. A superuser can set the date and time.
Syntax
date [options] [+format]
Common Options
-u use Universal Time (or Greenwich Mean Time)
+format specify the output format
%a weekday abbreviation, Sun to Sat
%h month abbreviation, Jan to Dec
%j day of year, 001 to 366
%n <new-line>
%t <TAB>
%y last 2 digits of year, 00 to 99
%D MM/DD/YY date
%H hour, 00 to 23
%M minute, 00 to 59
%S second, 00 to 59
%T HH:MM:SS time
Examples
> date
Mon Jun 10 09:01:05 EDT 1996
> date -u
Mon Jun 10 13:01:33 GMT 1996
> date +%a%t%D
Mon 06/10/96
> date '+%y:%j'
96:162
Terminal Control Keys
Several key combinations on your keyboard usually have a special effect on the
terminal.
These "control" (CTRL) keys are accomplished by holding the CTRL key while typing
the second key. For example, CTRL-c means to hold the CTRL key while you type the
letter "c".
The most common control keys are listed below:
Know what is happening in “real time” on your systems is in my opinion the basis to use and
optimize your OS. The top command can help us, this is a very useful system monitor that is
really easy to use, and that can also allows us to understand why our OS suffers and which
process use most resources. The command to be run on the terminal is:
$ top
Let’s see now every single row of this output to explain all the information found within the
screen.
1° Row — top
2° Row – task
3° Row – cpu
The third line indicates how the cpu is used. If you sum up all the percentages the total will be
100% of the cpu. Let’s see what these values indicate in order:
The fourth and fifth rows respectively indicate the use of physical memory (RAM) and swap. In
this order: Total memory in use, free, buffers cached.
And as last thing ordered by CPU usage (as default) there are the processes currently in use.
Let’s see what information we can get in the different columns:
PID – l’ID of the process(4522)
USER – The user that is the owner of the process (root)
PR – priority of the process (15)
NI – The “NICE” value of the process (0)
VIRT – virtual memory used by the process (132m)
RES – physical memory used from the process (14m)
SHR – shared memory of the process (3204)
S – indicates the status of the process: S=sleep R=running Z=zombie (S)
%CPU – This is the percentage of CPU used by this process (0.3)
%MEM – This is the percentage of RAM used by the process (0.7)
TIME+ –This is the total time of activity of this process (0:17.75)
COMMAND – And this is the name of the process (bb_monitor.pl)
Conclusions
Now that we have seen in detail all the information that the command “top” returns, it will be
easier to understand the reason of excessive load and/or the slowing of the system
Recover/Reset Root Password
7 – Exit chroot
exit
8 - Reboot your system
reboot
SIGHUP - The SIGHUP signal disconnects a process from the parent process. This an also be
used to restart processes. For example, "killall -SIGUP compiz" will restart Compiz. This is useful
for daemons with memory leaks.
SIGINT - This signal is the same as pressing ctrl-c. On some systems, "delete" + "break" sends the
same signal to the process. The process is interrupted and stopped. However, the process can ignore
this signal.
SIGQUIT - This is like SIGINT with the ability to make the process produce a core dump.
SIGILL - When a process performs a faulty, forbidden, or unknown function, the system sends the
SIGILL signal to the process. This is the ILLegal SIGnal.
SIGTRAP - This signal is used for debugging purposes. When a process has performed an action or
a condition is met that a debugger is waiting for, this signal will be sent to the process.
SIGABRT - This kill signal is the abort signal. Typically, a process will initiate this kill signal on
itself.
SIGBUS - When a process is sent the SIGBUS signal, it is because the process caused a bus error.
Commonly, these bus errors are due to a process trying to use fake physical addresses or the process
has its memory alignment set incorrectly.
SIGFPE - Processes that divide by zero are killed using SIGFPE. Imagine if humans got the death
penalty for such math. NOTE: The author of this article was recently drug out to the street and shot
for dividing by zero.
SIGKILL - The SIGKILL signal forces the process to stop executing immediately. The program
cannot ignore this signal. This process does not get to clean-up either.
SIGUSR1 - This indicates a user-defined condition. This signal can be set by the user by
programming the commands in sigusr1.c. This requires the programmer to know C/C++.
SIGSEGV - When an application has a segmentation violation, this signal is sent to the process.
SIGPIPE - When a process tries to write to a pipe that lacks an end connected to a reader, this
signal is sent to the process. A reader is a process that reads data at the end of a pipe.
SIGALRM - SIGALRM is sent when the real time or clock time timer expires.
SIGTERM - This signal requests a process to stop running. This signal can be ignored. The process
is given time to gracefully shutdown. When a program gracefully shuts down, that means it is given
time to save its progress and release resources. In other words, it is not forced to stop. SIGINT is
very similar to SIGTERM.
SIGCHLD - When a parent process loses its child process, the parent process is sent the
SIGCHLD signal. This cleans up resources used by the child process. In computers, a child process
is a process started by another process know as a parent.
SIGCONT - To make processes continue executing after being paused by the SIGTSTP or
SIGSTOP signal, send the SIGCONT signal to the paused process. This is the CONTinue SIGnal.
This signal is beneficial to Unix job control (executing background tasks).
SIGSTOP - This signal makes the operating system pause a process's execution. The process cannot
ignore the signal.
SIGTSTP - This signal is like pressing ctrl-z. This makes a request to the terminal containing the
process to ask the process to stop temporarily. The process can ignore the request.
SIGTTIN - When a process attempts to read from a tty (computer terminal), the process receives
this signal.
SIGTTOU - When a process attempts to write from a tty (computer terminal), the process receives
this signal.
SIGURG - When a process has urgent data to be read or the data is very large, the SIGURG signal
is sent to the process.
SIGXCPU - When a process uses the CPU past the allotted time, the system sends the process this
signal. SIGXCPU acts like a warning; the process has time to save the progress (if possible) and
close before the system kills the process with SIGKILL.
SIGXFSZ - Filesystems have a limit to how large a file can be made. When a program tries to
violate this limit, the system will send that process the SIGXFSZ signal.
SIGVTALRM - SIGVTALRM is sent when CPU time used by the process elapses.
SIGPROF - SIGPROF is sent when CPU time used by the process and by the system on behalf of
the process elapses.
SIGWINCH - When a process is in a terminal that changes its size, the process receives this signal.
SIGIO - Alias to SIGPOLL or at least behaves much like SIGPOLL.
SIGPWR - Power failures will cause the system to send this signal to processes (if the system is still
on).
SIGSYS - Processes that give a system call an invalid parameter will receive this signal.
SIGRTMIN* - This is a set of signals that varies between systems. They are labeled
SIGRTMIN+1, SIGRTMIN+2, SIGRTMIN+3, ......., and so on (usually up to 15). These are user-
defined signals; they must be programmed in the Linux kernel's source code. That would require the
user to know C/C++.
SIGRTMAX* - This is a set of signals that varies between systems. They are labeled SIGRTMAX-
1, SIGRTMAX-2, SIGRTMAX-3, ......., and so on (usually up to 14). These are user-defined signals;
they must be programmed in the Linux kernel's source code. That would require the user to know
C/C++.
SIGINFO - Terminals may sometimes send status requests to processes. When this happens,
processes will also receive this signal.
SIGLOST - Processes trying to access locked files will get this signal.
SIGPOLL - When a process causes an asynchronous I/O event, that process is sent the SIGPOLL
signal.
UNIX Kernel:
Technically speaking, the UNIX kernel "is" the operating system. It provides the basic full time software
connection to the hardware. By full time, it means that the kernel is always running while the computer
is turned on. When a system boots up, kernel is loaded. Likewise, the kernel is only exited when the
computer is turned off.
The UNIX kernel is built specifically for a machine when it is installed. It has a record of all the pieces of
hardware it needs to talk to and knows what languages they speak (how to turn switches on and off to
get a desired result). Thus, a kernel is not easily ported to another computer. Each individual computer
will have its own tailor- made kernel. If the computer's hardware configuration changes during its life,
the kernel must be "rebuilt" (told about the new pieces of hardware).
However, though the connection between the kernel and the hardware is "hardcoded" to a specific
machine, the connection between the user and the kernel is generic. That is the beauty of the UNIX
kernel. From your perspective, regardless of how the kernel interacts with the hardware, no matter which
UNIX computer you use, you will have the same kernel interface to work with. That is because the
hardware is "hidden" by the kernel.
The kernel also handles memory management, input and output requests, and process scheduling for
time-shared operations (we'll talk more about what this means later).
To help it with its work, the kernel also executes daemon programs which stay alive as long as the
machine is turned on and help perform tasks such as printing or serving web documents.
However, the task of hiding the hardware is a pretty much full time job for the kernel. As such, it does
not have too much time to provide for a fancy user-friendly interface. Thus, though the kernel is much
easier to talk to than the hardware, the language of the kernel is still pretty cryptic.
Fortunately, the UNIX operating system has built in "shells" which wrap around the kernel and provide a
much more user-friendly interface. Let's take a look at shells.
Shells
The shell sits between you and the kernel, acting as a command interpreter. It reads your terminal input
and translates the commands into actions taken by the system. The shell is analogous to command in
DOS. When you log into the system you are given a default shell. When the shell starts up it reads its
startup files and may set environment variables, command search paths, and command aliases, and
executes any commands specified in these files.
The original shell was the Bourne shell, sh. Every Linux platform will either have the Bourne shell, or a
Bourne compatible shell available. It has very good features for controlling input and output, but is not
well suited for the interactive user. To meet the latter need the C shell, csh, was written and is now found
on most, but not all, Linux systems. It uses C type syntax, the language Unix is written in, but has a more
awkward input/output implementation. It has job control, so that you can reattach a job running in the
background to the foreground. It also provides a history feature which allows you to modify and repeat
previously executed commands.
The default prompt for the Bourne shell is $ (or #, for the root user). The default prompt for C shell is %.
Numerous other shells are available from the network. Almost all of them are based on either sh or csh
with extensions to provide job control to sh, allow in-line editing of commands, page through previously
executed commands, provide command name completion and custom prompt, etc. Some of the more
well known of these may be on your favorite Linux system: the Korn shell, ksh, by David Korn and the
Bourne Again Shell, bash, from the Free Software Foundations GNU project, both based on sh, the T-C
shell, tcsh, and the extended C shell, cshe, both based on csh. Below we will describe some of the features
of sh and csh so that you can get started.
Built-in Commands
The shells have a number of built-in, or native commands. These commands are executed directly in the
shell and don’t have to call another program to be run. These built-in commands are different for the
different shells.
sh
For the Bourne shell some of the more commonly used built-in commands are:
: null command
. source (read and execute) commands from a file
case case conditional loop
cd change the working directory (default is $HOME)
echo write a string to standard output
eval evaluate the given arguments and feed the result back to the shell
exec execute the given command, replacing the current shell
exit exit the current shell
export share the specified environment variable with subsequent shells
for for conditional loop
if if conditional loop
pwd print the current working directory
read read a line of input from stdin
set set variables for the shell
test evaluate an expression as true or false
trap trap for a typed signal and execute commands
umask set a default file permission mask for new files
unset unset shell variables
wait wait for a specified process to terminate
while while conditional loop
csh
For the C shell the more commonly used built-in functions are:
alias assign a name to a function
bg put a job into the background
cd change the current working directory
echo write a string to stdout
eval evaluate the given arguments and feed the result back to the shell
exec execute the given command, replacing the current shell
exit exit the current shell
fg bring a job to the foreground
foreach for conditional loop
glob do filename expansion on the list, but no "\" escapes are honored
history print the command history of the shell
if if conditional loop
jobs list or control active jobs
kill kill the specified process
limit set limits on system resources
logout terminate the login shell
nice command lower the scheduling priority of the process, command
nohup command do not terminate command when the shell exits
set set a shell variable
setenv set an environment variable for this and subsequent shells
stop stop the specified background job
umask set a default file permission mask for new files
unalias remove the specified alias name
unset unset shell variables
while while conditional loop
Environment Variables
Environmental variables are used to provide information to the programs you use. You can have both
global environment and local shell variables. Global environment variables are set by your login
shell and new programs and shells inherit the environment of their parent shell. Local shell variables
are used only by that shell and are not passed on to other processes. A child process cannot pass a
variable back to its parent process.
The current environment variables are displayed with the "env" or "printenv" commands. Some
common ones are:
Many environment variables will be set automatically when you login. You can modify them or define
others with entries in your startup files or at any time within the shell. Some variables you might want
to change are PATH and DISPLAY. The PATH variable specifies the directories to be automatically
searched for the command you specify. Examples of this are in the shell startup scripts below.
You set a global environment variable with a command similar to the following for the C shell:
% setenv NAME value
and for Bourne shell:
$ NAME=value; export NAME
You can list your global environmental variables with the env or printenv commands. You unset them
with the unsetenv (C shell) or unset (Bourne shell) commands.
To set a local shell variable use the set command with the syntax below for C shell. Without options
set displays all the local variables.
% set name=value
For the Bourne shell set the variable with the syntax:
$ name=value
The current value of the variable is accessed via the "$name", or "${name}", notation
Shell
Whenever you login to a Linux system you are placed in a shell program. The shell's prompt is
usually visible at the cursor's position on your screen. To get your work done, you enter
commands at this prompt.
The shell is a command interpreter; it takes each command and passes it to the operating
system kernel to be acted upon. It then displays the results of this operation on your screen.
Several shells are usually available on any UNIX system, each with its own strengths and
weaknesses.
Different users may use different shells. Initially, your system administrator will supply a
default shell, which can be overridden or changed. The most commonly available shells are:
Bourne shell (sh)
C shell (csh)
Korn shell (ksh)
TC Shell (tcsh)
Bourne Again Shell (bash)
Each shell also includes its own programming language. Command files, called "shell scripts"
are used to accomplish a series of tasks.
$ chmod +x simple
After that, you can execute the script by specifying the filename as an argument to the bash
command:
$ bash simple
You can also execute scripts by just typing its name alone. However, for that method to work,
the directory containing the script must be defined in your PATH variable. When looking at
your .profile earlier in the course, you may have noticed that the PATH=$PATH:$HOME
definition was already in place. This enables you to run scripts located in your home directory
($HOME) without using the ksh command. For instance, because of that pre-defined PATH
variable, the simple script can be run from the command line like this:
$ simple
(For the purposes of this course, we'll simplify things by running all scripts by their script name
only, not as an argument to the ksh command.)
You can also invoke the script from your current shell by opening a background subprocess - or
subshell - where the actual command processing will occur. You won't see it running, but it will
free up your existing shell so you can continue working. This is really only necessary when
running long, processing-intensive scripts that would otherwise take over your current shell
until they complete.
To run the script you created in the background, invoke it this way:
$ simple &
When the script completes, you'll see output similar to this in the current shell:
It is important to understand that Korn shell scripts run in a somewhat different way than they
would in other shells. Specifically, variables defined in the Korn shell aren't understood outside
of the defining - or parent - shell. They must be explicitly exported from the parent shell to work
in a subsequent script or subshell. If you use the export or typeset -x commands to make the
variable known outside the parent shell, any subshell will automatically inherit the values you
defined for the parent shell.
For example, here's a script named lookmeup that does nothing more than print a line to
standard output using the myaddress (defined as 123 Anystreet USA) variable:
$ cat lookmeup
print "I live at $myaddress"
If you open a new shell (using the ksh command) from the parent shell and run the script, you
see that myaddress is undefined:
$ ksh
$ lookmeup
I live at
$ exit
$ export myaddress
and then open a new shell and run the lookmeup script again, the variable is now defined:
$ ksh
$ lookmeup
I live at 123 Anystreet USA
To illustrate further how the parent shell takes processing precedence, let's change the value of
myaddress in the subshell:
$ myaddress='Houston, Texas'
$ print $myaddress
Houston, Texas
Now, if you exit the new shell and go back to the parent shell and type the same command:
$ exit
$ print $myaddress
123 Anystreet USA
you see that the original value in the parent shell was not affected by what you did in the
subshell.
A way to export variables automatically is to use the set -o allexport command. This command
cannot export variables to the parent shell from a subshell, but can export variables created in
the parent shell to all subshells created after the command is run. Likewise, it can automatically
export variables created in subshells to new subshells created after running the command. set -o
allexport is a handy command to place in your .kshrc file.
Any Korn shell script should contain this line at the very beginning:
#!/usr/bin/ksh
As you probably already know, the # sign marks anything that follows it on the line as a
comment - anything coming after it won't be interpreted or processed as part of the script. But,
when the # character is followed by a ! (commonly called "bang"), the meaning changes. The line
above specifies that the Korn shell will be (or should be) executing the script. If nothing is
specified, the system will attempt to execute the script using whatever its default shell type is,
not necessarily a Korn shell. Since the Korn shell supports some commands that other shells do
not, this can sometimes cause a problem. To be valid, this line must be on the very first line of
the script.
Shell scripts are often used to automate day-to-day tasks. For example, a system administrator
might use the following script, named diskuse here, to keep track of disk space usage:
#!/usr/bin/ksh
# diskuse
# Shows disk usage in blocks for /home
cd /var/log
cp disk.log disk.log.0
cd /home
du -sk * > /var/log/disk.log
cat /var/log/disk.log
Shown again - but this time with annotation - the script's processing steps are clear:
#!/usr/bin/ksh
# SCRIPT NAME: diskuse
# SCRIPT PURPOSE: Shows disk usage in blocks for /home
It's not a good idea to hard-code pathnames into your scripts like we did in the previous
example. We specified /var/log as the target directory several times, but what if the location of
the files changed? In a short script like this one, the impact is not great. However, some scripts
can be hundreds of lines long, creating a maintenance headache if files are moved. A way
around this is to create a variable to take the place of the full pathname, such as:
LOGDIR=/var/log
cp disk.log disk.log.0
to:
cp ${LOGDIR}/disk.log ${LOGDIR}/disk.log.0
Then, if the locations of disk.log changes in the future, you would only have to change the
variable definition to update the script. Also note that since you are defining the pathname with
the LOGDIR variable, the cd /var/log line in the script is unnecessary. Likewise, the du -sk * >
/var/log/disk.log and cat /var/log/disk.log lines can substitute ${LOGDIR} for /var/log.
Basic Shell Scripts:
Output to screen
#!/bin/bash
# Simple output script
Defining Tasks
#!/bin/bash
# Define small tasks
whoami
echo
pwd
echo
hostname
echo
ls -ltr
echo
Defining variables
#!/bin/bash
# Example of defining variables
a=Imran
b=Afzal
c=’Linux class’
Read Input
#!/bin/bash
# Read user input
echo Hello $a $b
#!/bin/bash
# Script to run commands within
clear
echo "Hello `whoami`"
echo
echo "Today is `date`"
echo
echo "Number of user login: `who | wc -l `"
echo
#!/bin/bash
# This script will rename a file
mv $oldfilename $newfilename
echo The file has been renamed as $newfilename
for loop Scripts:
#!/bin/bash
for i in 1 2 3 4 5
do
echo "Welcome $i times"
done
#!/bin/bash
#!/bin/bash
for i in {1..5}
do
touch $i
done
#!/bin/bash
for i in {1..5}
do
rm $i
done
#!/bin/bash
i=1
for day in Mon Tue Wed Thu Fri
do
echo "Weekday $((i++)) : $day"
done
#!/bin/bash
i=1
for username in `awk -F: '{print $1}' /etc/passwd`
do
echo "Username $((i++)) : $username"
done
do-while Script
#!/bin/bash
c=1
while [ $c -le 5 ]
do
echo "Welcone $c times"
(( c++ ))
done
#!/bin/bash
count=0
num=10
while [ $count -lt 10 ]
do
echo
echo $num seconds left to stop this process $1
echo
sleep 1
num=`expr $num - 1`
count=`expr $count + 1`
done
echo
echo $1 process is stopped!!!
echo
If-then Scripts:
#!/bin/bash
count=100
if [ $count -eq 100 ]
then
echo Count is 100
else
echo Count is not 100
fi
#!/bin/bash
clear
if [ -e /home/iafzal/error.txt ]
then
echo "File exist"
else
echo "File does not exist"
fi
#!/bin/bash
if [ "$a" == Mon ]
then
echo Today is $a
else
echo Today is not Monday
fi
Check the response and then output
#!/bin/bash
clear
echo
echo "What is your name?"
echo
read a
echo
if [ "$Like" == y ]
then
echo You are cool
elif [ "$Like" == n ]
then
echo You should try IT, it’s a good field
echo
fi
Other If statements
Test if the error.txt file exist and its size is greater than zero
if test -s error.txt
Comparisons:
-eq equal to for numbers
== equal to for letters
-ne not equal to
!== not equal to for letters
-lt less than
-le less than or equal to
-gt greater than
-ge greater than or equal to
File Operations:
-s file exists and is not empty
-f file exists and is not a directory
-d directory exists
-x file is executable
-w file is writable
-r file is readable
case Scripts:
#!/bin/bash
echo
echo Please chose one of the options below
echo
echo 'a = Display Date and Time'
echo 'b = List file and directories'
echo 'c = List users logged in'
echo 'd = Check System uptime'
echo
read choices
case $choices in
a) date;;
b) ls;;
c) who;;
d) uptime;;
*) echo Invalid choice - Bye.
esac
This script will look at your current day and tell you the state of the
backup
#!/bin/bash
NOW=$(date +"%a")
case $NOW in
Mon)
echo "Full backup";;
Tue|Wed|Thu|Fri)
echo "Partial backup";;
Sat|Sun)
echo "No backup";;
*) ;;
esac
Aliases
The alias command allows you to define new commands. Useful for creating shortcuts
for longer commands. The syntax is.
alias alias-name=executed_command
Some examples:
alias m=more
alias rm="rm -i"
alias h="history -r | more"
A system can be booted into (i.e., started up into) any of several runlevels, each of which is
represented by a single digit integer. Each runlevel designates a different system configuration
and allows access to a different combination of processes (i.e., instances of executing programs).
The are differences in the runlevels according to the operating system. Seven runlevels are
supported in the standard Linux kernel (i.e., core of the operating system). They are:
3 - Multiple users, command line (i.e., all-text mode) interface; the standard runlevel for most
Linux-based server hardware.
4 - User-definable
5 - Multiple users, GUI (graphical user interface); the standard runlevel for most Linux-based
desktop systems.
By default Linux boots either to runlevel 3 or to runlevel 5. The former permits the system to
run all services except for a GUI. The latter allows all services including a GUI.
In addition to the standard runlevels, users can modify the preset runlevels or even create new
ones if desired. Runlevels 2 and 4 are usually used for user defined runlevels.
The program responsible for altering the runlevel is init, and it can be called using the telinit
command. For example, changing from runlevel 3 to runlevel 5, which allows the GUI to be
started, can be accomplished by the root (i.e., administrative) user by issuing the following
command:
telinit 5
Booting into a different runlevel can help solve certain problems. For example, if a change made
in the X Window System configuration on a machine that has been set up to boot into a GUI has
rendered the system unusable, it is possible to temporarily boot into a console (i.e., all-text
mode) runlevel (i.e., runlevels 3 or 1) in order to repair the error and then reboot into the GUI.
The X Window System is a widely used system for managing GUIs on single computers and on
networks of computers.
Likewise, if a machine will not boot due to a damaged configuration file or will not allow
logging in because of a corrupted /etc/passwd file (which stores user names and other data
about users) or because of a forgotten password, the problem can solved by first booting into
single-user mode (i.e. runlevel 1).
The runlevel command can be used to find both the current runlevel and the previous runlevel
by merely typing the following and pressing the Enter key:
/sbin/runlevel
The runlevel executable file (i.e., the ready-to-run form of the program) is typically located in
the /sbin directory, which contains mostly administrative tools and which by default is not in
the user's PATH (i.e., the list of directories in which the system searches for programs). Thus, it
is usually necessary to type the full path of the command as shown above rather than just the
name of the command itself.
The default runlevel for a system is specified in the /etc/inittab file, which will contain an entry
such as id:3:initdefault: if the system starts in runlevel 3, or id:5:initdefault: if it starts in runlevel
5. This file can be easily (and safely) read with a command such as cat, i.e.,
cat /etc/inittab
As an alternative to telinit, the runlevel into which the system boots can be changed by
modifying /etc/inittab manually with a text editor. However, it is generally easier and safer (i.e.,
less chance of accidental damage to the file) to use telinit. It is always wise to make a backup
copy of /etc/inittab or any other configuration file before attempting to modify it manually.
Partitioning a Disk
Linux
# fdisk /dev/emcpowerp OR fdisk /dev/sdb
m n p 1 enter enter w
e.g:
# mkdir /rocket
# cd /rocket
# mkdir IFMX_ROCKET
# mkdir ROCKET_DATA
Add these entries to /etc/fstab file so the system can mount on boot up
# cp /etc/fstab /etc/fstab.bak
Verify = df –h
To extend filesystem of a Linux VM using LVM
If M < 2
then S = M *2
Else S=M+2
Commands
dd
mkswap
swapon or swapoff
The following dd command example creates a swap file with the name “newswap” under /
directory with a size of 1024MB (1.0GB).
Change the permission of the swap file so that only root can access it.
# chmod go-r /newswap OR
# chmod 0600 /newswap
To make this swap file available as a swap area even after the reboot, add the following line to
the /etc/fstab file.
# cat /etc/fstab
/newswap swap swap defaults 0 0
Verify whether the newly created swap area is available for your use.
# swapon –s
# free –h
If you don’t want to reboot to verify whether the system takes all the swap space mentioned in
the /etc/fstab, you can do the following, which will disable and enable all the swap partition
mentioned in the /etc/fstab
# swapoff -a
# swapon -a
Overview of systemd for RHEL 7
The systemd system and service manager is responsible for controlling how services are started,
stopped and otherwise managed on Red Hat Enterprise Linux 7 systems. By offering on-demand
service start-up and better transactional dependency controls, systemd dramatically reduces start
up times. As a systemd user, you can prioritize critical services over less important services.
Although the systemd process replaces the init process (quite literally, /sbin/init is now a
symbolic link to /usr/lib/systemd/systemd) for starting services at boot time and changing
runlevels, systemd provides much more control than the init process does while still supporting
existing init scripts. Here are some examples of the features of systemd:
Logging: From the moment that the initial RAM disk is mounted to start the Linux kernel
to final shutdown of the system, all log messages are stored by the new systemd journal.
Before the systemd journal existed, initial boot messages were lost, requiring that you try
to watch the screen as messages scrolled by to debug boot problems.
Now, all system messages come in on a single stream and are stored in the /run directory.
Messages can then be consumed by the rsyslog facility (and redirected to traditional log
files in the /var/log directory or to remote log servers) or displayed using the journalctl
command across a variety of attributes.
Dependencies: With systemd, an explicit set of dependencies can be defined for each
service, instead of being implied by boot order. This allows a service to start at any point
that its dependencies are met. In this way, many services can start at the same time,
making the boot process faster. Likewise, complex sets of dependencies can be set up, so
the exact requirements of a service (such as storage availability or file system checking)
can be met before a service starts.
Cgroups: Services are identified by Cgroups, which allow every component of a service
to be managed. For example, the older System V init scripts would start a service by
launching a process which itself might start other child processes. When the service was
killed, it was hoped that the parent process would do the right thing and kill its children.
By using Cgroups, all components of a service have a tag that can be used to make sure
that all of those components are properly started or stopped.
Activating services: Services don't just have to be always running or not running based
on runlevel, as they were previous to systemd. Services can now be activated based on
path, socket, bus, timer, or hardware activation. Likewise, because systemd can set up
sockets, if a process handling communications goes away, the process that starts up in its
place can pick up the next message from the socket. To the clients using the service, it
can look as though the service continued without interruption.
More than services: Instead of just managing services, systemd can manage several
different unit types. These unit types include:
o Devices: Create and use devices.
o Mounts and automounts: Mount file systems upon request or automount a file
system based on a request for a file or directory within that file system.
o Paths: Check the existence of files or directories or create them as needed.
o Services: Start a service, which often means launching a service daemon and
related components.
o Slices: Divide up computer resources (such as CPU and memory) and apply them
to selected units.
o Snapshots: Take snapshots of the current state of the system.
o Sockets: Set up sockets to allow communication paths to processes that can
remain in place, even if the underlying process needs to restart.
o Swaps: Create and use swap files or swap partitions.
o Targets: Manage a set of services under a single unit, represented by a target
name rather than a runlevel number.
o Timers: Trigger actions based on a timer.
Resource management
o The fact that each systemd unit is always associated with its own cgroup lets you
control the amount of resources each service can use. For example, you can set a
percent of CPU usage by service which can put a cap on the total amount of CPU
that service can use -- in other words, spinning off more processes won't allow
more resources to be consumed by the service. Prior to systemd, nice levels were
often used to prevent processes from hogging precious CPU time. With systemd's
use of cgroups, precise limits can be set on CPU and memory usage, as well as
other resources.
o A feature called slices lets you slice up many different types of system resources
and assign them to users, services, virtual machines, and other units. Accounting
is also done on these resources, which can allow you to charge customers for their
resource usage.
Although there is not a strict order in which services are started when a RHEL 7 (systemd)
system is booted, there is a structure to the boot process. The direction that the systemd process
takes at boot time depends on the default.target file. A long listing of the default.target file
shows you which target starts when the system boots:
# cd /etc/systemd/system
# ls -l default.target
lrwxrwxrwx. 1 root root 16 Aug 23 19:18 default.target ->
/lib/systemd/system/graphical.target
You can see here that the graphical.target (common for desktop systems or servers with
graphical interfaces) is set as the default.target (via a symbolic link). To understand what
targets, services and other units start up with the graphical target, it helps to work backwards, as
systemd does, to build the dependency tree. Here's what to look for:
graphical.target: The /lib/systemd/system/graphical.target file includes these lines:
Requires=multi-user.target
Wants=display-manager.service
Conflicts=rescue.service rescue.target
After=multi-user.target rescue.service rescue.target display-
manager.service
AllowIsolate=yes
This tells systemd to start everything in the multi-user.target before starting the graphical
target. Once that's done, the "Wants" entry tells systemd to start the display-
manager.service service (/etc/systemd/system/display-manager.service), which runs
the GNOME display manager (/usr/sbin/gdm).
Requires=basic.target
# cd /etc/systemd/system/multi-user.target.wants
abrt-ccpp.service hypervkvpd.service postfix.service
abrtd.service hypervvssd.service remote-fs.target
abrt-oops.service irqbalance.service rhsmcertd.service
abrt-vmcore.service ksm.service rngd.service
abrt-xorg.service ksmtuned.service rpcbind.service
atd.service libstoragemgmt.service rsyslog.service
auditd.service libvirtd.service smartd.service
avahi-daemon.service mdmonitor.service sshd.service
chronyd.service ModemManager.service sysstat.service
crond.service netcf-transaction.service tuned.service
cups.path nfs.target vmtoolsd.service
Requires=sysinit.target
Wants=local-fs.target swap.target
Besides mounting file systems and enabling swap devices, the sysinit.target starts targets,
services, and mounts based on units contained in the
/usr/lib/systemd/system/sysinit.target.wants directory. These units enable logging, set
kernel options, start the udevd daemon to detect hardware, and allow file system
decryption, among other things. The /etc/systemd/system/sysinit.target.wants directory
contains services that start iSCSI, multipath, LVM monitoring and RAID services.
local-fs.target: The local-fs.target is set to run after the local-fs-pre.target target, based
on this line:
After=local-fs-pre.target
There are no services associated with the local-fs-pre.target target (you could add some to
a "wants" directory if you like). However, units in the /usr/lib/systemd/system/local-
fs.target.wants directory import the network configuration from the initramfs, run a file
system check (fsck) on the root file system when necessary, and remounting the root file
system (and special kernel file systems) based on the contents of the /etc/fstab file.
Although the boot process is built by systemd in the order just shown, it actually runs, in general,
in the opposite order. As a rule, a target on which another target is dependent must be running
before the units in the first target can start. To see more details about the boot process, see the
bootup man page (man 7 bootup).
Checking service status: To check the status of a service (for example, nfs-
server.service), type the following:
# systemctl status nfs-server.service
nfs-server.service - NFS Server
Loaded: loaded (/usr/lib/systemd/system/nfs-server.service;
disabled)
Active: active (exited) since Wed 2014-03-19 10:29:40 MDT; 57s ago
Process: 5206 ExecStartPost=/usr/libexec/nfs-utils/scripts/nfs-
server.postconfig (code=exited, status=0/SUCCESS)
Process: 5191 ExecStart=/usr/sbin/rpc.nfsd $RPCNFSDARGS $RPCNFSDCOUNT
(code=exited, status=0/SUCCESS)
Process: 5188 ExecStartPre=/usr/sbin/exportfs -r (code=exited,
status=0/SUCCESS)
Process: 5187 ExecStartPre=/usr/libexec/nfs-utils/scripts/nfs-
server.preconfig (code=exited, status=0/SUCCESS)
Main PID: 5191 (code=exited, status=0/SUCCESS)
CGroup: /system.slice/nfs-server.service
Mar 19 10:29:40 localhost.localdomain systemd[1]: Starting NFS
Server...
Mar 19 10:29:40 localhost.localdomain systemd[1]: Started NFS Server.
Stopping a service: To stop a service, use the stop option as follows:
# systemctl stop nfs-server.service
Starting a service: To start a service, use the start option as follows:
# systemctl start nfs-server.service
Enabling a service: To enable a service so it starts automatically at boot time, type the
following:
# systemctl enable nfs-server.service
Disable a service: To disable a service so it doesn't start automatically at boot time, type
the following:
# systemctl disable nfs-server.service
Listing dependencies: To see dependencies of a service, use the list-dependencies
option, as follows:
# systemctl list-dependencies nfs-server.service
nfs-server.service
├─nfs-idmap.service
├─nfs-mountd.service
├─nfs-rquotad.service
├─proc-fs-nfsd.mount
├─rpcbind.service
├─system.slice
├─var-lib-nfs-rpc_pipefs.mount
└─basic.target
├─alsa-restore.service
├─alsa-state.service
...
Listing units in targets: To see what services and other units (service, mount, path,
socket, and so on) are associated with a particular target, type the following:
# systemctl list-dependencies multi-user.target
multi-user.target
├─abrt-ccpp.service
├─abrt-oops.service
├─abrt-vmcore.service
├─abrt-xorg.service
├─abrtd.service
├─atd.service
├─auditd.service
├─avahi-daemon.service
├─brandbot.path
├─chronyd.service
├─crond.service
...
List specific types of units: Use the following command to list specific types of units (in
these examples, service and mount unit types):
# systemctl list-units --type service
UNIT LOAD ACTIVE SUB DESCRIPTION
abrt-ccpp.service loaded active exited Install ABRT
coredump hook
abrt-oops.service loaded active running ABRT kernel log
watcher
abrt-xorg.service loaded active running ABRT Xorg log
watcher
abrtd.service loaded active running ABRT Automated Bug
Reporting
accounts-daemon.service loaded active running Accounts Service
...
# systemctl list-units --type mount
UNIT LOAD ACTIVE SUB DESCRIPTION
-.mount loaded active mounted /
boot.mount loaded active mounted /boot
dev-hugepages.mount loaded active mounted Huge Pages File
System
dev-mqueue.mount loaded active mounted POSIX Message Queue
File Syst
mnt-repo.mount loaded active mounted /mnt/repo
proc-fs-nfsd.mount loaded active mounted RPC Pipe File System
run-user-1000-gvfs.mount loaded active mounted /run/user/1000/gvfs
...
Listing all units: To list all units installed on the system, along with their current states,
type the following:
# systemctl list-unit-files
UNIT FILE STATE
proc-sys-fs-binfmt_misc.automount static
dev-hugepages.mount static
dev-mqueue.mount static
proc-sys-fs-binfmt_misc.mount static
...
arp-ethers.service disabled
atd.service enabled
auditd.service enabled
...
View service processes with systemd-cgtop: To view processes associated with a
particular service (cgroup), you can use the systemd-cgtop command. Like the top
command (which sorts processes by such things as CPU and memory usage), systemd-
cgtop lists running processes based on their service (cgroup label). Once systemd-cgtop
is running, you can press keys to sort by memory (m), CPU (c), task (t), path (p), or I/O
load (i). Here is an example:
# systemd-cgtop
Recursively view cgroup contents: To output a recursive list of cgroup content, use the
systemd-cgls command:
# systemd-cgls
├─user.slice
│ ├─user-1000.slice
│ │ ├─session-5.scope
│ │ │ ├─2661 gdm-session-worker [pam/gdm-password]
│ │ │ ├─2672 /usr/bin/gnome-keyring-daemon --daemonize --login
│ │ │ ├─2674 gnome-session --session gnome-classic
│ │ │ ├─2682 dbus-launch --sh-syntax --exit-with-session
│ │ │ ├─2683 /bin/dbus-daemon --fork --print-pid 4 --print-address 6 --
session
│ │ │ ├─2748 /usr/libexec/gvfsd
...
View journal (log) files: Using the journalctl command you can view messages from
the systemd journal. Using different options you can select which group of messages to
display. The journalctl command also supports tab completion to fill in fields for which
to search. Here are some examples:
# journalctl -h View help for the command
# journalctl -k View kernel messages from current boot
# journalctl -f Follow journal messages (like tail -f)
# journalctl -u NetworkManager View messages for specific unit (can
tab complete)
Here are some details of how systemd compares to pre-RHEL 7 init and related commands:
System startup: The systemd process is the first process ID (PID 1) to run on RHEL 7
system. It initializes the system and launches all the services that were once started by the
traditional init process.
Managing system services: For RHEL 7, the systemctl command replaces service and
chkconfig. Prior to RHEL 7, once RHEL was up and running, the service command was
used to start and stop services immediately. The chkconfig command was used to
identify at which run levels a service would start or stop automatically.
Although you can still use the service and chkconfig commands to start/stop and
enable/disable services, respectively, they are not 100% compatible with the RHEL 7
systemctl command. For example, non-standard service options, such as those that start
databases or check configuration files, may not be supported in the same way for RHEL 7
services.
Changing runlevels: Prior to RHEL 7, runlevels were used to identify a set of services
that would start or stop when that runlevel was requested. Instead of runlevels, systemd
uses the concept of targets to group together sets of services that are started or stopped. A
target can also include other targets (for example, the multi-user target includes an nfs
target).
There are systemd targets that align with the earlier runlevels. However the point of
targets is not to necessarily imply a level of activity (for example, runlevel 3 implied
more services were active than runlevel 1). Instead targets just represent a group of
services, so it's appropriate that there are many more targets available than there are
runlevels. The following list shows how systemd targets align with traditional runlevels:
Traditional runlevel New target name Symbolically linked to...
Runlevel 0 | runlevel0.target -> poweroff.target
Runlevel 1 | runlevel1.target -> rescue.target
Runlevel 2 | runlevel2.target -> multi-user.target
Runlevel 3 | runlevel3.target -> multi-user.target
Runlevel 4 | runlevel4.target -> multi-user.target
Runlevel 5 | runlevel5.target -> graphical.target
Runlevel 6 | runlevel6.target -> reboot.target
Default runlevel: The default runlevel (previously set in the /etc/inittab file) is now
replaced by a default target. The location of the default target is
/etc/systemd/system/default.target, which by default is linked to the multi-user target.
Location of services: Before systemd, services were stored as scripts in the /etc/init.d
directory, then linked to different runlevel directories (such as /etc/rc3.d, /etc/rc5.d, and
so on). Services with systemd are named something.service, such as firewalld.service,
and are stored in /lib/systemd/system and /etc/systemd/system directories. Think of the
/lib files as being more permanent and the /etc files as the place you can modify
configurations as needed.
When you enable a service in RHEL 7, the service file is linked to a file in the
/etc/systemd/system/multi-user.target.wants directory. For example, if you run
systemctl enable fcoe.service a symbolic link is created from
/etc/systemd/system/multi-user.target.wants/fcoe.service that points to
/lib/systemd/system/fcoe.service to cause the fcoe.service to start at boot time.
Also, the older System V init scripts were actual shell scripts. The systemd files tasked to
do the same job are more like .ini files that contain the information needed to launch a
service.
Configuration files: The /etc/inittab file was used by the init process in RHEL 6 and
earlier to point to the initialization files (such as /etc/rc.sysinit) and runlevel service
directories (such as /etc/rc5.d) needed to start up the system. Changes to those services
was done in files (usually named after the service) in the /etc/sysconfig directory. For
systemd in RHEL 7, there are still files in /etc/sysconfig used to modify how services
behave. However, services can be modified by adding files to the /etc/systemd directory
to override the permanent service files in the /lib/systemd directories.
Transitioning to systemd
If you are used to using the init process and System V init scripts prior to RHEL 7, there are a
few things you should know about transitioning to systemd:
Using RHEL 6 commands: For the time being, you can use commands such as service,
chkconfig, runlevel, and init as you did in RHEL 6. They will cause appropriate systemd
commands to run, with similar, if not exactly the same, results. Here are some examples:
# service cups restart
Redirecting to /bin/systemctl restart cups.service
# chkconfig cups on
Note: Forwarding request to 'systemctl enable cups.service'.
System V init Scripts: Although not encouraged, System V init scripts are still
supported. There are still some services in RHEL 7 that are implemented in System V init
scripts. To see System V init scripts that are available on your system and the runlevels
on which they start, use the chkconfig command as follows:
# chkconfig --list
...
iprdump 0:off 1:off 2:on 3:on 4:on 5:on 6:off
iprinit 0:off 1:off 2:on 3:on 4:on 5:on 6:off
iprupdate 0:off 1:off 2:on 3:on 4:on 5:on 6:off
netconsole 0:off 1:off 2:off 3:off 4:off 5:on 6:off
network 0:off 1:off 2:on 3:on 4:on 5:on 6:off
rhnsd 0:off 1:off 2:on 3:on 4:on 5:on 6:off
...
Using chkconfig, however, will not show you the whole list of services on your system. To see
the systemd-specific services, run the systemctl list-unit-files command, as described earlier.
Customizing motd
You can have the MOTD (message of the day) display messages that may be unique to the machine. One way
to do this is to create a script that runs when a user logs on to the system.
First, create a script in /etc/profile.d = touch motd.sh
Make it executable = chmod a+x motd.sh (make sure it has the extension as .sh)
#!/bin/bash
#
echo -e "
##################################
#
# Welcome to `hostname`
# This system is running `cat /etc/redhat-release`
# kernel is `uname -r`
#
# You are logged in as `whoami`
#
##################################
"
PrintMotd no
#####################################
#
# Welcome to MyFirstLinuxVM
# This system is running CentOS Linux release 7.5.1804 (Core)
# kernel is 3.10.0-862.el7.x86_64
#
# You are logged in as iafzal
#
#####################################
Steps for NFS Server Configuration
• Once the packages are installed, enable and start NFS services
# mkdir /mypretzels
# exportfs -rv
• Once the packages are installed enable and start rpcbind service
# mkdir /mnt/kramer
# df –h
• To unmount
# umount /mnt/kramer
Red Hat Enterprise Linux 7
Milan Navrátil
Red Hat Customer Content Services
Jacquelynn East
Red Hat Customer Content Services
Don Domingo
Red Hat Customer Content Services
Josef Bacik
Server Development Kernel File System
jwhiter@redhat.com
Disk Quotas
Kamil Dudka
Base Operating System Core Services - BRNO
kdudka@redhat.com
Access Control Lists
Hans de Goede
Base Operating System Installer
hdegoede@redhat.com
Partitions
Harald Hoyer
Engineering Software Engineering
harald@redhat.com
File Systems
Dennis Keefe
Base Operating Systems Kernel Storage
dkeefe@redhat.com
VDO
Doug Ledford
Server Development Hardware Enablement
dledford@redhat.com
RAID
Daniel Novotny
Base Operating System Core Services - BRNO
dnovotny@redhat.com
The /proc File System
Nathan Straz
Quality Engineering QE - Platform
nstraz@redhat.com
Legal Notice
GFS2
Copyright
Andy Walsh© 2018 Red Hat, Inc.
Base Operating Systems Kernel Storage
This document is licensed by Red Hat under the Creative Commons Attribution-ShareAlike 3.0
awalsh@redhat.com
Unported
VDO License. If you distribute this document, or a modified version of it, you must provide
attribution to Red Hat, Inc. and provide a link to the original. If the document is modified, all Red Hat
David Wysochanski
trademarks must be removed.
Server Development Kernel Storage
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert,
dwysocha@redhat.com
Section
LVM/LVM2 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat,Christie
Michael Red Hat Enterprise Linux, the Shadowman logo, JBoss, OpenShift, Fedora, the Infinity
logo, and RHCE are trademarks
Server Development of Red Hat, Inc., registered in the United States and other
Kernel Storage
countries.
mchristi@redhat.com
Online Storage
Linux ® is the registered trademark of Linus Torvalds in the United States and other countries.
Sachin Prabhu
Java ® is a registered trademark of Oracle and/or its affiliates.
Software Maintenance Engineering
sprabhu@redhat.com
XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States
NFS
and/or other countries.
Rob
MySQL Evers
® is a registered trademark of MySQL AB in the United States, the European Union and
Server Development
other countries. Kernel Storage
revers@redhat.com
Online Storage
Node.js ® is an official trademark of Joyent. Red Hat Software Collections is not formally related to
or endorsed by the official Joyent Node.js open source or commercial project.
David Howells
Server
The OpenStack
Development
® WordHardware
Mark and
Enablement
OpenStack logo are either registered trademarks/service marks
dhowells@redhat.com
or trademarks/service marks of the OpenStack Foundation, in the United States and other countries
FS-Cache
and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or
sponsored by the OpenStack Foundation, or the OpenStack community.
David Lehman
Base
All other
Operating
trademarks
Systemare Installer
the property of their respective owners.
dlehman@redhat.com
Storage configuration during installation
Abstract
Jeff Moyer
This guide
Server provides instructions
Development Kernel File on how to effectively manage storage devices and file systems on
System
Red Hat Enterprise
jmoyer@redhat.com Linux 7. It is intended for use by system administrators with basic to
intermediate knowledge of Red Hat Enterprise Linux or Fedora.
Solid-State Disks
Eric Sandeen
Server Development Kernel File System
esandeen@redhat.com
ext3, ext4, XFS, Encrypted File Systems
Mike Snitzer
Server Development Kernel Storage
msnitzer@redhat.com
I/O Stack and Limits
Red Hat Subject Matter Experts
Contributors
Edited by
Marek Suchánek
Red Hat Customer Content Services
msuchane@redhat.com
Apurva Bhide
Red Hat Customer Content Services
abhide@redhat.com
Table of Contents
Table of Contents
.CHAPTER
. . . . . . . . .1.. .OVERVIEW
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7. . . . . . . . . .
1.1. NEW FEATURES AND ENHANCEMENTS IN RED HAT ENTERPRISE LINUX 7 7
. . . . . .I.. FILE
PART . . . . .SYSTEMS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9. . . . . . . . . .
.CHAPTER
. . . . . . . . .2.. .FILE
. . . . SYSTEM
. . . . . . . . STRUCTURE
. . . . . . . . . . . .AND
. . . . MAINTENANCE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
...........
2.1. OVERVIEW OF FILESYSTEM HIERARCHY STANDARD (FHS) 10
2.2. SPECIAL RED HAT ENTERPRISE LINUX FILE LOCATIONS 18
2.3. THE /PROC VIRTUAL FILE SYSTEM 18
2.4. DISCARD UNUSED BLOCKS 19
.CHAPTER
. . . . . . . . .3.. .THE
. . . .XFS
. . . .FILE
. . . . SYSTEM
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
...........
3.1. CREATING AN XFS FILE SYSTEM 21
3.2. MOUNTING AN XFS FILE SYSTEM 22
3.3. XFS QUOTA MANAGEMENT 23
3.4. INCREASING THE SIZE OF AN XFS FILE SYSTEM 25
3.5. REPAIRING AN XFS FILE SYSTEM 26
3.6. SUSPENDING AN XFS FILE SYSTEM 26
3.7. BACKING UP AND RESTORING XFS FILE SYSTEMS 27
3.8. CONFIGURING ERROR BEHAVIOR 30
3.9. OTHER XFS FILE SYSTEM UTILITIES 32
3.10. MIGRATING FROM EXT4 TO XFS 33
. . . . . . . . . .4.. .THE
CHAPTER . . . .EXT3
. . . . .FILE
. . . . SYSTEM
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
...........
4.1. CREATING AN EXT3 FILE SYSTEM 38
4.2. CONVERTING TO AN EXT3 FILE SYSTEM 39
4.3. REVERTING TO AN EXT2 FILE SYSTEM 39
.CHAPTER
. . . . . . . . .5.. .THE
. . . .EXT4
. . . . .FILE
. . . . SYSTEM
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
...........
5.1. CREATING AN EXT4 FILE SYSTEM 42
5.2. MOUNTING AN EXT4 FILE SYSTEM 44
5.3. RESIZING AN EXT4 FILE SYSTEM 44
5.4. BACKING UP EXT2, EXT3, OR EXT4 FILE SYSTEMS 45
5.5. RESTORING EXT2, EXT3, OR EXT4 FILE SYSTEMS 46
5.6. OTHER EXT4 FILE SYSTEM UTILITIES 49
.CHAPTER
. . . . . . . . .6.. .BTRFS
. . . . . . (TECHNOLOGY
. . . . . . . . . . . . . . PREVIEW)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
...........
6.1. CREATING A BTRFS FILE SYSTEM 51
6.2. MOUNTING A BTRFS FILE SYSTEM 51
6.3. RESIZING A BTRFS FILE SYSTEM 52
6.4. INTEGRATED VOLUME MANAGEMENT OF MULTIPLE DEVICES 55
6.5. SSD OPTIMIZATION 58
6.6. BTRFS REFERENCES 59
. . . . . . . . . .7.. .GLOBAL
CHAPTER . . . . . . . .FILE
. . . . SYSTEM
. . . . . . . . 2. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
...........
.CHAPTER
. . . . . . . . .8.. .NETWORK
. . . . . . . . . .FILE
. . . .SYSTEM
. . . . . . . .(NFS)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
...........
8.1. INTRODUCTION TO NFS 61
8.2. PNFS 64
8.3. CONFIGURING NFS CLIENT 65
8.4. AUTOFS 66
8.5. COMMON NFS MOUNT OPTIONS 72
8.6. STARTING AND STOPPING THE NFS SERVER 74
8.7. CONFIGURING THE NFS SERVER 75
1
Storage Administration Guide
.CHAPTER
. . . . . . . . .9.. .SERVER
. . . . . . . .MESSAGE
. . . . . . . . . BLOCK
. . . . . . . (SMB)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .89
...........
9.1. PROVIDING SMB SHARES 89
9.2. MOUNTING AN SMB SHARE 89
.CHAPTER
. . . . . . . . .10.
. . .FS-CACHE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .95
...........
10.1. PERFORMANCE GUARANTEE 96
10.2. SETTING UP A CACHE 96
10.3. USING THE CACHE WITH NFS 97
10.4. SETTING CACHE CULL LIMITS 99
10.5. STATISTICAL INFORMATION 100
10.6. FS-CACHE REFERENCES 100
. . . . . .II.
PART . .STORAGE
. . . . . . . . . ADMINISTRATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .101
............
. . . . . . . . . .11.
CHAPTER . . .STORAGE
. . . . . . . . . CONSIDERATIONS
. . . . . . . . . . . . . . . . .DURING
. . . . . . . .INSTALLATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .102
............
11.1. SPECIAL CONSIDERATIONS 102
.CHAPTER
. . . . . . . . .12.
. . .FILE
. . . . SYSTEM
. . . . . . . . CHECK
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .104
............
12.1. BEST PRACTICES FOR FSCK 104
12.2. FILE SYSTEM-SPECIFIC INFORMATION FOR FSCK 105
. . . . . . . . . .13.
CHAPTER . . .PARTITIONS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .109
............
Manipulating Partitions on Devices in Use 109
Modifying the Partition Table 109
13.1. VIEWING THE PARTITION TABLE 110
13.2. CREATING A PARTITION 112
13.3. REMOVING A PARTITION 115
13.4. SETTING A PARTITION TYPE 116
13.5. RESIZING A PARTITION WITH FDISK 116
. . . . . . . . . .14.
CHAPTER . . .CREATING
. . . . . . . . . .AND
. . . . MAINTAINING
. . . . . . . . . . . . .SNAPSHOTS
. . . . . . . . . . . WITH
. . . . . SNAPPER
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .119
............
14.1. CREATING INITIAL SNAPPER CONFIGURATION 119
14.2. CREATING A SNAPPER SNAPSHOT 120
14.3. TRACKING CHANGES BETWEEN SNAPPER SNAPSHOTS 124
14.4. REVERSING CHANGES IN BETWEEN SNAPSHOTS 127
14.5. DELETING A SNAPPER SNAPSHOT 129
. . . . . . . . . .15.
CHAPTER . . .SWAP
. . . . . .SPACE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .130
............
15.1. ADDING SWAP SPACE 131
15.2. REMOVING SWAP SPACE 133
15.3. MOVING SWAP SPACE 135
. . . . . . . . . .16.
CHAPTER . . .SYSTEM
. . . . . . . .STORAGE
. . . . . . . . . MANAGER
. . . . . . . . . .(SSM)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .136
............
16.1. SSM BACK ENDS 136
16.2. COMMON SSM TASKS 138
16.3. SSM RESOURCES 145
. . . . . . . . . .17.
CHAPTER . . .DISK
. . . . .QUOTAS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .147
............
17.1. CONFIGURING DISK QUOTAS 147
17.2. MANAGING DISK QUOTAS 152
17.3. DISK QUOTA REFERENCES 154
2
Table of Contents
.CHAPTER
. . . . . . . . .18.
. . .REDUNDANT
. . . . . . . . . . . .ARRAY
. . . . . . .OF
. . .INDEPENDENT
. . . . . . . . . . . . . DISKS
. . . . . . (RAID)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .156
............
18.1. RAID TYPES 156
18.2. RAID LEVELS AND LINEAR SUPPORT 157
18.3. LINUX RAID SUBSYSTEMS 159
18.4. RAID SUPPORT IN THE ANACONDA INSTALLER 159
18.5. CONVERTING ROOT DISK TO RAID1 AFTER INSTALLATION 160
18.6. CONFIGURING RAID SETS 160
18.7. CREATING ADVANCED RAID DEVICES 161
. . . . . . . . . .19.
CHAPTER . . .USING
. . . . . .THE
. . . . MOUNT
. . . . . . . COMMAND
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .163
............
19.1. LISTING CURRENTLY MOUNTED FILE SYSTEMS 163
19.2. MOUNTING A FILE SYSTEM 164
19.3. UNMOUNTING A FILE SYSTEM 173
19.4. MOUNT COMMAND REFERENCES 174
. . . . . . . . . .20.
CHAPTER . . .THE
. . . .VOLUME_KEY
. . . . . . . . . . . . .FUNCTION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .175
............
20.1. VOLUME_KEY COMMANDS 175
20.2. USING VOLUME_KEY AS AN INDIVIDUAL USER 176
20.3. USING VOLUME_KEY IN A LARGER ORGANIZATION 177
20.4. VOLUME_KEY REFERENCES 179
.CHAPTER
. . . . . . . . .21.
. . .SOLID-STATE
. . . . . . . . . . . . DISK
. . . . . DEPLOYMENT
. . . . . . . . . . . . . GUIDELINES
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .180
............
Deployment Considerations 180
Performance Tuning Considerations 182
. . . . . . . . . .22.
CHAPTER . . .WRITE
. . . . . . BARRIERS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .183
............
22.1. IMPORTANCE OF WRITE BARRIERS 183
22.2. ENABLING AND DISABLING WRITE BARRIERS 183
22.3. WRITE BARRIER CONSIDERATIONS 184
. . . . . . . . . .23.
CHAPTER . . .STORAGE
. . . . . . . . . I/O
. . . ALIGNMENT
. . . . . . . . . . . AND
. . . . .SIZE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .186
............
23.1. PARAMETERS FOR STORAGE ACCESS 186
23.2. USERSPACE ACCESS 187
23.3. I/O STANDARDS 188
23.4. STACKING I/O PARAMETERS 189
23.5. LOGICAL VOLUME MANAGER 189
23.6. PARTITION AND FILE SYSTEM TOOLS 189
. . . . . . . . . .24.
CHAPTER . . .SETTING
. . . . . . . . UP
. . . A. .REMOTE
. . . . . . . . DISKLESS
. . . . . . . . . .SYSTEM
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .191
............
24.1. CONFIGURING A TFTP SERVICE FOR DISKLESS CLIENTS 191
24.2. CONFIGURING DHCP FOR DISKLESS CLIENTS 192
24.3. CONFIGURING AN EXPORTED FILE SYSTEM FOR DISKLESS CLIENTS 193
. . . . . . . . . .25.
CHAPTER . . .ONLINE
. . . . . . . STORAGE
. . . . . . . . . MANAGEMENT
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .195
............
25.1. TARGET SETUP 195
25.2. CREATING AN ISCSI INITIATOR 204
25.3. FIBRE CHANNEL 205
25.4. CONFIGURING A FIBRE CHANNEL OVER ETHERNET INTERFACE 208
25.5. CONFIGURING AN FCOE INTERFACE TO AUTOMATICALLY MOUNT AT BOOT 209
25.6. ISCSI 211
25.7. PERSISTENT NAMING 212
25.8. REMOVING A STORAGE DEVICE 216
25.9. REMOVING A PATH TO A STORAGE DEVICE 218
25.10. ADDING A STORAGE DEVICE OR PATH 218
25.11. SCANNING STORAGE INTERCONNECTS 220
3
Storage Administration Guide
. . . . . . . . . .26.
CHAPTER . . .DEVICE
. . . . . . .MAPPER
. . . . . . . . MULTIPATHING
. . . . . . . . . . . . . . AND
. . . . .VIRTUAL
. . . . . . . . STORAGE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .240
............
26.1. VIRTUAL STORAGE 240
26.2. DM-MULTIPATH 240
.CHAPTER
. . . . . . . . .27.
. . .EXTERNAL
. . . . . . . . . .ARRAY
. . . . . . .MANAGEMENT
. . . . . . . . . . . . . .(LIBSTORAGEMGMT)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
............
27.1. INTRODUCTION TO LIBSTORAGEMGMT 242
27.2. LIBSTORAGEMGMT TERMINOLOGY 243
27.3. INSTALLING LIBSTORAGEMGMT 245
27.4. USING LIBSTORAGEMGMT 246
. . . . . . . . . .28.
CHAPTER . . .PERSISTENT
. . . . . . . . . . . .MEMORY:
. . . . . . . . .NVDIMMS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .251
............
NVDIMMs Interleaving 251
Persistent Memory Access Modes 251
28.1. CONFIGURING PERSISTENT MEMORY WITH NDCTL 252
28.2. CONFIGURING PERSISTENT MEMORY FOR USE AS A BLOCK DEVICE (LEGACY MODE) 255
28.3. CONFIGURING PERSISTENT MEMORY FOR FILE SYSTEM DIRECT ACCESS (DAX) 255
28.4. CONFIGURING PERSISTENT MEMORY FOR USE IN DEVICE DAX MODE 256
28.5. TROUBLESHOOTING 257
. . . . . .III.
PART . . DATA
. . . . . .DEDUPLICATION
. . . . . . . . . . . . . . . AND
. . . . .COMPRESSION
. . . . . . . . . . . . . .WITH
. . . . .VDO
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .258
............
. . . . . . . . . .29.
CHAPTER . . .VDO
. . . . INTEGRATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .259
............
29.1. THEORETICAL OVERVIEW OF VDO 259
29.2. SYSTEM REQUIREMENTS 262
29.3. GETTING STARTED WITH VDO 265
29.4. ADMINISTERING VDO 269
29.5. DEPLOYMENT SCENARIOS 278
29.6. TUNING VDO 279
29.7. VDO COMMANDS 285
29.8. STATISTICS FILES IN /SYS 303
. . . . . . . . . .30.
CHAPTER . . .VDO
. . . . EVALUATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .305
............
30.1. INTRODUCTION 305
30.2. TEST ENVIRONMENT PREPARATIONS 305
30.3. DATA EFFICIENCY TESTING PROCEDURES 309
30.4. PERFORMANCE TESTING PROCEDURES 317
30.5. ISSUE REPORTING 322
30.6. CONCLUSION 323
. . . . . . . . . . A.
APPENDIX . . .RED
. . . .HAT
. . . . CUSTOMER
. . . . . . . . . . .PORTAL
. . . . . . . .LABS
. . . . . RELEVANT
. . . . . . . . . . TO
. . . STORAGE
. . . . . . . . . .ADMINISTRATION
. . . . . . . . . . . . . . . . . . . . . . .324
............
SCSI DECODER 324
FILE SYSTEM LAYOUT CALCULATOR 324
LVM RAID CALCULATOR 324
ISCSI HELPER 324
4
Table of Contents
. . . . . . . . . . B.
APPENDIX . . .REVISION
. . . . . . . . .HISTORY
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .326
............
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .327
INDEX ............
5
Storage Administration Guide
6
CHAPTER 1. OVERVIEW
CHAPTER 1. OVERVIEW
The Storage Administration Guide contains extensive information on supported file systems and data
storage features in Red Hat Enterprise Linux 7. This book is intended as a quick reference for
administrators managing single-node (that is, non-clustered) storage solutions.
The Storage Administration Guide is split into the following parts: File Systems, Storage Administration,
and Data Deduplication and Compression with VDO.
The File Systems part details the various file systems Red Hat Enterprise Linux 7 supports. It describes
them and explains how best to utilize them.
The Storage Administration part details the various tools and storage administration tasks Red Hat
Enterprise Linux 7 supports. It describes them and explains how best to utilize them.
The Data Deduplication and Compression with VDO part describes the Virtual Data Optimizer (VDO). It
explains how to use VDO to reduce your storage requirements.
Snapper
Red Hat Enterprise Linux 7 introduces a new tool called Snapper that allows for the easy creation and
management of snapshots for LVM and Btrfs. For more information, see Chapter 14, Creating and
Maintaining Snapshots with Snapper.
7
Storage Administration Guide
NOTE
Btrfs is available as a Technology Preview feature in Red Hat Enterprise Linux 7 but has
been deprecated since the Red Hat Enterprise Linux 7.4 release. It will be removed in a
future major release of Red Hat Enterprise Linux.
For more information, see Deprecated Functionality in the Red Hat Enterprise Linux 7.4
Release Notes.
Btrfs is a local file system that aims to provide better performance and scalability, including integrated
LVM operations. This file system is not fully supported by Red Hat and as such is a technology preview.
For more information on Btrfs, see Chapter 6, Btrfs (Technology Preview).
8
PART I. FILE SYSTEMS
NOTE
Btrfs is available as a Technology Preview feature in Red Hat Enterprise Linux 7 but has
been deprecated since the Red Hat Enterprise Linux 7.4 release. It will be removed in a
future major release of Red Hat Enterprise Linux.
For more information, see Deprecated Functionality in the Red Hat Enterprise Linux 7.4
Release Notes.
For an overview of Red Hat Enterprise Linux file systems and storage limits, see Red Hat
Enterprise Linux technology capabilities and limits at Red Hat Knowledgebase.
XFS is the default file system in Red Hat Enterprise Linux 7 and Red Hat, and Red Hat recommends you
to use XFS unless you have a strong reason to use another file system. For general information on
common file systems and their properties, see the following Red Hat Knowledgebase article: How to
Choose your Red Hat Enterprise Linux File System.
9
Storage Administration Guide
Categorizing files in this manner helps correlate the function of each file with the permissions assigned
to the directories which hold them. How the operating system and its users interact with a file determines
the directory in which it is placed, whether that directory is mounted with read-only or read and write
permissions, and the level of access each user has to that file. The top level of this organization is
crucial; access to the underlying directories can be restricted, otherwise security problems could arise if,
from the top level down, access rules do not adhere to a rigid structure.
The FHS document is the authoritative reference to any FHS-compliant file system, but the standard
leaves many areas undefined or extensible. This section is an overview of the standard and a description
of the parts of the file system not covered by the standard.
The ability to mount a /usr/ partition as read-only. This is crucial, since /usr/ contains
common executables and should not be changed by users. In addition, since /usr/ is mounted
as read-only, it should be mountable from the CD-ROM drive or from another machine via a
read-only NFS mount.
NOTE
The directories that are available depend on what is installed on any given system. The
following lists are only an example of what may be found.
10
CHAPTER 2. FILE SYSTEM STRUCTURE AND MAINTENANCE
df Command
The df command reports the system's disk space usage. Its output looks similar to the following:
By default, df shows the partition size in 1 kilobyte blocks and the amount of used and available disk
space in kilobytes. To view the information in megabytes and gigabytes, use the command df -h. The
-h argument stands for "human-readable" format. The output for df -h looks similar to the following:
NOTE
In the given examples, the mounted partition /dev/shm represents the system's virtual
memory file system.
du Command
The du command displays the estimated amount of space being used by files in a directory, displaying
the disk usage of each subdirectory. The last line in the output of du shows the total disk usage of the
directory. To see only the total disk usage of a directory in human-readable format, use du -hs. For
more options, see man du.
To view the system's partitions and disk space usage in a graphical format, use the Gnome System
Monitor by clicking on Applications → System Tools → System Monitor or using the command
gnome-system-monitor. Select the File Systems tab to view the system's partitions. The following
figure illustrates the File Systems tab.
11
Storage Administration Guide
The /boot/ directory contains static files required to boot the system, for example, the Linux kernel.
These files are essential for the system to boot properly.
WARNING
Do not remove the /boot/ directory. Doing so renders the system unbootable.
The /dev/ directory contains device nodes that represent the following device types:
These device nodes are essential for the system to function properly. The udevd daemon creates and
removes device nodes in /dev/ as needed.
Devices in the /dev/ directory and subdirectories are defined as either character (providing only a serial
12
CHAPTER 2. FILE SYSTEM STRUCTURE AND MAINTENANCE
stream of input and output, for example, mouse or keyboard) or block (accessible randomly, such as a
hard drive or a floppy drive). If GNOME or KDE is installed, some storage devices are automatically
detected when connected (such as with USB) or inserted (such as a CD or DVD drive), and a pop-up
window displaying the contents appears.
File Description
Mapped device
A logical volume in a volume group, for example, /dev/mapper/VolGroup00-LogVol02.
Static device
A traditional storage volume, for example, /dev/sdbX, where sdb is a storage device name and X is
the partition number. /dev/sdbX can also be /dev/disk/by-id/WWID, or /dev/disk/by-
uuid/UUID. For more information, see Section 25.7, “Persistent Naming”.
The /etc/ directory is reserved for configuration files that are local to the machine. It should not contain
any binaries; if there are any binaries, move them to /usr/bin/ or /usr/sbin/.
For example, the /etc/skel/ directory stores "skeleton" user files, which are used to populate a home
directory when a user is first created. Applications also store their configuration files in this directory and
may reference them when executed. The /etc/exports file controls which file systems export to
remote hosts.
The /mnt/ directory is reserved for temporarily mounted file systems, such as NFS file system mounts.
For all removable storage media, use the /media/ directory. Automatically detected removable media is
mounted in the /media directory.
13
Storage Administration Guide
IMPORTANT
The /opt/ directory is normally reserved for software and add-on packages that are not part of the
default installation. A package that installs to /opt/ creates a directory bearing its name, for example,
/opt/packagename/. In most cases, such packages follow a predictable subdirectory structure; most
store their binaries in /opt/packagename/bin/ and their man pages in /opt/packagename/man/.
The /proc/ directory contains special files that either extract information from the kernel or send
information to it. Examples of such information include system memory, CPU information, and hardware
configuration. For more information about /proc/, see Section 2.3, “The /proc Virtual File System”.
The /srv/ directory contains site-specific data served by a Red Hat Enterprise Linux system. This
directory gives users the location of data files for a particular service, such as FTP, WWW, or CVS. Data
that only pertains to a specific user should go in the /home/ directory.
The /sys/ directory utilizes the new sysfs virtual file system specific to the kernel. With the increased
support for hot plug hardware devices in the kernel, the /sys/ directory contains information similar to
that held by /proc/, but displays a hierarchical view of device information specific to hot plug devices.
The /usr/ directory is for files that can be shared across multiple machines. The /usr/ directory is
often on its own partition and is mounted read-only. At a minimum, /usr/ should contain the following
subdirectories:
/usr/bin
This directory is used for binaries.
/usr/etc
This directory is used for system-wide configuration files.
/usr/games
This directory stores games.
/usr/include
This directory is used for C header files.
/usr/kerberos
This directory is used for Kerberos-related binaries and files.
14
CHAPTER 2. FILE SYSTEM STRUCTURE AND MAINTENANCE
/usr/lib
This directory is used for object files and libraries that are not designed to be directly utilized by shell
scripts or users.
As of Red Hat Enterprise Linux 7.0, the /lib/ directory has been merged with /usr/lib. Now it
also contains libraries needed to execute the binaries in /usr/bin/ and /usr/sbin/. These
shared library images are used to boot the system or execute commands within the root file system.
/usr/libexec
This directory contains small helper programs called by other programs.
/usr/sbin
As of Red Hat Enterprise Linux 7.0, /sbin has been moved to /usr/sbin. This means that it
contains all system administration binaries, including those essential for booting, restoring,
recovering, or repairing the system. The binaries in /usr/sbin/ require root privileges to use.
/usr/share
This directory stores files that are not architecture-specific.
/usr/src
This directory stores source code.
The /usr/ directory should also contain a /local/ subdirectory. As per the FHS, this subdirectory is
used by the system administrator when installing software locally, and should be safe from being
overwritten during system updates. The /usr/local directory has a structure similar to /usr/, and
contains the following subdirectories:
/usr/local/bin
/usr/local/etc
/usr/local/games
/usr/local/include
/usr/local/lib
/usr/local/libexec
/usr/local/sbin
/usr/local/share
/usr/local/src
Red Hat Enterprise Linux's usage of /usr/local/ differs slightly from the FHS. The FHS states that
/usr/local/ should be used to store software that should remain safe from system software
upgrades. Since the RPM Package Manager can perform software upgrades safely, it is not necessary
15
Storage Administration Guide
Instead, Red Hat Enterprise Linux uses /usr/local/ for software local to the machine. For instance, if
the /usr/ directory is mounted as a read-only NFS share from a remote host, it is still possible to install
a package or program under the /usr/local/ directory.
Since the FHS requires Linux to mount /usr/ as read-only, any programs that write log files or need
spool/ or lock/ directories should write them to the /var/ directory. The FHS states /var/ is for
variable data, which includes spool directories and files, logging data, transient and temporary files.
Following are some of the directories found within the /var/ directory:
/var/account/
/var/arpwatch/
/var/cache/
/var/crash/
/var/db/
/var/empty/
/var/ftp/
/var/gdm/
/var/kerberos/
/var/lib/
/var/local/
/var/lock/
/var/log/
/var/mailman/
/var/named/
/var/nis/
/var/opt/
/var/preserve/
/var/run/
/var/spool/
16
CHAPTER 2. FILE SYSTEM STRUCTURE AND MAINTENANCE
/var/tmp/
/var/tux/
/var/www/
/var/yp/
IMPORTANT
System log files, such as messages and lastlog, go in the /var/log/ directory. The
/var/lib/rpm/ directory contains RPM system databases. Lock files go in the /var/lock/ directory,
usually in directories for the program using the file. The /var/spool/ directory has subdirectories that
store data files for some programs. These subdirectories include:
/var/spool/at/
/var/spool/clientmqueue/
/var/spool/cron/
/var/spool/cups/
/var/spool/exim/
/var/spool/lpd/
/var/spool/mail/
/var/spool/mailman/
/var/spool/mqueue/
/var/spool/news/
/var/spool/postfix/
/var/spool/repackage/
/var/spool/rwho/
/var/spool/samba/
/var/spool/squid/
/var/spool/squirrelmail/
/var/spool/up2date/
/var/spool/uucp/
17
Storage Administration Guide
/var/spool/uucppublic/
/var/spool/vbox/
Most files pertaining to RPM are kept in the /var/lib/rpm/ directory. For more information on RPM,
see man rpm.
The /var/cache/yum/ directory contains files used by the Package Updater, including RPM header
information for the system. This location may also be used to temporarily store RPMs downloaded while
updating the system. For more information about the Red Hat Network, see https://rhn.redhat.com/.
Another location specific to Red Hat Enterprise Linux is the /etc/sysconfig/ directory. This directory
stores a variety of configuration information. Many scripts that run at boot time use the files in this
directory.
The /proc file system is not used for storage. Its main purpose is to provide a file-based interface to
hardware, memory, running processes, and other system components. Real-time information can be
retrieved on many system components by viewing the corresponding /proc file. Some of the files within
/proc can also be manipulated (by both users and applications) to configure the kernel.
The following /proc files are relevant in managing and monitoring system storage:
/proc/devices
Displays various character and block devices that are currently configured.
/proc/filesystems
Lists all file system types currently supported by the kernel.
/proc/mdstat
Contains current information on multiple-disk or RAID configurations on the system, if they exist.
/proc/mounts
Lists all mounts currently used by the system.
/proc/partitions
Contains partition block allocation information.
For more information about the /proc file system, see the Red Hat Enterprise Linux 7 Deployment
Guide.
18
CHAPTER 2. FILE SYSTEM STRUCTURE AND MAINTENANCE
Batch discard operations are run explicitly by the user with the fstrim command. This
command discards all unused blocks in a file system that match the user's criteria.
Online discard operations are specified at mount time, either with the -o discard option as
part of a mount command or with the discard option in the /etc/fstab file. They run in real
time without user intervention. Online discard operations only discard blocks that are
transitioning from used to free.
Both operation types are supported for use with ext4 file systems as of Red Hat Enterprise Linux 6.2 and
later and with XFS file systems since Red Hat Enterprise Linux 6.4. Also, the block device underlying the
file system must support physical discard operations. Physical discard operations are supported if the
value stored in the /sys/block/device/queue/discard_max_bytes file is not zero.
a logical device (LVM or MD) comprised of multiple devices, where any one of the device does
not support discard operations
fstrim -v /mnt/non_discard
fstrim: /mnt/non_discard: the discard operation is not supported
NOTE
The mount command allows you to mount a device that does not support discard
operations with the -o discard option.
Red Hat recommends batch discard operations unless the system's workload is such that batch discard
is not feasible, or online discard operations are necessary to maintain performance.
For more information, see the fstrim(8) and mount(8) man pages.
19
Storage Administration Guide
The XFS file system can be defragmented and enlarged while mounted and active.
In addition, Red Hat Enterprise Linux 7 supports backup and restore utilities specific to XFS.
Allocation Features
XFS features the following allocation schemes:
Extent-based allocation
Delayed allocation
Space pre-allocation
Delayed allocation and other performance optimizations affect XFS the same way that they do ext4.
Namely, a program's writes to an XFS file system are not guaranteed to be on-disk unless the
program issues an fsync() call afterwards.
For more information on the implications of delayed allocation on a file system (ext4 and XFS), see
Allocation Features in Chapter 5, The ext4 File System.
NOTE
Quota journaling
This avoids the need for lengthy quota consistency checks after a crash.
Project/directory quotas
This allows quota restrictions over a directory tree.
Subsecond timestamps
20
CHAPTER 3. THE XFS FILE SYSTEM
Procedure
# mkfs.xfs block_device
Replace block_device with the path to a partition or a logical volume. For example,
/dev/sdb1, /dev/disk/by-uuid/05e99ec8-def1-4a5e-8a9d-5945339ceb2a, or
/dev/my-volgroup/my-lv.
When using mkfs.xfs on a block device containing an existing file system, add the -f
option to overwrite that file system.
21
Storage Administration Guide
NOTE
After an XFS file system is created, its size cannot be reduced. However, it can still be
enlarged using the xfs_growfs command. For more information, see Section 3.4,
“Increasing the Size of an XFS File System”).
When creating filesystems on LVM or MD volumes, mkfs.xfs chooses an optimal geometry. This may
also be true on some hardware RAIDs that export geometry information to the operating system.
If the device exports stripe geometry information, the mkfs utility (for ext3, ext4, and xfs) will
automatically use this geometry. If stripe geometry is not detected by the mkfs utility and even though
the storage does, in fact, have stripe geometry, it is possible to manually specify it when creating the file
system using the following options:
su=value
Specifies a stripe unit or RAID chunk size. The value must be specified in bytes, with an optional k,
m, or g suffix.
sw=value
Specifies the number of data disks in a RAID device, or the number of stripe units in the stripe.
The following example specifies a chunk size of 64k on a RAID device containing 4 stripe units:
Additional Resources
For more information about creating XFS file systems, see:
The Red Hat Enterprise Linux Performance Tuning Guide, chapter Tuning XFS
NOTE
Unlike mke2fs, mkfs.xfs does not utilize a configuration file; they are all specified on
the command line.
Write Barriers
22
CHAPTER 3. THE XFS FILE SYSTEM
By default, XFS uses write barriers to ensure file system integrity even when power is lost to a device
with write caches enabled. For devices without write caches, or with battery-backed write caches,
disable the barriers by using the nobarrier option:
For more information about write barriers, see Chapter 22, Write Barriers.
When managing on a per-directory or per-project basis, XFS manages the disk usage of directory
hierarchies associated with a specific project. In doing so, XFS recognizes cross-organizational "group"
boundaries between projects. This provides a level of control that is broader than what is available when
managing quotas for users or groups.
XFS quotas are enabled at mount time, with specific mount options. Each mount option can also be
specified as noenforce; this allows usage reporting without enforcing any limits. Valid quota mount
options are:
Once quotas are enabled, the xfs_quota tool can be used to set limits and report on disk usage. By
default, xfs_quota is run interactively, and in basic mode. Basic mode subcommands simply report
usage, and are available to all users. Basic xfs_quota subcommands include:
quota username/userID
Show usage and limits for the given username or numeric userID
df
Shows free and used counts for blocks and inodes.
23
Storage Administration Guide
In contrast, xfs_quota also has an expert mode. The subcommands of this mode allow actual
configuration of limits, and are available only to users with elevated privileges. To use expert mode
subcommands interactively, use the following command:
# xfs_quota -x
report /path
Reports quota information for a specific file system.
limit
Modify quota limits.
For a complete list of subcommands for either basic or expert mode, use the subcommand help.
All subcommands can also be run directly from a command line using the -c option, with -x for expert
subcommands.
For example, to display a sample quota report for /home (on /dev/blockdevice), use the
command xfs_quota -x -c 'report -h' /home. This displays output similar to the following:
To set a soft and hard inode count limit of 500 and 700 respectively for user john, whose home
directory is /home/john, use the following command:
In this case, pass mount_point which is the mounted xfs file system.
By default, the limit subcommand recognizes targets as users. When configuring the limits for a
group, use the -g option (as in the previous example). Similarly, use -p for projects.
Soft and hard block limits can also be configured using bsoft or bhard instead of isoft or ihard.
For example, to set a soft and hard block limit of 1000m and 1200m, respectively, to group
accounting on the /target/path file system, use the following command:
24
CHAPTER 3. THE XFS FILE SYSTEM
NOTE
IMPORTANT
Quotas for projects with initialized directories can then be configured, with:
Generic quota configuration tools (quota, repquota, and edquota for example) may also be used to
manipulate XFS quotas. However, these tools cannot be used with XFS project quotas.
IMPORTANT
Red Hat recommends the use of xfs_quota over all other available tools.
For more information about setting XFS quotas, see man xfs_quota, man projid(5), and man
projects(5).
The -D size option grows the file system to the specified size (expressed in file system blocks).
Without the -D size option, xfs_growfs will grow the file system to the maximum size supported by
the device.
Before growing an XFS file system with -D size, ensure that the underlying block device is of an
appropriate size to hold the file system later. Use the appropriate resizing methods for the affected block
device.
25
Storage Administration Guide
NOTE
While XFS file systems can be grown while mounted, their size cannot be reduced at all.
For more information about growing a file system, see man xfs_growfs.
# xfs_repair /dev/device
The xfs_repair utility is highly scalable and is designed to repair even very large file systems with
many inodes efficiently. Unlike other Linux file systems, xfs_repair does not run at boot time, even
when an XFS file system was not cleanly unmounted. In the event of an unclean unmount, xfs_repair
simply replays the log at mount time, ensuring a consistent file system.
WARNING
The xfs_repair utility cannot repair an XFS file system with a dirty log. To clear
the log, mount and unmount the XFS file system. If the log is corrupt and cannot be
replayed, use the -L option ("force log zeroing") to clear the log, that is,
xfs_repair -L /dev/device. Be aware that this may result in further
corruption or data loss.
For more information about repairing an XFS file system, see man xfs_repair.
# xfs_freeze mount-point
Suspending write activity allows hardware-based device snapshots to be used to capture the file system
in a consistent state.
NOTE
The xfs_freeze utility is provided by the xfsprogs package, which is only available on
x86_64.
# xfs_freeze -f /mount/point
26
CHAPTER 3. THE XFS FILE SYSTEM
# xfs_freeze -u /mount/point
When taking an LVM snapshot, it is not necessary to use xfs_freeze to suspend the file system first.
Rather, the LVM management tools will automatically suspend the XFS file system before taking the
snapshot.
For more information about freezing and unfreezing an XFS file system, see man xfs_freeze.
Backup
The xfsdump utility also allows you to write multiple backups to the same tape. A backup can
span multiple tapes.
To back up multiple file systems to a single tape device, simply write the backup to a tape that
already contains an XFS backup. This appends the new backup to the previous one. By default,
xfsdump never overwrites existing backups.
The xfsdump utility uses dump levels to determine a base backup to which other backups are
relative. Numbers from 0 to 9 refer to increasing dump levels. An incremental backup only backs
up files that have changed since the last dump of a lower level:
A level 1 dump is the first incremental backup after a full backup. The next incremental
backup would be level 2, which only backs up files that have changed since the last level 1
dump; and so on, to a maximum of level 9.
Exclude files from a backup using size, subtree, or inode flags to filter them.
Restoration
The xfsrestore utility restores file systems from backups produced by xfsdump. The xfsrestore utility
has two modes:
27
Storage Administration Guide
The simple mode enables users to restore an entire file system from a level 0 dump. This is the
default mode.
The cumulative mode enables file system restoration from an incremental backup: that is, level 1
to level 9.
A unique session ID or session label identifies each backup. Restoring a backup from a tape containing
multiple backups requires its corresponding session ID or label.
To extract, add, or delete specific files from a backup, enter the xfsrestore interactive mode. The
interactive mode provides a set of commands to manipulate the backup files.
Replace level with the dump level of your backup. Use 0 to perform a full backup or 1 to 9 to
perform consequent incremental backups.
Replace backup-destination with the path where you want to store your backup. The
destination can be a regular file, a tape drive, or a remote tape device. For example,
/backup-files/Data.xfsdump for a file or /dev/st0 for a tape drive.
Replace path-to-xfs-filesystem with the mount point of the XFS file system you want to back
up. For example, /mnt/data/. The file system must be mounted.
When backing up multiple file systems and saving them on a single tape device, add a
session label to each backup using the -L label option so that it is easier to identify them
when restoring. Replace label with any name for your backup: for example, backup_data.
To back up the content of XFS file systems mounted on the /boot/ and /data/ directories
and save them as files in the /backup-files/ directory:
To back up multiple file systems on a single tape device, add a session label to each backup
using the -L label option:
Additional Resources
For more information about backing up XFS file systems, see the xfsdump(8) man page.
28
CHAPTER 3. THE XFS FILE SYSTEM
For more information about backing up XFS file systems, see the xfsdump(8) man page.
Prerequisites
You need a file or tape backup of XFS file systems, as described in Section 3.7.2, “Backing Up
an XFS File System”.
The command to restore the backup varies depending on whether you are restoring from a full
backup or an incremental one, or are restoring multiple backups from a single tape device:
Replace backup-location with the location of the backup. This can be a regular file, a tape
drive, or a remote tape device. For example, /backup-files/Data.xfsdump for a file or
/dev/st0 for a tape drive.
Replace restoration-path with the path to the directory where you want to restore the file
system. For example, /mnt/data/.
To restore a file system from an incremental (level 1 to level 9) backup, add the -r option.
To restore a backup from a tape device that contains multiple backups, specify the backup
using the -S or -L options.
The -S lets you choose a backup by its session ID, while the -L lets you choose by the
session label. To obtain the session ID and session labels, use the xfsrestore -I
command.
Replace session-id with the session ID of the backup. For example, b74a3586-e52e-
4a4a-8775-c3334fa8ea2c. Replace session-label with the session label of the backup.
For example, my_backup_session_label.
The interactive dialog begins after xfsrestore finishes reading the specified device.
Available commands in the interactive xfsrestore shell include cd, ls, add, delete, and
extract; for a complete list of commands, use the help command.
To restore the XFS backup files and save their content into directories under /mnt/:
To restore from a tape device containing multiple backups, specify each backup by its session label
or session ID:
29
Storage Administration Guide
The informational messages keep appearing until the matching backup is found.
Additional Resources
For more information about restoring XFS file systems, see the xfsrestore(8) man page.
XFS currently recognizes the following error conditions for which you can configure the desired behavior
specifically:
All other possible error conditions, which do not have specific handlers defined, share a single, global
configuration.
You can set the conditions under which XFS deems the errors permanent, both in the maximum number
of retries and the maximum time in seconds. XFS stops retrying when any one of the conditions is met.
30
CHAPTER 3. THE XFS FILE SYSTEM
There is also an option to immediately cancel the retries when unmounting the file system, regardless of
any other configuration. This allows the unmount operation to succeed even in case of persistent errors.
/sys/fs/xfs/device/error/metadata/condition/retry_timeout_seconds: the
time limit in seconds after which XFS will stop retrying the operation
All other possible error conditions, apart from those described in the previous section, share a common
configuration in these files:
3.8.2. Setting File System Behavior for Specific and Undefined Conditions
To set the maximum number of retries, write the desired number to the max_retries file.
value is a number between -1 and the maximum possible value of int, the C signed integer type. This
is 2147483647 on 64-bit Linux.
To set the time limit, write the desired number of seconds to the retry_timeout_seconds file.
31
Storage Administration Guide
value is a number between -1 and 86400, which is the number of seconds in a day.
In both the max_retries and retry_timeout_seconds options, -1 means to retry forever and 0 to
stop immediately.
device is the name of the device, as found in the /dev/ directory; for example, sda.
NOTE
The default behavior for a each error condition is dependent on the error context. Some
errors, like ENODEV, are considered to be fatal and unrecoverable, regardless of the retry
count, so their default value is 0.
value is either 1 or 0:
device is the name of the device, as found in the /dev/ directory; for example, sda.
IMPORTANT
xfs_fsr
32
CHAPTER 3. THE XFS FILE SYSTEM
Used to defragment mounted XFS file systems. When invoked with no arguments, xfs_fsr
defragments all regular files in all mounted XFS file systems. This utility also allows users to suspend
a defragmentation at a specified time and resume from where it left off later.
In addition, xfs_fsr also allows the defragmentation of only one file, as in xfs_fsr
/path/to/file. Red Hat advises not to periodically defrag an entire file system because XFS
avoids fragmentation by default. System wide defragmentation could cause the side effect of
fragmentation in free space.
xfs_bmap
Prints the map of disk blocks used by files in an XFS filesystem. This map lists each extent used by a
specified file, as well as regions in the file with no corresponding blocks (that is, holes).
xfs_info
Prints XFS file system information.
xfs_admin
Changes the parameters of an XFS file system. The xfs_admin utility can only modify parameters of
unmounted devices or file systems.
xfs_copy
Copies the contents of an entire XFS file system to one or more targets in parallel.
The following utilities are also useful in debugging and analyzing XFS file systems:
xfs_metadump
Copies XFS file system metadata to a file. Red Hat only supports using the xfs_metadump utility to
copy unmounted file systems or read-only mounted file systems; otherwise, generated dumps could
be corrupted or inconsistent.
xfs_mdrestore
Restores an XFS metadump image (generated using xfs_metadump) to a file system image.
xfs_db
Debugs an XFS file system.
For more information about these utilities, see their respective man pages.
The ext4 file system is still fully supported in Red Hat Enterprise Linux 7 and can be selected at
installation. While it is possible to migrate from ext4 to XFS, it is not required.
33
Storage Administration Guide
Ext3/4 runs e2fsck in userspace at boot time to recover the journal as needed. XFS, by comparison,
performs journal recovery in kernelspace at mount time. An fsck.xfs shell script is provided but
does not perform any useful action as it is only there to satisfy initscript requirements.
When an XFS file system repair or check is requested, use the xfs_repair command. Use the -n
option for a read-only check.
The xfs_repair command will not operate on a file system with a dirty log. To repair such a file
system mount and unmount must first be performed to replay the log. If the log is corrupt and cannot
be replayed, the -L option can be used to zero out in the log.
For more information on file system repair of XFS file systems, see Section 12.2.2, “XFS”
Quotas
XFS quotas are not a remountable option. The -o quota option must be specified on the initial
mount for quotas to be in effect.
While the standard tools in the quota package can perform basic quota administrative tasks (tools
such as setquota and repquota), the xfs_quota tool can be used for XFS-specific features, such as
Project Quota administration.
The quotacheck command has no effect on an XFS file system. The first time quota accounting is
turned on XFS does an automatic quotacheck internally. Because XFS quota metadata is a first-
class, journaled metadata object, the quota system will always be consistent until quotas are
manually turned off.
Inode numbers
For file systems larger than 1 TB with 256-byte inodes, or larger than 2 TB with 512-byte inodes, XFS
inode numbers might exceed 2^32. Such large inode numbers cause 32-bit stat calls to fail with the
EOVERFLOW return value. The described problem might occur when using the default Red Hat
Enterprise Linux 7 configuration: non-striped with four allocation groups. A custom configuration, for
example file system extension or changing XFS file system parameters, might lead to a different
behavior.
Applications usually handle such larger inode numbers correctly. If needed, mount the XFS file
system with the -o inode32 parameter to enforce inode numbers below 2^32. Note that using
inode32 does not affect inodes that are already allocated with 64-bit numbers.
34
CHAPTER 3. THE XFS FILE SYSTEM
IMPORTANT
Do not use the inode32 option unless it is required by a specific environment. The
inode32 option changes allocation behavior. As a consequence, the ENOSPC error
might occur if no space is available to allocate inodes in the lower disk blocks.
Speculative preallocation
XFS uses speculative preallocation to allocate blocks past EOF as files are written. This avoids file
fragmentation due to concurrent streaming write workloads on NFS servers. By default, this
preallocation increases with the size of the file and will be apparent in "du" output. If a file with
speculative preallocation is not dirtied for five minutes the preallocation will be discarded. If the inode
is cycled out of cache before that time, then the preallocation will be discarded when the inode is
reclaimed.
If premature ENOSPC problems are seen due to speculative preallocation, a fixed preallocation
amount may be specified with the -o allocsize=amount mount option.
Fragmentation-related tools
Fragmentation is rarely a significant issue on XFS file systems due to heuristics and behaviors, such
as delayed allocation and speculative preallocation. However, tools exist for measuring file system
fragmentation as well as defragmenting file systems. Their use is not encouraged.
The xfs_db frag command attempts to distill all file system allocations into a single fragmentation
number, expressed as a percentage. The output of the command requires significant expertise to
understand its meaning. For example, a fragmentation factor of 75% means only an average of 4
extents per file. For this reason the output of xfs_db's frag is not considered useful and more careful
analysis of any fragmentation problems is recommended.
WARNING
The xfs_fsr command may be used to defragment individual files, or all files
on a file system. The later is especially not recommended as it may destroy
locality of files and may fragment free space.
The following table compares common commands used with ext3 and ext4 to their XFS-specific
counterparts.
Table 3.1. Common Commands for ext3 and ext4 Compared to XFS
35
Storage Administration Guide
The following table lists generic tools that function on XFS file systems as well, but the XFS versions
have more specific functionality and as such are recommended.
More information on many the listed XFS commands is included in Chapter 3, The XFS File System. You
can also consult the manual pages of the listed XFS administration tools for more information.
36
CHAPTER 4. THE EXT3 FILE SYSTEM
Availability
After an unexpected power failure or system crash (also called an unclean system shutdown), each
mounted ext2 file system on the machine must be checked for consistency by the e2fsck program.
This is a time-consuming process that can delay system boot time significantly, especially with large
volumes containing a large number of files. During this time, any data on the volumes is unreachable.
It is possible to run fsck -n on a live filesystem. However, it will not make any changes and may
give misleading results if partially written metadata is encountered.
If LVM is used in the stack, another option is to take an LVM snapshot of the filesystem and run fsck
on it instead.
Finally, there is the option to remount the filesystem as read only. All pending metadata updates (and
writes) are then forced to the disk prior to the remount. This ensures the filesystem is in a consistent
state, provided there is no previous corruption. It is now possible to run fsck -n.
The journaling provided by the ext3 file system means that this sort of file system check is no longer
necessary after an unclean system shutdown. The only time a consistency check occurs using ext3 is
in certain rare hardware failure cases, such as hard drive failures. The time to recover an ext3 file
system after an unclean system shutdown does not depend on the size of the file system or the
number of files; rather, it depends on the size of the journal used to maintain consistency. The default
journal size takes about a second to recover, depending on the speed of the hardware.
NOTE
The only journaling mode in ext3 supported by Red Hat is data=ordered (default).
Data Integrity
The ext3 file system prevents loss of data integrity in the event that an unclean system shutdown
occurs. The ext3 file system allows you to choose the type and level of protection that your data
receives. With regard to the state of the file system, ext3 volumes are configured to keep a high level
of data consistency by default.
Speed
Despite writing some data more than once, ext3 has a higher throughput in most cases than ext2
because ext3's journaling optimizes hard drive head motion. You can choose from three journaling
modes to optimize speed, but doing so means trade-offs in regards to data integrity if the system was
to fail.
NOTE
The only journaling mode in ext3 supported by Red Hat is data=ordered (default).
Easy Transition
37
Storage Administration Guide
It is easy to migrate from ext2 to ext3 and gain the benefits of a robust journaling file system without
reformatting. For more information on performing this task, see Section 4.2, “Converting to an ext3
File System” .
NOTE
Red Hat Enterprise Linux 7 provides a unified extN driver. It does this by disabling the
ext2 and ext3 configurations and instead uses ext4.ko for these on-disk formats. This
means that kernel messages will always refer to ext4 regardless of the ext file system
used.
Prerequisites
Create or reuse a partition on your disk. For information on creating MBR or GPT partitions, see
Chapter 13, Partitions.
Procedure
1. Format the partition or LVM volume with the ext3 file system using the mkfs.ext3 utility:
# mkfs.ext3 block_device
Replace block_device with the path to a partition or a logical volume. For example,
/dev/sdb1, /dev/disk/by-uuid/05e99ec8-def1-4a5e-8a9d-5945339ceb2a, or
/dev/my-volgroup/my-lv.
Configuring UUID
It is also possible to set a specific UUID for a file system. To specify a UUID when creating a file system,
use the -U option:
Replace UUID with the UUID you want to set: for example, 7cd65de3-e0be-41d9-b66d-
96d749c02da7.
Replace device with the path to an ext3 file system to have the UUID added to it: for example,
/dev/sda8.
38
CHAPTER 4. THE EXT3 FILE SYSTEM
To change the UUID of an existing file system, see Section 25.7.3.2, “Modifying Persistent Naming
Attributes”
Additional Resources
The mkfs.ext3(8) man page
NOTE
To convert ext2 to ext3, always use the e2fsck utility to check your file system before
and after using tune2fs. Before trying to convert ext2 to ext3, back up all file systems in
case any errors occur.
In addition, Red Hat recommends creating a new ext3 file system and migrating data to it,
instead of converting from ext2 to ext3 whenever possible.
To convert an ext2 file system to ext3, log in as root and type the following command in a terminal:
# tune2fs -j block_device
For simplicity, the sample commands in this section use the following value for the block device:
/dev/mapper/VolGroup00-LogVol02
# umount /dev/mapper/VolGroup00-LogVol02
2. Change the file system type to ext2 by typing the following command:
# e2fsck -y /dev/mapper/VolGroup00-LogVol02
39
Storage Administration Guide
NOTE
If a .journal file exists at the root level of the partition, delete it.
To permanently change the partition to ext2, remember to update the /etc/fstab file, otherwise it will
revert back after booting.
40
CHAPTER 5. THE EXT4 FILE SYSTEM
NOTE
As with ext3, an ext4 volume must be umounted in order to perform an fsck. For more
information, see Chapter 4, The ext3 File System.
Main Features
The ext4 file system uses extents (as opposed to the traditional block mapping scheme used by ext2
and ext3), which improves performance when using large files and reduces metadata overhead for
large files. In addition, ext4 also labels unallocated block groups and inode table sections
accordingly, which allows them to be skipped during a file system check. This makes for quicker file
system checks, which becomes more beneficial as the file system grows in size.
Allocation Features
The ext4 file system features the following allocation schemes:
Persistent pre-allocation
Delayed allocation
Multi-block allocation
Stripe-aware allocation
Because of delayed allocation and other performance optimizations, ext4's behavior of writing files to
disk is different from ext3. In ext4, when a program writes to the file system, it is not guaranteed to be
on-disk unless the program issues an fsync() call afterwards.
By default, ext3 automatically forces newly created files to disk almost immediately even without
fsync(). This behavior hid bugs in programs that did not use fsync() to ensure that written data
was on-disk. The ext4 file system, on the other hand, often waits several seconds to write out
changes to disk, allowing it to combine and reorder writes for better disk performance than ext3.
WARNING
Unlike ext3, the ext4 file system does not force data to disk on transaction
commit. As such, it takes longer for buffered writes to be flushed to disk. As with
any file system, use data integrity calls such as fsync() to ensure that data is
written to permanent storage.
41
Storage Administration Guide
Extended attributes (xattr) — This allows the system to associate several additional name
and value pairs per file.
Quota journaling — This avoids the need for lengthy quota consistency checks after a crash.
NOTE
Procedure
# mkfs.ext4 block_device
Replace block_device with the path to a partition or a logical volume. For example,
/dev/sdb1, /dev/disk/by-uuid/05e99ec8-def1-4a5e-8a9d-5945339ceb2a, or
/dev/my-volgroup/my-lv.
In general, the default options are optimal for most usage scenarios.
Below is a sample output of this command, which displays the resulting file system geometry and
features:
42
CHAPTER 5. THE EXT4 FILE SYSTEM
IMPORTANT
It is possible to use tune2fs to enable certain ext4 features on ext3 file systems.
However, using tune2fs in this way has not been fully tested and is therefore not
supported in Red Hat Enterprise Linux 7. As a result, Red Hat cannot guarantee
consistent performance and predictable behavior for ext3 file systems converted or
mounted by using tune2fs.
When creating file systems on LVM or MD volumes, mkfs.ext4 chooses an optimal geometry. This
may also be true on some hardware RAIDs which export geometry information to the operating system.
To specify stripe geometry, use the -E option of mkfs.ext4 (that is, extended file system options) with
the following sub-options:
stride=value
Specifies the RAID chunk size.
stripe-width=value
Specifies the number of data disks in a RAID device, or the number of stripe units in the stripe.
For both sub-options, value must be specified in file system block units. For example, to create a file
system with a 64k stride (that is, 16 x 4096) on a 4k-block file system, use the following command:
Configuring UUID
It is also possible to set a specific UUID for a file system. To specify a UUID when creating a file system,
use the -U option:
Replace UUID with the UUID you want to set: for example, 7cd65de3-e0be-41d9-b66d-
96d749c02da7.
43
Storage Administration Guide
Replace device with the path to an ext4 file system to have the UUID added to it: for example,
/dev/sda8.
To change the UUID of an existing file system, see Section 25.7.3.2, “Modifying Persistent Naming
Attributes”
Additional Resources
For more information about creating ext4 file systems, see:
The ext4 file system also supports several mount options to influence behavior. For example, the acl
parameter enables access control lists, while the user_xattr parameter enables user extended
attributes. To enable both options, use their respective parameters with -o, as in:
As with ext3, the option data_err=abort can be used to abort the journal if an error occurs in file data.
The tune2fs utility also allows administrators to set default mount options in the file system superblock.
For more information on this, refer to man tune2fs.
Write Barriers
By default, ext4 uses write barriers to ensure file system integrity even when power is lost to a device
with write caches enabled. For devices without write caches, or with battery-backed write caches,
disable barriers using the nobarrier option, as in:
For more information about write barriers, refer to Chapter 22, Write Barriers.
44
CHAPTER 5. THE EXT4 FILE SYSTEM
Before growing an ext4 file system, ensure that the underlying block device is of an appropriate size to
hold the file system later. Use the appropriate resizing methods for the affected block device.
An ext4 file system may be grown while mounted using the resize2fs command:
The resize2fs command can also decrease the size of an unmounted ext4 file system:
When resizing an ext4 file system, the resize2fs utility reads the size in units of file system block size,
unless a suffix indicating a specific unit is used. The following suffixes indicate specific units:
K — kilobytes
M — megabytes
G — gigabytes
NOTE
The size parameter is optional (and often redundant) when expanding. The resize2fs
automatically expands to fill all available space of the container, usually a logical volume
or partition.
For more information about resizing an ext4 file system, refer to man resize2fs.
Prerequisites
If the system has been running for a long time, run the e2fsck utility on the partitions before
backup:
# e2fsck /dev/device
1. Back up configuration information, including the content of the /etc/fstab file and the output of
the fdisk -l command. This is useful for restoring the partitions.
To capture this information, run the sosreport or sysreport utilities. For more information
about sosreport, see the What is a sosreport and how to create one in Red Hat Enterprise
Linux 4.6 and later? Kdowledgebase article.
45
Storage Administration Guide
If the partition you are backing up is an operating system partition, boot your system into the
rescue mode. See the Booting to Rescue Mode section of the System Administrator's Guide.
Although it is possible to back up a data partition while it is mounted, the results of backing
up a mounted data partition can be unpredictable.
If you need to back up a mounted file system using the dump utility, do so when the file
system is not under a heavy load. The more activity is happening on the file system when
backing up, the higher the risk of backup corruption is.
Replace backup-file with a path to a file where you want the to store the backup. Replace device
with the name of the ext4 partition you want to back up. Make sure that you are saving the
backup to a directory mounted on a different partition than the partition you are backing up.
To back up the content of the /dev/sda1, /dev/sda2, and /dev/sda3 partitions into
backup files stored in the /backup-files/ directory, use the following commands:
To do a remote backup, use the ssh utility or configure a password-less ssh login. For more
information on ssh and password-less login, see the Using the ssh Utility and Using Key-based
Authentication sections of the System Administrator's Guide.
Note that if using standard redirection, you must pass the -f option separately.
Additional Resources
For more information, see the dump(8) man page.
Prerequisites
46
CHAPTER 5. THE EXT4 FILE SYSTEM
You need a backup of partitions and their metadata, as described in Section 5.4, “Backing up
ext2, ext3, or ext4 File Systems”.
1. If you are restoring an operating system partition, boot your system into Rescue Mode. See the
Booting to Rescue Mode section of the System Administrator's Guide.
2. Rebuild the partitions you want to restore by using the fdisk or parted utilites.
If the partitions no longer exist, recreate them. The new partitions must be large enough to
contain the restored data. It is important to get the start and end numbers right; these are the
starting and ending sector numbers of the partitions obtained from the fdisk utility when
backing up.
# mkfs.ext4 /dev/device
IMPORTANT
4. If you created new partitions, re-label all the partitions so they match their entries in the
/etc/fstab file:
# mkdir /mnt/device
# mount -t ext4 /dev/device /mnt/device
# cd /mnt/device
# restore -rf device-backup-file
If you want to restore on a remote machine or restore from a backup file that is stored on a
remote host, you can use the ssh utility. For more information on ssh, see the Using the ssh
Utility section of the System Administrator's Guide.
Note that you need to configure a password-less login for the following commands. For more
information on setting up a password-less ssh login, see the Using Key-based Authentication
section of the System Administrator's Guide.
To restore a partition on a remote machine from a backup file stored on the same machine:
47
Storage Administration Guide
/usr/sbin/restore -r -f -"
To restore a partition on a remote machine from a backup file stored on a different remote
machine:
7. Reboot:
# systemctl reboot
To restore the /dev/sda1, /dev/sda2, and /dev/sda3 partitions from Example 5.2, “Backing up
Multiple ext4 Partitions”:
# mkfs.ext4 /dev/sda1
# mkfs.ext4 /dev/sda2
# mkfs.ext4 /dev/sda3
# mkdir /mnt/sda1
# mount -t ext4 /dev/sda1 /mnt/sda1
# mkdir /mnt/sda2
# mount -t ext4 /dev/sda2 /mnt/sda2
# mkdir /mnt/sda3
# mount -t ext4 /dev/sda3 /mnt/sda3
# mkdir /backup-files
# mount -t ext4 /dev/sda6 /backup-files
# cd /mnt/sda1
# restore -rf /backup-files/sda1.dump
# cd /mnt/sda2
48
CHAPTER 5. THE EXT4 FILE SYSTEM
6. Reboot:
# systemctl reboot
Additional Resources
For more information, see the restore(8) man page.
e2fsck
Used to repair an ext4 file system. This tool checks and repairs an ext4 file system more efficiently
than ext3, thanks to updates in the ext4 disk structure.
e2label
Changes the label on an ext4 file system. This tool also works on ext2 and ext3 file systems.
quota
Controls and reports on disk space (blocks) and file (inode) usage by users and groups on an ext4 file
system. For more information on using quota, refer to man quota and Section 17.1, “Configuring
Disk Quotas”.
fsfreeze
To suspend access to a file system, use the command # fsfreeze -f mount-point to freeze it
and # fsfreeze -u mount-point to unfreeze it. This halts access to the file system and creates
a stable image on disk.
NOTE
As demonstrated in Section 5.2, “Mounting an ext4 File System”, the tune2fs utility can also adjust
configurable file system parameters for ext2, ext3, and ext4 file systems. In addition, the following tools
are also useful in debugging and analyzing ext4 file systems:
debugfs
Debugs ext2, ext3, or ext4 file systems.
e2image
Saves critical ext2, ext3, or ext4 file system metadata to a file.
49
Storage Administration Guide
For more information about these utilities, refer to their respective man pages.
50
CHAPTER 6. BTRFS (TECHNOLOGY PREVIEW)
NOTE
Btrfs is available as a Technology Preview feature in Red Hat Enterprise Linux 7 but has
been deprecated since the Red Hat Enterprise Linux 7.4 release. It will be removed in a
future major release of Red Hat Enterprise Linux.
For more information, see Deprecated Functionality in the Red Hat Enterprise Linux 7.4
Release Notes.
Btrfs is a next generation Linux file system that offers advanced management, reliability, and scalability
features. It is unique in offering snapshots, compression, and integrated device management.
# mkfs.btrfs /dev/device
For more information on creating btrfs file systems with added devices and specifying multi-device
profiles for metadata and data, refer to Section 6.4, “Integrated Volume Management of Multiple
Devices”.
device=/dev/name
Appending this option to the mount command tells btrfs to scan the named device for a btrfs volume.
This is used to ensure the mount will succeed as attempting to mount devices that are not btrfs will
cause the mount to fail.
NOTE
This does not mean all devices will be added to the file system, it only scans them.
max_inline=number
Use this option to set the maximum amount of space (in bytes) that can be used to inline data within a
metadata B-tree leaf. The default is 8192 bytes. For 4k pages it is limited to 3900 bytes due to
additional headers that need to fit into the leaf.
alloc_start=number
Use this option to set where in the disk allocations start.
thread_pool=number
51
Storage Administration Guide
discard
Use this option to enable discard/TRIM on freed blocks.
noacl
Use this option to disable the use of ACL's.
space_cache
Use this option to store the free space data on disk to make caching a block group faster. This is a
persistent change and is safe to boot into old kernels.
nospace_cache
Use this option to disable the above space_cache.
clear_cache
Use this option to clear all the free space caches during mount. This is a safe option but will trigger
the space cache to be rebuilt. As such, leave the file system mounted in order to let the rebuild
process finish. This mount option is intended to be used once and only after problems are apparent
with the free space.
enospc_debug
This option is used to debug problems with "no space left".
recovery
Use this option to enable autorecovery upon mount.
NOTE
The unit size is not case specific; it accepts both G or g for GiB.
The command does not accept t for terabytes or p for petabytes. It only accepts k, m, and
g.
For example:
52
CHAPTER 6. BTRFS (TECHNOLOGY PREVIEW)
To enlarge a multi-device file system, the device to be enlarged must be specified. First, show all devices
that have a btrfs file system at a specified mount point:
For example:
Btrfs v3.16.2
Then, after identifying the devid of the device to be enlarged, use the following command:
For example:
NOTE
The amount can also be max instead of a specified amount. This will use all remaining
free space on the device.
For example:
To shrink a multi-device file system, the device to be shrunk must be specified. First, show all devices
that have a btrfs file system at a specified mount point:
For example:
53
Storage Administration Guide
Btrfs v3.16.2
Then, after identifying the devid of the device to be shrunk, use the following command:
For example:
For example:
To set the file system size of a multi-device file system, the device to be changed must be specified.
First, show all devices that have a btrfs file system at the specified mount point:
For example:
Btrfs v3.16.2
Then, after identifying the devid of the device to be changed, use the following command:
For example:
54
CHAPTER 6. BTRFS (TECHNOLOGY PREVIEW)
raid0
raid1
raid10
dup
single
The -m single option instructs that no duplication of metadata is done. This may be desired when
using hardware raid.
NOTE
Create a file system across four devices (metadata mirrored, data striped).
55
Storage Administration Guide
Use the single option to use the full capacity of each drive when the drives are different sizes.
To add a new device to an already created multi-device file system, use the following command:
After rebooting or reloading the btrfs module, use the btrfs device scan command to discover all
multi-device file systems. See Section 6.4.2, “Scanning for btrfs Devices” for more information.
The btrfs device add command is used to add new devices to a mounted file system.
The btrfs filesystem balance command balances (restripes) the allocated extents across all
existing devices.
First, create and mount a btrfs file system. Refer to Section 6.1, “Creating a btrfs File System” for
more information on how to create a btrfs file system, and to Section 6.2, “Mounting a btrfs file
system” for more information on how to mount a btrfs file system.
# mkfs.btrfs /dev/device1
# mount /dev/device1
The metadata and data on these devices are still stored only on /dev/device1. It must now be
balanced to spread across all devices.
56
CHAPTER 6. BTRFS (TECHNOLOGY PREVIEW)
Balancing a file system will take some time as it reads all of the file system's data and metadata and
rewrites it across the new device.
To convert an existing single device system, /dev/sdb1 in this case, into a two device, raid1 system
in order to protect against a single disk failure, use the following commands:
IMPORTANT
If the metadata is not converted from the single-device default, it remains as DUP. This
does not guarantee that copies of the block are on separate devices. If data is not
converted it does not have any redundant copies at all.
57
Storage Administration Guide
The command btrfs device delete missing removes the first device that is described by the file
system metadata but not present when the file system was mounted.
IMPORTANT
It is impossible to go below the minimum number of devices required for the specific raid
layout, even including the missing one. It may be required to add a new device in order to
remove the failed one.
For example, for a raid1 layout with two devices, if a device fails it is required to:
If you do not have an initrd or it does not perform a btrfs device scan, it is possible to mount a multi-
volume btrfs file system by passing all the devices in the file system explicitly to the mount command.
Note that using universally unique identifiers (UUIDs) also works and is more stable than using device
paths.
The first way is mkfs.btrfs turns off metadata duplication on a single device when
58
CHAPTER 6. BTRFS (TECHNOLOGY PREVIEW)
The second way is through a group of SSD mount options: ssd, nossd, and ssd_spread.
NOTE
The ssd mount option only enables the ssd option. Use the nossd option to disable it.
Some SSDs perform best when reusing block numbers often, while others perform much better when
clustering strictly allocates big chunks of unused space. By default, mount -o ssd will find groupings of
blocks where there are several free blocks that might have allocated blocks mixed in. The command
mount -o ssd_spread ensures there are no allocated blocks mixed in. This improves performance
on lower end SSDs.
NOTE
The ssd_spread option enables both the ssd and the ssd_spread options. Use the
nossd to disable both these options.
The ssd_spread option is never automatically set if none of the ssd options are provided
and any of the devices are non-rotational.
These options will all need to be tested with your specific build to see if their use improves or reduces
performance, as each combination of SSD firmware and application loads are different.
The man page mkfs.btrfs(8) contains information on creating a btrfs file system including all the
options regarding it.
The man page btrfsck(8) for information regarding fsck on btrfs systems.
59
Storage Administration Guide
GFS2 is based on 64-bit architecture, which can theoretically accommodate an 8 exabyte file system.
However, the current supported maximum size of a GFS2 file system is 100 TB. If a system requires
GFS2 file systems larger than 100 TB, contact your Red Hat service representative.
When determining the size of a file system, consider its recovery needs. Running the fsck command on
a very large file system can take a long time and consume a large amount of memory. Additionally, in the
event of a disk or disk-subsystem failure, recovery time is limited by the speed of backup media.
When configured in a Red Hat Cluster Suite, Red Hat GFS2 nodes can be configured and managed with
Red Hat Cluster Suite configuration and management tools. Red Hat GFS2 then provides data sharing
among GFS2 nodes in a Red Hat cluster, with a single, consistent view of the file system namespace
across the GFS2 nodes. This allows processes on different nodes to share GFS2 files in the same way
that processes on the same node can share files on a local file system, with no discernible difference.
For information about the Red Hat Cluster Suite, see Red Hat's Cluster Administration guide.
A GFS2 must be built on a logical volume (created with LVM) that is a linear or mirrored volume. Logical
volumes created with LVM in a Red Hat Cluster suite are managed with CLVM (a cluster-wide
implementation of LVM), enabled by the CLVM daemon clvmd, and running in a Red Hat Cluster Suite
cluster. The daemon makes it possible to use LVM2 to manage logical volumes across a cluster,
allowing all nodes in the cluster to share the logical volumes. For information on the Logical Volume
Manager, see Red Hat's Logical Volume Manager Administration guide.
The gfs2.ko kernel module implements the GFS2 file system and is loaded on GFS2 cluster nodes.
For comprehensive information on the creation and configuration of GFS2 file systems in clustered and
non-clustered storage, see Red Hat's Global File System 2 guide.
60
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
NFS version 3 (NFSv3) supports safe asynchronous writes and is more robust at error handling
than the previous NFSv2; it also supports 64-bit file sizes and offsets, allowing clients to access
more than 2 GB of file data.
NFS version 4 (NFSv4) works through firewalls and on the Internet, no longer requires an
rpcbind service, supports ACLs, and utilizes stateful operations.
Red Hat Enterprise Linux fully supports NFS version 4.2 (NFSv4.2) since the Red Hat
Enterprise Linux 7.4 release.
Following are the features of NFSv4.2 in Red Hat Enterprise Linux 7.5 :
Server-Side Copy: NFSv4.2 supports copy_file_range() system call, which allows the NFS
client to efficiently copy data without wasting network resources.
Sparse Files: It verifies space efficiency of a file and allows placeholder to improve storage
efficiency. It is a file having one or more holes; holes are unallocated or uninitialized data blocks
consisting only of zeroes. lseek() operation in NFSv4.2, supports seek_hole() and
seek_data(), which allows application to map out the location of holes in the sparse file.
Space Reservation: It permits storage servers to reserve free space, which prohibits servers to
run out of space. NFSv4.2 supports allocate() operation to reserve space, deallocate()
operation to unreserve space, and fallocate() operation to preallocate or deallocate space
in a file.
Labeled NFS: It enforces data access rights and enables SELinux labels between a client and a
server for individual files on an NFS file system.
Layout Enhancements: NFSv4.2 provides new operation, layoutstats(), which the client can
use to notify the metadata server about its communication with the layout.
Versions of Red Hat Enterprise Linux earlier than 7.4 support NFS up to version 4.1.
Enhances performance and security of network, and also includes client-side support for Parallel
NFS (pNFS).
No longer requires a separate TCP connection for callbacks, which allows an NFS server to
grant delegations even when it cannot contact the client. For example, when NAT or a firewall
interferes.
61
Storage Administration Guide
It provides exactly once semantics (except for reboot operations), preventing a previous issue
whereby certain operations could return an inaccurate result if a reply was lost and the operation
was sent twice.
NFS clients attempt to mount using NFSv4.1 by default, and fall back to NFSv4.0 when the server does
not support NFSv4.1. The mount later fall back to NFSv3 when server does not support NFSv4.0.
NOTE
All versions of NFS can use Transmission Control Protocol (TCP) running over an IP network, with
NFSv4 requiring it. NFSv3 can use the User Datagram Protocol (UDP) running over an IP network to
provide a stateless network connection between the client and server.
When using NFSv3 with UDP, the stateless UDP connection (under normal conditions) has less protocol
overhead than TCP. This can translate into better performance on very clean, non-congested networks.
However, because UDP is stateless, if the server goes down unexpectedly, UDP clients continue to
saturate the network with requests for the server. In addition, when a frame is lost with UDP, the entire
RPC request must be retransmitted; with TCP, only the lost frame needs to be resent. For these
reasons, TCP is the preferred protocol when connecting to an NFS server.
The mounting and locking protocols have been incorporated into the NFSv4 protocol. The server also
listens on the well-known TCP port 2049. As such, NFSv4 does not need to interact with rpcbind [1],
lockd, and rpc.statd daemons. The rpc.mountd daemon is still required on the NFS server to set
up the exports, but is not involved in any over-the-wire operations.
NOTE
TCP is the default transport protocol for NFS version 3 under Red Hat Enterprise Linux.
UDP can be used for compatibility purposes as needed, but is not recommended for wide
usage. NFSv4 requires TCP.
All the RPC/NFS daemons have a '-p' command line option that can set the port,
making firewall configuration easier.
After TCP wrappers grant access to the client, the NFS server refers to the /etc/exports configuration
file to determine whether the client is allowed to access any exported file systems. Once verified, all file
and directory operations are available to the user.
IMPORTANT
In order for NFS to work with a default installation of Red Hat Enterprise Linux with a
firewall enabled, configure IPTables with the default TCP port 2049. Without proper
IPTables configuration, NFS will not function properly.
The NFS initialization script and rpc.nfsd process now allow binding to any specified
port during system start up. However, this can be error-prone if the port is unavailable, or
if it conflicts with another daemon.
62
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
NFS file sharing. All NFS versions rely on Remote Procedure Calls (RPC) between clients and servers.
RPC services under Red Hat Enterprise Linux 7 are controlled by the rpcbind service. To share or
mount NFS file systems, the following services work together depending on which version of NFS is
implemented:
NOTE
The portmap service was used to map RPC program numbers to IP address port number
combinations in earlier versions of Red Hat Enterprise Linux. This service is now replaced
by rpcbind in Red Hat Enterprise Linux 7 to enable IPv6 support.
nfs
systemctl start nfs starts the NFS server and the appropriate RPC processes to service
requests for shared NFS file systems.
nfslock
systemctl start nfs-lock activates a mandatory service that starts the appropriate RPC
processes allowing NFS clients to lock files on the server.
rpcbind
rpcbind accepts port reservations from local RPC services. These ports are then made available (or
advertised) so the corresponding remote RPC services can access them. rpcbind responds to
requests for RPC services and sets up connections to the requested RPC service. This is not used
with NFSv4.
rpc.mountd
This process is used by an NFS server to process MOUNT requests from NFSv3 clients. It checks that
the requested NFS share is currently exported by the NFS server, and that the client is allowed to
access it. If the mount request is allowed, the rpc.mountd server replies with a Success status and
provides the File-Handle for this NFS share back to the NFS client.
rpc.nfsd
rpc.nfsd allows explicit NFS versions and protocols the server advertises to be defined. It works
with the Linux kernel to meet the dynamic demands of NFS clients, such as providing server threads
each time an NFS client connects. This process corresponds to the nfs service.
lockd
lockd is a kernel thread which runs on both clients and servers. It implements theNetwork Lock
Manager (NLM) protocol, which allows NFSv3 clients to lock files on the server. It is started
automatically whenever the NFS server is run and whenever an NFS file system is mounted.
rpc.statd
This process implements the Network Status Monitor (NSM) RPC protocol, which notifies NFS clients
when an NFS server is restarted without being gracefully brought down. rpc.statd is started
automatically by the nfslock service, and does not require user configuration. This is not used with
NFSv4.
63
Storage Administration Guide
rpc.rquotad
This process provides user quota information for remote users. rpc.rquotad is started
automatically by the nfs service and does not require user configuration.
rpc.idmapd
rpc.idmapd provides NFSv4 client and server upcalls, which map between on-the-wire NFSv4
names (strings in the form of user@domain) and local UIDs and GIDs. For idmapd to function with
NFSv4, the /etc/idmapd.conf file must be configured. At a minimum, the "Domain" parameter
should be specified, which defines the NFSv4 mapping domain. If the NFSv4 mapping domain is the
same as the DNS domain name, this parameter can be skipped. The client and server must agree on
the NFSv4 mapping domain for ID mapping to function properly.
NOTE
In Red Hat Enterprise Linux 7, only the NFSv4 server uses rpc.idmapd. The NFSv4
client uses the keyring-based idmapper nfsidmap. nfsidmap is a stand-alone
program that is called by the kernel on-demand to perform ID mapping; it is not a
daemon. If there is a problem with nfsidmap does the client fall back to using
rpc.idmapd. More information regarding nfsidmap can be found on the nfsidmap
man page.
8.2. PNFS
Support for Parallel NFS (pNFS) as part of the NFS v4.1 standard is available as of Red Hat
Enterprise Linux 6.4. The pNFS architecture improves the scalability of NFS, with possible improvements
to performance. That is, when a server implements pNFS as well, a client is able to access data through
multiple servers concurrently. It supports three storage protocols or layouts: files, objects, and blocks.
NOTE
The protocol allows for three possible pNFS layout types: files, objects, and blocks. While
the Red Hat Enterprise Linux 6.4 client only supported the files layout type, Red Hat
Enterprise Linux 7 supports the files layout type, with objects and blocks layout types
being included as a technology preview.
Red Hat Enterprise Linux can mount NFS shares from Flex Files servers since Red Hat Enterprise
Linux 7.4.
64
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
To mount an NFS share with the Flex Files feature from a server that supports Flex Files, use
NFS version 4.2 or later:
Additional Resources
For more information on pNFS, refer to: http://www.pnfs.com.
options
A comma-delimited list of mount options; for more information on valid NFS mount options, see
Section 8.5, “Common NFS Mount Options”.
server
The hostname, IP address, or fully qualified domain name of the server exporting the file system you
wish to mount
/remote/export
The file system or directory being exported from the server, that is, the directory you wish to mount
/local/directory
The client location where /remote/export is mounted
The NFS protocol version used in Red Hat Enterprise Linux 7 is identified by the mount options
nfsvers or vers. By default, mount uses NFSv4 with mount -t nfs. If the server does not support
NFSv4, the client automatically steps down to a version supported by the server. If the nfsvers/vers
option is used to pass a particular version not supported by the server, the mount fails. The file system
type nfs4 is also available for legacy reasons; this is equivalent to running mount -t nfs -o
nfsvers=4 host:/remote/export /local/directory.
If an NFS share was mounted manually, the share will not be automatically mounted upon reboot. Red
65
Storage Administration Guide
Hat Enterprise Linux offers two methods for mounting remote file systems automatically at boot time: the
/etc/fstab file and the autofs service. For more information, see Section 8.3.1, “Mounting NFS File
Systems Using /etc/fstab” and Section 8.4, “autofs”.
An alternate way to mount an NFS share from another machine is to add a line to the /etc/fstab file.
The line must state the hostname of the NFS server, the directory on the server being exported, and the
directory on the local machine where the NFS share is to be mounted. You must be root to modify the
/etc/fstab file.
The mount point /pub must exist on the client machine before this command can be executed. After
adding this line to /etc/fstab on the client system, use the command mount /pub, and the mount
point /pub is mounted from the server.
A valid /etc/fstab entry to mount an NFS export should contain the following information:
The variables server, /remote/export, /local/directory, and options are the same ones used when
manually mounting an NFS share. For more information, see Section 8.3, “Configuring NFS Client”.
NOTE
The mount point /local/directory must exist on the client before /etc/fstab is read.
Otherwise, the mount fails.
After editing /etc/fstab, regenerate mount units so that your system registers the new configuration:
# systemctl daemon-reload
Additional Resources
8.4. AUTOFS
One drawback of using /etc/fstab is that, regardless of how infrequently a user accesses the NFS
mounted file system, the system must dedicate resources to keep the mounted file system in place. This
is not a problem with one or two mounts, but when the system is maintaining mounts to many systems at
one time, overall system performance can be affected. An alternative to /etc/fstab is to use the
kernel-based automount utility. An automounter consists of two components:
66
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
The automount utility can mount and unmount NFS file systems automatically (on-demand mounting),
therefore saving system resources. It can be used to mount other file systems including AFS, SMBFS,
CIFS, and local file systems.
IMPORTANT
The nfs-utils package is now a part of both the 'NFS file server' and the 'Network File
System Client' groups. As such, it is no longer installed by default with the Base group.
Ensure that nfs-utils is installed on the system first before attempting to automount an
NFS share.
autofs uses /etc/auto.master (master map) as its default primary configuration file. This can be
changed to use another supported network source and name using the autofs configuration (in
/etc/sysconfig/autofs) in conjunction with the Name Service Switch (NSS) mechanism. An
instance of the autofs version 4 daemon was run for each mount point configured in the master map
and so it could be run manually from the command line for any given mount point. This is not possible
with autofs version 5, because it uses a single daemon to manage all configured mount points; as
such, all automounts must be configured in the master map. This is in line with the usual requirements of
other industry standard automounters. Mount point, hostname, exported directory, and options can all be
specified in a set of files (or other supported network sources) rather than configuring them manually for
each host.
67
Storage Administration Guide
For more information on the supported syntax of this file, see man nsswitch.conf. Not all NSS
databases are valid map sources and the parser will reject ones that are invalid. Valid sources are
files, yp, nis, nisplus, ldap, and hesiod.
Example 8.2. Multiple Master Map Entries per autofs Mount Point
Following is an example in the connectathon test maps for the direct mounts:
/- /tmp/auto_dcthon
/- /tmp/auto_test3_direct
/- /tmp/auto_test4_direct
mount-point
The autofs mount point, /home, for example.
map-name
The name of a map source which contains a list of mount points, and the file system location from
which those mount points should be mounted.
options
If supplied, these applies to all entries in the given map provided they do not themselves have options
specified. This behavior is different from autofs version 4 where options were cumulative. This has
been changed to implement mixed environment compatibility.
68
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
The following is a sample line from /etc/auto.master file (displayed with cat
/etc/auto.master):
/home /etc/auto.misc
The general format of maps is similar to the master map, however the "options" appear between the
mount point and the location instead of at the end of the entry as in the master map:
mount-point
This refers to the autofs mount point. This can be a single directory name for an indirect mount or
the full path of the mount point for direct mounts. Each direct and indirect map entry key (mount-
point) may be followed by a space separated list of offset directories (subdirectory names each
beginning with a /) making them what is known as a multi-mount entry.
options
Whenever supplied, these are the mount options for the map entries that do not specify their own
options.
location
This refers to the file system location such as a local file system path (preceded with the Sun map
format escape character ":" for map names beginning with /), an NFS file system or other valid file
system location.
The following is a sample of contents from a map file (for example, /etc/auto.misc):
The first column in a map file indicates the autofs mount point (sales and payroll from the server
called personnel). The second column indicates the options for the autofs mount while the third
column indicates the source of the mount. Following the given configuration, the autofs mount points will
be /home/payroll and /home/sales. The -fstype= option is often omitted and is generally not
needed for correct operation.
The automounter create the directories if they do not exist. If the directories exist before the automounter
was started, the automounter will not remove them when it exits.
69
Storage Administration Guide
Using the given configuration, if a process requires access to an autofs unmounted directory such as
/home/payroll/2006/July.sxc, the automount daemon automatically mounts the directory. If a
timeout is specified, the directory is automatically unmounted if the directory is not accessed for the
timeout period.
To view the status of the automount daemon, use the following command:
Automounter maps are stored in NIS and the /etc/nsswitch.conf file has the following
directive:
+auto.master
/home auto.home
beth fileserver.example.com:/export/home/beth
joe fileserver.example.com:/export/home/joe
* fileserver.example.com:/export/home/&
Given these conditions, let's assume that the client system needs to override the NIS map auto.home
and mount home directories from a different server. In this case, the client needs to use the following
/etc/auto.master map:
/home /etc/auto.home
+auto.master
* labserver.example.com:/export/home/&
Because the automounter only processes the first occurrence of a mount point, /home contain the
contents of /etc/auto.home instead of the NIS auto.home map.
70
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
Alternatively, to augment the site-wide auto.home map with just a few entries, create an
/etc/auto.home file map, and in it put the new entries. At the end, include the NISauto.home map.
Then the /etc/auto.home file map looks similar to:
mydir someserver:/export/mydir
+auto.home
With these NIS auto.home map conditions, the ls /home command outputs:
This last example works as expected because autofs does not include the contents of a file map of the
same name as the one it is reading. As such, autofs moves on to the next map source in the
nsswitch configuration.
The most recently established schema for storing automount maps in LDAP is described by
rfc2307bis. To use this schema it is necessary to set it in the autofs configuration
(/etc/sysconfig/autofs) by removing the comment characters from the schema definition. For
example:
DEFAULT_MAP_OBJECT_CLASS="automountMap"
DEFAULT_ENTRY_OBJECT_CLASS="automount"
DEFAULT_MAP_ATTRIBUTE="automountMapName"
DEFAULT_ENTRY_ATTRIBUTE="automountKey"
DEFAULT_VALUE_ATTRIBUTE="automountInformation"
Ensure that these are the only schema entries not commented in the configuration. The automountKey
replaces the cn attribute in the rfc2307bis schema. Following is an example of an LDAP Data
Interchange Format (LDIF) configuration:
# extended LDIF
#
# LDAPv3
# base <> with scope subtree
# filter: (&(objectclass=automountMap)(automountMapName=auto.master))
# requesting: ALL
#
# auto.master, example.com
dn: automountMapName=auto.master,dc=example,dc=com
objectClass: top
71
Storage Administration Guide
objectClass: automountMap
automountMapName: auto.master
# extended LDIF
#
# LDAPv3
# base <automountMapName=auto.master,dc=example,dc=com> with scope
subtree
# filter: (objectclass=automount)
# requesting: ALL
#
automountKey: /home
automountInformation: auto.home
# extended LDIF
#
# LDAPv3
# base <> with scope subtree
# filter: (&(objectclass=automountMap)(automountMapName=auto.home))
# requesting: ALL
#
# auto.home, example.com
dn: automountMapName=auto.home,dc=example,dc=com
objectClass: automountMap
automountMapName: auto.home
# extended LDIF
#
# LDAPv3
# base <automountMapName=auto.home,dc=example,dc=com> with scope subtree
# filter: (objectclass=automount)
# requesting: ALL
#
# /, auto.home, example.com
dn: automountKey=/,automountMapName=auto.home,dc=example,dc=com
objectClass: automount
automountKey: /
automountInformation: filer.example.com:/export/&
72
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
Beyond mounting a file system with NFS on a remote host, it is also possible to specify other options at
mount time to make the mounted share easier to use. These options can be used with manual mount
commands, /etc/fstab settings, and autofs.
intr
Allows NFS requests to be interrupted if the server goes down or cannot be reached.
lookupcache=mode
Specifies how the kernel should manage its cache of directory entries for a given mount point. Valid
arguments for mode are all, none, or pos/positive.
nfsvers=version
Specifies which version of the NFS protocol to use, where version is 3 or 4. This is useful for hosts
that run multiple NFS servers. If no version is specified, NFS uses the highest version supported by
the kernel and mount command.
The option vers is identical to nfsvers, and is included in this release for compatibility reasons.
noacl
Turns off all ACL processing. This may be needed when interfacing with older versions of Red Hat
Enterprise Linux, Red Hat Linux, or Solaris, since the most recent ACL technology is not compatible
with older systems.
nolock
Disables file locking. This setting is sometimes required when connecting to very old NFS servers.
noexec
Prevents execution of binaries on mounted file systems. This is useful if the system is mounting a
non-Linux file system containing incompatible binaries.
nosuid
Disables set-user-identifier or set-group-identifier bits. This prevents remote users
from gaining higher privileges by running a setuid program.
port=num
Specifies the numeric value of the NFS server port. If num is 0 (the default value), then mount
queries the remote host's rpcbind service for the port number to use. If the remote host's NFS
daemon is not registered with its rpcbind service, the standard NFS port number of TCP 2049 is
used instead.
There is no fixed default value for rsize and wsize. By default, NFS uses the largest possible value
that both the server and the client support. In Red Hat Enterprise Linux 7, the client and server
maximum is 1,048,576 bytes. For more details, see the What are the default and maximum values for
rsize and wsize with NFS mounts? KBase article.
73
Storage Administration Guide
sec=mode
Its default setting is sec=sys, which uses local UNIX UIDs and GIDs. These use AUTH_SYS to
authenticate NFS operations.
sec=krb5 uses Kerberos V5 instead of local UNIX UIDs and GIDs to authenticate users.
sec=krb5i uses Kerberos V5 for user authentication and performs integrity checking of NFS
operations using secure checksums to prevent data tampering.
sec=krb5p uses Kerberos V5 for user authentication, integrity checking, and encrypts NFS traffic to
prevent traffic sniffing. This is the most secure setting, but it also involves the most performance
overhead.
tcp
Instructs the NFS mount to use the TCP protocol.
udp
Instructs the NFS mount to use the UDP protocol.
For servers that support NFSv2 or NFSv3 connections, the rpcbind[1] service must be running.
To verify that rpcbind is active, use the following command:
To configure an NFSv4-only server, which does not require rpcbind, see Section 8.7.7,
“Configuring an NFSv4-only Server”.
On Red Hat Enterprise Linux 7.0, if your NFS server exports NFSv3 and is enabled to start at
boot, you need to manually start and enable the nfs-lock service:
On Red Hat Enterprise Linux 7.1 and later, nfs-lock starts automatically if needed, and an
attempt to enable it manually fails.
Procedures
To start an NFS server, use the following command:
74
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
The restart option is a shorthand way of stopping and then starting NFS. This is the most
efficient way to make configuration changes take effect after editing the configuration file for
NFS. To restart the server type:
After you edit the /etc/sysconfig/nfs file, restart the nfs-config service by running the
following command for the new values to take effect:
The try-restart command only starts nfs if it is currently running. This command is the
equivalent of condrestart (conditional restart) in Red Hat init scripts and is useful because it
does not start the daemon if NFS is not running.
To reload the NFS server configuration file without restarting the service type:
Manually editing the NFS configuration file, that is, /etc/exports, and
Through the command line, that is, by using the command exportfs
The /etc/exports file controls which file systems are exported to remote hosts and specifies options.
It follows the following syntax rules:
Any lists of authorized hosts placed after an exported file system must be separated by space
characters.
75
Storage Administration Guide
Options for each of the hosts must be placed in parentheses directly after the host identifier,
without any spaces separating the host and the first parenthesis.
Each entry for an exported file system has the following structure:
export host(options)
export
The directory being exported
host
The host or network to which the export is being shared
options
The options to be used for host
It is possible to specify multiple hosts, along with specific options for each host. To do so, list them on the
same line as a space-delimited list, with each hostname followed by its respective options (in
parentheses), as in:
For information on different methods for specifying hostnames, see Section 8.7.5, “Hostname Formats”.
In its simplest form, the /etc/exports file only specifies the exported directory and the hosts permitted
to access it, as in the following example:
/exported/directory bob.example.com
Here, bob.example.com can mount /exported/directory/ from the NFS server. Because no
options are specified in this example, NFS uses default settings.
ro
The exported file system is read-only. Remote hosts cannot change the data shared on the file
system. To allow hosts to make changes to the file system (that is, read and write), specify the rw
option.
sync
The NFS server will not reply to requests before changes made by previous requests are written to
disk. To enable asynchronous writes instead, specify the option async.
wdelay
The NFS server will delay writing to the disk if it suspects another write request is imminent. This can
76
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
improve performance as it reduces the number of times the disk must be accessed by separate write
commands, thereby reducing write overhead. To disable this, specify the no_wdelay. no_wdelay is
only available if the default sync option is also specified.
root_squash
This prevents root users connected remotely (as opposed to locally) from having root privileges;
instead, the NFS server assigns them the user ID nfsnobody. This effectively "squashes" the power
of the remote root user to the lowest local user, preventing possible unauthorized writes on the remote
server. To disable root squashing, specify no_root_squash.
To squash every remote user (including root), use all_squash. To specify the user and group IDs that
the NFS server should assign to remote users from a particular host, use the anonuid and anongid
options, respectively, as in:
export host(anonuid=uid,anongid=gid)
Here, uid and gid are user ID number and group ID number, respectively. The anonuid and anongid
options allow you to create a special user and group account for remote NFS users to share.
By default, access control lists (ACLs) are supported by NFS under Red Hat Enterprise Linux. To disable
this feature, specify the no_acl option when exporting the file system.
Each default for every exported file system must be explicitly overridden. For example, if the rw option is
not specified, then the exported file system is shared as read-only. The following is a sample line from
/etc/exports which overrides two default options:
/another/exported/directory 192.168.0.3(rw,async)
In this example 192.168.0.3 can mount /another/exported/directory/ read and write and all
writes to disk are asynchronous. For more information on exporting options, see man exportfs.
Other options are available where no default value is specified. These include the ability to disable sub-
tree checking, allow access from insecure ports, and allow insecure file locks (necessary for certain early
NFS client implementations). For more information on these less-used options, see man exports.
IMPORTANT
The format of the /etc/exports file is very precise, particularly in regards to use of the
space character. Remember to always separate exported file systems from hosts and
hosts from one another with a space character. However, there should be no other space
characters in the file except on comment lines.
For example, the following two lines do not mean the same thing:
/home bob.example.com(rw)
/home bob.example.com (rw)
The first line allows only users from bob.example.com read and write access to the
/home directory. The second line allows users from bob.example.com to mount the
directory as read-only (the default), while the rest of the world can mount it read/write.
77
Storage Administration Guide
Every file system being exported to remote users with NFS, as well as the access level for those file
systems, are listed in the /etc/exports file. When the nfs service starts, the /usr/sbin/exportfs
command launches and reads this file, passes control to rpc.mountd (if NFSv3) for the actual mounting
process, then to rpc.nfsd where the file systems are then available to remote users.
When issued manually, the /usr/sbin/exportfs command allows the root user to selectively export
or unexport directories without restarting the NFS service. When given the proper options, the
/usr/sbin/exportfs command writes the exported file systems to /var/lib/nfs/xtab. Since
rpc.mountd refers to the xtab file when deciding access privileges to a file system, changes to the list
of exported file systems take effect immediately.
-r
Causes all directories listed in /etc/exports to be exported by constructing a new export list in
/etc/lib/nfs/xtab. This option effectively refreshes the export list with any changes made to
/etc/exports.
-a
Causes all directories to be exported or unexported, depending on what other options are passed to
/usr/sbin/exportfs. If no other options are specified, /usr/sbin/exportfs exports all file
systems specified in /etc/exports.
-o file-systems
Specifies directories to be exported that are not listed in /etc/exports. Replace file-systems with
additional file systems to be exported. These file systems must be formatted in the same way they
are specified in /etc/exports. This option is often used to test an exported file system before
adding it permanently to the list of file systems to be exported. For more information on
/etc/exports syntax, see Section 8.7.1, “The /etc/exports Configuration File”.
-i
Ignores /etc/exports; only options given from the command line are used to define exported file
systems.
-u
Unexports all shared directories. The command /usr/sbin/exportfs -ua suspends NFS file
sharing while keeping all NFS daemons up. To re-enable NFS sharing, use exportfs -r.
-v
Verbose operation, where the file systems being exported or unexported are displayed in greater
detail when the exportfs command is executed.
If no options are passed to the exportfs command, it displays a list of currently exported file systems.
For more information about the exportfs command, see man exportfs.
In Red Hat Enterprise Linux 7, no extra steps are required to configure NFSv4 exports as any filesystems
mentioned are automatically available to NFSv3 and NFSv4 clients using the same path. This was not
the case in previous versions.
78
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
The /etc/sysconfig/nfs file does not exist by default on all systems. If /etc/sysconfig/nfs
does not exist, create it and specify the following:
RPCMOUNTDOPTS="-p port"
This adds "-p port" to the rpc.mount command line: rpc.mount -p port.
To specify the ports to be used by the nlockmgr service, set the port number for the nlm_tcpport and
nlm_udpport options in the /etc/modprobe.d/lockd.conf file.
If NFS fails to start, check /var/log/messages. Commonly, NFS fails to start if you specify a port
number that is already in use. After editing /etc/sysconfig/nfs, you need to restart the nfs-
config service for the new values to take effect in Red Hat Enterprise Linux 7.2 and prior by running:
NOTE
This process is not needed for NFSv4.1 or higher, and the other ports for mountd,
statd, and lockd are not required in a pure NFSv4 environment.
There are two ways to discover which file systems an NFS server exports.
$ showmount -e myserver
Export list for mysever
/exports/foo
/exports/bar
On any server that supports NFSv4, mount the root directory and look around.
79
Storage Administration Guide
On servers that support both NFSv4 and NFSv3, both methods work and give the same results.
NOTE
Before Red Hat Enterprise Linux 6 on older NFS servers, depending on how they are
configured, it is possible to export filesystems to NFSv4 clients at different paths. Because
these servers do not enable NFSv4 by default, this should not be a problem.
Note that rpc-rquotad is, if enabled, started automatically after starting the nfs-server
service.
3. To make the quota RPC service accessible behind a firewall, UDP or TCP port 875 need to be
open. The default port number is defined in the /etc/services file.
You can override the default port number by appending -p port-number to the
RPCRQUOTADOPTS variable in the /etc/sysconfig/rpc-rquotad file.
80
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
Single machine
A fully-qualified domain name (that can be resolved by the server), hostname (that can be resolved
by the server), or an IP address.
IP networks
Use a.b.c.d/z, where a.b.c.d is the network and z is the number of bits in the netmask (for example
192.168.0.0/24). Another acceptable format is a.b.c.d/netmask, where a.b.c.d is the network and
netmask is the netmask (for example, 192.168.100.8/255.255.255.0).
Netgroups
Use the format @group-name, where group-name is the NIS netgroup name.
Note that with earlier kernel versions, a system reboot is needed after editing
/etc/rdma/rdma.conf for the changes to take effect.
81
Storage Administration Guide
When your NFS server is configured as NFSv4-only, clients attempting to mount shares using NFSv2 or
NFSv3 fail with an error like the following:
To configure your NFS server to support only NFS version 4.0 and later:
1. Disable NFSv2, NFSv3, and UDP by adding the following line to the /etc/sysconfig/nfs
configuration file:
RPCNFSDARGS="-N 2 -N 3 -U"
2. Optionally, disable listening for the RPCBIND, MOUNT, and NSM protocol calls, which are not
necessary in the NFSv4-only case.
Clients that attempt to mount shares from your server using NFSv2 or NFSv3 become
unresponsive.
The NFS server itself is unable to mount NFSv2 and NFSv3 file systems.
RPCMOUNTDOPTS="-N 2 -N 3"
The changes take effect as soon as you start or restart the NFS server.
You can verify that your NFS server is configured in the NFSv4-only mode by using the netstat utility.
The following is an example netstat output on an NFSv4-only server; listening for RPCBIND,
MOUNT, and NSM is also disabled. Here, nfs is the only listening NFS service:
# netstat -ltu
82
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
In comparison, the netstat output before configuring an NFSv4-only server includes the
sunrpc and mountd services:
# netstat -ltu
83
Storage Administration Guide
First, the server restricts which hosts are allowed to mount which file systems either by IP address or by
host name.
Second, the server enforces file system permissions for users on NFS clients in the same way it does
local users. Traditionally it does this using AUTH_SYS (also called AUTH_UNIX) which relies on the client
to state the UID and GID's of the user. Be aware that this means a malicious or misconfigured client can
easily get this wrong and allow a user access to files that it should not.
To limit the potential risks, administrators often allow read-only access or squash user permissions to a
common user and group ID. Unfortunately, these solutions prevent the NFS share from being used in the
way it was originally intended.
Additionally, if an attacker gains control of the DNS server used by the system exporting the NFS file
system, the system associated with a particular hostname or fully qualified domain name can be pointed
to an unauthorized machine. At this point, the unauthorized machine is the system permitted to mount
the NFS share, since no username or password information is exchanged to provide additional security
for the NFS mount.
Wildcards should be used sparingly when exporting directories through NFS, as it is possible for the
scope of the wildcard to encompass more systems than intended.
It is also possible to restrict access to the rpcbind[1] service with TCP wrappers. Creating rules with
iptables can also limit access to ports used by rpcbind, rpc.mountd, and rpc.nfsd.
84
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
For more information on securing NFS and rpcbind, refer to man iptables.
NFSv4 revolutionized NFS security by mandating the implementation of RPCSEC_GSS and the
Kerberos version 5 GSS-API mechanism. However, RPCSEC_GSS and the Kerberos mechanism are
also available for all versions of NFS. In FIPS mode, only FIPS-approved algorithms can be used.
Unlike AUTH_SYS, with the RPCSEC_GSS Kerberos mechanism, the server does not depend on the
client to correctly represent which user is accessing the file. Instead, cryptography is used to
authenticate users to the server, which prevents a malicious client from impersonating a user without
having that user's Kerberos credentials. Using the RPCSEC_GSS Kerberos mechanism is the most
straightforward way to secure mounts because after configuring Kerberos, no additional setup is
needed.
Configuring Kerberos
Before configuring an NFSv4 Kerberos-aware server, you need to install and configure a Kerberos Key
Distribution Centre (KDC). Kerberos is a network authentication system that allows clients and servers to
authenticate to each other by using symmetric encryption and a trusted third party, the KDC. Red Hat
recommends using Identity Management (IdM) for setting up Kerberos.
Procedure 8.3. Configuring an NFS Server and Client for IdM to Use RPCSEC_GSS
Create the host/hostname.domain@REALM principal on both the server and the client
side.
Add the corresponding keys to keytabs for the client and server.
For instructions, see the Adding and Editing Service Entries and Keytabs and Setting up a
Kerberos-aware NFS Server sections in the Red Hat Enterprise Linux 7 Linux Domain Identity,
Authentication, and Policy Guide.
2. On the server side, use the sec= option to enable the wanted security flavors. To enable all
security flavors as well as non-cryptographic mounts:
/export *(sec=sys:krb5:krb5i:krb5p)
3. On the client side, add sec=krb5 (or sec=krb5i, or sec=krb5p, depending on the setup) to
the mount options:
85
Storage Administration Guide
For information on how to configure a NFS client, see the Setting up a Kerberos-aware NFS
Client section in the Red Hat Enterprise Linux 7 Linux Domain Identity, Authentication, and
Policy Guide.
Although Red Hat recommends using IdM, Active Directory (AD) Kerberos servers are also supported.
For details, see the following Red Hat Knowledgebase article: How to set up NFS using Kerberos
authentication on RHEL 7 using SSSD and Active Directory.
For more information, see the exports(5) and nfs(5) manual pages, and Section 8.5, “Common NFS
Mount Options”.
For further information on the RPCSEC_GSS framework, including how gssproxy and rpc.gssd inter-
operate, see the GSSD flow description.
NFSv4 includes ACL support based on the Microsoft Windows NT model, not the POSIX model,
because of the Microsoft Windows NT model's features and wide deployment.
Another important security feature of NFSv4 is the removal of the use of the MOUNT protocol for mounting
file systems. The MOUNT protocol presented a security risk because of the way the protocol processed
file handles.
By default, access control lists (ACLs) are supported by NFS under Red Hat Enterprise Linux. Red Hat
recommends that this feature is kept enabled.
By default, NFS uses root squashing when exporting a file system. This sets the user ID of anyone
accessing the NFS share as the root user on their local machine to nobody. Root squashing is
controlled by the default option root_squash; for more information about this option, refer to
Section 8.7.1, “The /etc/exports Configuration File”. If possible, never disable root squashing.
When exporting an NFS share as read-only, consider using the all_squash option. This option makes
every user accessing the exported file system take the user ID of the nfsnobody user.
NOTE
The following section only applies to NFSv3 implementations that require the rpcbind
service for backward compatibility.
For information on how to configure an NFSv4-only server, which does not need
rpcbind, see Section 8.7.7, “Configuring an NFSv4-only Server”.
The rpcbind[1] utility maps RPC services to the ports on which they listen. RPC processes notify
rpcbind when they start, registering the ports they are listening on and the RPC program numbers they
86
CHAPTER 8. NETWORK FILE SYSTEM (NFS)
expect to serve. The client system then contacts rpcbind on the server with a particular RPC program
number. The rpcbind service redirects the client to the proper port number so it can communicate with
the requested service.
Because RPC-based services rely on rpcbind to make all connections with incoming client requests,
rpcbind must be available before any of these services start.
The rpcbind service uses TCP wrappers for access control, and access control rules for rpcbind
affect all RPC-based services. Alternatively, it is possible to specify access control rules for each of the
NFS RPC daemons. The man pages for rpc.mountd and rpc.statd contain information regarding the
precise syntax for these rules.
Because rpcbind[1] provides coordination between RPC services and the port numbers used to
communicate with them, it is useful to view the status of current RPC services using rpcbind when
troubleshooting. The rpcinfo command shows each RPC-based service with port numbers, an RPC
program number, a version number, and an IP protocol type (TCP or UDP).
To make sure the proper NFS RPC-based services are enabled for rpcbind, use the following
command:
# rpcinfo -p
87
Storage Administration Guide
If one of the NFS services does not start up correctly, rpcbind will be unable to map RPC requests from
clients for that service to the correct port. In many cases, if NFS is not present in rpcinfo output,
restarting NFS causes the service to correctly register with rpcbind and begin working.
For more information and a list of options on rpcinfo, see its man page.
Installed Documentation
man mount — Contains a comprehensive look at mount options for both NFS server and client
configurations.
man fstab — Provides detail for the format of the /etc/fstab file used to mount file systems
at boot-time.
man nfs — Provides details on NFS-specific file system export and mount options.
man exports — Shows common options used in the /etc/exports file when exporting NFS
file systems.
Useful Websites
http://linux-nfs.org — The current site for developers where project status updates can be
viewed.
http://nfs.sourceforge.net/ — The old home for developers which still contains a lot of useful
information.
Related Books
Managing NFS and NIS by Hal Stern, Mike Eisler, and Ricardo Labiaga; O'Reilly & Associates
— Makes an excellent reference guide for the many different NFS export and mount options
available.
[1] The rpcbind service replaces portmap, which was used in previous versions of Red Hat Enterprise Linux to
map RPC program numbers to IP address port number combinations. For more information, refer to Section 8.1.1,
“Required Services”.
88
CHAPTER 9. SERVER MESSAGE BLOCK (SMB)
NOTE
In the context of SMB, you sometimes read about the Common Internet File System
(CIFS) protocol, which is a dialect of SMB. Both the SMB and CIFS protocol are
supported and the kernel module and utilities involved in mounting SMB and CIFS shares
both use the name cifs.
Set and display Access Control Lists (ACL) in a security descriptor on SMB and CIFS shares
SMB 1
SMB 2.0
SMB 2.1
SMB 3.0
NOTE
Depending on the protocol version, not all SMB features are implemented.
89
Storage Administration Guide
Samba uses the CAP_UNIX capability bit in the SMB protocol to provide the UNIX extensions feature.
These extensions are also supported by the cifs.ko kernel module. However, both Samba and the
kernel module support UNIX extensions only in the SMB 1 protocol.
1. Set the server min protocol option in the [global] section in the
/etc/samba/smb.conf file to NT1. This is the default on Samba servers.
2. Mount the share using the SMB 1 protocol by providing the -o vers=1.0 option to the mount
command. For example:
By default, the kernel module uses SMB 2 or the highest later protocol version supported by the
server. Passing the -o vers=1.0 option to the mount command forces that the kernel module
uses the SMB 1 protocol that is required for using UNIX extensions.
To verify if UNIX extensions are enabled, display the options of the mounted share:
# mount
...
//server/share on /mnt type cifs (...,unix,...)
If the unix entry is displayed in the list of mount options, UNIX extensions are enabled.
In the -o options parameter, you can specify options that will be used to mount the share. For details,
see Section 9.2.6, “Frequently Used Mount Options” and the OPTIONS section in the mount.cifs(8) man
page.
90
CHAPTER 9. SERVER MESSAGE BLOCK (SMB)
IMPORTANT
To enable the system to mount a share automatically, you must store the user name,
password, and domain name in a credentials file. For details, see Section 9.2.4,
“Authenticating To an SMB Share Using a Credentials File”.
In the fourth field of the /etc/fstab file, specify mount options, such as the path to the credentials file.
For details, see Section 9.2.6, “Frequently Used Mount Options” and the OPTIONS section in the
mount.cifs(8) man page.
# mount /mnt/
1. Create a file, such as ~/smb.cred, and specify the user name, password, and domain name
that file:
username=user_name
password=password
domain=domain_name
2. Set the permissions to only allow the owner to access the file:
You can now pass the credentials=file_name mount option to the mount utility or use it in the
/etc/fstab file to mount the share without being prompted for the user name and password.
However, in certain situations, the administrator wants to mount a share automatically when the system
boots, but users should perform actions on the share's content using their own credentials. The
multiuser mount options lets you configure this scenario.
91
Storage Administration Guide
IMPORTANT
To use multiuser, you must additionally set the sec=security_type mount option to
a security type which supports providing credentials in a non-interactive way, such as
krb5 or the ntlmssp option with a credentials file. See the section called “Accessing a
Share as a User”.
The root user mounts the share using the multiuser option and an account that has minimal access
to the contents of the share. Regular users can then provide their user name and password to the current
session's kernel keyring using the cifscreds utility. If the user accesses the content of the mounted
share, the kernel uses the credentials from the kernel keyring instead of the one initially used to mount
the share.
To mount a share automatically with the multiuser option when the system boots:
Procedure 9.2. Creating an /etc/fstab File Entry with the multiuser Option
1. Create the entry for the share in the /etc/fstab file. For example:
# mount /mnt/
If you do not want to mount the share automatically when the system boots, mount it manually by
passing -o multiuser,sec=security_type to the mount command. For details about mounting an
SMB share manually, see Section 9.2.2, “Manually Mounting an SMB Share”.
# mount
...
//server_name/share_name on /mnt type cifs (sec=ntlmssp,multiuser,...)
If an SMB share is mounted with the multiuser option, users can provide their credentials for the
server to the kernel's keyring:
Now, when the user performs operations in the directory that contains the mounted SMB share, the
server applies the file system permissions for this user, instead of the one initially used when the share
was mounted.
92
CHAPTER 9. SERVER MESSAGE BLOCK (SMB)
NOTE
Multiple users can perform operations using their own credentials on the mounted share
at the same time.
How the connection will be established with the server. For example, which SMB protocol
version is used when connecting to the server.
How the share will be mounted into the local file system. For example, if the system overrides
the remote file and directory permissions to enable multiple local users to access the content on
the server.
To set multiple options in the fourth field of the /etc/fstab file or in the -o parameter of a mount
command, separate them with commas. For example, see Procedure 9.2, “Creating an /etc/fstab
File Entry with the multiuser Option”.
Option Description
credentials=file_name Sets the path to the credentials file. See Section 9.2.4, “Authenticating To an
SMB Share Using a Credentials File”.
dir_mode=mode Sets the directory mode if the server does not support CIFS UNIX
extensions.
file_mode=mode Sets the file mode if the server does not support CIFS UNIX extensions.
password=password Sets the password used to authenticate to the SMB server. Alternatively,
specify a credentials file using the credentials option.
seal Enables encryption support for connections using SMB 3.0 or a later
protocol version. Therefore, use seal together with the vers mount option
set to 3.0 or later. See Example 9.1, “Mounting a Share Using an
Encrypted SMB 3.0 Connection”.
sec=security_mode Sets the security mode, such as ntlmsspi, to enable NTLMv2 password
hashing and enabled packet signing. For a list of supported values, see the
option's description in the mount.cifs(8) man page.
If the server does not support the ntlmv2 security mode, use
sec=ntlmssp , which is the default. For security reasons, do not use the
insecure ntlm security mode.
username=user_name Sets the user name used to authenticate to the SMB server. Alternatively,
specify a credentials file using the credentials option.
93
Storage Administration Guide
Option Description
vers=SMB_protocol_version Sets the SMB protocol version used for the communication with the server.
For a complete list, see the OPTIONS section in the mount.cifs(8) man page.
94
CHAPTER 10. FS-CACHE
FS-Cache does not alter the basic operation of a file system that works over the network - it merely
provides that file system with a persistent place in which it can cache data. For instance, a client can still
mount an NFS share whether or not FS-Cache is enabled. In addition, cached NFS can handle files that
won't fit into the cache (whether individually or collectively) as files can be partially cached and do not
have to be read completely up front. FS-Cache also hides all I/O errors that occur in the cache from the
client file system driver.
95
Storage Administration Guide
To provide caching services, FS-Cache needs a cache back end. A cache back end is a storage driver
configured to provide caching services (i.e. cachefiles). In this case, FS-Cache requires a mounted
block-based file system that supports bmap and extended attributes (e.g. ext3) as its cache back end.
FS-Cache cannot arbitrarily cache any file system, whether through the network or otherwise: the shared
file system's driver must be altered to allow interaction with FS-Cache, data storage/retrieval, and
metadata setup and validation. FS-Cache needs indexing keys and coherency data from the cached file
system to support persistence: indexing keys to match file system objects to cache objects, and
coherency data to determine whether the cache objects are still valid.
NOTE
In Red Hat Enterprise Linux 7, the cachefilesd package is not installed by default and
needs to be installed manually.
For example, using FS-Cache to cache an NFS share between two computers over an otherwise
unladen GigE network will not demonstrate any performance improvements on file access. Rather, NFS
requests would be satisfied faster from server memory rather than from local disk.
The use of FS-Cache, therefore, is a compromise between various factors. If FS-Cache is being used to
cache NFS traffic, for instance, it may slow the client down a little, but massively reduce the network and
server loading by satisfying read requests locally without consuming network bandwidth.
The first setting to configure in a cache back end is which directory to use as a cache. To configure this,
use the following parameter:
$ dir /path/to/cache
$ dir /var/cache/fscache
If you want to change the cache back end directory, the selinux context must be same as
/var/cache/fscache:
96
CHAPTER 10. FS-CACHE
NOTE
If the given commands for setting selinux context did not work, use the following
commands:
FS-Cache will store the cache in the file system that hosts /path/to/cache. On a laptop, it is
advisable to use the root file system (/) as the host file system, but for a desktop machine it would be
more prudent to mount a disk partition specifically for the cache.
File systems that support functionalities required by FS-Cache cache back end include the Red Hat
Enterprise Linux 7 implementations of the following file systems:
ext4
Btrfs
XFS
The host file system must support user-defined extended attributes; FS-Cache uses these attributes to
store coherency maintenance information. To enable user-defined extended attributes for ext3 file
systems (i.e. device), use:
Alternatively, extended attributes for a file system can be enabled at mount time, as in:
The cache back end works by maintaining a certain amount of free space on the partition hosting the
cache. It grows and shrinks the cache in response to other elements of the system using up free space,
making it safe to use on the root file system (for example, on a laptop). FS-Cache sets defaults on this
behavior, which can be configured via cache cull limits. For more information about configuring cache
cull limits, refer to Section 10.4, “Setting Cache Cull Limits”.
To configure cachefilesd to start at boot time, execute the following command as root:
97
Storage Administration Guide
All access to files under /mount/point will go through the cache, unless the file is opened for direct I/O
or writing. For more information, see Section 10.3.2, “Cache Limitations with NFS”. NFS indexes cache
contents using NFS file handle, not the file name, which means hard-linked files share the cache
correctly.
Caching is supported in version 2, 3, and 4 of NFS. However, each version uses different branches for
caching.
To avoid coherency management problems between superblocks, all NFS superblocks that wish to
cache data have unique Level 2 keys. Normally, two NFS mounts with same source volume and options
share a superblock, and thus share the caching, even if they mount different directories within that
volume.
Here, /home/fred and /home/jim likely share the superblock as they have the same options,
especially if they come from the same volume/partition on the NFS server (home0). Now, consider
the next two subsequent mount commands:
In this case, /home/fred and /home/jim will not share the superblock as they have different
network access parameters, which are part of the Level 2 key. The same goes for the following mount
sequence:
Here, the contents of the two subtrees (/home/fred1 and /home/fred2) will be cached twice.
98
CHAPTER 10. FS-CACHE
Another way to avoid superblock sharing is to suppress it explicitly with the nosharecache
parameter. Using the same example:
However, in this case only one of the superblocks is permitted to use cache since there is nothing to
distinguish the Level 2 keys of home0:/disk0/fred and home0:/disk0/jim. To address this,
add a unique identifier on at least one of the mounts, i.e. fsc=unique-identifier. For example:
Here, the unique identifier jim is added to the Level 2 key used in the cache for /home/jim.
Opening a file from a shared file system for writing will not work on NFS version 2 and 3. The
protocols of these versions do not provide sufficient coherency management information for the
client to detect a concurrent write to the same file from another client.
Opening a file from a shared file system for either direct I/O or writing flushes the cached copy of
the file. FS-Cache will not cache the file again until it is no longer opened for direct I/O or writing.
Furthermore, this release of FS-Cache only caches regular NFS files. FS-Cache will not cache
directories, symlinks, device files, FIFOs and sockets.
Cache culling is done on the basis of the percentage of blocks and the percentage of files available in the
underlying file system. There are six limits controlled by settings in /etc/cachefilesd.conf:
99
Storage Administration Guide
If the amount of available space or the number of available files in the cache falls below either of
these limits, then no further allocation of disk space or files is permitted until culling has raised things
above these limits again.
brun/frun - 10%
bcull/fcull - 7%
bstop/fstop - 3%
These are the percentages of available space and available files and do not appear as 100 minus the
percentage displayed by the df program.
IMPORTANT
Culling depends on both bxxx and fxxx pairs simultaneously; they can not be treated
separately.
# cat /proc/fs/fscache/stats
FS-Cache statistics includes information on decision points and object counters. For more information,
see the following kernel document:
/usr/share/doc/kernel-
doc-version/Documentation/filesystems/caching/fscache.txt
/usr/share/doc/cachefilesd-version-number/README
/usr/share/man/man5/cachefilesd.conf.5.gz
/usr/share/man/man8/cachefilesd.8.gz
For general information about FS-Cache, including details on its design constraints, available statistics,
and capabilities, see the following kernel document: /usr/share/doc/kernel-
doc-version/Documentation/filesystems/caching/fscache.txt
100
PART II. STORAGE ADMINISTRATION
101
Storage Administration Guide
This chapter discusses several considerations when planning a storage configuration for your system.
For installation instructions (including storage configuration during installation), see the Installation Guide
provided by Red Hat.
For information on what Red Hat officially supports with regards to size and storage limits, see the article
http://www.redhat.com/resourcelibrary/articles/articles-red-hat-enterprise-linux-6-technology-capabilities-
and-limits.
For zFCP devices, you must list the device number, logical unit number (LUN), and world wide port name
(WWPN). Once the zFCP device is initialized, it is mapped to a CCW path. The FCP_x= lines on the boot
command line (or in a CMS configuration file) allow you to specify this information for the installer.
102
CHAPTER 11. STORAGE CONSIDERATIONS DURING INSTALLATION
WARNING
Removing/deleting RAID metadata from disk could potentially destroy any stored
data. Red Hat recommends that you back up your data before proceeding.
To delete RAID metadata from the disk, use the following command:
dmraid -r -E /device/
For more information about managing RAID devices, see man dmraid and Chapter 18, Redundant
Array of Independent Disks (RAID).
DASD
Direct-access storage devices (DASD) cannot be added or configured during installation. Such devices
are specified in the CMS configuration file.
This causes the I/O to later fail with a checksum error. This problem is common to all block device (or file
system-based) buffered I/O or mmap(2) I/O, so it is not possible to work around these errors caused by
overwrites.
As such, block devices with DIF/DIX enabled should only be used with applications that use O_DIRECT.
Such applications should use the raw block device. Alternatively, it is also safe to use the XFS file
system on a DIF/DIX enabled block device, as long as only O_DIRECT I/O is issued through the file
system. XFS is the only file system that does not fall back to buffered I/O when doing certain allocation
operations.
The responsibility for ensuring that the I/O data does not change after the DIF/DIX checksum has been
computed always lies with the application, so only applications designed for use with O_DIRECT I/O and
DIF/DIX hardware should use DIF/DIX.
103
Storage Administration Guide
NOTE
These file system checkers only guarantee metadata consistency across the file system;
they have no awareness of the actual data contained within the file system and are not
data recovery tools.
File system inconsistencies can occur for various reasons, including but not limited to hardware errors,
storage administration errors, and software bugs.
Before modern metadata-journaling file systems became common, a file system check was required any
time a system crashed or lost power. This was because a file system update could have been
interrupted, leading to an inconsistent state. As a result, a file system check is traditionally run on each
file system listed in /etc/fstab at boot-time. For journaling file systems, this is usually a very short
operation, because the file system's metadata journaling ensures consistency even after a crash.
However, there are times when a file system inconsistency or corruption may occur, even for journaling
file systems. When this happens, the file system checker must be used to repair the file system. The
following provides best practices and other useful information when performing this procedure.
IMPORTANT
Red Hat does not recommended this unless the machine does not boot, the file system is
extremely large, or the file system is on remote storage. It is possible to disable file
system check at boot by setting the sixth field in /etc/fstab to 0.
Dry run
Most file system checkers have a mode of operation which checks but does not repair the file system.
In this mode, the checker prints any errors that it finds and actions that it would have taken, without
actually modifying the file system.
NOTE
104
CHAPTER 12. FILE SYSTEM CHECK
contains only metadata. Because file system checkers operate only on metadata, such an image can
be used to perform a dry run of an actual file system repair, to evaluate what changes would actually
be made. If the changes are acceptable, the repair can then be performed on the file system itself.
NOTE
Severely damaged file systems may cause problems with metadata image creation.
Disk errors
File system check tools cannot repair hardware problems. A file system must be fully readable and
writable if repair is to operate successfully. If a file system was corrupted due to a hardware error, the
file system must first be moved to a good disk, for example with the dd(8) utility.
A full file system check and repair is invoked for ext2, which is not a metadata journaling file system, and
for ext4 file systems without a journal.
For ext3 and ext4 file systems with metadata journaling, the journal is replayed in userspace and the
binary exits. This is the default action as journal replay ensures a consistent file system after a crash.
If these file systems encounter metadata inconsistencies while mounted, they record this fact in the file
system superblock. If e2fsck finds that a file system is marked with such an error, e2fsck performs a
full check after replaying the journal (if present).
e2fsck may ask for user input during the run if the -p option is not specified. The -p option tells
e2fsck to automatically do all repairs that may be done safely. If user intervention is required, e2fsck
indicates the unfixed problem in its output and reflect this status in the exit code.
-n
105
Storage Administration Guide
-b superblock
Specify block number of an alternate suprerblock if the primary one is damaged.
-f
Force full check even if the superblock has no recorded errors.
-j journal-dev
Specify the external journal device, if any.
-p
Automatically repair or "preen" the file system with no user input.
-y
Assume an answer of "yes" to all questions.
All options for e2fsck are specified in the e2fsck(8) manual page.
The following five basic phases are performed by e2fsck while running:
The e2image(8) utility can be used to create a metadata image prior to repair for diagnostic or testing
purposes. The -r option should be used for testing purposes in order to create a sparse file of the same
size as the file system itself. e2fsck can then operate directly on the resulting file. The -Q option should
be specified if the image is to be archived or provided for diagnostic. This creates a more compact file
format suitable for transfer.
12.2.2. XFS
No repair is performed automatically at boot time. To initiate a file system check or repair, use the
xfs_repair tool.
NOTE
Although an fsck.xfs binary is present in the xfsprogs package, this is present only to
satisfy initscripts that look for an fsck.file system binary at boot time. fsck.xfs
immediately exits with an exit code of 0.
Older xfsprogs packages contain an xfs_check tool. This tool is very slow and does not
scale well for large file systems. As such, it has been deprecated in favor of xfs_repair
-n.
106
CHAPTER 12. FILE SYSTEM CHECK
A clean log on a file system is required for xfs_repair to operate. If the file system was not cleanly
unmounted, it should be mounted and unmounted prior to using xfs_repair. If the log is corrupt and
cannot be replayed, the -L option may be used to zero the log.
IMPORTANT
The -L option must only be used if the log cannot be replayed. The option discards all
metadata updates in the log and results in further inconsistencies.
It is possible to run xfs_repair in a dry run, check-only mode by using the -n option. No changes will
be made to the file system when this option is specified.
-n
No modify mode. Check-only operation.
-L
Zero metadata log. Use only if log cannot be replayed with mount.
-m maxmem
Limit memory used during run to maxmem MB. 0 can be specified to obtain a rough estimate of the
minimum memory required.
-l logdev
Specify the external log device, if present.
All options for xfs_repair are specified in the xfs_repair(8) manual page.
The following eight basic phases are performed by xfs_repair while running:
4. Directory checks.
5. Pathname checks.
7. Freemap checks.
xfs_repair is not interactive. All operations are performed automatically with no input from the user.
107
Storage Administration Guide
If it is desired to create a metadata image prior to repair for diagnostic or testing purposes, the
xfs_metadump(8) and xfs_mdrestore(8) utilities may be used.
12.2.3. Btrfs
NOTE
Btrfs is available as a Technology Preview feature in Red Hat Enterprise Linux 7 but has
been deprecated since the Red Hat Enterprise Linux 7.4 release. It will be removed in a
future major release of Red Hat Enterprise Linux.
For more information, see Deprecated Functionality in the Red Hat Enterprise Linux 7.4
Release Notes.
The btrfsck tool is used to check and repair btrfs file systems. This tool is still in early development
and may not detect or repair all types of file system corruption.
By default, btrfsck does not make changes to the file system; that is, it runs check-only mode by
default. If repairs are desired the --repair option must be specified.
The following three basic phases are performed by btrfsck while running:
1. Extent checks.
The btrfs-image(8) utility can be used to create a metadata image prior to repair for diagnostic or
testing purposes.
108
CHAPTER 13. PARTITIONS
The parted package is installed by default on Red Hat Enterprise Linux 7. To start parted, log in as root
and enter the following command:
# parted /dev/sda
Replace /dev/sda with the device name for the drive to configure.
If you want to remove or resize a partition, the device on which that partition resides must not be in use.
It is possible to create a new partition on a device that is in use, but this is not recommended.
The easiest way to modify disks that are currently in use is:
1. Boot the system in rescue mode if the partitions on the disk are impossible to unmount, for
example in the case of a system disk.
If the drive does not contain any partitions in use, that is there are no system processes that use or lock
the file system from being unmounted, you can unmount the partitions with the umount command and
turn off all the swap space on the hard drive with the swapoff command.
To see commonly used parted commands, see Table 13.1, “parted Commands”.
IMPORTANT
Do not use the parted utility to create file systems. Use the mkfs tool instead.
109
Storage Administration Guide
Command Description
mkpart part-type [fs-type] start-mb Make a partition without creating a new file system
end-mb
name minor-num name Name the partition for Mac and PC98 disklabels only
set minor-num flag state Set the flag on a partition; state is either on or off
1. Start parted.
(parted) print
110
CHAPTER 13. PARTITIONS
Model: ATA ST3160812AS (scsi): explains the disk type, manufacturer, model number, and
interface.
In the partition table, Number is the partition number. For example, the partition with minor
number 1 corresponds to /dev/sda1. The Start and End values are in megabytes. Valid
Types are metadata, free, primary, extended, or logical. The File system is the file system
type. The Flags column lists the flags set for the partition. Available flags are boot, root, swap,
hidden, raid, lvm, or lba.
The File system in the partition table can be any of the following:
ext2
ext3
fat16
fat32
hfs
jfs
linux-swap
ntfs
reiserfs
hp-ufs
sun-ufs
xfs
If a File system of a device shows no value, this means that its file system type is unknown.
111
Storage Administration Guide
NOTE
To select a different device without having to restart parted, use the following command
and replace /dev/sda with the device you want to select:
WARNING
1. Before creating a partition, boot into rescue mode, or unmount any partitions on the device and
turn off any swap space on the device.
2. Start parted:
# parted /dev/sda
Replace /dev/sda with the device name on which you want to create the partition.
3. View the current partition table to determine if there is enough free space:
(parted) print
If there is not enough free space, you can resize an existing partition. For more information, see
Section 13.5, “Resizing a Partition with fdisk”.
From the partition table, determine the start and end points of the new partition and what partition
type it should be. You can only have four primary partitions, with no extended partition, on a
device. If you need more than four partitions, you can have three primary partitions, one
extended partition, and multiple logical partitions within the extended. For an overview of disk
partitions, see the appendix An Introduction to Disk Partitions in the Red Hat Enterprise Linux 7
Installation Guide.
4. To create partition:
Replace part-type with with primary, logical, or extended as per your requirement.
Replace name with partition-name; name is required for GPT partition tables.
112
CHAPTER 13. PARTITIONS
Replace fs-type with any one of btrfs, ext2, ext3, ext4, fat16, fat32, hfs, hfs+, linux-swap, ntfs,
reiserfs, or xfs; fs-type is optional.
Replace start end with the size in megabytes as per your requirement.
For example, to create a primary partition with an ext3 file system from 1024 megabytes until
2048 megabytes on a hard drive, type the following command:
NOTE
If you use the mkpartfs command instead, the file system is created after the
partition is created. However, parted does not support creating an ext3 file
system. Thus, if you wish to create an ext3 file system, use mkpart and create
the file system with the mkfs command as described later.
The changes start taking place as soon as you press Enter, so review the command before
executing to it.
5. View the partition table to confirm that the created partition is in the partition table with the
correct partition type, file system type, and size using the following command:
(parted) print
Also remember the minor number of the new partition so that you can label any file systems on
it.
(parted) quit
7. Use the following command after parted is closed to make sure the kernel recognizes the new
partition:
# cat /proc/partitions
The maximum number of partitions parted can create is 128. While the GUID Partition Table (GPT)
specification allows for more partitions by growing the area reserved for the partition table, common
practice used by parted is to limit it to enough area for 128 partitions.
1. The partition does not have a file system. To create the ext4 file system, use:
# mkfs.ext4 /dev/sda6
113
Storage Administration Guide
WARNING
Formatting the partition permanently destroys any data that currently exists
on the partition.
2. Label the file system on the partition. For example, if the file system on the new partition is
/dev/sda6 and you want to label it Work, use:
By default, the installation program uses the mount point of the partition as the label to make
sure the label is unique. You can use any label you want.
1. As root, edit the /etc/fstab file to include the new partition using the partition's UUID.
Use the command blkid -o list for a complete list of the partition's UUID, or blkid
device for individual device details.
In /etc/fstab:
The first column should contain UUID= followed by the file system's UUID.
The second column should contain the mount point for the new partition.
The third column should be the file system type: for example, ext4 or swap.
The fourth column lists mount options for the file system. The word defaults here means
that the partition is mounted at boot time with default options.
The fifth and sixth field specify backup and check options. Example values for a non-root
partition are 0 2.
2. Regenerate mount units so that your system registers the new configuration:
# systemctl daemon-reload
3. Try mounting the file system to verify that the configuration works:
# mount /work
Additional Information
If you need more information about the format of /etc/fstab, see the fstab(5) man page.
114
CHAPTER 13. PARTITIONS
WARNING
Unmount any partitions on the device and turn off any swap space on the device.
# parted device
Replace device with the device on which to remove the partition: for example, /dev/sda.
3. View the current partition table to determine the minor number of the partition to remove:
(parted) print
4. Remove the partition with the command rm. For example, to remove the partition with minor
number 3:
(parted) rm 3
The changes start taking place as soon as you press Enter, so review the command before
committing to it.
5. After removing the partition, use the print command to confirm that it is removed from the
partition table:
(parted) print
(parted) quit
7. Examine the content of the /proc/partitions file to make sure the kernel knows the partition
is removed:
# cat /proc/partitions
115
Storage Administration Guide
8. Remove the partition from the /etc/fstab file. Find the line that declares the removed
partition, and remove it from the file.
9. Regenerate mount units so that your system registers the new /etc/fstab configuration:
# systemctl daemon-reload
You can start the fdisk utility and use the t command to set the partition type. The following example
shows how to change the partition type of the first partition to 0x83, default on Linux:
# fdisk /dev/sdc
Command (m for help): t
Selected partition 1
Partition type (type L to list all types): 83
Changed type of partition 'Linux LVM' to 'Linux'.
The parted utility provides some control of partition types by trying to map the partition type to 'flags',
which is not convenient for end users. The parted utility can handle only certain partition types, for
example LVM or RAID. To remove, for example, the lvm flag from the first partition with parted, use:
For a list of commonly used partition types and hexadecimal numbers used to represent them, see the
Partition Types table in the Partitions: Turning One Drive Into Many appendix of the Red Hat
Enterprise Linux 7 Installation Guide.
Before resizing a partition, back up the data stored on the file system and test the procedure, as the only
way to change a partition size using fdisk is by deleting and recreating the partition.
IMPORTANT
The partition you are resizing must be the last partition on a particular disk.
The following procedure is provided only for reference. To resize a partition using fdisk:
116
CHAPTER 13. PARTITIONS
# umount /dev/vda
# fdisk /dev/vda
Welcome to fdisk (util-linux 2.23.2).
Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.
3. Use the p option to determine the line number of the partition to be deleted.
4. Use the d option to delete a partition. If there is more than one partition available, fdisk
prompts you to provide a number of the partition to delete:
5. Use the n option to create a partition and follow the prompts. Allow enough space for any future
resizing. The fdisk default behavior (press Enter) is to use all space on the device. You can
specify the end of the partition by sectors, or specify a human-readable size by using
+<size><suffix>, for example +500M, or +10G.
Red Hat recommends using the human-readable size specification if you do not want to use all
free space, as fdisk aligns the end of the partition with the physical sectors. If you specify the
size by providing an exact number (in sectors), fdisk does not align the end of the partition.
117
Storage Administration Guide
7. Write the changes with the w option when you are sure the changes are correct, as errors can
cause instability with the selected partition.
# e2fsck /dev/vda
e2fsck 1.41.12 (17-May-2010)
Pass 1:Checking inodes, blocks, and sizes
Pass 2:Checking directory structure
Pass 3:Checking directory connectivity
Pass 4:Checking reference counts
Pass 5:Checking group summary information
ext4-1:11/131072 files (0.0% non-contiguous),27050/524128 blocks
# mount /dev/vda
118
CHAPTER 14. CREATING AND MAINTAINING SNAPSHOTS WITH SNAPPER
The file system recommended by Red Hat with Snapper depends on your Red Hat Enterprise Linux
version:
In Red Hat Enterprise Linux 7.4 or earlier versions of Red Hat Enterprise Linux 7, use ext4 with
Snapper. Use the XFS file system on lvm-thin volumes only if you are monitoring the amount of
free space in the pool to prevent out-of-space problems that can lead to a failure.
In Red Hat Enterprise Linux 7.5 or later versions, use XFS with Snapper.
Note that the Btrfs tools and file system are provided as a Technology Preview, which make them
unsuitable for production systems.
Although it is possible to allow a user or group other than root to use certain Snapper commands,
Red Hat recommends that you do not add elevated permissions to otherwise unprivileged users or
groups. Such a configuration bypasses SELinux and could pose a security risk. Red Hat recommends
that you review these capabilities with your Security Team and consider using the sudo infrastructure
instead.
NOTE
Btrfs is available as a Technology Preview feature in Red Hat Enterprise Linux 7 but has
been deprecated since the Red Hat Enterprise Linux 7.4 release. It will be removed in a
future major release of Red Hat Enterprise Linux.
For more information, see Deprecated Functionality in the Red Hat Enterprise Linux 7.4
Release Notes.
A thinly-provisioned logical volume with a Red Hat supported file system on top of it, or
A Btrfs subvolume.
For LVM2:
119
Storage Administration Guide
For example, to create a configuration file called lvm_config on an LVM2 subvolume with an
ext4 file system, mounted at /lvm_mount, use:
For Btrfs:
The -f file_system tells snapper what file system to use; if this is omitted snapper will
attempt to detect the file system.
Pre Snapshot
A pre snapshot serves as a point of origin for a post snapshot. The two are closely tied and designed
to track file system modification between the two points. The pre snapshot must be created before
the post snapshot.
Post Snapshot
A post snapshot serves as the end point to the pre snapshot. The coupled pre and post snapshots
define a range for comparison. By default, every new snapper volume is configured to create a
background comparison after a related post snapshot is created successfully.
Single Snapshot
A single snapshot is a standalone snapshot created at a specific moment. These can be used to
track a timeline of modifications and have a general point to return to later.
120
CHAPTER 14. CREATING AND MAINTAINING SNAPSHOTS WITH SNAPPER
The -c config_name option creates a snapshot according to the specifications in the named
configuration file. If the configuration file does not yet exist, see Section 14.1, “Creating Initial Snapper
Configuration”.
The create -t option specifies what type of snapshot to create. Accepted entries are pre, post, or
single.
For example, to create a pre snapshot using the lvm_config configuration file, as created in
Section 14.1, “Creating Initial Snapper Configuration”, use:
The -p option prints the number of the created snapshot and is optional.
A post snapshot is the end point of the snapshot and should be created after the parent pre snapshot by
following the instructions in Section 14.2.1.1, “Creating a Pre Snapshot with Snapper”.
For example, to display the list of snapshots created using the configuration file lvm_config,
use the following:
The -t post option specifies the creation of the post snapshot type.
121
Storage Administration Guide
For example, to create a post snapshot using the lvm_config configuration file and is linked to
pre snapshot number 1, use:
The -p option prints the number of the created snapshot and is optional.
3. The pre and post snapshots 1 and 2 are now created and paired. Verify this with the list
command:
You can also wrap a command within a pre and post snapshot, which can be useful when testing. See
Procedure 14.3, “Wrapping a Command in Pre and Post Snapshots”, which is a shortcut for the following
steps:
2. Running a command or a list of commands to perform actions with a possible impact on the file
system content.
122
CHAPTER 14. CREATING AND MAINTAINING SNAPSHOTS WITH SNAPPER
Use the list command to verify the number of the snapshot if needed.
For more information on the status command, see Section 14.3, “Tracking Changes Between
Snapper Snapshots”.
Note that there is no guarantee that the command in the given example is the only thing the snapshots
capture. Snapper also records anything that is modified by the system, not just what a user modifies.
For example, the following command creates a single snapshot using the lvm_config configuration file.
Although single snapshots are not specifically designed to track changes, you can use the snapper
diff, xadiff, and status commands to compare any two snapshots. For more information on these
commands, see Section 14.3, “Tracking Changes Between Snapper Snapshots” .
10 hourly snapshots, and the final hourly snapshot is saved as a “daily” snapshot.
10 daily snapshots, and the final daily snapshot for a month is saved as a “monthly” snapshot.
10 monthly snapshots, and the final monthly snapshot is saved as a “yearly” snapshot.
10 yearly snapshots.
Note that Snapper keeps by default no more that 50 snapshots in total. However, Snapper keeps by
default all snapshots created less than 1,800 seconds ago.
123
Storage Administration Guide
status
The status command shows a list of files and directories that have been created, modified, or
deleted between two snapshots, that is a comprehensive list of changes between two snapshots. You
can use this command to get an overview of the changes without excessive details.
For more information, see Section 14.3.1, “Comparing Changes with the status Command”.
diff
The diff command shows a diff of modified files and directories between two snapshots as received
from the status command if there is at least one modification detected.
For more information, see Section 14.3.2, “Comparing Changes with the diff Command”.
xadiff
The xadiff command compares how the extended attributes of a file or directory have changed
between two snapshots.
For more information, see Section 14.3.3, “Comparing Changes with the xadiff Command”.
The status command shows a list of files and directories that have been created, modified, or deleted
between two snapshots.
For example, the following command displays the changes made between snapshot 1 and 2, using the
configuration file lvm_config.
Read letters and dots in the first part of the output as columns:
+..... /lvm_mount/file3
||||||
123456
124
CHAPTER 14. CREATING AND MAINTAINING SNAPSHOTS WITH SNAPPER
Column 1 indicates any modification of the file (directory entry) type. Possible values are:
Column 1
Output Meaning
+ File created.
- File deleted.
c Content changed.
Column 2 indicates any changes in the file permissions. Possible values are:
Column 2
Output Meaning
. No permissions changed.
p Permissions changed.
Column 3 indicates any changes in the user ownership. Possible values are:
Column 3
Output Meaning
Column 4 indicates any changes in the group ownership. Possible values are:
Column 4
125
Storage Administration Guide
Output Meaning
Column 5 indicates any changes in the extended attributes. Possible values are:
Column 5
Output Meaning
Column 6 indicates any changes in the access control lists (ACLs). Possible values are:
Column 6
Output Meaning
. No ACLs changed.
a ACLs modified.
The diff command shows the changes of modified files and directories between two snapshots.
Use the list command to determine the number of the snapshot if needed.
For example, to compare the changes made in files between snapshot 1 and snapshot 2 that were
made using the lvm_config configuration file, use:
This output shows that file4 had been modified to add "words" into the file.
126
CHAPTER 14. CREATING AND MAINTAINING SNAPSHOTS WITH SNAPPER
The xadiff command compares how the extended attributes of a file or directory have changed
between two snapshots:
Use the list command to determine the number of the snapshot if needed.
For example, to show the xadiff output between snapshot number 1 and snapshot number 2 that were
made using the lvm_config configuration file, use:
IMPORTANT
Using the undochange command does not revert the Snapper volume back to its original
state and does not provide data consistency. Any file modification that occurs outside of
the specified range, for example after snapshot 2, will remain unchanged after reverting
back, for example to the state of snapshot 1. For example, if undochange is run to undo
the creation of a user, any files owned by that user can still remain.
Do not use the Snapper undochange command with the root file system, as doing so is
likely to lead to a failure.
127
Storage Administration Guide
The diagram shows the point in time in which snapshot_1 is created, file_a is created, then file_b
deleted. Snapshot_2 is then created, after which file_a is edited and file_c is created. This is now
the current state of the system. The current system has an edited version of file_a, no file_b, and a
newly created file_c.
When the undochange command is called, Snapper generates a list of modified files between the first
listed snapshot and the second. In the diagram, if you use the snapper -c SnapperExample
undochange 1..2 command, Snapper creates a list of modified files (that is, file_a is created;
file_b is deleted) and applies them to the current system. Therefore:
the current system will not have file_a, as it has yet to be created when snapshot_1 was
created.
file_b will exist, copied from snapshot_1 into the current system.
file_c will exist, as its creation was outside the specified time.
Be aware that if file_b and file_c conflict, the system can become corrupted.
You can also use the snapper -c SnapperExample undochange 2..1 command. In this case,
the current system replaces the edited version of file_a with one copied from snapshot_1, which
undoes edits of that file made after snapshot_2 was created.
If needed, the mount command activates respective LVM Snapper snapshot before mounting. Use the
mount and unmount commands if you are, for example, interested in mounting snapshots and
extracting older version of several files manually. To revert files manually, copy them from a mounted
128
CHAPTER 14. CREATING AND MAINTAINING SNAPSHOTS WITH SNAPPER
snapshot to the current file system. The current file system, snapshot 0, is the live file system created in
Procedure 14.1, “Creating a Snapper Configuration File”. Copy the files to the subtree of the original
/mount-point.
Use the mount and unmount commands for explicit client-side requests. The
/etc/snapper/configs/config_name file contains the ALLOW_USERS= and ALLOW_GROUPS=
variables where you can add users and groups. Then, snapperd allows you to perform mount
operations for the added users and groups.
You can use the list command to verify that the snapshot was successfully deleted.
129
Storage Administration Guide
In years past, the recommended amount of swap space increased linearly with the amount of RAM in the
system. However, modern systems often include hundreds of gigabytes of RAM. As a consequence,
recommended swap space is considered a function of system memory workload, not system memory.
Table 15.1, “Recommended System Swap Space” illustrates the recommended size of a swap partition
depending on the amount of RAM in your system and whether you want sufficient memory for your
system to hibernate. The recommended swap partition size is established automatically during
installation. To allow for hibernation, however, you need to edit the swap space in the custom partitioning
stage.
Recommendations in Table 15.1, “Recommended System Swap Space” are especially important on
systems with low memory (1 GB and less). Failure to allocate sufficient swap space on these systems
can cause issues such as instability or even render the installed system unbootable.
Amount of RAM in the system Recommended swap space Recommended swap space if
allowing for hibernation
At the border between each range listed in Table 15.1, “Recommended System Swap Space”, for
example a system with 2 GB, 8 GB, or 64 GB of system RAM, discretion can be exercised with regard to
chosen swap space and hibernation support. If your system resources allow for it, increasing the swap
space may lead to better performance. A swap space of at least 100 GB is recommended for systems
with over 140 logical processors or over 3 TB of RAM.
Note that distributing swap space over multiple storage devices also improves swap space performance,
particularly on systems with fast drives, controllers, and interfaces.
130
CHAPTER 15. SWAP SPACE
IMPORTANT
File systems and LVM2 volumes assigned as swap space should not be in use when
being modified. Any attempts to modify swap fail if a system process or the kernel is using
swap space. Use the free and cat /proc/swaps commands to verify how much and
where swap is in use.
You should modify swap space while the system is booted in rescue mode, see Booting
Your Computer in Rescue Mode in the Red Hat Enterprise Linux 7 Installation Guide.
When prompted to mount the file system, select Skip.
You have three options: create a new swap partition, create a new swap file, or extend swap on an
existing LVM2 logical volume. It is recommended that you extend an existing logical volume.
After adding additional storage to the swap space's volume group, it is now possible to extend it. To do
so, perform the following procedure (assuming /dev/VolGroup00/LogVol01 is the volume you want
to extend by 2 GB):
# swapoff -v /dev/VolGroup00/LogVol01
# mkswap /dev/VolGroup00/LogVol01
# swapon -v /dev/VolGroup00/LogVol01
5. To test if the swap logical volume was successfully extended and activated, inspect active swap
space:
131
Storage Administration Guide
$ cat /proc/swaps
$ free -h
# mkswap /dev/VolGroup00/LogVol02
4. Regenerate mount units so that your system registers the new configuration:
# systemctl daemon-reload
# swapon -v /dev/VolGroup00/LogVol02
6. To test if the swap logical volume was successfully created and activated, inspect active swap
space:
$ cat /proc/swaps
$ free -h
1. Determine the size of the new swap file in megabytes and multiply by 1024 to determine the
number of blocks. For example, the block size of a 64 MB swap file is 65536.
Replace count with the value equal to the desired block size.
132
CHAPTER 15. SWAP SPACE
# mkswap /swapfile
5. To enable the swap file at boot time, edit /etc/fstab as root to include the following entry:
The next time the system boots, it activates the new swap file.
6. Regenerate mount units so that your system registers the new /etc/fstab configuration:
# systemctl daemon-reload
# swapon /swapfile
8. To test if the new swap file was successfully created and activated, inspect active swap space:
$ cat /proc/swaps
$ free -h
You have three options: remove an entire LVM2 logical volume used for swap, remove a swap file, or
reduce swap space on an existing LVM2 logical volume.
# swapoff -v /dev/VolGroup00/LogVol01
133
Storage Administration Guide
# mkswap /dev/VolGroup00/LogVol01
# swapon -v /dev/VolGroup00/LogVol01
5. To test if the swap logical volume was successfully reduced, inspect active swap space:
$ cat /proc/swaps
$ free -h
# swapoff -v /dev/VolGroup00/LogVol02
# lvremove /dev/VolGroup00/LogVol02
4. Regenerate mount units so that your system registers the new configuration:
# systemctl daemon-reload
5. To test if the logical volume was successfully removed, inspect active swap space:
$ cat /proc/swaps
$ free -h
1. At a shell prompt, execute the following command to disable the swap file (where /swapfile is
the swap file):
# swapoff -v /swapfile
134
CHAPTER 15. SWAP SPACE
3. Regenerate mount units so that your system registers the new configuration:
# systemctl daemon-reload
# rm /swapfile
135
Storage Administration Guide
This chapter explains how SSM interacts with various back ends and some common use cases.
There are already several back ends registered in SSM. The following sections provide basic information
on them as well as definitions on how they handle pools, volumes, snapshots, and devices.
NOTE
Btrfs is available as a Technology Preview feature in Red Hat Enterprise Linux 7 but has
been deprecated since the Red Hat Enterprise Linux 7.4 release. It will be removed in a
future major release of Red Hat Enterprise Linux.
For more information, see Deprecated Functionality in the Red Hat Enterprise Linux 7.4
Release Notes.
Btrfs, a file system with many advanced features, is used as a volume management back end in SSM.
Pools, volumes, and snapshots can be created with the Btrfs back end.
The Btrfs file system itself is the pool. It can be extended by adding more devices or shrunk by removing
devices. SSM creates a Btrfs file system when a Btrfs pool is created. This means that every new Btrfs
pool has one volume of the same name as the pool which cannot be removed without removing the
entire pool. The default Btrfs pool name is btrfs_pool.
The name of the pool is used as the file system label. If there is already an existing Btrfs file system in
the system without a label, the Btrfs pool will generate a name for internal use in the format of
btrfs_device_base_name.
Volumes created after the first volume in a pool are the same as sub-volumes. SSM temporarily mounts
the Btrfs file system if it is unmounted in order to create a sub-volume.
136
CHAPTER 16. SYSTEM STORAGE MANAGER (SSM)
The name of a volume is used as the subvolume path in the Btrfs file system. For example, a subvolume
displays as /dev/lvm_pool/lvol001. Every object in this path must exist in order for the volume to
be created. Volumes can also be referenced with its mount point.
Snapshots can be taken of any Btrfs volume in the system with SSM. Be aware that Btrfs does not
distinguish between subvolumes and snapshots. While this means that SSM cannot recognize the Btrfs
snapshot destination, it will try to recognize special name formats. If the name specified when creating
the snapshot does the specific pattern, the snapshot is not be recognized and instead be listed as a
regular Btrfs volume.
LVM pool is the same as an LVM volume group. This means that grouping devices and new logical
volumes can be created out of the LVM pool. The default LVM pool name is lvm_pool.
When a snapshot is created from the LVM volume a new snapshot volume is created which can then
be handled just like any other LVM volume. Unlike Btrfs, LVM is able to distinguish snapshots from
regular volumes so there is no need for a snapshot name to match a particular pattern.
SSM makes the need for an LVM back end to be created on a physical device transparent for the user.
Only volumes can be created with a crypt back end; pooling is not supported and it does not require
special devices.
The following sections define volumes and snapshots from the crypt point of view.
137
Storage Administration Guide
Crypt volumes are created by dm-crypt and represent the data on the original encrypted device in an
unencrypted form. It does not support RAID or any device concatenation.
Two modes, or extensions, are supported: luks and plain. Luks is used by default. For more information
on the extensions, see man cryptsetup.
While the crypt back end does not support snapshotting, if the encrypted volume is created on top of an
LVM volume, the volume itself can be snapshotted. The snapshot can then be opened by using
cryptsetup.
There are several back ends that are enabled only if the supporting packages are installed:
The Crypt back end requires the device-mapper and cryptsetup packages.
# ssm list
----------------------------------------------------------
Device Free Used Total Pool Mount point
----------------------------------------------------------
/dev/sda 2.00 GB PARTITIONED
/dev/sda1 47.83 MB /test
/dev/vda 15.00 GB PARTITIONED
/dev/vda1 500.00 MB /boot
/dev/vda2 0.00 KB 14.51 GB 14.51 GB rhel
----------------------------------------------------------
------------------------------------------------
Pool Type Devices Free Used Total
------------------------------------------------
rhel lvm 1 0.00 KB 14.51 GB 14.51 GB
138
CHAPTER 16. SYSTEM STORAGE MANAGER (SSM)
------------------------------------------------
----------------------------------------------------------------------
-----------
Volume Pool Volume size FS FS size Free Type
Mount point
----------------------------------------------------------------------
-----------
/dev/rhel/root rhel 13.53 GB xfs 13.52 GB 9.64 GB linear /
/dev/rhel/swap rhel 1000.00 MB linear
/dev/sda1 47.83 MB xfs 44.50 MB 44.41 MB part
/test
/dev/vda1 500.00 MB xfs 496.67 MB 403.56 MB part
/boot
----------------------------------------------------------------------
-----------
This display can be further narrowed down by using arguments to specify what should be displayed. The
list of available options can be found with the ssm list --help command.
NOTE
Running the devices or dev argument omits some devices. CDRoms and
DM/MD devices, for example, are intentionally hidden as they are listed as
volumes.
Some back ends do not support snapshots and cannot distinguish between a
snapshot and a regular volume. Running the snapshot argument on one of
these back ends cause SSM to attempt to recognize the volume name in order to
identify a snapshot. If the SSM regular expression does not match the snapshot
pattern then the snapshot is not be recognized.
With the exception of the main Btrfs volume (the file system itself), any
unmounted Btrfs volumes are not shown.
The command to create this scenario is ssm create --fs xfs -s 1G /dev/vdb /dev/vdc. The
following options are used:
The --fs option specifies the required file system type. Current supported file system types are:
ext3
ext4
xfs
btrfs
139
Storage Administration Guide
The -s specifies the size of the logical volume. The following suffixes are supported to define
units:
K or k for kilobytes
M or m for megabytes
G or g for gigabytes
T or t for terabytes
P or p for petabytes
E or e for exabytes
The two listed devices, /dev/vdb and /dev/vdc, are the two devices you wish to create.
There are two other options for the ssm command that may be useful. The first is the -p pool
command. This specifies the pool the volume is to be created on. If it does not yet exist, then SSM
creates it. This was omitted in the given example which caused SSM to use the default name
lvm_pool. However, to use a specific name to fit in with any existing naming conventions, the -p
option should be used.
The second useful option is the -n name command. This names the newly created logical volume. As
with the -p, this is needed in order to use a specific name to fit in with any existing naming conventions.
SSM has now created two physical volumes, a pool, and a logical volume with the ease of only one
command.
To check all devices in the volume lvol001, run the command ssm check
/dev/lvm_pool/lvol001.
140
CHAPTER 16. SYSTEM STORAGE MANAGER (SSM)
For this example, we currently have one logical volume on /dev/vdb that is 900MB called lvol001.
# ssm list
-----------------------------------------------------------------
Device Free Used Total Pool Mount point
-----------------------------------------------------------------
/dev/vda 15.00 GB PARTITIONED
/dev/vda1 500.00 MB /boot
/dev/vda2 0.00 KB 14.51 GB 14.51 GB rhel
/dev/vdb 120.00 MB 900.00 MB 1.00 GB lvm_pool
/dev/vdc 1.00 GB
-----------------------------------------------------------------
---------------------------------------------------------
Pool Type Devices Free Used Total
---------------------------------------------------------
lvm_pool lvm 1 120.00 MB 900.00 MB 1020.00 MB
rhel lvm 1 0.00 KB 14.51 GB 14.51 GB
---------------------------------------------------------
----------------------------------------------------------------------
----------------------
141
Storage Administration Guide
The logical volume needs to be increased by another 500MB. To do so we will need to add an extra
device to the pool:
142
CHAPTER 16. SYSTEM STORAGE MANAGER (SSM)
SSM runs a check on the device and then extends the volume by the specified amount. This can be
verified with the ssm list command.
# ssm list
------------------------------------------------------------------
Device Free Used Total Pool Mount point
------------------------------------------------------------------
/dev/vda 15.00 GB PARTITIONED
/dev/vda1 500.00 MB /boot
/dev/vda2 0.00 KB 14.51 GB 14.51 GB rhel
/dev/vdb 0.00 KB 1020.00 MB 1.00 GB lvm_pool
/dev/vdc 640.00 MB 380.00 MB 1.00 GB lvm_pool
------------------------------------------------------------------
------------------------------------------------------
Pool Type Devices Free Used Total
------------------------------------------------------
lvm_pool lvm 2 640.00 MB 1.37 GB 1.99 GB
rhel lvm 1 0.00 KB 14.51 GB 14.51 GB
------------------------------------------------------
----------------------------------------------------------------------
------------------------
Volume Pool Volume size FS FS size
Free Type Mount point
----------------------------------------------------------------------
------------------------
/dev/rhel/root rhel 13.53 GB xfs 13.52 GB 9.64 GB
linear /
/dev/rhel/swap rhel 1000.00 MB
linear
/dev/lvm_pool/lvol001 lvm_pool 1.37 GB xfs 1.36 GB 1.36 GB
linear
/dev/vda1 500.00 MB xfs 496.67 MB 403.56 MB
part /boot
----------------------------------------------------------------------
------------------------
143
Storage Administration Guide
NOTE
It is only possible to decrease an LVM volume's size; it is not supported with other volume
types. This is done by using a - instead of a +. For example, to decrease the size of an
LVM volume by 50M the command would be:
16.2.6. Snapshot
To take a snapshot of an existing volume, use the ssm snapshot command.
NOTE
This operation fails if the back end that the volume belongs to does not support
snapshotting.
To verify this, use the ssm list, and note the extra snapshot section.
# ssm list
----------------------------------------------------------------
Device Free Used Total Pool Mount point
----------------------------------------------------------------
/dev/vda 15.00 GB PARTITIONED
/dev/vda1 500.00 MB /boot
/dev/vda2 0.00 KB 14.51 GB 14.51 GB rhel
/dev/vdb 0.00 KB 1020.00 MB 1.00 GB lvm_pool
/dev/vdc 1.00 GB
----------------------------------------------------------------
--------------------------------------------------------
Pool Type Devices Free Used Total
--------------------------------------------------------
lvm_pool lvm 1 0.00 KB 1020.00 MB 1020.00 MB
rhel lvm 1 0.00 KB 14.51 GB 14.51 GB
--------------------------------------------------------
----------------------------------------------------------------------
------------------------
Volume Pool Volume size FS FS size
Free Type Mount point
----------------------------------------------------------------------
144
CHAPTER 16. SYSTEM STORAGE MANAGER (SSM)
------------------------
/dev/rhel/root rhel 13.53 GB xfs 13.52 GB 9.64 GB
linear /
/dev/rhel/swap rhel 1000.00 MB
linear
/dev/lvm_pool/lvol001 lvm_pool 900.00 MB xfs 896.67 MB 896.54 MB
linear
/dev/vda1 500.00 MB xfs 496.67 MB 403.56 MB
part /boot
----------------------------------------------------------------------
------------------------
----------------------------------------------------------------------
------------
Snapshot Origin Pool Volume size
Size Type
----------------------------------------------------------------------
------------
/dev/lvm_pool/snap20150519T130900 lvol001 lvm_pool 120.00 MB 0.00 KB
linear
----------------------------------------------------------------------
------------
NOTE
If a device is being used by a pool when removed, it will fail. This can be forced using the
-f argument.
If the volume is mounted when removed, it will fail. Unlike the device, it cannot be forced
with the -f argument.
To remove the lvm_pool and everything within it use the following command:
The man ssm page provides good descriptions and examples, as well as details on all of the
commands and options too specific to be documented here.
145
Storage Administration Guide
146
CHAPTER 17. DISK QUOTAS
Disk quotas can be configured for individual users as well as user groups. This makes it possible to
manage the space allocated for user-specific files (such as email) separately from the space allocated to
the projects a user works on (assuming the projects are given their own groups).
In addition, quotas can be set not just to control the number of disk blocks consumed but to control the
number of inodes (data structures that contain information about files in UNIX file systems). Because
inodes are used to contain file-related information, this allows control over the number of files that can be
created.
NOTE
This chapter is for all file systems, however some file systems have their own quota
management tools. See the corresponding description for the applicable file systems.
For XFS file systems, see Section 3.3, “XFS Quota Management”.
3. Create the quota database files and generate the disk usage table.
1. Log in as root.
3. Add either the usrquota or grpquota or both options to the file systems that require quotas.
For example, to use the text editor vim type the following:
# vim /etc/fstab
147
Storage Administration Guide
In this example, the /home file system has both user and group quotas enabled.
NOTE
The following examples assume that a separate /home partition was created during the
installation of Red Hat Enterprise Linux. The root (/) partition can be used for setting
quota policies in the /etc/fstab file.
Run the umount command followed by the mount command to remount the file system. See the
man page for both umount and mount for the specific syntax for mounting and unmounting
various file system types.
Run the mount -o remount file-system command (where file-system is the name of
the file system) to remount the file system. For example, to remount the /home file system, run
the mount -o remount /home command.
If the file system is currently in use, the easiest method for remounting the file system is to reboot the
system.
The quotacheck command examines quota-enabled file systems and builds a table of the current disk
usage per file system. The table is then used to update the operating system's copy of disk usage. In
addition, the file system's disk quota files are updated.
NOTE
The quotacheck command has no effect on XFS as the table of disk usage is completed
automatically at mount time. See the man page xfs_quota(8) for more information.
148
CHAPTER 17. DISK QUOTAS
1. Create the quota files on the file system using the following command:
2. Generate the table of current disk usage per file system using the following command:
# quotacheck -avug
c
Specifies that the quota files should be created for each file system with quotas enable.
u
Checks for user quotas.
g
Checks for group quotas. If only -g is specified, only the group quota file is created.
If neither the -u or -g options are specified, only the user quota file is created.
The following options are used to generate the table of current disk usage:
a
Check all quota-enabled, locally-mounted file systems
v
Display verbose status information as the quota check proceeds
u
Check user disk quota information
g
Check group disk quota information
After quotacheck has finished running, the quota files corresponding to the enabled quotas (either user
or group or both) are populated with data for each quota-enabled locally-mounted file system such as
/home.
Prerequisite
149
Storage Administration Guide
# edquota username
Replace username with the user to which you want to assign the quotas.
2. To verify that the quota for the user has been set, use the following command:
# quota username
NOTE
The text editor defined by the EDITOR environment variable is used by edquota. To
change the editor, set the EDITOR environment variable in your ~/.bash_profile file
to the full path of the editor of your choice.
The first column is the name of the file system that has a quota enabled for it. The second column shows
how many blocks the user is currently using. The next two columns are used to set soft and hard block
limits for the user on the file system. The inodes column shows how many inodes the user is currently
using. The last two columns are used to set the soft and hard inode limits for the user on the file system.
The hard block limit is the absolute maximum amount of disk space that a user or group can use. Once
this limit is reached, no further disk space can be used.
The soft block limit defines the maximum amount of disk space that can be used. However, unlike the
hard limit, the soft limit can be exceeded for a certain amount of time. That time is known as the grace
period. The grace period can be expressed in seconds, minutes, hours, days, weeks, or months.
If any of the values are set to 0, that limit is not set. In the text editor, change the desired limits.
For example:
150
CHAPTER 17. DISK QUOTAS
To verify that the quota for the user has been set, use the command:
# quota testuser
Disk quotas for user username (uid 501):
Filesystem blocks quota limit grace files quota limit
grace
/dev/sdb 1000* 1000 1000 0 0 0
Prerequisite
# edquota -g groupname
2. To verify that the group quota is set, use the following command:
# quota -g groupname
For example, to set a group quota for the devel group, use the command:
# edquota -g devel
This command displays the existing quota for the group in the text editor:
To verify that the group quota has been set, use the command:
# quota -g devel
151
Storage Administration Guide
# edquota -t
This command works on quotas for inodes or blocks, for either users or groups.
IMPORTANT
While other edquota commands operate on quotas for a particular user or group, the -t
option operates on every file system with quotas enabled.
If users repeatedly exceed their quotas or consistently reach their soft limits, a system administrator has
a few choices to make depending on what type of users they are and how much disk space impacts their
work. The administrator can either help the user determine how to use less disk space or increase the
user's disk quota.
# quotaoff -vaug
If neither the -u or -g options are specified, only the user quotas are disabled. If only -g is specified,
only group quotas are disabled. The -v switch causes verbose status information to display as the
command executes.
To enable user and group quotas again, use the following command:
# quotaon
To enable user and group quotas for all file systems, use the following command:
# quotaon -vaug
If neither the -u or -g options are specified, only the user quotas are enabled. If only -g is specified,
only group quotas are enabled.
To enable quotas for a specific file system, such as /home, use the following command:
152
CHAPTER 17. DISK QUOTAS
NOTE
The quotaon command is not always needed for XFS because it is performed
automatically at mount time. Refer to the man page quotaon(8) for more information.
To view the disk usage report for all (option -a) quota-enabled file systems, use the command:
# repquota -a
While the report is easy to read, a few points should be explained. The -- displayed after each user is a
quick way to determine whether the block or inode limits have been exceeded. If either soft limit is
exceeded, a + appears in place of the corresponding -; the first - represents the block limit, and the
second represents the inode limit.
The grace columns are normally blank. If a soft limit has been exceeded, the column contains a time
specification equal to the amount of time remaining on the grace period. If the grace period has expired,
none appears in its place.
# quotacheck
However, quotacheck can be run on a regular basis, even if the system has not crashed. Safe
methods for periodically running quotacheck include:
NOTE
This method works best for (busy) multiuser systems which are periodically rebooted.
153
Storage Administration Guide
Save a shell script into the /etc/cron.daily/ or /etc/cron.weekly/ directory or schedule one
using the following command:
# crontab -e
The crontab -e command contains the touch /forcequotacheck command. This creates an
empty forcequotacheck file in the root directory, which the system init script looks for at boot time.
If it is found, the init script runs quotacheck. Afterward, the init script removes the
/forcequotacheck file; thus, scheduling this file to be created periodically with cron ensures that
quotacheck is run during the next reboot.
WARNING
quotacheck
edquota
repquota
154
CHAPTER 17. DISK QUOTAS
quota
quotaon
quotaoff
155
Storage Administration Guide
RAID allows information to be spread across several disks. RAID uses techniques such as disk striping
(RAID Level 0), disk mirroring (RAID Level 1), and disk striping with parity (RAID Level 5) to achieve
redundancy, lower latency, increased bandwidth, and maximized ability to recover from hard disk
crashes.
RAID distributes data across each drive in the array by breaking it down into consistently-sized chunks
(commonly 256K or 512k, although other values are acceptable). Each chunk is then written to a hard
drive in the RAID array according to the RAID level employed. When the data is read, the process is
reversed, giving the illusion that the multiple drives in the array are actually one large drive.
System Administrators and others who manage large amounts of data would benefit from using RAID
technology. Primary reasons to deploy RAID include:
Enhances speed
Firmware RAID
Firmware RAID, also known as ATARAID, is a type of software RAID where the RAID sets can be
configured using a firmware-based menu. The firmware used by this type of RAID also hooks into the
BIOS, allowing you to boot from its RAID sets. Different vendors use different on-disk metadata formats
to mark the RAID set members. The Intel Matrix RAID is a good example of a firmware RAID system.
Hardware RAID
The hardware-based array manages the RAID subsystem independently from the host. It presents a
single disk per RAID array to the host.
A Hardware RAID device may be internal or external to the system, with internal devices commonly
consisting of a specialized controller card that handles the RAID tasks transparently to the operating
system and with external devices commonly connecting to the system via SCSI, Fibre Channel, iSCSI,
InfiniBand, or other high speed network interconnect and presenting logical volumes to the system.
RAID controller cards function like a SCSI controller to the operating system, and handle all the actual
drive communications. The user plugs the drives into the RAID controller (just like a normal SCSI
controller) and then adds them to the RAID controllers configuration. The operating system will not be
able to tell the difference.
Software RAID
156
CHAPTER 18. REDUNDANT ARRAY OF INDEPENDENT DISKS (RAID)
Software RAID implements the various RAID levels in the kernel disk (block device) code. It offers the
cheapest possible solution, as expensive disk controller cards or hot-swap chassis [2] are not required.
Software RAID also works with cheaper IDE disks as well as SCSI disks. With today's faster CPUs,
Software RAID also generally outperforms Hardware RAID.
The Linux kernel contains a multi-disk (MD) driver that allows the RAID solution to be completely
hardware independent. The performance of a software-based array depends on the server CPU
performance and load.
Multithreaded design
Automatic CPU detection to take advantage of certain CPU features such as streaming SIMD
support
Regular consistency checks of RAID data to ensure the health of the array
Proactive monitoring of arrays with email alerts sent to a designated email address on important
events
Write-intent bitmaps which drastically increase the speed of resync events by allowing the kernel
to know precisely which portions of a disk need to be resynced instead of having to resync the
entire array
Resync checkpointing so that if you reboot your computer during a resync, at startup the resync
will pick up where it left off and not start all over again
The ability to change parameters of the array after installation. For example, you can grow a 4-
disk RAID5 array to a 5-disk RAID5 array when you have a new disk to add. This grow operation
is done live and does not require you to reinstall on the new array.
Level 0
RAID level 0, often called "striping," is a performance-oriented striped data mapping technique. This
means the data being written to the array is broken down into strips and written across the member
disks of the array, allowing high I/O performance at low inherent cost but provides no redundancy.
Many RAID level 0 implementations will only stripe the data across the member devices up to the size
of the smallest device in the array. This means that if you have multiple devices with slightly different
sizes, each device will get treated as though it is the same size as the smallest drive. Therefore, the
common storage capacity of a level 0 array is equal to the capacity of the smallest member disk in a
Hardware RAID or the capacity of smallest member partition in a Software RAID multiplied by the
number of disks or partitions in the array.
157
Storage Administration Guide
Level 1
RAID level 1, or "mirroring," has been used longer than any other form of RAID. Level 1 provides
redundancy by writing identical data to each member disk of the array, leaving a "mirrored" copy on
each disk. Mirroring remains popular due to its simplicity and high level of data availability. Level 1
operates with two or more disks, and provides very good data reliability and improves performance
for read-intensive applications but at a relatively high cost. [3]
The storage capacity of the level 1 array is equal to the capacity of the smallest mirrored hard disk in
a Hardware RAID or the smallest mirrored partition in a Software RAID. Level 1 redundancy is the
highest possible among all RAID types, with the array being able to operate with only a single disk
present.
Level 4
Level 4 uses parity [4] concentrated on a single disk drive to protect data. Because the dedicated
parity disk represents an inherent bottleneck on all write transactions to the RAID array, level 4 is
seldom used without accompanying technologies such as write-back caching, or in specific
circumstances where the system administrator is intentionally designing the software RAID device
with this bottleneck in mind (such as an array that will have little to no write transactions once the
array is populated with data). RAID level 4 is so rarely used that it is not available as an option in
Anaconda. However, it could be created manually by the user if truly needed.
The storage capacity of Hardware RAID level 4 is equal to the capacity of the smallest member
partition multiplied by the number of partitions minus one. Performance of a RAID level 4 array will
always be asymmetrical, meaning reads will outperform writes. This is because writes consume extra
CPU and main memory bandwidth when generating parity, and then also consume extra bus
bandwidth when writing the actual data to disks because you are writing not only the data, but also the
parity. Reads need only read the data and not the parity unless the array is in a degraded state. As a
result, reads generate less traffic to the drives and across the busses of the computer for the same
amount of data transfer under normal operating conditions.
Level 5
This is the most common type of RAID. By distributing parity across all of an array's member disk
drives, RAID level 5 eliminates the write bottleneck inherent in level 4. The only performance
bottleneck is the parity calculation process itself. With modern CPUs and Software RAID, that is
usually not a bottleneck at all since modern CPUs can generate parity very fast. However, if you have
a sufficiently large number of member devices in a software RAID5 array such that the combined
aggregate data transfer speed across all devices is high enough, then this bottleneck can start to
come into play.
As with level 4, level 5 has asymmetrical performance, with reads substantially outperforming writes.
The storage capacity of RAID level 5 is calculated the same way as with level 4.
Level 6
This is a common level of RAID when data redundancy and preservation, and not performance, are
the paramount concerns, but where the space inefficiency of level 1 is not acceptable. Level 6 uses a
complex parity scheme to be able to recover from the loss of any two drives in the array. This
complex parity scheme creates a significantly higher CPU burden on software RAID devices and also
imposes an increased burden during write transactions. As such, level 6 is considerably more
asymmetrical in performance than levels 4 and 5.
The total capacity of a RAID level 6 array is calculated similarly to RAID level 5 and 4, except that you
must subtract 2 devices (instead of 1) from the device count for the extra parity storage space.
158
CHAPTER 18. REDUNDANT ARRAY OF INDEPENDENT DISKS (RAID)
Level 10
This RAID level attempts to combine the performance advantages of level 0 with the redundancy of
level 1. It also helps to alleviate some of the space wasted in level 1 arrays with more than 2 devices.
With level 10, it is possible to create a 3-drive array configured to store only 2 copies of each piece of
data, which then allows the overall array size to be 1.5 times the size of the smallest devices instead
of only equal to the smallest device (like it would be with a 3-device, level 1 array).
The number of options available when creating level 10 arrays as well as the complexity of selecting
the right options for a specific use case make it impractical to create during installation. It is possible
to create one manually using the command line mdadm tool. For more information on the options and
their respective performance trade-offs, see man md.
Linear RAID
Linear RAID is a grouping of drives to create a larger virtual drive. In linear RAID, the chunks are
allocated sequentially from one member drive, going to the next drive only when the first is completely
filled. This grouping provides no performance benefit, as it is unlikely that any I/O operations split
between member drives. Linear RAID also offers no redundancy and decreases reliability; if any one
member drive fails, the entire array cannot be used. The capacity is the total of all member disks.
mdraid
The mdraid subsystem was designed as a software RAID solution for Linux; it is also the preferred
solution for software RAID under Linux. This subsystem uses its own metadata format, generally
referred to as native mdraid metadata.
mdraid also supports other metadata formats, known as external metadata. Red Hat Enterprise Linux 7
uses mdraid with external metadata to access ISW / IMSM (Intel firmware RAID) sets. mdraid sets are
configured and controlled through the mdadm utility.
dmraid
Device-mapper RAID or dmraid refers to device-mapper kernel code that offers the mechanism to piece
disks together into a RAID set. This same kernel code does not provide any RAID configuration
mechanism.
dmraid is configured entirely in user-space, making it easy to support various on-disk metadata formats.
As such, dmraid is used on a wide variety of firmware RAID implementations. dmraid also supports
Intel firmware RAID, although Red Hat Enterprise Linux 7 uses mdraid to access Intel firmware RAID
sets.
159
Storage Administration Guide
The Anaconda installer automatically detects any hardware and firmware RAID sets on a system,
making them available for installation. Anaconda also supports software RAID using mdraid, and can
recognize existing mdraid sets.
Anaconda provides utilities for creating RAID sets during installation; however, these utilities only allow
partitions (as opposed to entire disks) to be members of new sets. To use an entire disk for a set, create
a partition on it spanning the entire disk, and use that partition as the RAID set member.
When the root file system uses a RAID set, Anaconda adds special kernel command-line options to the
bootloader configuration telling the initrd which RAID set(s) to activate before searching for the root
file system.
For instructions on configuring RAID during installation, see the Red Hat Enterprise Linux 7 Installation
Guide.
1. Copy the contents of the PowerPC Reference Platform (PReP) boot partition from /dev/sda1
to /dev/sdb1:
# dd if=/dev/sda1 of=/dev/sdb1
2. Update the Prep and boot flag on the first partition on both disks:
NOTE
Some hardware RAID controllers allow you to configure RAID sets on-the-fly or even define completely
new sets after adding extra disks. This requires the use of driver-specific utilities, as there is no standard
API for this. For more information, see your hardware RAID controller's driver documentation for
information on this.
mdadm
160
CHAPTER 18. REDUNDANT ARRAY OF INDEPENDENT DISKS (RAID)
The mdadm command-line tool is used to manage software RAID in Linux, i.e. mdraid. For information
on the different mdadm modes and options, see man mdadm. The man page also contains useful
examples for common operations like creating, monitoring, and assembling software RAID arrays.
dmraid
As the name suggests, dmraid is used to manage device-mapper RAID sets. The dmraid tool finds
ATARAID devices using multiple metadata format handlers, each supporting various formats. For a
complete list of supported formats, run dmraid -l.
As mentioned earlier in Section 18.3, “Linux RAID Subsystems”, the dmraid tool cannot configure RAID
sets after creation. For more information about using dmraid, see man dmraid.
2. During the initial boot up, select Rescue Mode instead of Install or Upgrade. When the system
fully boots into Rescue mode, the user will be presented with a command line terminal.
3. From this terminal, use parted to create RAID partitions on the target hard drives. Then, use
mdadm to manually create raid arrays from those partitions using any and all settings and options
available. For more information on how to do these, see Chapter 13, Partitions, man parted,
and man mdadm.
4. Once the arrays are created, you can optionally create file systems on the arrays as well.
5. Reboot the computer and this time select Install or Upgrade to install as normal. As Anaconda
searches the disks in the system, it will find the pre-existing RAID devices.
6. When asked about how to use the disks in the system, select Custom Layout and click Next. In
the device listing, the pre-existing MD RAID devices will be listed.
7. Select a RAID device, click Edit and configure its mount point and (optionally) the type of file
system it should use (if you did not create one earlier) then click Done. Anaconda will perform
the install to this pre-existing RAID device, preserving the custom options you selected when you
created it in Rescue Mode.
NOTE
The limited Rescue Mode of the installer does not include man pages. Both the man
mdadm and man md contain useful information for creating custom RAID arrays, and may
be needed throughout the workaround. As such, it can be helpful to either have access to
a machine with these man pages present, or to print them out prior to booting into Rescue
Mode and creating your custom arrays.
161
Storage Administration Guide
[2] A hot-swap chassis allows you to remove a hard drive without having to power-down your system.
[3] RAID level 1 comes at a high cost because you write the same information to all of the disks in the array,
provides data reliability, but in a much less space-efficient manner than parity based RAID levels such as level 5.
However, this space inefficiency comes with a performance benefit: parity-based RAID levels consume
considerably more CPU power in order to generate the parity while RAID level 1 simply writes the same data more
than once to the multiple RAID members with very little CPU overhead. As such, RAID level 1 can outperform the
parity-based RAID levels on machines where software RAID is employed and CPU resources on the machine are
consistently taxed with operations other than RAID activities.
[4] Parity information is calculated based on the contents of the rest of the member disks in the array. This
information can then be used to reconstruct data when one disk in the array fails. The reconstructed data can then
be used to satisfy I/O requests to the failed disk before it is replaced and to repopulate the failed disk after it has
been replaced.
162
CHAPTER 19. USING THE MOUNT COMMAND
$ mount
This command displays the list of known mount points. Each line provides important information about
the device name, the file system type, the directory in which it is mounted, and relevant mount options in
the following form:
The findmnt utility, which allows users to list mounted file systems in a tree-like form, is also available
from Red Hat Enterprise Linux 6.1. To display all currently attached file systems, run the findmnt
command with no additional arguments:
$ findmnt
$ mount -t type
Similarly, to display only the devices with a certain file system using the findmnt command:
$ findmnt -t type
For a list of common file system types, see Table 19.1, “Common File System Types”. For an example
usage, see Example 19.1, “Listing Currently Mounted ext4 File Systems”.
Usually, both / and /boot partitions are formatted to use ext4. To display only the mount points that
use this file system, use the following command:
$ mount -t ext4
/dev/sda2 on / type ext4 (rw)
/dev/sda1 on /boot type ext4 (rw)
163
Storage Administration Guide
$ findmnt -t ext4
TARGET SOURCE FSTYPE OPTIONS
/ /dev/sda2 ext4 rw,realtime,seclabel,barrier=1,data=ordered
/boot /dev/sda1 ext4 rw,realtime,seclabel,barrier=1,data=ordered
Note that while a file system is mounted, the original content of the directory is not accessible.
IMPORTANT
Linux does not prevent a user from mounting a file system to a directory with a file system
already attached to it. To determine whether a particular directory serves as a mount
point, run the findmnt utility with the directory as its argument and verify the exit code:
When you run the mount command without all required information, that is without the device name, the
target directory, or the file system type, the mount reads the contents of the /etc/fstab file to check if
the given file system is listed. The /etc/fstab file contains a list of device names and the directories in
which the selected file systems are set to be mounted as well as the file system type and mount options.
Therefore, when mounting a file system that is specified in /etc/fstab, you can choose one of the
following options:
Note that permissions are required to mount the file systems unless the command is run as root (see
Section 19.2.2, “Specifying the Mount Options”).
164
CHAPTER 19. USING THE MOUNT COMMAND
NOTE
To determine the UUID and—if the device uses it—the label of a particular device, use the
blkid command in the following form:
blkid device
# blkid /dev/sda3
/dev/sda3: LABEL="home" UUID="34795a28-ca6d-4fd8-a347-
73671d0c19cb" TYPE="ext3"
Table 19.1, “Common File System Types” provides a list of common file system types that can be used
with the mount command. For a complete list of all available file system types, see the section called
“Manual Page Documentation”.
Type Description
iso9660 The ISO 9660 file system. It is commonly used by optical media, typically CDs.
nfs The NFS file system. It is commonly used to access files over the network.
nfs4 The NFSv4 file system. It is commonly used to access files over the network.
165
Storage Administration Guide
Type Description
ntfs The NTFS file system. It is commonly used on machines that are running the Windows
operating system.
udf The UDF file system. It is commonly used by optical media, typically DVDs.
vfat The FAT file system. It is commonly used on machines that are running the Windows
operating system, and on certain digital media such as USB flash drives or floppy disks.
See Example 19.2, “Mounting a USB Flash Drive” for an example usage.
Older USB flash drives often use the FAT file system. Assuming that such drive uses the /dev/sdc1
device and that the /media/flashdisk/ directory exists, mount it to this directory by typing the
following at a shell prompt as root:
When supplying multiple options, do not insert a space after a comma, or mount interprets incorrectly
the values following spaces as additional parameters.
Table 19.2, “Common Mount Options” provides a list of common mount options. For a complete list of all
available options, consult the relevant manual page as referred to in the section called “Manual Page
Documentation”.
Option Description
auto Allows the file system to be mounted automatically using the mount -a command.
exec Allows the execution of binary files on the particular file system.
166
CHAPTER 19. USING THE MOUNT COMMAND
Option Description
noauto Default behavior disallows the automatic mount of the file system using the mount -a
command.
noexec Disallows the execution of binary files on the particular file system.
nouser Disallows an ordinary user (that is, other than root) to mount and unmount the file
system.
user Allows an ordinary user (that is, other than root) to mount and unmount the file
system.
An ISO image (or a disk image in general) can be mounted by using the loop device. Assuming that
the ISO image of the Fedora 14 installation disc is present in the current working directory and that
the /media/cdrom/ directory exists, mount the image to this directory by running the following
command:
Although this command allows a user to access the file system from both places, it does not apply on the
file systems that are mounted within the original directory. To include these mounts as well, use the
following command:
167
Storage Administration Guide
Additionally, to provide as much flexibility as possible, Red Hat Enterprise Linux 7 implements the
functionality known as shared subtrees. This feature allows the use of the following four mount types:
Shared Mount
A shared mount allows the creation of an exact replica of a given mount point. When a mount point is
marked as a shared mount, any mount within the original mount point is reflected in it, and vice
versa. To change the type of a mount point to a shared mount, type the following at a shell prompt:
Alternatively, to change the mount type for the selected mount point and all mount points under it:
See Example 19.4, “Creating a Shared Mount Point” for an example usage.
There are two places where other file systems are commonly mounted: the /media/ directory for
removable media, and the /mnt/ directory for temporarily mounted file systems. By using a
shared mount, you can make these two directories share the same content. To do so, as root,
mark the /media/ directory as shared:
It is now possible to verify that a mount within /media/ also appears in /mnt/. For example, if
the CD-ROM drive contains non-empty media and the /media/cdrom/ directory exists, run the
following commands:
Similarly, it is possible to verify that any file system mounted in the /mnt/ directory is reflected in
/media/. For instance, if a non-empty USB flash drive that uses the /dev/sdc1 device is
plugged in and the /mnt/flashdisk/ directory is present, type:
Slave Mount
168
CHAPTER 19. USING THE MOUNT COMMAND
A slave mount allows the creation of a limited duplicate of a given mount point. When a mount point
is marked as a slave mount, any mount within the original mount point is reflected in it, but no mount
within a slave mount is reflected in its original. To change the type of a mount point to a slave mount,
type the following at a shell prompt:
Alternatively, it is possible to change the mount type for the selected mount point and all mount points
under it by typing:
See Example 19.5, “Creating a Slave Mount Point” for an example usage.
This example shows how to get the content of the /media/ directory to appear in /mnt/ as well,
but without any mounts in the /mnt/ directory to be reflected in /media/. As root, first mark the
/media/ directory as shared:
Now verify that a mount within /media/ also appears in /mnt/. For example, if the CD-ROM
drive contains non-empty media and the /media/cdrom/ directory exists, run the following
commands:
Also verify that file systems mounted in the /mnt/ directory are not reflected in /media/. For
instance, if a non-empty USB flash drive that uses the /dev/sdc1 device is plugged in and the
/mnt/flashdisk/ directory is present, type:
Private Mount
A private mount is the default type of mount, and unlike a shared or slave mount, it does not receive
or forward any propagation events. To explicitly mark a mount point as a private mount, type the
following at a shell prompt:
169
Storage Administration Guide
Alternatively, it is possible to change the mount type for the selected mount point and all mount points
under it:
See Example 19.6, “Creating a Private Mount Point” for an example usage.
Taking into account the scenario in Example 19.4, “Creating a Shared Mount Point”, assume that
a shared mount point has been previously created by using the following commands as root:
It is now possible to verify that none of the mounts within /media/ appears in /mnt/. For
example, if the CD-ROM drives contains non-empty media and the /media/cdrom/ directory
exists, run the following commands:
It is also possible to verify that file systems mounted in the /mnt/ directory are not reflected in
/media/. For instance, if a non-empty USB flash drive that uses the /dev/sdc1 device is
plugged in and the /mnt/flashdisk/ directory is present, type:
Unbindable Mount
In order to prevent a given mount point from being duplicated whatsoever, an unbindable mount is
used. To change the type of a mount point to an unbindable mount, type the following at a shell
prompt:
Alternatively, it is possible to change the mount type for the selected mount point and all mount points
under it:
170
CHAPTER 19. USING THE MOUNT COMMAND
See Example 19.7, “Creating an Unbindable Mount Point” for an example usage.
This way, any subsequent attempt to make a duplicate of this mount fails with an error:
See Example 19.8, “Moving an Existing NFS Mount Point” for an example usage.
An NFS storage contains user directories and is already mounted in /mnt/userdirs/. As root,
move this mount point to /home by using the following command:
To verify the mount point has been moved, list the content of both directories:
# ls /mnt/userdirs
# ls /home
jill joe
Sometimes, you need to mount the root file system with read-only permissions. Example use cases
include enhancing security or ensuring data integrity after an unexpected system power-off.
171
Storage Administration Guide
GRUB_CMDLINE_LINUX="crashkernel=auto rd.lvm.lv=rhel/root
rd.lvm.lv=rhel/swap rhgb quiet ro"
# grub2-mkconfig -o /boot/grub2/grub.cfg
5. If you need to add files and directories to be mounted with write permissions in the tmpfs file
system, create a text file in the /etc/rwtab.d/ directory and put the configuration there. For
example, to mount /etc/example/file with write permissions, add this line to the
/etc/rwtab.d/example file:
files /etc/example/file
IMPORTANT
Changes made to files and directories in tmpfs do not persist across boots.
See Section 19.2.5.3, “Files and Directories That Retain Write Permissions” for more information
on this step.
If root (/) was mounted with read-only permissions on system boot, you can remount it with write
permissions:
# mount -o remount,rw /
This can be particularly useful when / is incorrectly mounted with read-only permissions.
# mount -o remount,ro /
172
CHAPTER 19. USING THE MOUNT COMMAND
NOTE
This command mounts the whole / with read-only permissions. A better approach is to
retain write permissions for certain files and directories by copying them into RAM, as
described in Section 19.2.5.1, “Configuring root to Mount with Read-only Permissions on
Boot”.
For the system to function properly, some files and directories need to retain write permissions. With root
in read-only mode, they are mounted in RAM in the tmpfs temporary file system. The default set of
such files and directories is read from the /etc/rwtab file, which contains:
dirs /var/cache/man
dirs /var/gdm
[output truncated]
empty /tmp
empty /var/cache/foomatic
[output truncated]
files /etc/adjtime
files /etc/ntp.conf
[output truncated]
dirs path: A directory tree is copied to tmpfs, empty. Example: dirs /var/run
files path: A file or a directory tree is copied to tmpfs intact. Example: files
/etc/resolv.conf
$ umount directory
$ umount device
Note that unless this is performed while logged in as root, the correct permissions must be available to
unmount the file system. For more information, see Section 19.2.2, “Specifying the Mount Options”. See
Example 19.9, “Unmounting a CD” for an example usage.
173
Storage Administration Guide
IMPORTANT
When a file system is in use (for example, when a process is reading a file on this file
system, or when it is used by the kernel), running the umount command fails with an
error. To determine which processes are accessing the file system, use the fuser
command in the following form:
$ fuser -m directory
For example, to list the processes that are accessing a file system mounted to the
/media/cdrom/ directory:
$ fuser -m /media/cdrom
/media/cdrom: 1793 2013 2022 2435 10532c 10672c
To unmount a CD that was previously mounted to the /media/cdrom/ directory, use the following
command:
$ umount /media/cdrom
man 8 umount: The manual page for the umount command that provides a full documentation
on its usage.
man 8 findmnt: The manual page for the findmnt command that provides a full
documentation on its usage.
man 5 fstab: The manual page providing a thorough description of the /etc/fstab file
format.
Useful Websites
Shared subtrees — An LWN article covering the concept of shared subtrees.
174
CHAPTER 20. THE VOLUME_KEY FUNCTION
This is useful for when the primary user forgets their keys and passwords, after an employee leaves
abruptly, or in order to extract data after a hardware or software failure corrupts the header of the
encrypted volume. In a corporate setting, the IT help desk can use volume_key to back up the
encryption keys before handing over the computer to the end user.
NOTE
volume_key is not included in a standard install of Red Hat Enterprise Linux 7 server.
For information on installing it, refer to
http://fedoraproject.org/wiki/Disk_encryption_key_escrow_use_cases.
The operands and mode of operation for volume_key are determined by specifying one of the following
options:
--save
This command expects the operand volume [packet]. If a packet is provided then volume_key will
extract the keys and passphrases from it. If packet is not provided, then volume_key will extract the
keys and passphrases from the volume, prompting the user where necessary. These keys and
passphrases will then be stored in one or more output packets.
--restore
This command expects the operands volume packet. It then opens the volume and uses the keys and
passphrases in the packet to make the volume accessible again, prompting the user where
necessary, such as allowing the user to enter a new passphrase, for example.
--setup-volume
This command expects the operands volume packet name. It then opens the volume and uses the
keys and passphrases in the packet to set up the volume for use of the decrypted data as name.
Name is the name of a dm-crypt volume. This operation makes the decrypted volume available as
/dev/mapper/name.
This operation does not permanently alter the volume by adding a new passphrase, for example. The
user can access and modify the decrypted volume, modifying volume in the process.
175
Storage Administration Guide
These three commands perform similar functions with varying output methods. They each require the
operand packet, and each opens the packet, decrypting it where necessary. --reencrypt then
stores the information in one or more new output packets. --secrets outputs the keys and
passphrases contained in the packet. --dump outputs the content of the packet, though the keys and
passphrases are not output by default. This can be changed by appending --with-secrets to the
command. It is also possible to only dump the unencrypted parts of the packet, if any, by using the --
unencrypted command. This does not require any passphrase or private key access.
--output-format format
This command uses the specified format for all output packets. Currently, format can be one of the
following:
asymmetric: uses CMS to encrypt the whole packet, and requires a certificate
passphrase: uses GPG to encrypt the whole packet, and requires a passphrase
--create-random-passphrase packet
This command generates a random alphanumeric passphrase, adds it to the volume (without
affecting other passphrases), and then stores this random passphrase into the packet.
NOTE
For all examples in this file, /path/to/volume is a LUKS device, not the plaintext
device contained within. blkid -s type /path/to/volume should report
type="crypto_LUKS".
1. Run:
A prompt will then appear requiring an escrow packet passphrase to protect the key.
2. Save the generated escrow-packet file, ensuring that the passphrase is not forgotten.
176
CHAPTER 20. THE VOLUME_KEY FUNCTION
If the volume passphrase is forgotten, use the saved escrow packet to restore access to the data.
1. Boot the system in an environment where volume_key can be run and the escrow packet is
available (a rescue mode, for example).
2. Run:
A prompt will appear for the escrow packet passphrase that was used when creating the escrow
packet, and for the new passphrase for the volume.
To free up the passphrase slot in the LUKS header of the encrypted volume, remove the old, forgotten
passphrase by using the command cryptsetup luksKillSlot.
This section will cover the procedures required for preparation before saving encryption keys, how to
save encryption keys, restoring access to a volume, and setting up emergency passphrases.
2. Designate trusted users who are trusted not to compromise the private key. These users will be
able to decrypt the escrow packets.
3. Choose which systems will be used to decrypt the escrow packets. On these systems, set up an
NSS database that contains the private key.
If the private key was not created in an NSS database, follow these steps:
Run:
certutil -d /the/nss/directory -N
At this point it is possible to choose an NSS database password. Each NSS database can
have a different password so the designated users do not need to share a single password if
a separate NSS database is used by each user.
177
Storage Administration Guide
Run:
4. Distribute the certificate to anyone installing systems or saving keys on existing systems.
5. For saved private keys, prepare storage that allows them to be looked up by machine and
volume. For example, this can be a simple directory with one subdirectory per machine, or a
database used for other system management tasks as well.
NOTE
For all examples in this file, /path/to/volume is a LUKS device, not the plaintext
device contained within; blkid -s type /path/to/volume should report
type="crypto_LUKS".
1. Run:
2. Save the generated escrow-packet file in the prepared storage, associating it with the system
and the volume.
1. Get the escrow packet for the volume from the packet storage and send it to one of the
designated users for decryption.
After providing the NSS database password, the designated user chooses a passphrase for
encrypting escrow-packet-out. This passphrase can be different every time and only
protects the encryption keys while they are moved from the designated user to the target
system.
3. Obtain the escrow-packet-out file and the passphrase from the designated user.
178
CHAPTER 20. THE VOLUME_KEY FUNCTION
4. Boot the target system in an environment that can run volume_key and have the escrow-
packet-out file available, such as in a rescue mode.
5. Run:
A prompt will appear for the packet passphrase chosen by the designated user, and for a new
passphrase for the volume.
It is possible to remove the old passphrase that was forgotten by using cryptsetup luksKillSlot,
for example, to free up the passphrase slot in the LUKS header of the encrypted volume. This is done
with the command cryptsetup luksKillSlot device key-slot. For more information and
examples see cryptsetup --help.
This generates a random passphrase, adds it to the specified volume, and stores it to passphrase-
packet. It is also possible to combine the --create-random-passphrase and -o options to
generate both packets at the same time.
This shows the random passphrase. Give this passphrase to the end user.
online at http://fedoraproject.org/wiki/Disk_encryption_key_escrow_use_cases
179
Storage Administration Guide
Performance degrades as the number of used blocks approaches the disk capacity. The degree of
performance impact varies greatly by vendor. However, all devices experience some degradation.
To address the degradation issue, the host system (for example, the Linux kernel) may use discard
requests to inform the storage that a given range of blocks is no longer in use. An SSD can use this
information to free up space internally, using the free blocks for wear-leveling. Discards will only be
issued if the storage advertises support in terms of its storage protocol (be it ATA or SCSI). Discard
requests are issued to the storage using the negotiated discard command specific to the storage protocol
(TRIM command for ATA, and WRITE SAME with UNMAP set, or UNMAP command for SCSI).
Enabling discard support is most useful when the following points are true:
Most logical blocks on the underlying storage device have already been written to.
For more information about TRIM, see Data Set Management T13 Specifications.
For more information about UNMAP, see the section 4.7.3.4 of the SCSI Block Commands 3 T10
Specification.
NOTE
Not all solid-state devices in the market have discard support. To determine if your
solid-state device has discard support, check for
/sys/block/sda/queue/discard_granularity, which is the size of internal
allocation unit of device.
Deployment Considerations
Because of the internal layout and operation of SSDs, it is best to partition devices on an internal erase
block boundary. Partitioning utilities in Red Hat Enterprise Linux 7 chooses sane defaults if the SSD
exports topology information. However, if the device does not export topology information, Red Hat
recommends that the first partition should be created at a 1MB boundary.
SSD has various types of TRIM mechanism depending on the vendors choice. The early versions of
disks improved the performance by compromising possible data leakage after the read command.
Non-deterministic TRIM
The first two types of TRIM mechanism can cause data leakage as the read command to the LBA after a
TRIM returns different or same data. RZAT returns zero after the read command and Red Hat
180
CHAPTER 21. SOLID-STATE DISK DEPLOYMENT GUIDELINES
recommends this TRIM mechanism to avoid data leakage. It is affected only in SSD. Choose the disk
which supports RZAT mechanism.
Type of TRIM mechanism used depends on hardware implementation. To find the type of TRIM
mechanism on ATA, use the hdparm command. See the following example to find the type of TRIM
mechanism:
The Logical Volume Manager (LVM), the device-mapper (DM) targets, and MD (software raid) targets
that LVM uses support discards. The only DM targets that do not support discards are dm-snapshot, dm-
crypt, and dm-raid45. Discard support for the dm-mirror was added in Red Hat Enterprise Linux 6.1 and
as of 7.0 MD supports discards.
Using RAID level 5 over SSD results in low performance if SSDs do not handle discard correctly. You
can set discard in the raid456.conf file, or in the GRUB2 configuration. For instructions, see the
following procedures.
# cat /sys/block/disk-name/queue/discard_zeroes_data
If the returned value is 1, discards are supported. If the command returns 0, the RAID code has
to zero the disk out, which takes more time.
# cat /sys/block/disk-name/queue/discard_zeroes_data
If the returned value is 1, discards are supported. If the command returns 0, the RAID code has
to zero the disk out, which takes more time.
181
Storage Administration Guide
raid456.devices_handle_discard_safely=Y
3. The location of the GRUB2 configuration file is different on systems with the BIOS firmware and
on systems with UEFI. Use one of the following commands to recreate the GRUB2 configuration
file.
# grub2-mkconfig -o /boot/grub2/grub.cfg
# grub2-mkconfig -o /boot/efi/EFI/redhat/grub.cfg
NOTE
In Red Hat Enterprise Linux 7, discard is fully supported by the ext4 and XFS file systems
only.
In Red Hat Enterprise Linux 6.3 and earlier, only the ext4 file system fully supports discard. Starting with
Red Hat Enterprise Linux 6.4, both ext4 and XFS file systems fully support discard. To enable discard
commands on a device, use the discard option of the mount command. For example, to mount
/dev/sda2 to /mnt with discard enabled, use:
By default, ext4 does not issue the discard command to, primarily, avoid problems on devices which
might not properly implement discard. The Linux swap code issues discard commands to discard-
enabled devices, and there is no option to control this behavior.
182
CHAPTER 22. WRITE BARRIERS
Enabling write barriers incurs a substantial performance penalty for some applications. Specifically,
applications that use fsync() heavily or create and delete many small files will likely run much slower.
1. The file system sends the body of the transaction to the storage device.
3. If the transaction and its corresponding commit block are written to disk, the file system assumes
that the transaction will survive any power failure.
However, file system integrity during power failure becomes more complex for storage devices with extra
caches. Storage target devices like local S-ATA or SAS drives may have write caches ranging from
32MB to 64MB in size (with modern drives). Hardware RAID controllers often contain internal write
caches. Further, high end arrays, like those from NetApp, IBM, Hitachi and EMC (among others), also
have large caches.
Storage devices with write caches report I/O as "complete" when the data is in cache; if the cache loses
power, it loses its data as well. Worse, as the cache de-stages to persistent storage, it may change the
original metadata ordering. When this occurs, the commit block may be present on disk without having
the complete, associated transaction in place. As a result, the journal may replay these uninitialized
transaction blocks into the file system during post-power-loss recovery; this will cause data inconsistency
and corruption.
With barriers enabled, an fsync() call also issues a storage cache flush. This guarantees that file data
is persistent on disk even if power loss occurs shortly after fsync() returns.
183
Storage Administration Guide
NOTE
Write caches are designed to increase I/O performance. However, enabling write barriers
means constantly flushing these caches, which can significantly reduce performance.
For devices with non-volatile, battery-backed write caches and those with write-caching disabled, you
can safely disable write barriers at mount time using the -o nobarrier option for mount. However,
some devices do not support write barriers; such devices log an error message to
/var/log/messages. For more information, see Table 22.1, “Write Barrier Error Messages per File
System”.
Most controllers use vendor-specific tools to query and manipulate target drives. For example, the LSI
Megaraid SAS controller uses a battery-backed write cache; this type of controller requires the
MegaCli64 tool to manage target drives. To show the state of all back-end drives for LSI Megaraid
SAS, use:
184
CHAPTER 22. WRITE BARRIERS
To disable the write cache of all back-end drives for LSI Megaraid SAS, use:
NOTE
Hardware RAID cards recharge their batteries while the system is operational. If a system
is powered off for an extended period of time, the batteries will lose their charge, leaving
stored data vulnerable during a power failure.
High-End Arrays
High-end arrays have various ways of protecting data in the event of a power failure. As such, there is no
need to verify the state of the internal drives in external RAID storage.
NFS
NFS clients do not need to enable write barriers, since data integrity is handled by the NFS server side.
As such, NFS servers should be configured to ensure data persistence throughout a power loss (whether
through write barriers or other means).
185
Storage Administration Guide
The Linux I/O stack has been enhanced to process vendor-provided I/O alignment and I/O size
information, allowing storage management tools (parted, lvm, mkfs.*, and the like) to optimize data
placement and access. If a legacy device does not export I/O alignment and size data, then storage
management tools in Red Hat Enterprise Linux 7 will conservatively align I/O on a 4k (or larger power of
2) boundary. This will ensure that 4k-sector devices operate correctly even if they do not indicate any
required/preferred I/O alignment and size.
For information on determining the information that the operating system obtained from the device, see
the Section 23.2, “Userspace Access”. This data is subsequently used by the storage management tools
to determine data placement.
The IO scheduler has changed for Red Hat Enterprise Linux 7. Default IO Scheduler is now Deadline,
except for SATA drives. CFQ is the default IO scheduler for SATA drives. For faster storage, Deadline
outperforms CFQ and when it is used there is a performance increase without the need of special tuning.
If default is not right for some disks (for example, SAS rotational disks), then change the IO scheduler to
CFQ. This instance will depend on the workload.
physical_block_size
Smallest internal unit on which the device can operate
logical_block_size
Used externally to address a location on the device
alignment_offset
The number of bytes that the beginning of the Linux block device (partition/MD/LVM device) is offset
from the underlying physical alignment
minimum_io_size
The device’s preferred minimum unit for random I/O
optimal_io_size
The device’s preferred unit for streaming I/O
For example, certain 4K sector devices may use a 4K physical_block_size internally but expose a
more granular 512-byte logical_block_size to Linux. This discrepancy introduces potential for
misaligned I/O. To address this, the Red Hat Enterprise Linux 7 I/O stack will attempt to start all data
areas on a naturally-aligned boundary (physical_block_size) by making sure it accounts for any
alignment_offset if the beginning of the block device is offset from the underlying physical alignment.
Storage vendors can also supply I/O hints about the preferred minimum unit for random I/O
186
CHAPTER 23. STORAGE I/O ALIGNMENT AND SIZE
With native 4K devices (i.e. logical_block_size is 4K) it is now critical that applications perform
direct I/O in multiples of the device's logical_block_size. This means that applications will fail with
native 4k devices that perform 512-byte aligned I/O rather than 4k-aligned I/O.
To avoid this, an application should consult the I/O parameters of a device to ensure it is using the
proper I/O alignment and size. As mentioned earlier, I/O parameters are exposed through the both
sysfs and block device ioctl interfaces.
For more information, see man libblkid. This man page is provided by the libblkid-devel
package.
sysfs Interface
/sys/block/disk/alignment_offset
or
/sys/block/disk/partition/alignment_offset
NOTE
The file location depends on whether the disk is a physical disk (be that a local
disk, local RAID, or a multipath LUN) or a virtual disk. The first file location is
applicable to physical disks while the second file location is applicable to virtual
disks. The reason for this is because virtio-blk will always report an alignment
value for the partition. Physical disks may or may not report an alignment value.
/sys/block/disk/queue/physical_block_size
/sys/block/disk/queue/logical_block_size
/sys/block/disk/queue/minimum_io_size
/sys/block/disk/queue/optimal_io_size
The kernel will still export these sysfs attributes for "legacy" devices that do not provide I/O parameters
information, for example:
alignment_offset: 0
physical_block_size: 512
logical_block_size: 512
187
Storage Administration Guide
minimum_io_size: 512
optimal_io_size: 0
BLKPBSZGET: physical_block_size
BLKSSZGET: logical_block_size
BLKIOMIN: minimum_io_size
BLKIOOPT: optimal_io_size
ATA
ATA devices must report appropriate information via the IDENTIFY DEVICE command. ATA devices
only report I/O parameters for physical_block_size, logical_block_size, and
alignment_offset. The additional I/O hints are outside the scope of the ATA Command Set.
SCSI
I/O parameters support in Red Hat Enterprise Linux 7 requires at least version 3 of the SCSI Primary
Commands (SPC-3) protocol. The kernel will only send an extended inquiry (which gains access to the
BLOCK LIMITS VPD page) and READ CAPACITY(16) command to devices which claim compliance
with SPC-3.
The READ CAPACITY(16) command provides the block sizes and alignment offset:
/sys/block/disk/alignment_offset
/sys/block/disk/partition/alignment_offset
The BLOCK LIMITS VPD page (0xb0) provides the I/O hints. It also uses OPTIMAL TRANSFER
LENGTH GRANULARITY and OPTIMAL TRANSFER LENGTH to derive:
/sys/block/disk/queue/minimum_io_size
/sys/block/disk/queue/optimal_io_size
188
CHAPTER 23. STORAGE I/O ALIGNMENT AND SIZE
The sg3_utils package provides the sg_inq utility, which can be used to access the BLOCK LIMITS
VPD page. To do so, run:
Only one layer in the I/O stack should adjust for a non-zero alignment_offset; once a layer
adjusts accordingly, it will export a device with an alignment_offset of zero.
A striped Device Mapper (DM) device created with LVM must export a minimum_io_size and
optimal_io_size relative to the stripe count (number of disks) and user-provided chunk size.
In Red Hat Enterprise Linux 7, Device Mapper and Software Raid (MD) device drivers can be used to
arbitrarily combine devices with different I/O parameters. The kernel's block layer will attempt to
reasonably combine the I/O parameters of the individual devices. The kernel will not prevent combining
heterogeneous devices; however, be aware of the risks associated with doing so.
For instance, a 512-byte device and a 4K device may be combined into a single logical DM device, which
would have a logical_block_size of 4K. File systems layered on such a hybrid device assume that
4K will be written atomically, but in reality it will span 8 logical block addresses when issued to the 512-
byte device. Using a 4K logical_block_size for the higher-level DM device increases potential for a
partial write to the 512-byte device if there is a system crash.
If combining the I/O parameters of multiple devices results in a conflict, the block layer may issue a
warning that the device is susceptible to partial writes and/or is misaligned.
By default, LVM will adjust for any alignment_offset, but this behavior can be disabled by setting
data_alignment_offset_detection to 0 in /etc/lvm/lvm.conf. Disabling this is not
recommended.
LVM will also detect the I/O hints for a device. The start of a device's data area will be a multiple of the
minimum_io_size or optimal_io_size exposed in sysfs. LVM will use the minimum_io_size if
optimal_io_size is undefined (i.e. 0).
By default, LVM will automatically determine these I/O hints, but this behavior can be disabled by setting
data_alignment_detection to 0 in /etc/lvm/lvm.conf. Disabling this is not recommended.
189
Storage Administration Guide
This section describes how different partition and file system management tools interact with a device's
I/O parameters.
Always use the reported alignment_offset as the offset for the start of the first primary
partition.
This is the catch-all for "legacy" devices which don't appear to provide I/O hints. As such, by
default all partitions will be aligned on a 1MB boundary.
NOTE
Red Hat Enterprise Linux 7 cannot distinguish between devices that don't provide
I/O hints and those that do so with alignment_offset=0 and
optimal_io_size=0. Such a device might be a single SAS 4K device; as such,
at worst 1MB of space is lost at the start of the disk.
Except for mkfs.gfs2, all other mkfs.filesystem utilities also use the I/O hints to layout on-disk data
structure and data areas relative to the minimum_io_size and optimal_io_size of the underlying
storage device. This allows file systems to be optimally formatted for various RAID (striped) layouts.
190
CHAPTER 24. SETTING UP A REMOTE DISKLESS SYSTEM
tftp-server
xinetd
dhcp
syslinux
dracut-network
NOTE
add_dracutmodules+="nfs"
Remote diskless system booting requires both a tftp service (provided by tftp-server) and a DHCP
service (provided by dhcp). The tftp service is used to retrieve kernel image and initrd over the
network via the PXE loader.
NOTE
SELinux is only supported over NFSv4.2. To use SELinux, NFS must be explicitly
enabled in /etc/sysconfig/nfs by adding the line:
RPCNFSDARGS="-V 4.2"
The following sections outline the necessary procedures for deploying remote diskless systems in a
network environment.
IMPORTANT
Some RPM packages have started using file capabilities (such as setcap and getcap).
However, NFS does not currently support these so attempting to install or update any
packages that use file capabilities will fail.
191
Storage Administration Guide
Procedure
To configure tftp, perform the following steps:
# cp /usr/share/syslinux/pxelinux.0 /var/lib/tftpboot/
# mkdir -p /var/lib/tftpboot/pxelinux.cfg/
As tftp supports TCP wrappers, you can configure host access to tftp in the
/etc/hosts.allow configuration file. For more information on configuring TCP wrappers and
the /etc/hosts.allow configuration file, see the Red Hat Enterprise Linux 7 Security Guide.
The hosts_access(5) also provides information about /etc/hosts.allow.
Next Steps
After configuring tftp for diskless clients, configure DHCP, NFS, and the exported file system
accordingly. For instructions on configuring the DHCP, NFS, and the exported file system, see
Section 24.2, “Configuring DHCP for Diskless Clients” and Section 24.3, “Configuring an Exported File
System for Diskless Clients”.
Configure the tftp service. See Section 24.1, “Configuring a tftp Service for Diskless Clients”.
Procedure
1. After configuring a tftp server, you need to set up a DHCP service on the same host machine.
For instructions on setting up a DHCP server, see the Configuring a DHCP Server.
2. Enable PXE booting on the DHCP server by adding the following configuration to
/etc/dhcp/dhcp.conf:
allow booting;
allow bootp;
class "pxeclients" {
match if substring(option vendor-class-identifier, 0, 9) =
"PXEClient";
192
CHAPTER 24. SETTING UP A REMOTE DISKLESS SYSTEM
next-server server-ip;
filename "pxelinux.0";
}
Replace server-ip with the IP address of the host machine on which the tftp and DHCP
services reside.
NOTE
When libvirt virtual machines are used as the diskless client, libvirt
provides the DHCP service and the stand alone DHCP server is not used. In this
situation, network booting must be enabled with the bootp file='filename'
option in the libvirt network configuration, virsh net-edit.
Next Steps
Now that tftp and DHCP are configured, configure NFS and the exported file system. For instructions,
see the Section 24.3, “Configuring an Exported File System for Diskless Clients”.
Configure the tftp service. See Section 24.1, “Configuring a tftp Service for Diskless Clients”.
Configure DHCP. See Section 24.2, “Configuring DHCP for Diskless Clients”.
Procedure
1. The root directory of the exported file system (used by diskless clients in the network) is shared
via NFS. Configure the NFS service to export the root directory by adding it to /etc/exports.
For instructions on how to do so, see the Section 8.7.1, “The /etc/exports Configuration
File”.
2. To accommodate completely diskless clients, the root directory should contain a complete
Red Hat Enterprise Linux installation. You can either clone an existing installation or install a
new base system:
Replace hostname.com with the hostname of the running system with which to
synchronize via rsync.
To install Red Hat Enterprise Linux to the exported location, use the yum utility with the --
installroot option:
193
Storage Administration Guide
The file system to be exported still needs to be configured further before it can be used by diskless
clients. To do this, perform the following procedure:
1. Select the kernel that diskless clients should use (vmlinuz-kernel-version) and copy it to
the tftp boot directory:
# cp /boot/vmlinuz-kernel-version /var/lib/tftpboot/
3. Change the initrd's file permissions to 644 using the following command:
WARNING
If the initrd's file permissions are not changed, the pxelinux.0 boot loader
will fail with a "file not found" error.
4. Copy the resulting initramfs-kernel-version.img into the tftp boot directory as well.
5. Edit the default boot configuration to use the initrd and kernel in the /var/lib/tftpboot/
directory. This configuration should instruct the diskless client's root to mount the exported file
system (/exported/root/directory) as read-write. Add the following configuration in the
/var/lib/tftpboot/pxelinux.cfg/default file:
default rhel7
label rhel7
kernel vmlinuz-kernel-version
append initrd=initramfs-kernel-version.img root=nfs:server-
ip:/exported/root/directory rw
Replace server-ip with the IP address of the host machine on which the tftp and DHCP
services reside.
The NFS share is now ready for exporting to diskless clients. These clients can boot over the network via
PXE.
194
CHAPTER 25. ONLINE STORAGE MANAGEMENT
This chapter focuses on adding, removing, modifying, and monitoring storage devices. It does not
discuss the Fibre Channel or iSCSI protocols in detail. For more information about these protocols, refer
to other documentation.
This chapter makes reference to various sysfs objects. Red Hat advises that the sysfs object names
and directory structure are subject to change in major Red Hat Enterprise Linux releases. This is
because the upstream Linux kernel does not provide a stable internal API. For guidelines on how to
reference sysfs objects in a transportable way, refer to the document /usr/share/doc/kernel-
doc-version/Documentation/sysfs-rules.txt in the kernel source tree for guidelines.
WARNING
In addition, Red Hat recommends that you back up all data before reconfiguring
online storage.
The hierarchy of targetcli does not always match the kernel interface exactly because targetcli is
simplified where possible.
IMPORTANT
To ensure that the changes made in targetcli are persistent, start and enable the
target service:
195
Storage Administration Guide
Open port 3260 in the firewall and reload the firewall configuration:
Use the targetcli command, and then use the ls command for the layout of the tree interface:
# targetcli
:
/> ls
o- /........................................[...]
o- backstores.............................[...]
| o- block.................[Storage Objects: 0]
| o- fileio................[Storage Objects: 0]
| o- pscsi.................[Storage Objects: 0]
| o- ramdisk...............[Storage Ojbects: 0]
o- iscsi...........................[Targets: 0]
o- loopback........................[Targets: 0]
NOTE
In Red Hat Enterprise Linux 7.0, using the targetcli command from Bash, for example,
targetcli iscsi/ create, does not work and does not return an error. Starting with
Red Hat Enterprise Linux 7.1, an error status code is provided to make using targetcli
with shell scripts more useful.
196
CHAPTER 25. ONLINE STORAGE MANAGEMENT
NOTE
In Red Hat Enterprise Linux 6, the term 'backing-store' is used to refer to the mappings
created. However, to avoid confusion between the various ways 'backstores' can be used,
in Red Hat Enterprise Linux 7 the term 'storage objects' refers to the mappings created
and 'backstores' is used to describe the different types of backing devices.
To create a fileio storage object, run the command /backstores/fileio create file_name
file_location file_size write_back=false. For example:
NOTE
To create a BLOCK backstore using any block device, use the following command:
# fdisk /dev/vdb
Welcome to fdisk (util-linux 2.23.2).
Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.
197
Storage Administration Guide
NOTE
WARNING
To create a PSCSI backstore for a physical SCSI device, a TYPE_ROM device using /dev/sr0 in
this example, use:
198
CHAPTER 25. ONLINE STORAGE MANAGEMENT
1. Run targetcli.
/> iscsi/
NOTE
/iscsi> create
Created target
iqn.2003-01.org.linux-iscsi.hostname.x8664:sn.78b473f296ff
Created TPG1
4. Verify that the newly created target is visible when targets are listed with ls.
/iscsi > ls
o- iscsi.......................................[1 Target]
o- iqn.2006-04.com.example:444................[1 TPG]
o- tpg1...........................[enabled, auth]
o- acls...............................[0 ACL]
o- luns...............................[0 LUN]
o- portals.........................[0 Portal]
NOTE
As of Red Hat Enterprise Linux 7.1, whenever a target is created, a default portal is also
created.
199
Storage Administration Guide
NOTE
As of Red Hat Enterprise Linux 7.1 when an iSCSI target is created, a default portal is
created as well. This portal is set to listen on all IP addresses with the default port number
(that is, 0.0.0.0:3260). To remove this and add only specified portals, use /iscsi/iqn-
name/tpg1/portals delete ip_address=0.0.0.0 ip_port=3260 then create a
new portal with the required information.
/iscsi> iqn.2006-04.example:444/tpg1/
2. There are two ways to create a portal: create a default portal, or create a portal specifying what
IP address to listen to.
Creating a default portal uses the default iSCSI port 3260 and allows the target to listen on all IP
addresses on that port.
To create a portal specifying what IP address to listen to, use the following command.
3. Verify that the newly created portal is visible with the ls command.
/iscsi/iqn.20...mple:444/tpg1> ls
o- tpg.................................. [enambled, auth]
o- acls ......................................[0 ACL]
o- luns ......................................[0 LUN]
o- portals ................................[1 Portal]
o- 192.168.122.137:3260......................[OK]
200
CHAPTER 25. ONLINE STORAGE MANAGEMENT
/iscsi/iqn.20...mple:444/tpg1> ls
o- tpg.................................. [enambled, auth]
o- acls ......................................[0 ACL]
o- luns .....................................[3 LUNs]
| o- lun0.........................[ramdisk/ramdisk1]
| o- lun1.................[block/block1 (/dev/vdb1)]
| o- lun2...................[fileio/file1 (/foo.img)]
o- portals ................................[1 Portal]
o- 192.168.122.137:3260......................[OK]
NOTE
Be aware that the default LUN name starts at 0, as opposed to 1 as was the case
when using tgtd in Red Hat Enterprise Linux 6.
IMPORTANT
By default, LUNs are created with read-write permissions. In the event that a new LUN is
added after ACLs have been created that LUN will be automatically mapped to all
available ACLs. This can cause a security risk. Use the following procedure to create a
LUN as read-only.
1. To create a LUN with read-only permissions, first use the following command:
This prevents the auto mapping of LUNs to existing ACLs allowing the manual mapping of LUNs.
/> iscsi/iqn.2015-06.com.redhat:target/tpg1/acls/iqn.2015-
06.com.redhat:initiator/ create mapped_lun=1
tpg_lun_or_backstore=/backstores/block/block2 write_protect=1
Created LUN 1.
Created Mapped LUN 1.
/> ls
o- / ...................................................... [...]
o- backstores ........................................... [...]
201
Storage Administration Guide
<snip>
o- iscsi ......................................... [Targets: 1]
| o- iqn.2015-06.com.redhat:target .................. [TPGs: 1]
| o- tpg1 ............................ [no-gen-acls, no-auth]
| o- acls ....................................... [ACLs: 2]
| | o- iqn.2015-06.com.redhat:initiator .. [Mapped LUNs: 2]
| | | o- mapped_lun0 .............. [lun0 block/disk1 (rw)]
| | | o- mapped_lun1 .............. [lun1 block/disk2 (ro)]
| o- luns ....................................... [LUNs: 2]
| | o- lun0 ...................... [block/disk1 (/dev/vdb)]
| | o- lun1 ...................... [block/disk2 (/dev/vdc)]
<snip>
The mapped_lun1 line now has (ro) at the end (unlike mapped_lun0's (rw)) stating that it is read-
only.
/iscsi/iqn.20...mple:444/tpg1> acls/
NOTE
The given example's behavior depends on the setting used. In this case, the
global setting auto_add_mapped_luns is used. This automatically maps LUNs
to any created ACL.
You can set user-created ACLs within the TPG node on the target server:
202
CHAPTER 25. ONLINE STORAGE MANAGEMENT
/iscsi/iqn.20...444/tpg1/acls> ls
o- acls .................................................[1 ACL]
o- iqn.2006-04.com.example.foo:888 ....[3 Mapped LUNs, auth]
o- mapped_lun0 .............[lun0 ramdisk/ramdisk1 (rw)]
o- mapped_lun1 .................[lun1 block/block1 (rw)]
o- mapped_lun2 .................[lun2 fileio/file1 (rw)]
IMPORTANT
Before proceeding, refer to Section 25.4, “Configuring a Fibre Channel over Ethernet
Interface” and verify that basic FCoE setup is completed, and that fcoeadm -i displays
configured FCoE interfaces.
1. Setting up an FCoE target requires the installation of the targetcli package, along with its
dependencies. Refer to Section 25.1, “Target Setup” for more information on targetcli basics
and set up.
If FCoE interfaces are present on the system, tab-completing after create will list available
interfaces. If not, ensure fcoeadm -i shows active interfaces.
/> tcm_fc/00:11:22:33:44:55:66:77
5. To make the changes persistent across reboots, use the saveconfig command and type yes
when prompted. If this is not done the configuration will be lost after rebooting.
203
Storage Administration Guide
/> /backstores/backstore-type/backstore-name
To remove parts of an iSCSI target, such as an ACL, use the following command:
To remove the entire target, including all ACLs, LUNs, and portals, use the following command:
man targetcli
The targetcli man page. It includes an example walk through.
NOTE
This was uploaded on February 28, 2012. As such, the service name has changed
from targetcli to target.
In Red Hat Enterprise Linux 7, the iSCSI service is lazily started by default: the service starts after
running the iscsiadm command.
1. Install iscsi-initiator-utils:
2. If the ACL was given a custom name in Section 25.1.6, “Configuring ACLs”, modify the
/etc/iscsi/initiatorname.iscsi file accordingly. For example:
204
CHAPTER 25. ONLINE STORAGE MANAGEMENT
# cat /etc/iscsi/initiatorname.iscsi
InitiatorName=iqn.2006-04.com.example.node1
# vi /etc/iscsi/initiatorname.iscsi
4. Log in to the target with the target IQN you discovered in step 3:
This procedure can be followed for any number of initators connected to the same LUN so long
as their specific initiator names are added to the ACL as described in Section 25.1.6,
“Configuring ACLs”.
5. Find the iSCSI disk name and create a file system on this iSCSI dick:
# mkfs.ext4 /dev/disk_name
# mkdir /mount/point
# mount /dev/disk_name /mount/point
7. Edit the /etc/fstab to mount the file system automatically when the system boots:
# vim /etc/fstab
/dev/disk_name /mount/point ext4 _netdev 0 0
205
Storage Administration Guide
IMPORTANT
If your system is using multipath software, Red Hat recommends that you consult your
hardware vendor before changing any of the values described in this section.
Transport: /sys/class/fc_transport/targetH:B:T/
port_id
node_name
port_name
dev_loss_tmo: controls when the scsi device gets removed from the system. After
dev_loss_tmo triggers, the scsi device is removed.
In multipath.conf, you can set dev_loss_tmo to infinity, which sets its value to
2,147,483,647 seconds, or 68 years, and is the maximum dev_loss_tmo value.
In Red Hat Enterprise Linux 7, if you do not set the fast_io_fail_tmo option,
dev_loss_tmo is capped to 600 seconds. By default, fast_io_fail_tmo is set to 5
seconds in Red Hat Enterprise Linux 7 if the multipathd service is running; otherwise, it is
set to off.
If I/O is in a blocked queue, it will not be failed until dev_loss_tmo expires and the queue is
unblocked.
Host: /sys/class/fc_host/hostH/
port_id
206
CHAPTER 25. ONLINE STORAGE MANAGEMENT
lpfc
qla2xxx
zfcp
bfa
IMPORTANT
The qla2xxx driver runs in initiator mode by default. To use qla2xxx with Linux-IO, enable
Fibre Channel target mode with the corresponding qlini_mode module parameter.
First, make sure that the firmware package for your qla device, such as ql2200-firmware
or similar, is installed.
Then, use the dracut -f command to rebuild the initial ramdisk (initrd), and reboot
the system for the changes to take effect.
Table 25.1, “Fibre Channel API Capabilities” describes the different Fibre Channel API capabilities of
each native Red Hat Enterprise Linux 7 driver. X denotes support for the capability.
Transport X X X X
port_id
Transport X X X X
node_name
Transport X X X X
port_name
Remote Port X X X X
dev_loss_tmo
207
Storage Administration Guide
Host port_id X X X X
Host issue_lip X X X
fcoe-utils
lldpad
Once these packages are installed, perform the following procedure to enable FCoE over a virtual LAN
(VLAN):
1. To configure a new VLAN, make a copy of an existing network script, for example
/etc/fcoe/cfg-eth0, and change the name to the Ethernet device that supports FCoE. This
provides you with a default file to configure. Given that the FCoE device is ethX, run:
# cp /etc/fcoe/cfg-ethx /etc/fcoe/cfg-ethX
Modify the contents of cfg-ethX as needed. Notably, set DCB_REQUIRED to no for networking
interfaces that implement a hardware Data Center Bridging Exchange (DCBX) protocol client.
2. If you want the device to automatically load during boot time, set ONBOOT=yes in the
corresponding /etc/sysconfig/network-scripts/ifcfg-ethX file. For example, if the
FCoE device is eth2, edit /etc/sysconfig/network-scripts/ifcfg-eth2 accordingly.
4. For networking interfaces that implement a hardware DCBX client, skip this step.
For interfaces that require a software DCBX client, enable data center bridging on the Ethernet
interface by running:
208
CHAPTER 25. ONLINE STORAGE MANAGEMENT
Note that these commands only work if the dcbd settings for the Ethernet interface were not
changed.
The FCoE device appears soon if all other settings on the fabric are correct. To view configured
FCoE devices, run:
# fcoeadm -i
After correctly configuring the Ethernet interface to use FCoE, Red Hat recommends that you set FCoE
and the lldpad service to run at startup. To do so, use the systemctl utility:
NOTE
Running the # systemctl stop fcoe command stops the daemon, but does not reset
the configuration of FCoE interfaces. To do so, run the # systemctl -s SIGHUP
kill fcoe command.
As of Red Hat Enterprise Linux 7, Network Manager has the ability to query and set the DCB settings of
a DCB capable Ethernet interface.
NOTE
You can mount newly discovered disks via udev rules, autofs, and other similar methods. Sometimes,
however, a specific service might require the FCoE disk to be mounted at boot-time. In such cases, the
FCoE disk should be mounted as soon as the fcoe service runs and before the initiation of any service
that requires the FCoE disk.
209
Storage Administration Guide
To configure an FCoE disk to automatically mount at boot, add proper FCoE mounting code to the
startup script for the fcoe service. The fcoe startup script is
/lib/systemd/system/fcoe.service.
The FCoE mounting code is different per system configuration, whether you are using a simple formatted
FCoE disk, LVM, or multipathed device node.
The following is a sample FCoE mounting code for mounting file systems specified via wild cards in
/etc/fstab:
mount_fcoe_disks_from_fstab()
{
local timeout=20
local done=1
local fcoe_disks=($(egrep 'by-path\/fc-.*_netdev' /etc/fstab | cut
-d ' ' -f1))
The mount_fcoe_disks_from_fstab function should be invoked after the fcoe service script starts
the fcoemon daemon. This will mount FCoE disks specified by the following paths in /etc/fstab:
210
CHAPTER 25. ONLINE STORAGE MANAGEMENT
Entries with fc- and _netdev sub-strings enable the mount_fcoe_disks_from_fstab function to
identify FCoE disk mount entries. For more information on /etc/fstab entries, refer to man 5 fstab.
NOTE
The fcoe service does not implement a timeout for FCoE disk discovery. As such, the
FCoE mounting code should implement its own timeout period.
25.6. ISCSI
This section describes the iSCSI API and the iscsiadm utility. Before using the iscsiadm utility, install
the iscsi-initiator-utils package first by running yum install iscsi-initiator-utils.
In Red Hat Enterprise Linux 7, the iSCSI service is lazily started by default. If root is not on an iSCSI
device or there are no nodes marked with node.startup = automatic then the iSCSI service will
not start until an iscsiadm command is run that requires iscsid or the iscsi kernel modules to be started.
For example, running the discovery command iscsiadm -m discovery -t st -p ip:port will
cause iscsiadmin to start the iSCSI service.
To force the iscsid daemon to run and iSCSI kernel modules to load, run systemctl start
iscsid.service.
# iscsiadm -m session -P 3
This command displays the session/device state, session ID (sid), some negotiated parameters, and the
SCSI devices accessible through the session.
For shorter output (for example, to display only the sid-to-node mapping), run:
# iscsiadm -m session -P 0
or
# iscsiadm -m session
These commands print the list of running sessions with the format:
For example:
# iscsiadm -m session
211
Storage Administration Guide
The major and minor number range and associated sd names are allocated for each device when it is
detected. This means that the association between the major and minor number range and associated
sd names can change if the order of device detection changes. Although this is unusual with some
hardware configurations (for example, with an internal SCSI controller and disks that have their SCSI
target ID assigned by their physical location within a chassis), it can nevertheless occur. Examples of
situations where this can happen are as follows:
A disk may fail to power up or respond to the SCSI controller. This will result in it not being
detected by the normal device probe. The disk will not be accessible to the system and
subsequent devices will have their major and minor number range, including the associated sd
names shifted down. For example, if a disk normally referred to as sdb is not detected, a disk
that is normally referred to as sdc would instead appear as sdb.
A SCSI controller (host bus adapter, or HBA) may fail to initialize, causing all disks connected to
that HBA to not be detected. Any disks connected to subsequently probed HBAs would be
assigned different major and minor number ranges, and different associated sd names.
The order of driver initialization could change if different types of HBAs are present in the
system. This would cause the disks connected to those HBAs to be detected in a different order.
This can also occur if HBAs are moved to different PCI slots on the system.
Disks connected to the system with Fibre Channel, iSCSI, or FCoE adapters might be
inaccessible at the time the storage devices are probed, due to a storage array or intervening
switch being powered off, for example. This could occur when a system reboots after a power
failure, if the storage array takes longer to come online than the system take to boot. Although
some Fibre Channel drivers support a mechanism to specify a persistent SCSI target ID to
WWPN mapping, this will not cause the major and minor number ranges, and the associated sd
names to be reserved, it will only provide consistent SCSI target ID numbers.
These reasons make it undesirable to use the major and minor number range or the associated sd
names when referring to devices, such as in the /etc/fstab file. There is the possibility that the wrong
device will be mounted and data corruption could result.
212
CHAPTER 25. ONLINE STORAGE MANAGEMENT
Occasionally, however, it is still necessary to refer to the sd names even when another mechanism is
used (such as when errors are reported by a device). This is because the Linux kernel uses sd names
(and also SCSI host/channel/target/LUN tuples) in kernel messages regarding the device.
This identifier can be obtained by issuing a SCSI Inquiry to retrieve the Device Identification Vital
Product Data (page 0x83) or Unit Serial Number (page 0x80). The mappings from these WWIDs to the
current /dev/sd names can be seen in the symlinks maintained in the /dev/disk/by-id/ directory.
Red Hat Enterprise Linux automatically maintains the proper mapping from the WWID-based device
name to a current /dev/sd name on that system. Applications can use the /dev/disk/by-id/ name
to reference the data on the disk, even if the path to the device changes, and even when accessing the
device from different systems.
If there are multiple paths from a system to a device, DM Multipath uses the WWID to detect this. DM
Multipath then presents a single "pseudo-device" in the /dev/mapper/wwid directory, such as
/dev/mapper/3600508b400105df70000e00000ac0000.
DM Multipath automatically maintains the proper mapping of each WWID-based device name to its
corresponding /dev/sd name on the system. These names are persistent across path changes, and
they are consistent when accessing the device from different systems.
213
Storage Administration Guide
When the user_friendly_names feature (of DM Multipath) is used, the WWID is mapped to a name
of the form /dev/mapper/mpathn. By default, this mapping is maintained in the file
/etc/multipath/bindings. These mpathn names are persistent as long as that file is maintained.
IMPORTANT
In addition to these persistent names provided by the system, you can also use udev rules to implement
persistent names of your own, mapped to the WWID of the storage.
The kernel
Generates events that are sent to user space when devices are added, removed, or changed.
This mechanism is used for all types of devices in Linux, not just for storage devices. In the case of
storage devices, Red Hat Enterprise Linux contains udev rules that create symbolic links in the
/dev/disk/ directory allowing storage devices to be referred to by their contents, a unique identifier,
their serial number, or the hardware path used to access the device.
/dev/disk/by-label/
Entries in this directory provide a symbolic name that refers to the storage device by a label in the
contents (that is, the data) stored on the device. The blkid utility is used to read data from the device
and determine a name (that is, a label) for the device. For example:
/dev/disk/by-label/Boot
NOTE
The information is obtained from the contents (that is, the data) on the device so if the
contents are copied to another device, the label will remain the same.
The label can also be used to refer to the device in /etc/fstab using the following syntax:
LABEL=Boot
/dev/disk/by-uuid/
214
CHAPTER 25. ONLINE STORAGE MANAGEMENT
Entries in this directory provide a symbolic name that refers to the storage device by a unique
identifier in the contents (that is, the data) stored on the device. The blkid utility is used to read data
from the device and obtain a unique identifier (that is, the UUID) for the device. For example:
UUID=3e6be9de-8139-11d1-9106-a43f08d823a6
/dev/disk/by-id/
Entries in this directory provide a symbolic name that refers to the storage device by a unique
identifier (different from all other storage devices). The identifier is a property of the device but is not
stored in the contents (that is, the data) on the devices. For example:
/dev/disk/by-id/scsi-3600508e000000000ce506dc50ab0ad05
/dev/disk/by-id/wwn-0x600508e000000000ce506dc50ab0ad05
The id is obtained from the world-wide ID of the device, or the device serial number. The
/dev/disk/by-id/ entries may also include a partition number. For example:
/dev/disk/by-id/scsi-3600508e000000000ce506dc50ab0ad05-part1
/dev/disk/by-id/wwn-0x600508e000000000ce506dc50ab0ad05-part1
/dev/disk/by-path/
Entries in this directory provide a symbolic name that refers to the storage device by the hardware
path used to access the device, beginning with a reference to the storage controller in the PCI
hierarchy, and including the SCSI host, channel, target, and LUN numbers and, optionally, the
partition number. Although these names are preferable to using major and minor numbers or sd
names, caution must be used to ensure that the target numbers do not change in a Fibre Channel
SAN environment (for example, through the use of persistent binding) and that the use of the names
is updated if a host adapter is moved to a different PCI slot. In addition, there is the possibility that the
SCSI host numbers could change if a HBA fails to probe, if drivers are loaded in a different order, or
if a new HBA is installed on the system. An example of by-path listing is:
/dev/disk/by-path/pci-0000:03:00.0-scsi-0:1:0:0
The /dev/disk/by-path/ entries may also include a partition number, such as:
/dev/disk/by-path/pci-0000:03:00.0-scsi-0:1:0:0-part1
It is possible that the device may not be accessible at the time the query is performed because
the udev mechanism may rely on the ability to query the storage device when the udev rules
are processed for a udev event. This is more likely to occur with Fibre Channel, iSCSI or FCoE
storage devices when the device is not located in the server chassis.
The kernel may also send udev events at any time, causing the rules to be processed and
possibly causing the /dev/disk/by-*/ links to be removed if the device is not accessible.
215
Storage Administration Guide
There can be a delay between when the udev event is generated and when it is processed,
such as when a large number of devices are detected and the user-space udevd service takes
some amount of time to process the rules for each one). This could cause a delay between when
the kernel detects the device and when the /dev/disk/by-*/ names are available.
External programs such as blkid invoked by the rules may open the device for a brief period of
time, making the device inaccessible for other uses.
Although udev naming attributes are persistent, in that they do not change on their own across system
reboots, some are also configurable. You can set custom values for the following persistent naming
attributes:
Because the UUID and LABEL attributes are related to the file system, the tool you need to use depends
on the file system on that partition.
To change the UUID or LABEL attributes of an XFS file system, unmount the file system and then
use the xfs_admin utility to change the attribute:
# umount /dev/device
# xfs_admin [-U new_uuid] [-L new_label] /dev/device
# udevadm settle
To change the UUID or LABEL attributes of an ext4, ext3, or ext2 file system, use the tune2fs
utility:
Replace new_uuid with the UUID you want to set; for example, 1cdfbc07-1c90-4984-b5ec-
f61943f5ea50. Replace new_label with a label; for example, backup_data.
NOTE
Changing udev attributes happens in the background and might take a long time. The
udevadm settle command waits until the change is fully registered, which ensures that
your next command will be able to utilize the new attribute correctly.
You should also use the command after creating new devices; for example, after using the
parted tool to create a partition with a custom PARTUUID or PARTLABEL attribute, or after
creating a new file system.
216
CHAPTER 25. ONLINE STORAGE MANAGEMENT
Identifier (WWID)”) and each of the identifiers that represent a path to the device. If you are only
removing a path to a multipath device, and other paths will remain, then the procedure is simpler, as
described in Section 25.10, “Adding a Storage Device or Path”.
Removal of a storage device is not recommended when the system is under memory pressure, since the
I/O flush will add to the load. To determine the level of memory pressure, run the command vmstat 1
100; device removal is not recommended if:
Free memory is less than 5% of the total memory in more than 10 samples per 100 (the
command free can also be used to display the total memory).
1. Close all users of the device and backup device data as needed.
2. Use umount to unmount any file systems that mounted the device.
3. Remove the device from any md and LVM volume using it. If the device is a member of an LVM
Volume group, then it may be necessary to move data off the device using the pvmove
command, then use the vgreduce command to remove the physical volume, and (optionally)
pvremove to remove the LVM metadata from the disk.
4. If the device uses multipathing, run multipath -l and note all the paths to the device.
Afterwards, remove the multipathed device using multipath -f device.
5. Run blockdev --flushbufs device to flush any outstanding I/O to all paths to the device.
This is particularly important for raw devices, where there is no umount or vgreduce operation
to cause an I/O flush.
6. Remove any reference to the device's path-based name, like /dev/sd, /dev/disk/by-path
or the major:minor number, in applications, scripts, or utilities on the system. This is important
in ensuring that different devices added in the future will not be mistaken for the current device.
7. Finally, remove each path to the device from the SCSI subsystem. To do so, use the command
echo 1 > /sys/block/device-name/device/delete where device-name may be sde,
for example.
NOTE
You can determine the device-name, HBA number, HBA channel, SCSI target ID and LUN for a device
from various commands, such as lsscsi, scsi_id, multipath -l, and ls -l /dev/disk/by-*.
217
Storage Administration Guide
After performing Procedure 25.9, “Ensuring a Clean Device Removal”, a device can be physically
removed safely from a running system. It is not necessary to stop I/O to other devices while doing so.
Other procedures, such as the physical removal of the device, followed by a rescan of the SCSI bus (as
described in Section 25.11, “Scanning Storage Interconnects”) to cause the operating system state to be
updated to reflect the change, are not recommended. This will cause delays due to I/O timeouts, and
devices may be removed unexpectedly. If it is necessary to perform a rescan of an interconnect, it must
be done while I/O is paused, as described in Section 25.11, “Scanning Storage Interconnects”.
1. Remove any reference to the device's path-based name, like /dev/sd or /dev/disk/by-
path or the major:minor number, in applications, scripts, or utilities on the system. This is
important in ensuring that different devices added in the future will not be mistaken for the
current device.
This will cause any subsequent I/O sent to the device on this path to be failed immediately.
Device-mapper-multipath will continue to use the remaining paths to the device.
3. Remove the path from the SCSI subsystem. To do so, use the command echo 1 >
/sys/block/device-name/device/delete where device-name may be sde, for
example (as described in Procedure 25.9, “Ensuring a Clean Device Removal”).
After performing Procedure 25.10, “Removing a Path to a Storage Device”, the path can be safely
removed from the running system. It is not necessary to stop I/O while this is done, as device-mapper-
multipath will re-route I/O to remaining paths according to the configured path grouping and failover
policies.
Other procedures, such as the physical removal of the cable, followed by a rescan of the SCSI bus to
cause the operating system state to be updated to reflect the change, are not recommended. This will
cause delays due to I/O timeouts, and devices may be removed unexpectedly. If it is necessary to
perform a rescan of an interconnect, it must be done while I/O is paused, as described in Section 25.11,
“Scanning Storage Interconnects”.
1. The first step in adding a storage device or path is to physically enable access to the new
storage device, or a new path to an existing device. This is done using vendor-specific
commands at the Fibre Channel or iSCSI storage server. When doing so, note the LUN value for
the new storage that will be presented to your host. If the storage server is Fibre Channel, also
218
CHAPTER 25. ONLINE STORAGE MANAGEMENT
take note of the World Wide Node Name (WWNN) of the storage server, and determine whether
there is a single WWNN for all ports on the storage server. If this is not the case, note the World
Wide Port Name (WWPN) for each port that will be used to access the new LUN.
2. Next, make the operating system aware of the new storage device, or path to an existing device.
The recommended command to use is:
In the previous command, h is the HBA number, c is the channel on the HBA, t is the SCSI
target ID, and l is the LUN.
NOTE
a. In some Fibre Channel hardware, a newly created LUN on the RAID array may not be visible
to the operating system until a Loop Initialization Protocol (LIP) operation is performed. Refer
to Section 25.11, “Scanning Storage Interconnects” for instructions on how to do this.
IMPORTANT
b. If a new LUN has been added on the RAID array but is still not being configured by the
operating system, confirm the list of LUNs being exported by the array using the sg_luns
command, part of the sg3_utils package. This will issue the SCSI REPORT LUNS command
to the RAID array and return a list of LUNs that are present.
For Fibre Channel storage servers that implement a single WWNN for all ports, you can
determine the correct h,c,and t values (i.e. HBA number, HBA channel, and SCSI target ID) by
searching for the WWNN in sysfs.
/sys/class/fc_transport/target5:0:2/node_name:0x5006016090203181
/sys/class/fc_transport/target5:0:3/node_name:0x5006016090203181
/sys/class/fc_transport/target6:0:2/node_name:0x5006016090203181
/sys/class/fc_transport/target6:0:3/node_name:0x5006016090203181
This indicates there are four Fibre Channel routes to this target (two single-channel HBAs,
each leading to two storage ports). Assuming a LUN value is 56, then the following command
will configure the first path:
219
Storage Administration Guide
For Fibre Channel storage servers that do not implement a single WWNN for all ports, you can
determine the correct HBA number, HBA channel, and SCSI target ID by searching for each of
the WWPNs in sysfs.
Another way to determine the HBA number, HBA channel, and SCSI target ID is to refer to
another device that is already configured on the same path as the new device. This can be done
with various commands, such as lsscsi, scsi_id, multipath -l, and ls -l
/dev/disk/by-*. This information, plus the LUN number of the new device, can be used as
shown above to probe and configure that path to the new device.
3. After adding all the SCSI paths to the device, execute the multipath command, and check to
see that the device has been properly configured. At this point, the device can be added to md,
LVM, mkfs, or mount, for example.
If the steps above are followed, then a device can safely be added to a running system. It is not
necessary to stop I/O to other devices while this is done. Other procedures involving a rescan (or a
reset) of the SCSI bus, which cause the operating system to update its state to reflect the current device
connectivity, are not recommended while storage I/O is in progress.
All I/O on the effected interconnects must be paused and flushed before executing the
procedure, and the results of the scan checked before I/O is resumed.
As with removing a device, interconnect scanning is not recommended when the system is
under memory pressure. To determine the level of memory pressure, run the vmstat 1 100
command. Interconnect scanning is not recommended if free memory is less than 5% of the total
memory in more than 10 samples per 100. Also, interconnect scanning is not recommended if
swapping is active (non-zero si and so columns in the vmstat output). The free command
can also display the total memory.
Note that issue_lip is an asynchronous operation. The command can complete before the entire
scan has completed. You must monitor /var/log/messages to determine when issue_lip
finishes.
220
CHAPTER 25. ONLINE STORAGE MANAGEMENT
The lpfc, qla2xxx, and bnx2fc drivers support issue_lip. For more information about the API
capabilities supported by each driver in Red Hat Enterprise Linux, see Table 25.1, “Fibre Channel
API Capabilities”.
/usr/bin/rescan-scsi-bus.sh
The /usr/bin/rescan-scsi-bus.sh script was introduced in Red Hat Enterprise Linux 5.4. By
default, this script scans all the SCSI buses on the system, and updates the SCSI layer to reflect new
devices on the bus. The script provides additional options to allow device removal, and the issuing of
LIPs. For more information about this script, including known issues, see Section 25.17,
“Adding/Removing a Logical Unit Through rescan-scsi-bus.sh”.
During target discovery, the iscsiadm tool uses the settings in /etc/iscsi/iscsid.conf to create
two types of records:
Before using different settings for discovery, delete the current discovery records (i.e.
/var/lib/iscsi/discovery_type) first. To do this, use the following command: [5]
For details on different types of discovery, refer to the DISCOVERY TYPES section of the iscsiadm(8)
man page.
221
Storage Administration Guide
Alternatively, iscsiadm can also be used to directly change discovery record settings, as in:
Refer to the iscsiadm(8) man page for more information on available setting options and valid
value options for each.
After configuring discovery settings, any subsequent attempts to discover new targets will use the new
settings. Refer to Section 25.14, “Scanning iSCSI Interconnects” for details on how to scan for new
iSCSI targets.
For more information on configuring iSCSI target discovery, refer to the man pages of iscsiadm and
iscsid. The /etc/iscsi/iscsid.conf file also contains examples on proper configuration syntax.
The network subsystem can be configured to determine the path/NIC that iSCSI interfaces should use
for binding. For example, if portals and NICs are set up on different subnets, then it is not necessary to
manually configure iSCSI interfaces for binding.
Before attempting to configure an iSCSI interface for binding, run the following command first:
If ping fails, then you will not be able to bind a session to a NIC. If this is the case, check the network
settings first.
Software iSCSI
This stack allocates an iSCSI host instance (that is, scsi_host) per session, with a single
connection per session. As a result, /sys/class_scsi_host and /proc/scsi will report a
scsi_host for each connection/session you are logged into.
Offload iSCSI
This stack allocates a scsi_host for each PCI device. As such, each port on a host bus adapter will
show up as a different PCI device, with a different scsi_host per HBA port.
222
CHAPTER 25. ONLINE STORAGE MANAGEMENT
To manage both types of initiator implementations, iscsiadm uses the iface structure. With this
structure, an iface configuration must be entered in /var/lib/iscsi/ifaces for each HBA port,
software iSCSI, or network device (ethX) used to bind sessions.
To view available iface configurations, run iscsiadm -m iface. This will display iface information
in the following format:
iface_name
transport_name,hardware_address,ip_address,net_ifacename,initiator_name
Setting Description
iface0 qla4xxx,00:c0:dd:08:63:e8,20.15.0.7,default,iqn.2005-
06.com.redhat:madmax
iface1 qla4xxx,00:c0:dd:08:63:ea,20.15.0.9,default,iqn.2005-
06.com.redhat:madmax
For software iSCSI, each iface configuration must have a unique name (with less than 65 characters).
The iface_name for network devices that support offloading appears in the format
transport_name.hardware_name.
For example, the sample output of iscsiadm -m iface on a system using a Chelsio network card
might appear as:
223
Storage Administration Guide
default tcp,<empty>,<empty>,<empty>,<empty>
iser iser,<empty>,<empty>,<empty>,<empty>
cxgb3i.00:07:43:05:97:07 cxgb3i,00:07:43:05:97:07,<empty>,<empty>,
<empty>
It is also possible to display the settings of a specific iface configuration in a more friendly way. To do
so, use the option -I iface_name. This will display the settings in the following format:
iface.setting = value
Example 25.8. Using iface Settings with a Chelsio Converged Network Adapter
Using the previous example, the iface settings of the same Chelsio converged network adapter (i.e.
iscsiadm -m iface -I cxgb3i.00:07:43:05:97:07) would appear as:
Before
To create an iface configuration for software iSCSI, run the following command:
This will create a new empty iface configuration with a specified iface_name. If an existing iface
configuration already has the same iface_name, then it will be overwritten with a new, empty one.
224
CHAPTER 25. ONLINE STORAGE MANAGEMENT
WARNING
Do not use default or iser as iface names. Both strings are special values
used by iscsiadm for backward compatibility. Any manually-created iface
configurations named default or iser will disable backwards compatibility.
Before using the iface of a network card for iSCSI offload, first set the iface.ipaddress value of the
offload interface to the initiator IP address that the interface should use:
For devices that use the be2iscsi driver, the IP address is configured in the BIOS setup
screen.
For all other devices, to configure the IP address of the iface, use:
For example, to set the iface IP address to 20.15.0.66 when using a card with the iface name
of cxgb3i.00:07:43:05:97:07, use:
This behavior was implemented for compatibility reasons. To override this, use the -I iface_name to
specify which portal to bind to an iface, as in:
By default, the iscsiadm utility will not automatically bind any portals to iface configurations that use
225
Storage Administration Guide
offloading. This is because such iface configurations will not have iface.transport set to tcp. As
such, the iface configurations need to be manually bound to discovered portals.
It is also possible to prevent a portal from binding to any existing iface. To do so, use default as the
iface_name, as in:
To delete bindings for a specific portal (e.g. for Equalogic targets), use:
NOTE
However, if the targets do not send an iSCSI async event, you need to manually scan them using the
iscsiadm utility. Before doing so, however, you need to first retrieve the proper --targetname and
the --portal values. If your device model supports only a single logical unit and portal per target, use
iscsiadm to issue a sendtargets command to the host, as in:
target_IP:port,target_portal_group_tag proper_target_name
10.15.84.19:3260,2 iqn.1992-08.com.netapp:sn.33615311
226
CHAPTER 25. ONLINE STORAGE MANAGEMENT
10.15.85.19:3260,3 iqn.1992-08.com.netapp:sn.33615311
In this example, the target has two portals, each using target_ip:ports of 10.15.84.19:3260
and 10.15.85.19:3260.
To see which iface configuration will be used for each session, add the -P 1 option. This option will
print also session information in tree format, as in:
Target: proper_target_name
Portal: target_IP:port,target_portal_group_tag
Iface Name: iface_name
Target: iqn.1992-08.com.netapp:sn.33615311
Portal: 10.15.84.19:3260,2
Iface Name: iface2
Portal: 10.15.85.19:3260,3
Iface Name: iface2
This means that the target iqn.1992-08.com.netapp:sn.33615311 will use iface2 as its
iface configuration.
With some device models a single target may have multiple logical units and portals. In this case, issue a
sendtargets command to the host first to find new portals on the target. Then, rescan the existing
sessions using:
You can also rescan a specific session by specifying the session's SID value, as in:
If your device supports multiple targets, you will need to issue a sendtargets command to the hosts to
find new portals for each target. Rescan existing sessions to discover new logical units on existing
sessions using the --rescan option.
227
Storage Administration Guide
IMPORTANT
To safely add new targets/portals or delete old ones, use the -o new or -o delete
options, respectively. For example, to add new targets/portals without overwriting
/var/lib/iscsi/nodes, use the following command:
To delete /var/lib/iscsi/nodes entries that the target did not display during
discovery, use:
ip:port,target_portal_group_tag proper_target_name
For example, given a device with a single target, logical unit, and portal, with equallogic-iscsi1
as your target_name, the output should appear similar to the following:
10.16.41.155:3260,0 iqn.2001-05.com.equallogic:6-8a0900-ac3fe0101-
63aff113e344a4a2-dl585-03-1
At this point, you now have the proper --targetname and --portal values needed to manually scan
for iSCSI devices. To do so, run the following command:
228
CHAPTER 25. ONLINE STORAGE MANAGEMENT
When this command is executed, the iSCSI init scripts will automatically log into targets where the
node.startup setting is configured as automatic. This is the default value of node.startup for all
targets.
To prevent automatic login to a target, set node.startup to manual. To do this, run the following
command:
Deleting the entire record will also prevent automatic login. To do this, run:
To automatically mount a file system from an iSCSI device on the network, add a partition entry for the
mount in /etc/fstab with the _netdev option. For example, to automatically mount the iSCSI device
sdb to /mount/iscsi during startup, add the following line to /etc/fstab:
NOTE
229
Storage Administration Guide
To resize the online logical unit, start by modifying the logical unit size through the array management
interface of your storage device. This procedure differs with each array; as such, consult your storage
array vendor documentation for more information on this.
NOTE
In order to resize an online file system, the file system must not reside on a partitioned
device.
IMPORTANT
To re-scan Fibre Channel logical units on a system that uses multipathing, execute the
aforementioned command for each sd device (i.e. sd1, sd2, and so on) that represents a
path for the multipathed logical unit. To determine which devices are paths for a multipath
logical unit, use multipath -ll; then, find the entry that matches the logical unit being
resized. It is advisable that you refer to the WWID of each entry to make it easier to find
which one matches the logical unit being resized.
Replace target_name with the name of the target where the device is located.
NOTE
You can also re-scan iSCSI logical units using the following command:
Replace interface with the corresponding interface name of the resized logical unit (for
example, iface0). This command performs two operations:
It scans for new devices in the same way that the command echo "- - -" >
/sys/class/scsi_host/host/scan does (refer to Section 25.14, “Scanning
iSCSI Interconnects”).
It re-scans for new/modified logical units the same way that the command echo
1 > /sys/block/sdX/device/rescan does. Note that this command is the
same one used for re-scanning Fibre Channel logical units.
230
CHAPTER 25. ONLINE STORAGE MANAGEMENT
The multipath_device variable is the corresponding multipath entry of your device in /dev/mapper.
Depending on how multipathing is set up on your system, multipath_device can be either of two
formats:
mpathX, where X is the corresponding entry of your device (for example, mpath0)
To determine which multipath entry corresponds to your resized logical unit, run multipath -ll. This
displays a list of all existing multipath entries in the system, along with the major and minor numbers of
their corresponding devices.
IMPORTANT
For more information about multipathing, refer to the Red Hat Enterprise Linux 7 DM Multipath guide.
Run the following command, replacing XYZ with the desired device designator, to determine the
operating system's current view of the R/W state of a device:
The following command is also available for Red Hat Enterprise Linux 7:
When using multipath, refer to the ro or rw field in the second line of output from the multipath -ll
command. For example:
231
Storage Administration Guide
To move the device from R/W to RO, ensure no further writes will be issued. Do this by stopping
the application, or through the use of an appropriate, application-specific action.
Ensure that all outstanding write I/Os are complete with the following command:
Replace device with the desired designator; for a device mapper multipath, this is the entry for
your device in dev/mapper. For example, /dev/mapper/mpath3.
2. Use the management interface of the storage device to change the state of the logical unit from
R/W to RO, or from RO to R/W. The procedure for this differs with each array. Consult
applicable storage array vendor documentation for more information.
3. Perform a re-scan of the device to update the operating system's view of the R/W state of the
device. If using a device mapper multipath, perform this re-scan for each path to the device
before issuing the command telling multipath to reload its device maps.
This process is explained in further detail in Section 25.16.4.1, “Rescanning Logical Units” .
After modifying the online logical unit Read/Write state, as described in Section 25.16.4, “Changing the
Read/Write State of an Online Logical Unit”, re-scan the logical unit to ensure the system detects the
updated state with the following command:
To re-scan logical units on a system that uses multipathing, execute the above command for each sd
device that represents a path for the multipathed logical unit. For example, run the command on sd1, sd2
and all other sd devices. To determine which devices are paths for a multipath unit, use multipath -
11, then find the entry that matches the logical unit to be changed.
For example, the multipath -11 above shows the path for the LUN with WWID
36001438005deb4710000500000640000. In this case, enter:
232
CHAPTER 25. ONLINE STORAGE MANAGEMENT
If multipathing is enabled, after rescanning the logical unit, the change in its state will need to be reflected
in the logical unit's corresponding multipath drive. Do this by reloading the multipath device maps with
the following command:
# multipath -r
The multipath -11 command can then be used to confirm the change.
25.16.4.3. Documentation
Further information can be found in the Red Hat Knowledgebase. To access this, navigate to
https://www.redhat.com/wapps/sso/login.html?redirect=https://access.redhat.com/knowledge/ and log in.
Then access the article at https://access.redhat.com/kb/docs/DOC-32850.
In order for rescan-scsi-bus.sh to work properly, LUN0 must be the first mapped logical
unit. The rescan-scsi-bus.sh can only detect the first mapped logical unit if it is LUN0. The
rescan-scsi-bus.sh will not be able to scan any other logical unit unless it detects the first
mapped logical unit even if you use the --nooptscan option.
A race condition requires that rescan-scsi-bus.sh be run twice if logical units are mapped
for the first time. During the first scan, rescan-scsi-bus.sh only adds LUN0; all other logical
units are added in the second scan.
A bug in the rescan-scsi-bus.sh script incorrectly executes the functionality for recognizing
a change in logical unit size when the --remove option is used.
The rescan-scsi-bus.sh script does not recognize ISCSI logical unit removals.
233
Storage Administration Guide
If a driver implements the Transport dev_loss_tmo callback, access attempts to a device through a link
will be blocked when a transport problem is detected. To verify if a device is blocked, run the following
command:
$ cat /sys/block/device/device/state
This command will return blocked if the device is blocked. If the device is operating normally, this
command will return running.
$ cat
/sys/class/fc_remote_port/rport-H:B:R/port_state
2. This command will return Blocked when the remote port (along with devices accessed through
it) are blocked. If the remote port is operating normally, the command will return Online.
3. If the problem is not resolved within dev_loss_tmo seconds, the rport and devices will be
unblocked and all I/O running on that device (along with any new I/O sent to that device) will be
failed.
To change the dev_loss_tmo value, echo in the desired value to the file. For example, to set
dev_loss_tmo to 30 seconds, run:
$ echo 30 >
/sys/class/fc_remote_port/rport-H:B:R/dev_loss_tmo
For more information about dev_loss_tmo, refer to Section 25.3.1, “Fibre Channel API”.
When a link loss exceeds dev_loss_tmo, the scsi_device and sdN devices are removed. Typically,
the Fibre Channel class will leave the device as is; i.e. /dev/sdx will remain /dev/sdx. This is
because the target binding is saved by the Fibre Channel driver so when the target port returns, the
SCSI addresses are recreated faithfully. However, this cannot be guaranteed; the sdx will be restored
only if no additional change on in-storage box configuration of LUNs is made.
This ensures that I/O errors are retried and queued if all paths are failed in the dm-multipath layer.
You may need to adjust iSCSI timers further to better monitor your SAN for problems. Available iSCSI
timers you can configure are NOP-Out Interval/Timeouts and replacement_timeout, which are
discussed in the following sections.
234
CHAPTER 25. ONLINE STORAGE MANAGEMENT
To help monitor problems the SAN, the iSCSI layer sends a NOP-Out request to each target. If a NOP-
Out request times out, the iSCSI layer responds by failing any running commands and instructing the
SCSI layer to requeue those commands when possible.
When dm-multipath is being used, the SCSI layer will fail those running commands and defer them to
the multipath layer. The multipath layer then retries those commands on another path. If dm-multipath
is not being used, those commands are retried five times before failing altogether.
Intervals between NOP-Out requests are 10 seconds by default. To adjust this, open
/etc/iscsi/iscsid.conf and edit the following line:
Once set, the iSCSI layer will send a NOP-Out request to each target every [interval value] seconds.
This sets the iSCSI layer to timeout a NOP-Out request after [timeout value] seconds.
If the SCSI Error Handler is running, running commands on a path will not be failed immediately when a
NOP-Out request times out on that path. Instead, those commands will be failed after
replacement_timeout seconds. For more information about replacement_timeout, refer to
Section 25.18.2.2, “replacement_timeout”.
# iscsiadm -m session -P 3
25.18.2.2. replacement_timeout
replacement_timeout controls how long the iSCSI layer should wait for a timed-out path/session to
reestablish itself before failing any commands on it. The default replacement_timeout value is 120
seconds.
node.session.timeo.replacement_timeout = [replacement_timeout]
By configuring a lower replacement_timeout, I/O is quickly sent to a new path and executed (in the
event of a NOP-Out timeout) while the iSCSI layer attempts to re-establish the failed path/session. If all
paths time out, then the multipath and device mapper layer will internally queue I/O based on the settings
235
Storage Administration Guide
IMPORTANT
Whether your considerations are failover speed or security, the recommended value for
replacement_timeout will depend on other factors. These factors include the network,
target, and system workload. As such, it is recommended that you thoroughly test any
new configurations to replacements_timeout before applying it to a mission-critical
system.
To start with, NOP-Outs should be disabled. You can do this by setting both NOP-Out interval and
timeout to zero. To set this, open /etc/iscsi/iscsid.conf and edit as follows:
node.conn[0].timeo.noop_out_interval = 0
node.conn[0].timeo.noop_out_timeout = 0
In line with this, replacement_timeout should be set to a high number. This will instruct the system to
wait a long time for a path/session to reestablish itself. To adjust replacement_timeout, open
/etc/iscsi/iscsid.conf and edit the following line:
node.session.timeo.replacement_timeout = replacement_timeout
After configuring /etc/iscsi/iscsid.conf, you must perform a re-discovery of the affected storage.
This will allow the system to load and use any new values in /etc/iscsi/iscsid.conf. For more
information on how to discover iSCSI devices, refer to Section 25.14, “Scanning iSCSI Interconnects”.
You can also configure timeouts for a specific session and make them non-persistent (instead of using
/etc/iscsi/iscsid.conf). To do so, run the following command (replace the variables accordingly):
IMPORTANT
The configuration described here is recommended for iSCSI sessions involving root
partition access. For iSCSI sessions involving access to other types of storage (namely, in
systems that use dm-multipath), refer to Section 25.18.2, “iSCSI Settings with dm-
multipath”.
236
CHAPTER 25. ONLINE STORAGE MANAGEMENT
The Linux SCSI layer sets a timer on each command. When this timer expires, the SCSI layer will
quiesce the host bus adapter (HBA) and wait for all outstanding commands to either time out or
complete. Afterwards, the SCSI layer will activate the driver's error handler.
When the error handler is triggered, it attempts the following operations in order (until one successfully
executes):
If all of these operations fail, the device will be set to the offline state. When this occurs, all I/O to that
device will be failed, until the problem is corrected and the user sets the device to running.
The process is different, however, if a device uses the Fibre Channel protocol and the rport is blocked.
In such cases, the drivers wait for several seconds for the rport to become online again before
activating the error handler. This prevents devices from becoming offline due to temporary transport
problems.
Device States
To display the state of a device, use:
$ cat /sys/block/device-name/device/state
Command Timer
To control the command timer, modify the /sys/block/device-name/device/timeout file:
Replace value in the command with the timeout value, in seconds, that you want to implement.
237
Storage Administration Guide
1. Determine which mpath link entries in /etc/lvm/cache/.cache are specific to the stale
logical unit. To do this, run the following command:
Using the same example in the previous step, the lines you need to delete are:
/dev/dm-4
/dev/dm-5
/dev/mapper/3600d0230003414f30000203a7bc41a00
/dev/mapper/3600d0230003414f30000203a7bc41a00p1
/dev/mpath/3600d0230003414f30000203a7bc41a00
/dev/mpath/3600d0230003414f30000203a7bc41a00p1
238
CHAPTER 25. ONLINE STORAGE MANAGEMENT
IMPORTANT
In most scenarios, you do not need to enable the eh_deadline parameter. Using the
eh_deadline parameter can be useful in certain specific scenarios, for example if a link
loss occurs between a Fibre Channel switch and a target port, and the Host Bus Adapter
(HBA) does not receive Registered State Change Notifications (RSCNs). In such a case,
I/O requests and error recovery commands all time out rather than encounter an error.
Setting eh_deadline in this environment puts an upper limit on the recovery time, which
enables the failed I/O to be retried on another available path by multipath.
However, if RSCNs are enabled, the HBA does not register the link becoming
unavailable, or both, the eh_deadline functionality provides no additional benefit, as the
I/O and error recovery commands fail immediately, which allows multipath to retry.
The SCSI host object eh_deadline parameter enables you to configure the maximum amount of time
that the SCSI error handling mechanism attempts to perform error recovery before stopping and resetting
the entire HBA.
The value of the eh_deadline is specified in seconds. The default setting is off, which disables the
time limit and allows all of the error recovery to take place. In addition to using sysfs, a default value
can be set for all SCSI HBAs by using the scsi_mod.eh_deadline kernel parameter.
Note that when eh_deadline expires, the HBA is reset, which affects all target paths on that HBA, not
only the failing one. As a consequence, I/O errors can occur if some of the redundant paths are not
available for other reasons. Enable eh_deadline only if you have a fully redundant multipath
configuration on all targets.
[5] The target_IP and port variables refer to the IP address and port combination of a target/portal, respectively. For
more information, refer to Section 25.6.1, “iSCSI API” and Section 25.14, “Scanning iSCSI Interconnects” .
[6] Refer to Section 25.14, “Scanning iSCSI Interconnects” for information on proper_target_name .
[7] For information on how to retrieve a session's SID value, refer to Section 25.6.1, “iSCSI API”.
[8] This is a single command split into multiple lines, to accommodate printed and PDF versions of this document.
All concatenated lines — preceded by the backslash (\) — should be treated as one command, sans backslashes.
[9] Prior to Red Hat Enterprise Linux 5.4, the default NOP-Out requests time out was 15 seconds.
239
Storage Administration Guide
Fibre Channel
iSCSI
NFS
GFS2
Virtualization in Red Hat Enterprise Linux 7 uses libvirt to manage virtual instances. The libvirt
utility uses the concept of storage pools to manage storage for virtualized guests. A storage pool is
storage that can be divided up into smaller volumes or allocated directly to a guest. Volumes of a storage
pool can be allocated to virtualized guests. There are two categories of storage pools available:
IMPORTANT
26.2. DM-MULTIPATH
Device Mapper Multipathing (DM-Multipath) is a feature that allows you to configure multiple I/O paths
between server nodes and storage arrays into a single device. These I/O paths are physical SAN
connections that can include separate cables, switches, and controllers. Multipathing aggregates the I/O
paths, creating a new device that consists of the aggregated paths.
Redundancy
DM-Multipath can provide failover in an active/passive configuration. In an active/passive
configuration, only half the paths are used at any time for I/O. If any element of an I/O path (the cable,
switch, or controller) fails, DM-Multipath switches to an alternate path.
240
CHAPTER 26. DEVICE MAPPER MULTIPATHING AND VIRTUAL STORAGE
Improved Performance
DM-Multipath can be configured in active/active mode, where I/O is spread over the paths in a round-
robin fashion. In some configurations, DM-Multipath can detect loading on the I/O paths and
dynamically re-balance the load.
IMPORTANT
241
Storage Administration Guide
This library is used as a building block for other higher level management tools and applications. End
system administrators can also use it as a tool to manually manage storage and automate storage
management tasks with the use of scripts.
Create and delete volumes, access groups, file systems, or NFS exports.
Server resources such as CPU and interconnect bandwidth are not utilized because the operations are
all done on the array.
A stable C and Python API for client application and plug-in developers.
242
CHAPTER 27. EXTERNAL ARRAY MANAGEMENT (LIBSTORAGEMGMT)
WARNING
This library and its associated tool have the ability to destroy any and all data
located on the arrays it manages. It is highly recommended to develop and test
applications and scripts against the storage simulator plug-in to remove any logic
errors before working with production systems. Testing applications and scripts on
actual non-production hardware before deploying to production is also strongly
encouraged if possible.
The libStorageMgmt library in Red Hat Enterprise Linux 7 adds a default udev rule to handle the
REPORTED LUNS DATA HAS CHANGED unit attention.
When a storage configuration change has taken place, one of several Unit Attention ASC/ASCQ codes
reports the change. A uevent is then generated and is rescanned automatically with sysfs.
The libStorageMgmt library uses a plug-in architecture to accommodate differences in storage arrays.
For more information on libStorageMgmt plug-ins and how to write them, refer to the Red Hat
Developer Guide.
Storage array
Any storage system that provides block access (FC, FCoE, iSCSI) or file access through Network
Attached Storage (NAS).
Volume
Storage Area Network (SAN) Storage Arrays can expose a volume to the Host Bus Adapter (HBA)
over different transports, such as FC, iSCSI, or FCoE. The host OS treats it as block devices. One
volume can be exposed to many disks if multipath[2] is enabled).
This is also known as the Logical Unit Number (LUN), StorageVolume with SNIA terminology, or
virtual disk.
Pool
A group of storage spaces. File systems or volumes can be created from a pool. Pools can be
created from disks, volumes, and other pools. A pool may also hold RAID settings or thin provisioning
settings.
Snapshot
A point in time, read only, space efficient copy of data.
243
Storage Administration Guide
Clone
A point in time, read writeable, space efficient copy of data.
Copy
A full bitwise copy of the data. It occupies the full space.
Mirror
A continuously updated copy (synchronous and asynchronous).
Access group
Collections of iSCSI, FC, and FCoE initiators which are granted access to one or more storage
volumes. This ensures that only storage volumes are accessibly by the specified initiators.
Access Grant
Exposing a volume to a specified access group or initiator. The libStorageMgmt library currently
does not support LUN mapping with the ability to choose a specific logical unit number. The
libStorageMgmt library allows the storage array to select the next available LUN for assignment. If
configuring a boot from SAN or masking more than 256 volumes be sure to read the OS, Storage
Array, or HBA documents.
System
Represents a storage array or a direct attached storage RAID.
File system
A Network Attached Storage (NAS) storage array can expose a file system to host an OS through an
IP network, using either NFS or CIFS protocol. The host OS treats it as a mount point or a folder
containing files depending on the client operating system.
Disk
The physical disk holding the data. This is normally used when creating a pool with RAID settings.
Initiator
In Fibre Channel (FC) or Fibre Channel over Ethernet (FCoE), the intiator is the World Wide Port
Name (WWPN) or World Wide Node Name (WWNN). In iSCSI, the initiator is the iSCSI Qualified
Name (IQN). In NFS or CIFS, the initiator is the host name or the IP address of the host.
Child dependency
Some arrays have an implicit relationship between the origin (parent volume or file system) and the
child (such as a snapshot or a clone). For example, it is impossible to delete the parent if it has one
or more depend children. The API provides methods to determine if any such relationship exists and
244
CHAPTER 27. EXTERNAL ARRAY MANAGEMENT (LIBSTORAGEMGMT)
To develop C applications that utilize the library, install the libstoragemgmt-devel package with the
following command:
To install libStorageMgmt for use with hardware arrays, select one or more of the appropriate plug-in
packages with the following command:
libstoragemgmt-smis-plugin
Generic SMI-S array support.
libstoragemgmt-netapp-plugin
Specific support for NetApp files.
libstoragemgmt-nstor-plugin
Specific support for NexentaStor.
libstoragemgmt-targetd-plugin
Specific support for targetd.
The daemon is then installed and configured to run at start up but will not do so until the next reboot. To
use it immediately without rebooting, start the daemon manually.
To manage an array requires support through a plug-in. The base install package includes open source
plug-ins for a number of different vendors. Additional plug-in packages will be available separately as
array support improves. Currently supported hardware is constantly changing and improving.
The libStorageMgmt daemon (lsmd) behaves like any standard service for the system.
245
Storage Administration Guide
A Uniform Resource Identifier (URI) which is used to identify the plug-in to connect to the array
and any configurable options the array requires.
plugin+optional-transport://user-name@host:port/?query-string-parameters
$ lsmcli -u sim://...
3. Place the URI in the file ~/.lsmcli, which contains name-value pairs separated by "=". The
only currently supported configuration is 'uri'.
Determining which URI to use needs to be done in this order. If all three are supplied, only the first one
on the command line will be used.
Supply the password by specifying the -P option on the command line or by placing it in an
environmental variable LSMCLI_PASSWORD.
246
CHAPTER 27. EXTERNAL ARRAY MANAGEMENT (LIBSTORAGEMGMT)
An example for using the command line to create a new volume and making it visible to an initiator.
Create a volume.
247
Storage Administration Guide
---------------------------------+------------+---------------------
-------------+-----------
782d00c8ac63819d6cca7069282e03a0 | example_ag | iqn.1994-
05.com.domain:01.89bd01 | sim-01
The design of the library provides for a process separation between the client and the plug-in by means
of inter-process communication (IPC). This prevents bugs in the plug-in from crashing the client
application. It also provides a means for plug-in writers to write plug-ins with a license of their own
choosing. When a client opens the library passing a URI, the client library looks at the URI to determine
which plug-in should be used.
The plug-ins are technically stand alone applications but they are designed to have a file descriptor
passed to them on the command line. The client library then opens the appropriate Unix domain socket
which causes the daemon to fork and execute the plug-in. This gives the client library a point to point
communcation channel with the plug-in. The daemon can be restarted without affecting existing clients.
While the client has the library open for that plug-in, the plug-in process is running. After one or more
commands are sent and the plug-in is closed, the plug-in process cleans up and then exits.
The default behavior of lsmcli is to wait until the operation is completee. Depending on the requested
operations, this could potentially could take many hours. To allow a return to normal usage, it is possible
to use the -b option on the command line. If the exit code is 0 the command is completed. If the exit
code is 7 the command is in progress and a job identifier is written to standard output. The user or script
can then take the job ID and query the status of the command as needed by using lsmcli --
jobstatus JobID. If the job is now completed, the exit value will be 0 and the results printed to
standard output. If the command is still in progress, the return value will be 7 and the percentage
complete will be printed to the standard output.
Create a volume passing the -b option so that the command returns immediately.
Check to see what the exit value was, remembering that 7 indicates the job is still in progress.
$ echo $?
7
Check to see what the exit value was, remembering that 7 indicates the job is still in progress so the
standard output is the percentage done or 33% based on the above screen.
$ echo $?
248
CHAPTER 27. EXTERNAL ARRAY MANAGEMENT (LIBSTORAGEMGMT)
Wait some more and check it again, remembering that exit 0 means success and standard out
displays the new volume.
For scripting, pass the -t SeparatorCharacters option. This will make it easier to parse the output.
249
Storage Administration Guide
For more information on lsmcli, refer to the man pages or the command lsmcli --help.
250
CHAPTER 28. PERSISTENT MEMORY: NVDIMMS
Persistent memory is byte-addressable, so it can be accessed by using CPU load and store
instructions. In addition to read() or write() system calls that are required for accessing
traditional block-based storage, pmem also supports direct load and store programming model.
The performance characteristics of persistent memory are similar to DRAM with very low access
latency, typically in the tens to hundreds of nanoseconds.
Contents of persistent memory are preserved when the power is off, like with storage.
Persistent memory allows an application to keep the warm cache across reboots if the application is
designed properly. In this instance, there would be no page cache involved: the application would
cache data directly in the persistent memory.
Fast write-cache
File servers often do not acknowledge a client's write request until the data is on durable media. Using
persistent memory as a fast write cache enables a file server to acknowledge the write request
quickly thanks to the low latency of pmem.
NVDIMMs Interleaving
Non-Volatile Dual In-line Memory Modules (NVDIMMs) can be grouped into interleave sets in the same
way as regular DRAM. An interleave set is like a RAID 0 (stripe) across multiple DIMMs.
Like DRAM, NVDIMMs benefit from increased performance when they are configured into
interleave sets.
It can be used to combine multiple smaller NVDIMMs into one larger logical device.
If your NVDIMMs support labels, the region device can be further subdivided into namespaces.
If your NVDIMMs do not support labels, the region devices can only contain a single namespace.
In this case, the kernel creates a default namespace which covers the entire region.
251
Storage Administration Guide
You can use persistent memory in sector, memory, dax (Direct Access) or raw mode:
sector mode
It presents the storage as a fast block device. Using sector mode is useful for legacy applications that
have not been modified to use persistent memory, or for applications that make use of the full I/O
stack, including the Device Mapper.
memory mode
It enables persistent memory devices to support direct access programming as described in the
Storage Networking Industry Association (SNIA) Non-Volatile Memory (NVM) Programming Model
specification. In memory mode, I/O bypasses the storage stack of the kernel, and many Device
Mapper drivers therefore cannot be used.
dax mode
The dax mode,also called device DAX, provides raw access to persistent memory by using a DAX
character device node. Data on a DAX device can be made durable using CPU cache flushing and
fencing instructions. Certain databases and virtual machine hypervisors might benefit from DAX
mode. File systems cannot be created on device dax instances.
raw mode
The raw mode namespaces have several limitations and should not be used.
Procedure 28.1. Configuring Persistent Memory for device that does not support labels
1. List the available pmem regions on your system. In the following example, the command lists an
NVDIMM-N device that does not support labels:
252
CHAPTER 28. PERSISTENT MEMORY: NVDIMMS
OS creates a default namespace for each region because the NVDIMM-N device here does not
support labels. Hence, the available size is 0 bytes.
3. Reconfigure the inactive namespaces in order to make use of this space. For example, to use
namespace0.0 for a file system that supports DAX, use the following command:
Procedure 28.2. Configuring Persistent Memory for device that support labels
1. List the available pmem regions on your system. In the following example, the command lists an
NVDIMM-N device that support labels:
253
Storage Administration Guide
"type":"pmem",
"iset_id":-137289417188962304
}
]
2. If an NVDIMM support labels, default namespaces are not created, and you can allocate one or
more namespaces from a region without using the --force or --reconfigure flags:
Now, you can create another namespace from the same region:
You can also create namespaces of different types from the same region, using the following
command:
254
CHAPTER 28. PERSISTENT MEMORY: NVDIMMS
In the example, namespace1.0 is reconfigured to sector mode. Note that the block device name
changed from pmem1 to pmem1s. This device can be used in the same way as any other block device on
the system. For example, the device can be partitioned, you can create a file system on the device, the
device can be configured as part of a software RAID set, and the device can be the cache device for dm-
cache.
In the example, namespace0.0 is converted to namespace memory mode. With the --map=mem
argument, ndctl puts operating system data structures used for Direct Memory Access (DMA) in system
DRAM.
To perform DMA, the kernel requires a data structure for each page in the memory region. The overhead
of this data structure is 64 bytes per 4-KiB page. For small devices, the amount of overhead is small
enough to fit in DRAM with no problems. For example, the 16-GiB namespace only requires 256MiB for
page structures. Because the NVDIMM is small and expensive, storing the kernel’s page tracking data
structures in DRAM is preferable, as indicated by the --map=mem parameter.
255
Storage Administration Guide
In the future, NVDIMM devices might be terabytes in size. For such devices, the amount of memory
required to store the page tracking data structures might exceed the amount of DRAM in the system. One
TiB of persistent memory requires 16 GiB just for page structures. As a result, specifying the --map=dev
parameter to store the data structures in the persistent memory itself is preferable in such cases.
After configuring the namespace in memory mode, the namespace is ready for a file system. Starting
with Red Hat Enterprise Linux 7.3, both the Ext4 and XFS file system enable using persistent memory as
a Technology Preview. File system creation requires no special arguments. To get the DAX functionality,
mount the file system with the dax mount option. For example:
Then, applications can use persistent memory and create files in the /mnt/pmem/ directory, open the
files, and use the mmap operation to map the files for direct access.
When creating partitions on a pmem device to be used for direct access, partitions must be aligned on
page boundaries. On the Intel 64 and AMD64 architecture, at least 4KiB alignment for the start and end
of the partition, but 2MiB is the preferred alignment. By default, the parted tool aligns partitions on 1MiB
boundaries. For the first partition, specify 2MiB as the start of the partition. If the size of the partition is a
multiple of 2MiB, all other partitions are also aligned.
The given command ensures that the operating system would fault in 2MiB pages at a time. For the Intel
64 and AMD64 architecture, the following fault granularities are supported:
4KiB
2MiB
1GiB
Device DAX nodes (/dev/daxN.M) only supports the following system call:
open()
close()
mmap()
fallocate()
read() and write() variants are not supported because the use case is tied to persistent memory
programming.
256
CHAPTER 28. PERSISTENT MEMORY: NVDIMMS
28.5. TROUBLESHOOTING
Some NVDIMMs support Self-Monitoring, Analysis and Reporting Technology (S.M.A.R.T.) interfaces for
retrieving health information.
NOTE
On some systems, the acpi_ipmi driver must be loaded to retrieve health information
using the following command:
# modprobe acpi_ipmi
257
Storage Administration Guide
258
CHAPTER 29. VDO INTEGRATION
Instead of writing the same data more than once, VDO detects each duplicate block and records
it as a reference to the original block. VDO maintains a mapping from logical block addresses,
which are used by the storage layer above VDO, to physical block addresses, which are used
by the storage layer under VDO.
After deduplication, multiple logical block addresses may be mapped to the same physical block
address; these are called shared blocks. Block sharing is invisible to users of the storage, who
read and write blocks as they would if VDO were not present. When a shared block is
overwritten, a new physical block is allocated for storing the new block data to ensure that other
logical block addresses that are mapped to the shared physical block are not modified.
Compression is a data-reduction technique that works well with file formats that do not
necessarily exhibit block-level redundancy, such as log files and databases. See Section 29.4.8,
“Using Compression” for more detail.
kvdo
A kernel module that loads into the Linux Device Mapper layer to provide a deduplicated,
compressed, and thinly provisioned block storage volume
uds
A kernel module that communicates with the Universal Deduplication Service (UDS) index on the
volume and analyzes data for duplicates.
The UDS index provides the foundation of the VDO product. For each new piece of data, it quickly
determines if that piece is identical to any previously stored piece of data. If the index finds match, the
storage system can then internally reference the existing item to avoid storing the same information more
than once.
The UDS index runs inside the kernel as the uds kernel module.
The kvdo Linux kernel module provides block-layer deduplication services within the Linux Device
Mapper layer. In the Linux kernel, Device Mapper serves as a generic framework for managing pools of
block storage, allowing the insertion of block-processing modules into the storage stack between the
259
Storage Administration Guide
The kvdo module is exposed as a block device that can be accessed directly for block storage or
presented through one of the many available Linux file systems, such as XFS or ext4. When kvdo
receives a request to read a (logical) block of data from a VDO volume, it maps the requested logical
block to the underlying physical block and then reads and returns the requested data.
When kvdo receives a request to write a block of data to a VDO volume, it first checks whether it is a
DISCARD or TRIM request or whether the data is uniformly zero. If either of these conditions holds, kvdo
updates its block map and acknowledges the request. Otherwise, a physical block is allocated for use by
the request.
1. It temporarily writes the data in the request to the allocated block and then acknowledges the
request.
3. If the VDO index contains an entry for a block with the same signature, kvdo reads the indicated
block and does a byte-by-byte comparison of the two blocks to verify that they are identical.
4. If they are indeed identical, then kvdo updates its block map so that the logical block points to
the corresponding physical block and releases the allocated physical block.
5. If the VDO index did not contain an entry for the signature of the block being written, or the
indicated block does not actually contain the same data, kvdo updates its block map to make the
temporary physical block permanent.
2. It will then attempt to deduplicate the block in same manner as described above.
3. If the block turns out to be a duplicate, kvdo will update its block map and release the allocated
block. Otherwise, it will write the data in the request to the allocated block and update the block
map to make the physical block permanent.
260
CHAPTER 29. VDO INTEGRATION
Slabs
The physical storage of the VDO volume is divided into a number of slabs, each of which is a contiguous
region of the physical space. All of the slabs for a given volume will be of the same size, which may be
any power of 2 multiple of 128 MB up to 32 GB.
The default slab size is 2 GB in order to facilitate evaluating VDO on smaller test systems. A single VDO
volume may have up to 8096 slabs. Therefore, in the default configuration with 2 GB slabs, the
maximum allowed physical storage is 16 TB. When using 32 GB slabs, the maximum allowed physical
storage is 256 TB.
For a recommendation on what slab size to choose depending on your physical volume size, see
Table 29.1, “Recommended VDO Slab Sizes by Physical Volume Size”.
At least one entire slab will be reserved by VDO for metadata, and therefore cannot be used for storing
user data.
The size of a slab can be controlled by providing the --vdoSlabSize=megabytes option to the vdo
create command.
Slab Size 1 GB 2 GB 32 GB 32 GB 32 GB 32 GB
Both physical size and available physical size describe the amount of disk space on the block device
that VDO can utilize:
Physical size is the same size as the underlying block device. VDO uses this storage for:
Available physical size is the portion of the physical size that VDO is able to use for user data.
It is equivalent to the physical size minus the size of the metadata, minus the remainder after
dividing the volume into slabs by the given slab size.
261
Storage Administration Guide
For examples of how much storage VDO metadata require on block devices of different sizes, see
Section 29.2.3, “Examples of VDO System Requirements by Physical Volume Size”.
Logical Size
If the --vdoLogicalSize option is not specified, the logical volume size defaults to the available
physical volume size. Note that, in Figure 29.1, “VDO Disk Organization”, the VDO deduplicated storage
target sits completely on top of the block device, meaning the physical size of the VDO volume is the
same size as the underlying block device.
VDO currently supports any logical size up to 254 times the size of the physical volume with an absolute
maximum logical size of 4PB.
vdo
Creates, configures, and controls VDO volumes
vdostats
Provides utilization and performance statistics
RAM
Each VDO volume has two distinct memory requirements:
The VDO module requires 370 MB plus an additional 268 MB per each 1 TB of physical storage
managed.
The Universal Deduplication Service (UDS) index requires a minimum of 250 MB of DRAM,
which is also the default amount that deduplication uses. For details on the memory usage of
UDS, see Section 29.2.1, “UDS Index Memory Requirements”.
Storage
A single VDO volume can be configured to use up to 256 TB of physical storage. See Section 29.2.2,
“VDO Storage Requirements” for the calculations to determine the usable size of a VDO-managed
volume from the physical size of the storage pool the VDO is given.
LVM
Python 2.7
The yum package manager will install all necessary software dependencies automatically.
262
CHAPTER 29. VDO INTEGRATION
On top of VDO: LVM cache, LVM Logical Volumes, LVM snapshots, and LVM Thin Provisioning.
IMPORTANT
VDO supports two write modes: sync and async. When VDO is in sync mode, writes to
the VDO device are acknowledged when the underlying storage has written the data
permanently. When VDO is in async mode, writes are acknowledged before being
written to persistent storage.
It is critical to set the VDO write policy to match the behavior of the underlying storage. By
default, VDO write policy is set to the auto option, which selects the appropriate policy
automatically.
For more information, see Section 29.4.2, “Selecting VDO Write Modes”.
A compact representation is used in memory that contains at most one entry per unique block.
An on-disk component which records the associated block names presented to the index as they
occur, in order.
The on-disk component maintains a bounded history of data passed to UDS. UDS provides deduplication
advice for data that falls within this deduplication window, containing the names of the most recently
seen blocks. The deduplication window allows UDS to index data as efficiently as possible while limiting
the amount of memory required to index large data repositories. Despite the bounded nature of the
deduplication window, most datasets which have high levels of deduplication also exhibit a high degree
of temporal locality — in other words, most deduplication occurs among sets of blocks that were written
at about the same time. Furthermore, in general, data being written is more likely to duplicate data that
263
Storage Administration Guide
was recently written than data that was written a long time ago. Therefore, for a given workload over a
given time interval, deduplication rates will often be the same whether UDS indexes only the most recent
data or all the data.
Because duplicate data tends to exhibit temporal locality, it is rarely necessary to index every block in
the storage system. Were this not so, the cost of index memory would outstrip the savings of reduced
storage costs from deduplication. Index size requirements are more closely related to the rate of data
ingestion. For example, consider a storage system with 100 TB of total capacity but with an ingestion
rate of 1 TB per week. With a deduplication window of 4 TB, UDS can detect most redundancy among
the data written within the last month.
UDS's Sparse Indexing feature (the recommended mode for VDO) further exploits temporal locality by
attempting to retain only the most relevant index entries in memory. UDS can maintain a deduplication
window that is ten times larger while using the same amount of memory. While the sparse index provides
the greatest coverage, the dense index provides more advice. For most workloads, given the same
amount of memory, the difference in deduplication rates between dense and sparse indexes is
negligible.
The memory required for the index is determined by the desired size of the deduplication window:
For a dense index, UDS will provide a deduplication window of 1 TB per 1 GB of RAM. A 1 GB
index is generally sufficient for storage systems of up to 4 TB.
For a sparse index, UDS will provide a deduplication window of 10 TB per 1 GB of RAM. A 1 GB
sparse index is generally sufficient for up to 40 TB of physical storage.
For concrete examples of UDS Index memory requirements, see Section 29.2.3, “Examples of VDO
System Requirements by Physical Volume Size”
The first type scales with the physical size of the VDO volume and uses approximately 1 MB
for each 4 GB of physical storage plus an additional 1 MB per slab.
The second type scales with the logical size of the VDO volume and consumes
approximately 1.25 MB for each 1 GB of logical storage, rounded up to the nearest slab.
The UDS index is stored within the VDO volume group and is managed by the associated VDO
instance. The amount of storage required depends on the type of index and the amount of RAM
allocated to the index. For each 1 GB of RAM, a dense UDS index will use 17 GB of storage,
and a sparse UDS index will use 170 GB of storage.
For concrete examples of VDO storage requirements, see Section 29.2.3, “Examples of VDO System
Requirements by Physical Volume Size”
264
CHAPTER 29. VDO INTEGRATION
In the primary storage case, the UDS index is between 0.01% to 25% the size of the physical volume.
Table 29.2. VDO Storage and Memory Requirements for Primary Storage
Sparse:
250 MB
Sparse: 22 GB
In the backup storage case, the UDS index covers the size of the backup set but is not bigger than the
physical volume. If you expect the backup set or the physical size to grow in the future, factor this into
the index size.
Table 29.3. VDO Storage and Memory Requirements for Backup Storage
29.3.1. Introduction
Virtual Data Optimizer (VDO) provides inline data reduction for Linux in the form of deduplication,
compression, and thin provisioning. When you set up a VDO volume, you specify a block device on
which to construct your VDO volume and the amount of logical storage you plan to present.
When hosting active VMs or containers, Red Hat recommends provisioning storage at a 10:1
logical to physical ratio: that is, if you are utilizing 1 TB of physical storage, you would present it
as 10 TB of logical storage.
265
Storage Administration Guide
For object storage, such as the type provided by Ceph, Red Hat recommends using a 3:1 logical
to physical ratio: that is, 1 TB of physical storage would present as 3 TB logical storage.
In either case, you can simply put a file system on top of the logical device presented by VDO and then
use it directly or as part of a distributed cloud storage architecture.
the direct-attached use case for virtualization servers, such as those built using Red Hat
Virtualization, and
the cloud storage use case for object-based distributed storage clusters, such as those built
using Ceph Storage.
NOTE
This chapter provides examples for configuring VDO for use with a standard Linux file system that can
be easily deployed for either use case; see the diagrams in Section 29.3.5, “Deployment Examples”.
vdo
kmod-kvdo
To install VDO, use the yum package manager to install the RPM packages:
In all the following steps, replace vdo_name with the identifier you want to use for your VDO volume; for
example, vdo1.
NOTE
Before creating volumes, VDO uses LVM utilities such as, pvcreate --test to validate
block device.
# vdo create \
--name=vdo_name \
--device=block_device \
--vdoLogicalSize=logical_size
266
CHAPTER 29. VDO INTEGRATION
Replace block_device with the persistent name of the block device where you want to create
the VDO volume. For example, /dev/disk/by-id/scsi-
3600508b1001c264ad2af21e903ad031f.
IMPORTANT
Use a persistent device name. If you use a non-persistent device name, then
VDO might fail to start properly in the future if the device name changes.
Replace logical_size with the amount of logical storage that the VDO volume should present:
For active VMs or container storage, use logical size that is ten times the physical size
of your block device. For example, if your block device is 1 TB in size, use 10T here.
For object storage, use logical size that is three times the physical size of your block
device. For example, if your block device is 1 TB in size, use 3T here.
For example, to create a VDO volume for container storage on a 1 TB block device, you
might use:
# vdo create \
--name=vdo1 \
--device=/dev/disk/by-id/scsi-
3600508b1001c264ad2af21e903ad031f \
--vdoLogicalSize=10T
When a VDO volume is created, VDO adds an entry to the /etc/vdoconf.yml configuration
file. The vdo.service systemd unit then uses the entry to start the volume by default.
IMPORTANT
If a failure occurs when creating the VDO volume, remove the volume to clean up.
See Section 29.4.3.1, “Removing an Unsuccessfully Created Volume” for details.
# mkfs.xfs -K /dev/mapper/vdo_name
267
Storage Administration Guide
4. To configure the file system to mount automatically, use either the /etc/fstab file or a
systemd mount unit:
If you decide to use the /etc/fstab configuration file, add one of the following lines to the
file:
Alternatively, if you decide to use a systemd unit, create a systemd mount unit file with the
appropriate filename. For the mount point of your VDO volume, create the
/etc/systemd/system/mnt-vdo_name.mount file with the following content:
[Unit]
Description = VDO unit file to mount file system
name = vdo_name.mount
Requires = vdo.service
After = multi-user.target
Conflicts = umount.target
[Mount]
What = /dev/mapper/vdo_name
Where = /mnt/vdo_name
Type = xfs
[Install]
WantedBy = multi-user.target
5. Enable the discard feature for the file system on your VDO device. Both batch and online
operations work with VDO.
For information on how to set up the discard feature, see Section 2.4, “Discard Unused
Blocks”.
268
CHAPTER 29. VDO INTEGRATION
VDO space usage and efficiency can be monitored using the vdostats utility:
# vdostats --human-readable
To see how VDO can be deployed successfully on a KVM server configured with Direct Attached
Storage, see Figure 29.2, “VDO Deployment with KVM”.
For more information on VDO deployment, see Section 29.5, “Deployment Scenarios”.
The VDO systemd unit is installed and enabled by default when the vdo package is installed. This unit
automatically runs the vdo start --all command at system startup to bring up all activated VDO
volumes. See Section 29.4.6, “Automatically Starting VDO Volumes at System Boot” for more
269
Storage Administration Guide
information.
To stop a given VDO volume, or all VDO volumes, and the associated UDS index(es), use one of these
commands:
If restarted after an unclean shutdown, VDO will perform a rebuild to verify the consistency of its
metadata and will repair it if necessary. Rebuilds are automatic and do not require user intervention. See
Section 29.4.5, “Recovering a VDO Volume After an Unclean Shutdown” for more information on the
rebuild process.
In synchronous mode, all writes that were acknowledged by VDO prior to the shutdown will be
rebuilt.
In asynchronous mode, all writes that were acknowledged prior to the last acknowledged flush
request will be rebuilt.
In either mode, some writes that were either unacknowledged or not followed by a flush may also be
rebuilt.
For details on VDO write modes, see Section 29.4.2, “Selecting VDO Write Modes”.
When VDO is in sync mode, the layers above it assume that a write command writes data to
persistent storage. As a result, it is not necessary for the file system or application, for example,
to issue FLUSH or Force Unit Access (FUA) requests to cause the data to become persistent at
critical points.
VDO must be set to sync mode only when the underlying storage guarantees that data is written
to persistent storage when the write command completes. That is, the storage must either have
no volatile write cache, or have a write through cache.
When VDO is in async mode, the data is not guaranteed to be written to persistent storage
when a write command is acknowledged. The file system or application must issue FLUSH or
FUA requests to ensure data persistence at critical points in each transaction.
VDO must be set to async mode if the underlying storage does not guarantee that data is
written to persistent storage when the write command completes; that is, when the storage has a
volatile write back cache.
For information on how to find out if a device uses volatile cache or not, see the section called
“Checking for a Volatile Cache”.
The auto mode automatically selects sync or async based on the characteristics of each
device. This is the default option.
For a more detailed theoretical overview of how write policies operate, see the section called “Overview
of VDO Write Policies”.
270
CHAPTER 29. VDO INTEGRATION
To set a write policy, use the --writePolicy option. This can be specified either when creating a VDO
volume as in Section 29.3.3, “Creating a VDO Volume” or when modifying an existing VDO volume with
the changeWritePolicy subcommand:
IMPORTANT
Using the incorrect write policy might result in data loss on power failure.
$ cat '/sys/block/sda/device/scsi_disk/7:0:0:0/cache_type'
write back
$ cat '/sys/block/sdb/device/scsi_disk/1:2:0:0/cache_type'
None
Additionally, in the kernel boot log, you can find whether the above mentioned devices have a write
cache or not:
See the Viewing and Managing Log Files chapter in the System Administrator's Guide for more
information on reading the system log.
NOTE
You should configure VDO to use the sync write policy if the cache_type value is none
or write through.
271
Storage Administration Guide
Prior to removing a VDO volume, unmount file systems and stop applications that are using the storage.
The vdo remove command removes the VDO volume and its associated UDS index, as well as logical
volumes where they reside.
If a failure occurs when the vdo utility is creating a VDO volume, the volume is left in an intermediate
state. This might happen when, for example, the system crashes, power fails, or the administrator
interrupts a running vdo create command.
To clean up from this situation, remove the unsuccessfully created volume with the --force option:
The --force option is required because the administrator might have caused a conflict by changing the
system configuration since the volume was unsuccessfully created. Without the --force option, the
vdo remove command fails with the following message:
[...]
A previous operation failed.
Recovery from the failure either failed or was interrupted.
Add '--force' to 'remove' to perform the following cleanup.
Steps to clean up VDO my_vdo:
umount -f /dev/mapper/my_vdo
udevadm settle
dmsetup remove my_vdo
vdo: ERROR - VDO volume my_vdo previous operation (create) is incomplete
In general, Red Hat recommends using a sparse UDS index for all production use cases. This is an
extremely efficient indexing data structure, requiring approximately one-tenth of a byte of DRAM per
block in its deduplication window. On disk, it requires approximately 72 bytes of disk space per block.
The minimum configuration of this index uses 256 MB of DRAM and approximately 25 GB of space on
disk. To use this configuration, specify the --sparseIndex=enabled --indexMem=0.25 options to
the vdo create command. This configuration results in a deduplication window of 2.5 TB (meaning it
will remember a history of 2.5 TB). For most use cases, a deduplication window of 2.5 TB is appropriate
for deduplicating storage pools that are up to 10 TB in size.
The default configuration of the index, however, is to use a dense index. This index is considerably less
efficient (by a factor of 10) in DRAM, but it has much lower (also by a factor of 10) minimum required
disk space, making it more convenient for evaluation in constrained environments.
272
CHAPTER 29. VDO INTEGRATION
In general, a deduplication window which is one quarter of the physical size of a VDO volume is a
recommended configuration. However, this is not an actual requirement. Even small deduplication
windows (compared to the amount of physical storage) can find significant amounts of duplicate data in
many use cases. Larger windows may also be used, but it in most cases, there will be little additional
benefit to doing so.
Speak with your Red Hat Technical Account Manager representative for additional guidelines on tuning
this important system parameter.
If VDO was running on synchronous storage and write policy was set to sync, then all data
written to the volume will be fully recovered.
If the write policy was async, then some writes may not be recovered if they were not made
durable by sending VDO a FLUSH command, or a write I/O tagged with the FUA flag (force unit
access). This is accomplished from user mode by invoking a data integrity operation like fsync,
fdatasync, sync, or umount.
In the majority of cases, most of the work of rebuilding an unclean VDO volume can be done after the
VDO volume has come back online and while it is servicing read and write requests. Initially, the amount
of space available for write requests may be limited. As more of the volume's metadata is recovered,
more free space may become available. Furthermore, data written while the VDO is recovering may fail
to deduplicate against data written before the crash if that data is in a portion of the volume which has not
yet been recovered. Data may be compressed while the volume is being recovered. Previously
compressed blocks may still be read or overwritten.
During an online recovery, a number of statistics will be unavailable: for example, blocks in use and
blocks free. These statistics will become available once the rebuild is complete.
VDO can recover from most hardware and software errors. If a VDO volume cannot be recovered
successfully, it is placed in a read-only mode that persists across volume restarts. Once a volume is in
read-only mode, there is no guarantee that data has not been lost or corrupted. In such cases, Red Hat
recommends copying the data out of the read-only volume and possibly restoring the volume from
backup. (The operating mode attribute of vdostats indicates whether a VDO volume is in read-only
mode.)
If the risk of data corruption is acceptable, it is possible to force an offline rebuild of the VDO volume
metadata so the volume can be brought back online and made available. Again, the integrity of the rebuilt
data cannot be guaranteed.
To force a rebuild of a read-only VDO volume, first stop the volume if it is running:
273
Storage Administration Guide
To prevent certain existing volumes from being started automatically, deactivate those volumes by
running either of these commands:
You can also create a VDO volume that does not start automatically by adding the --
activate=disabled option to the vdo create command.
For systems that place LVM volumes on top of VDO volumes as well as beneath them (for example,
Figure 29.5, “Deduplicated Unified Storage”), it is vital to start services in the right order:
1. The lower layer of LVM must be started first (in most systems, starting this layer is configured
automatically when the LVM2 package is installed).
3. Finally, additional scripts must be run in order to start LVM volumes or other services on top of
the now running VDO volumes.
274
CHAPTER 29. VDO INTEGRATION
This stops the associated UDS index and informs the VDO volume that deduplication is no
longer active.
This restarts the associated UDS index and informs the VDO volume that deduplication is active
again.
You can also disable deduplication when creating a new VDO volume by adding the --
deduplication=disabled option to the vdo create command.
29.4.8.1. Introduction
In addition to block-level deduplication, VDO also provides inline block-level compression using the
HIOPS Compression™ technology. While deduplication is the optimal solution for virtual machine
environments and backup applications, compression works very well with structured and unstructured file
formats that do not typically exhibit block-level redundancy, such as log files and databases.
Compression operates on blocks that have not been identified as duplicates. When unique data is seen
for the first time, it is compressed. Subsequent copies of data that have already been stored are
deduplicated without requiring an additional compression step. The compression feature is based on a
parallelized packaging algorithm that enables it to handle many compression operations at once. After
first storing the block and responding to the requestor, a best-fit packing algorithm finds multiple blocks
that, when compressed, can fit into a single physical block. After it is determined that a particular
physical block is unlikely to hold additional compressed blocks, it is written to storage and the
uncompressed blocks are freed and reused. By performing the compression and packaging operations
after having already responded to the requestor, using compression imposes a minimal latency penalty.
When creating a volume, you can disable compression by adding the --compression=disabled
option to the vdo create command.
275
Storage Administration Guide
Whenever the number of logical blocks (virtual storage) exceeds the number of physical blocks (actual
storage), it becomes possible for file systems and applications to unexpectedly run out of space. For that
reason, storage systems using VDO must provide storage administrators with a way of monitoring the
size of the VDO's free pool. The size of this free pool may be determined by using the vdostats utility;
see Section 29.7.2, “vdostats” for details. The default output of this utility lists information for all running
VDO volumes in a format similar to the Linux df utility. For example:
If the size of VDO's free pool drops below a certain level, the storage administrator can take action by
deleting data (which will reclaim space whenever the deleted data is not duplicated), adding physical
storage, or even deleting LUNs.
VDO cannot reclaim space unless file systems communicate that blocks are free using DISCARD, TRIM,
or UNMAP commands. For file systems that do not use DISCARD, TRIM, or UNMAP, free space may be
manually reclaimed by storing a file consisting of binary zeros and then deleting that file.
File systems may generally be configured to issue DISCARD requests in one of two ways:
For file systems that support online discard, you can enable it by setting the discard option at mount
time.
Batch discard
Batch discard is a user-initiated operation that causes the file system to notify the block layer (VDO)
of any unused blocks. This is accomplished by sending the file system an ioctl request called
FITRIM.
You can use the fstrim utility (for example from cron) to send this ioctl to the file system.
For more information on the discard feature, see Section 2.4, “Discard Unused Blocks”.
It is also possible to manage free space when the storage is being used as a block storage target without
a file system. For example, a single VDO volume can be carved up into multiple subvolumes by
installing the Logical Volume Manager (LVM) on top of it. Before deprovisioning a volume, the
blkdiscard command can be used in order to free the space previously used by that logical volume.
276
CHAPTER 29. VDO INTEGRATION
LVM supports the REQ_DISCARD command and will forward the requests to VDO at the appropriate
logical block addresses in order to free the space. If other volume managers are being used, they would
also need to support REQ_DISCARD, or equivalently, UNMAP for SCSI devices or TRIM for ATA devices.
VDO volumes (or portions of volumes) can also be provisioned to hosts on a Fibre Channel storage
fabric or an Ethernet network using SCSI target frameworks such as LIO or SCST. SCSI initiators can
use the UNMAP command to free space on thinly provisioned storage targets, but the SCSI target
framework will need to be configured to advertise support for this command. This is typically done by
enabling thin provisioning on these volumes. Support for UNMAP can be verified on Linux-based SCSI
initiators by running the following command:
In the output, verify that the "Maximum unmap LBA count" value is greater than zero.
The use of this command allows storage administrators to initially create VDO volumes which have a
logical size small enough to be safe from running out of space. After some period of time, the actual rate
of data reduction can be evaluated, and if sufficient, the logical size of the VDO volume can be grown to
take advantage of the space savings.
The exact procedure depends on the type of the device. For example, to resize an MBR
partition, use the fdisk utility as described in Section 13.5, “Resizing a Partition with fdisk”.
2. Use the growPhysical option to add the new physical storage space to the VDO volume:
277
Storage Administration Guide
29.5.3. LVM
More feature-rich systems may make further use of LVM to provide multiple LUNs that are all backed by
the same deduplicated storage pool. In Figure 29.5, “Deduplicated Unified Storage”, the VDO target is
registered as a physical volume so that it can be managed by LVM. Multiple logical volumes (LV1 to
LV4) are created out of the deduplicated storage pool. In this way, VDO can support multiprotocol unified
block/file access to the underlying deduplicated storage pool.
278
CHAPTER 29. VDO INTEGRATION
Deduplicated unified storage design allows for multiple file systems to collectively use the same
deduplication domain through the LVM tools. Also, file systems can take advantage of LVM snapshot,
copy-on-write, and shrink or grow features, all on top of VDO.
29.5.4. Encryption
Data security is critical today. More and more companies have internal policies regarding data
encryption. Linux Device Mapper mechanisms such as DM-Crypt are compatible with VDO. Encrypting
VDO volumes will help ensure data security, and any file systems above VDO still gain the deduplication
feature for disk optimization. Note that applying encryption above VDO results in little if any data
deduplication; encryption renders duplicate blocks different before VDO can deduplicate them.
279
Storage Administration Guide
tuning VDO are the number of threads assigned to different types of work, the CPU affinity settings for
those threads, and cache settings.
LBNs are divided into chunks (a block map page contains a bit over 3 MB of LBNs) and these chunks
are grouped into zones that are divided up among the threads.
Processing should be distributed fairly evenly across the threads, though some unlucky access
patterns may occasionally concentrate work in one thread or another. For example, frequent access
to LBNs within a given block map page will cause one of the logical threads to process all of those
operations.
The number of logical zone threads can be controlled using the --vdoLogicalThreads=thread
count option of the vdo command
Like LBNs, PBNs are divided into chunks called slabs, which are further divided into zones and
assigned to worker threads that distribute the processing load.
280
CHAPTER 29. VDO INTEGRATION
If these threads are frequently shown in D state by ps or top utilities, then VDO is frequently keeping
the storage system busy with I/O requests. This is generally good if the storage system can service
multiple requests in parallel, as some SSDs can, or if the request processing is pipelined. If thread
CPU utilization is very low during these periods, it may be possible to reduce the number of I/O
submission threads.
CPU usage and memory contention are dependent on the device driver(s) beneath VDO. If CPU
utilization per I/O request increases as more threads are added then check for CPU, memory, or lock
contention in those device drivers.
The number of I/O submission threads can be controlled using the --vdoBioThreads=thread
count option of the vdo command.
CPU-processing threads
kvdo:cpuQ threads exist to perform any CPU-intensive work such as computing hash values or
compressing data blocks that do not block or require exclusive access to data structures associated
with other thread types.
Deduplication thread
The kvdo:dedupeQ thread takes queued I/O requests and contacts UDS. Since the socket buffer
can fill up if the server cannot process requests quickly enough or if kernel memory is constrained by
other system activity, this work is done by a separate thread so if a thread should block, other VDO
processing can continue. There is also a timeout mechanism in place to skip an I/O request after a
long delay (several seconds).
Journal thread
The kvdo:journalQ thread updates the recovery journal and schedules journal blocks for writing. A
VDO device uses only one journal, so this work cannot be split across threads.
Packer thread
The kvdo:packerQ thread, active in the write path when compression is enabled, collects data
blocks compressed by the kvdo:cpuQ threads to minimize wasted space. There is one packer data
structure, and thus one packer thread, per VDO device.
29.6.3.1. CPU/memory
281
Storage Administration Guide
The logical, physical, cpu, and I/O acknowledgement work can be spread across multiple threads, the
number of which can be specified during initial configuration or later if the VDO device is restarted.
One core, or one thread, can do a finite amount of work during a given time. Having one thread compute
all data-block hash values, for example, would impose a hard limit on the number of data blocks that
could be processed per second. Dividing the work across multiple threads (and cores) relieves that
bottleneck.
As a thread or core approaches 100% usage, more work items will tend to queue up for processing.
While this may result in CPU having fewer idle cycles, queueing delays and latency for individual I/O
requests will typically increase. According to some queueing theory models, utilization levels above 70%
or 80% can lead to excessive delays that can be several times longer than the normal processing time.
Thus it may be helpful to distribute work further for a thread or core with 50% or higher utilization, even if
those threads or cores are not always busy.
In the opposite case, where a thread or CPU is very lightly loaded (and thus very often asleep), supplying
work for it to do is more likely to incur some additional cost. (A thread attempting to wake another thread
must acquire a global lock on the scheduler's data structures, and may potentially send an inter-
processor interrupt to transfer work to another core). As more cores are configured to run VDO threads, it
becomes less likely that a given piece of data will be cached as work is moved between threads or as
threads are moved between cores — so too much work distribution can also degrade performance.
The work performed by the logical, physical, and CPU threads per I/O request will vary based on the
type of workload, so systems should be tested with the different types of workloads they are expected to
service.
Write operations in sync mode involving successful deduplication will entail extra I/O operations (reading
the previously stored data block), some CPU cycles (comparing the new data block to confirm that they
match), and journal updates (remapping the LBN to the previously-stored data block's PBN) compared to
writes of new data. When duplication is detected in async mode, data write operations are avoided at the
cost of the read and compare operations described above; only one journal update can happen per write,
whether or not duplication is detected.
If compression is enabled, reads and writes of compressible data will require more processing by the
CPU threads.
Blocks containing all zero bytes (a zero block) are treated specially, as they commonly occur. A special
entry is used to represent such data in the block map, and the zero block is not written to or read from the
storage device. Thus, tests that write or read all-zero blocks may produce misleading results. The same
is true, to a lesser degree, of tests that write over zero blocks or uninitialized blocks (those that were
never written since the VDO device was created) because reference count updates done by the physical
threads are not required for zero or uninitialized blocks.
Acknowledging I/O operations is the only task that is not significantly affected by the type of work being
done or the data being operated upon, as one callback is issued per I/O operation.
Accessing memory across NUMA node boundaries takes longer than accessing memory on the local
node. With Intel processors sharing the last-level cache between cores on a node, cache contention
between nodes is a much greater problem than cache contention within a node.
Tools such as top can not distinguish between CPU cycles that do work and cycles that are stalled.
These tools interpret cache contention and slow memory accesses as actual work. As a result, moving a
thread between nodes may appear to reduce the thread's apparent CPU utilization while increasing the
282
CHAPTER 29. VDO INTEGRATION
While many of VDO's kernel threads maintain data structures that are accessed by only one thread, they
do frequently exchange messages about the I/O requests themselves. Contention may be high if VDO
threads are run on multiple nodes, or if threads are reassigned from one node to another by the
scheduler. If it is possible to run other VDO-related work (such as I/O submissions to VDO, or interrupt
processing for the storage device) on the same node as the VDO threads, contention may be further
reduced. If one node does not have sufficient cycles to run all VDO-related work, memory contention
should be considered when selecting threads to move onto other nodes.
If practical, collect VDO threads on one node using the taskset utility. If other VDO-related work can
also be run on the same node, that may further reduce contention. In that case, if one node lacks the
CPU power to keep up with processing demands then memory contention must be considered when
choosing threads to move onto other nodes. For example, if a storage device's driver has a significant
number of data structures to maintain, it may help to move both the device's interrupt handling and
VDO's I/O submissions (the bio threads that call the device's driver code) to another node. Keeping I/O
acknowledgment (ack threads) and higher-level I/O submission threads (user-mode threads doing direct
I/O, or the kernel's page cache flush thread) paired is also good practice.
Performance measurements are further complicated by CPUs that dynamically vary their frequencies
based on workload, because the time needed to accomplish a specific piece of work may vary due to
other work the CPU has been doing, even without task switching or cache contention.
29.6.3.2. Caching
VDO caches a number of block map pages for efficiency. The cache size defaults to 128 MB, but it can
be increased with the --blockMapCacheSize=megabytes option of the vdo command. Using a
larger cache may produce significant benefits for random-access workloads.
A second cache may be used for caching data blocks read from the storage system to verify VDO's
deduplication advice. If similar data blocks are seen within a short time span, the number of I/O
operations needed may be reduced.
The read cache also holds storage blocks containing compressed user data. If multiple compressible
blocks were written within a short period of time, their compressed versions may be located within the
same storage system block. Likewise, if they are read within a short time, caching may avoid the need
for additional reads from the storage system.
The vdo command's --readCache={enabled | disabled} option controls whether a read cache is
used. If enabled, the cache has a minimum size of 8 MB, but it can be increased with the --
readCacheSize=megabytes option. Managing the read cache incurs a slight overhead, so it may not
increase performance if the storage system is fast enough. The read cache is disabled by default.
283
Storage Administration Guide
For generic hard drives in a RAID configuration, one or two bio threads may be sufficient for submitting
I/O operations. If the storage device driver requires its I/O submission threads to do significantly more
work (updating driver data structures or communicating with the device) such that one or two threads are
very busy and storage devices are often idle, the bio thread count can be increased to compensate.
However, depending on the driver implementation, raising the thread count too high may lead to cache or
spin lock contention. If device access timing is not uniform across all NUMA nodes, it may be helpful to
run bio threads on the node "closest" to the storage device controllers.
If a device driver does significant work in its interrupt handler and does not use a threaded IRQ handler,
it may prevent the scheduler from providing the best performance. CPU time spent servicing hardware
interrupts may look like normal VDO (or other) kernel thread execution in some ways. For example, if
hardware IRQ handling required 30% of a core's cycles, a busy kernel thread on the same core could
only use the remaining 70%. However, if the work queued up for that thread demanded 80% of the core's
cycles, the thread would never catch up, and the scheduler might simply leave that thread to run
impeded on that core instead of switching that thread to a less busy core.
Using such a device driver under a heavy VDO workload may require a large number of cycles to service
hardware interrupts (the %hi indicator in the header of the top display). In that case it may help to
assign IRQ handling to certain cores and adjust the CPU affinity of VDO kernel threads not to run on
those cores.
The maximum allowed size of DISCARD (TRIM) operations to a VDO device can be tuned via
/sys/kvdo/max_discard_sectors, based on system usage. The default is 8 sectors (that is, one 4
KB block). Larger sizes may be specified, though VDO will still process them in a loop, one block at a
time, ensuring that metadata updates for one discarded block are written to the journal and flushed to
disk before starting on the next block.
When using a VDO volume as a local file system, Red Hat testing found that a small discard size works
best, as the generic block-device code in the Linux kernel will break large discard requests into multiple
smaller ones and submit them in parallel. If there is low I/O activity on the device, VDO can process
many smaller requests concurrently and much more quickly than one large request.
If the VDO device is to be used as a SCSI target, the initiator and target software introduce additional
factors to consider. If the target SCSI software is SCST, it reads the maximum discard size and relays it
to the initiator. (Red Hat has not attempted to tune VDO configurations in conjunction with LIO SCSI
target code.)
Because the Linux SCSI initiator code allows only one discard operation at a time, discard requests that
exceed the maximum size would be broken into multiple smaller discards and sent, one at a time, to the
target system (and to VDO). So, in addition to VDO processing a number of small discard operations in
serial, the round-trip communication time between the two systems adds additional latency.
Setting a larger maximum discard size can reduce this communication overhead, though that larger
request is passed in its entirety to VDO and processed one 4 KB block at a time. While there is no per-
block communication delay, additional processing time for the larger block may cause the SCSI initiator
software to time out.
For SCSI target usage, Red Hat recommends configuring the maximum discard size to be moderately
284
CHAPTER 29. VDO INTEGRATION
large while still keeping the typical discard time well within the initiator's timeout setting. An extra round-
trip cost every few seconds, for example, should not significantly affect performance and SCSI initiators
with timeouts of 30 or 60 seconds should not time out.
Thread or CPU utilization above 70%, as seen in utilities such as top or ps, generally implies that too
much work is being concentrated in one thread or on one CPU. However, in some cases it could mean
that a VDO thread was scheduled to run on the CPU but no work actually happened; this scenario could
occur with excessive hardware interrupt handler processing, memory contention between cores or
NUMA nodes, or contention for a spin lock.
When using the top utility to examine system performance, Red Hat suggests running top -H to show
all process threads separately and then entering the 1 f j keys, followed by the Enter/Return key; the
top command then displays the load on individual CPU cores and identifies the CPU on which each
process or thread last ran. This information can provide the following insights:
If a core has low %id (idle) and %wa (waiting-for-I/O) values, it is being kept busy with work of
some kind.
If the %hi value for a core is very low, that core is doing normal processing work, which is being
load-balanced by the kernel scheduler. Adding more cores to that set may reduce the load as
long as it does not introduce NUMA contention.
If the %hi for a core is more than a few percent and only one thread is assigned to that core, and
%id and %wa are zero, the core is over-committed and the scheduler is not addressing the
situation. In this case the kernel thread or the device interrupt handling should be reassigned to
keep them on separate cores.
The perf utility can examine the performance counters of many CPUs. Red Hat suggests using the
perf top subcommand as a starting point to examine the work a thread or processor is doing. If, for
example, the bioQ threads are spending many cycles trying to acquire spin locks, there may be too
much contention in the device driver below VDO, and reducing the number of bioQ threads might
alleviate the situation. High CPU use (in acquiring spin locks or elsewhere) could also indicate contention
between NUMA nodes if, for example, the bioQ threads and the device interrupt handler are running on
different nodes. If the processor supports them, counters such as stalled-cycles-backend,
cache-misses, and node-load-misses may be of interest.
The sar utility can provide periodic reports on multiple system statistics. The sar -d 1 command
reports block device utilization levels (percentage of the time they have at least one I/O operation in
progress) and queue lengths (number of I/O requests waiting) once per second. However, not all block
device drivers can report such information, so the sar usefulness might depend on the device drivers in
use.
vdo
The vdo utility manages both the kvdo and UDS components of VDO.
285
Storage Administration Guide
vdostats
The vdostats utility displays statistics for each configured (or specified) device in a format similar to
the Linux df utility.
29.7.1. vdo
The vdo utility manages both the kvdo and UDS components of VDO.
Synopsis
Sub-Commands
Sub-Command Description
286
CHAPTER 29. VDO INTEGRATION
Sub-Command Description
create Creates a VDO volume and its associated index and makes it available. If
−−activate=disabled is specified the VDO volume is created but
not made available. Will not overwrite an existing file system or
formatted VDO volume unless −−force is given. This command must
be run with root privileges. Applicable options include:
--name=volume (required)
--device=device (required)
--activate={enabled | disabled}
--indexMem=gigabytes
--blockMapCacheSize=megabytes
--blockMapPeriod=period
--compression={enabled | disabled}
--confFile=file
--deduplication={enabled | disabled}
--emulate512={enabled | disabled}
--sparseIndex={enabled | disabled}
--vdoAckThreads=thread count
--vdoBioRotationInterval=I/O count
--vdoBioThreads=thread count
--vdoCpuThreads=thread count
--vdoHashZoneThreads=thread count
--vdoLogicalThreads=thread count
--vdoLogLevel=level
--vdoLogicalSize=megabytes
--vdoPhysicalThreads=thread count
--readCache={enabled | disabled}
--readCacheSize=megabytes
--vdoSlabSize=megabytes
--verbose
--logfile=pathname
287
Storage Administration Guide
Sub-Command Description
remove Removes one or more stopped VDO volumes and associated indexes.
This command must be run with root privileges. Applicable options
include:
--confFile=file
--force
--verbose
--logfile=pathname
start Starts one or more stopped, activated VDO volumes and associated
services. This command must be run with root privileges. Applicable
options include:
--confFile=file
--forceRebuild
--verbose
--logfile=pathname
stop Stops one or more running VDO volumes and associated services. This
command must be run with root privileges. Applicable options include:
--confFile=file
--force
--verbose
--logfile=pathname
activate Activates one or more VDO volumes. Activated volumes can be started
using the
start
--confFile=file
--logfile=pathname
--verbose
288
CHAPTER 29. VDO INTEGRATION
Sub-Command Description
--confFile=file
--verbose
--logfile=pathname
status Reports VDO system and volume status in YAML format. This command
does not require root privileges though information will be incomplete if
run without. Applicable options include:
--confFile=file
--verbose
--logfile=pathname
See Table 29.6, “VDO Status Output” for the output provided.
--all
--confFile=file
--logfile=pathname
--verbose
289
Storage Administration Guide
Sub-Command Description
--blockMapCacheSize=megabytes
--blockMapPeriod=period
--confFile=file
--vdoAckThreads=thread count
--vdoBioThreads=thread count
--vdoCpuThreads=thread count
--vdoHashZoneThreads=thread count
--vdoLogicalThreads=thread count
--vdoPhysicalThreads=thread count
--readCache={enabled | disabled}
--readCacheSize=megabytes
--verbose
--logfile=pathname
changeWritePolicy Modifies the write policy of one or all running VDO volumes. This
command must be run with root privileges.
(required)
--confFile=file
--logfile=pathname
--verbose
290
CHAPTER 29. VDO INTEGRATION
Sub-Command Description
--confFile=file
--verbose
--logfile=pathname
--confFile=file
--verbose
--logfile=pathname
enableCompression Enables compression on one or more VDO volumes. If the VDO volume
is running, takes effect immediately. If the VDO volume is not running
compression will be enabled the next time the VDO volume is started.
This command must be run with root privileges. Applicable options
include:
--confFile=file
--verbose
--logfile=pathname
disableCompression Disables compression on one or more VDO volumes. If the VDO volume
is running, takes effect immediately. If the VDO volume is not running
compression will be disabled the next time the VDO volume is started.
This command must be run with root privileges. Applicable options
include:
--confFile=file
--verbose
--logfile=pathname
291
Storage Administration Guide
Sub-Command Description
growLogical Adds logical space to a VDO volume. The volume must exist and must be
running. This command must be run with root privileges. Applicable
options include:
--name=volume (required)
--vdoLogicalSize=megabytes
(required)
--confFile=file
--verbose
--logfile=pathname
growPhysical Adds physical space to a VDO volume. The volume must exist and must
be running. This command must be run with root privileges. Applicable
options include:
--name=volume (required)
--confFile=file
--verbose
--logfile=pathname
printConfigFile Prints the configuration file to stdout . This command require root
privileges. Applicable options include:
--confFile=file
--logfile=pathname
--verbose
Options
Option Description
--indexMem=gigabytes Specifies the amount of UDS server memory in gigabytes; the default
size is 1 GB. The special decimal values 0.25, 0.5, 0.75 can be used, as
can any positive integer.
--all Indicates that the command should be applied to all configured VDO
volumes. May not be used with --name .
292
CHAPTER 29. VDO INTEGRATION
Option Description
-- Specifies the amount of memory allocated for caching block map pages;
blockMapCacheSize=mega the value must be a multiple of 4096. Using a value with a B (ytes),
bytes K (ilobytes), M (egabytes), G (igabytes), T (erabytes), P (etabytes) or
E (xabytes) suffix is optional. If no suffix is supplied, the value will be
interpreted as megabytes. The default is 128M; the value must be at
least 128M and less than 16T. Note that there is a memory overhead of
15%.
--compression={enabled Enables or disables compression within the VDO device. The default is
| disabled} enabled. Compression may be disabled if necessary to maximize
performance or to speed processing of data that is unlikely to compress.
--deduplication= Enables or disables deduplication within the VDO device. The default is
{enabled | disabled} enabled. Deduplication may be disabled in instances where data is not
expected to have good deduplication rates but compression is still
desired.
--forceRebuild Forces an offline rebuild before starting a read-only VDO volume so that
it may be brought back online and made available. This option may
result in data loss or corruption.
--logfile=pathname Specify the file to which this script's log messages are directed. Warning
and error messages are always logged to syslog as well.
--name=volume Operates on the specified VDO volume. May not be used with --all.
--device=device Specifies the absolute path of the device to use for VDO storage.
--activate={enabled | The argument disabled indicates that the VDO volume should only be
disabled} created. The volume will not be started or enabled. The default is
enabled.
293
Storage Administration Guide
Option Description
--vdoBioThreads=thread Specifies the number of threads to use for submitting I/O operations to
count the storage device. Minimum is 1; maximum is 100. The default is 4; the
value must be at least 1 and less than or equal to 100.
--vdoCpuThreads=thread Specifies the number of threads to use for CPU- intensive work such as
count hashing or compression. The default is 2; the value must be at least 1
and less than or equal to 100.
--vdoLogLevel=level Specifies the VDO driver log level: critical, error, warning,
notice , info, or debug. Levels are case sensitive; the default is
info.
-- Specifies the logical VDO volume size in megabytes. Using a value with
vdoLogicalSize=megabyt a S (ectors), B (ytes), K (ilobytes), M (egabytes), G (igabytes), T (erabytes),
es P (etabytes) or E (xabytes) suffix is optional. Used for over- provisioning
volumes. This defaults to the size of the storage device.
294
CHAPTER 29. VDO INTEGRATION
Option Description
--readCache={enabled | Enables or disables the read cache within the VDO device. The default is
disabled} disabled. The cache should be enabled if write workloads are
expected to have high levels of deduplication, or for read intensive
workloads of highly compressible data.
-- Specifies the extra VDO device read cache size in megabytes. This
readCacheSize=megabytes space is in addition to a system- defined minimum. Using a value with a
B (ytes), K (ilobytes), M (egabytes), G (igabytes), T (erabytes), P (etabytes)
or E (xabytes) suffix is optional. The default is 0M. 1.12 MB of memory
will be used per MB of read cache specified, per bio thread.
The status subcommand returns the following information in YAML format, divided into keys as
follows:
Key Description
VDO Status Information in this key covers the name of the host and date and time at which the status
inquiry is being made. Parameters reported in this area include:
Date The date and time at which the vdo status command is run.
295
Storage Administration Guide
Key Description
Configuratio Information in this key covers the location and status of the VDO configuration file.
n
File Location of the VDO configuration file.
VDOs Provides configuration information for all VDO volumes. Parameters reported for each VDO
volume include:
512 byte Indicates whether the volume is running in 512-byte emulation mode.
emulation
Write policy The configured value of the write policy (sync or async).
29.7.2. vdostats
The vdostats utility displays statistics for each configured (or specified) device in a format similar to the
Linux df utility.
The output of the vdostats utility may be incomplete if it is not run with root privileges.
Synopsis
296
CHAPTER 29. VDO INTEGRATION
Options
Option Description
--verbose Displays the utilization and block I/O (bios) statistics for one (or more) VDO devices.
See Table 29.9, “vdostats --verbose Output” for details.
--human- Displays block values in readable form (Base 2: 1 KB = 2 10 bytes = 1024 bytes).
readable
--si The --si option modifies the output of the --human-readable option to use SI
units (Base 10: 1 KB = 103 bytes = 1000 bytes). If the --human-readable option is
not supplied, the --si option has no effect.
--all This option is only for backwards compatibility. It is now equivalent to the --verbose
option.
device ... Specifies one or more specific volumes to report on. If this argument is omitted,
vdostats will report on all devices.
Output
The following example shows sample output if no options are provided, which is described in Table 29.8,
“Default vdostats Output”:
Item Description
1K-blocks The total number of 1K blocks allocated for a VDO volume (= physical volume size *
block size / 1024)
Used The total number of 1K blocks used on a VDO volume (= physical blocks used * block
size / 1024)
Available The total number of 1K blocks available on a VDO volume (= physical blocks free *
block size / 1024)
297
Storage Administration Guide
Item Description
Use% The percentage of physical blocks used on a VDO volume (= used blocks / allocated
blocks * 100)
Space Saving% The percentage of physical blocks saved on a VDO volume (= [logical blocks used -
physical blocks used] / logical blocks used)
The --human-readable option converts block counts into conventional units (1 KB = 1024 bytes):
The --human-readable and --si options convert block counts into SI units (1 KB = 1000 bytes):
The --verbose (Table 29.9, “vdostats --verbose Output” ) option displays VDO device statistics in
YAML format for one (or all) VDO devices.
Statistics printed in bold in Table 29.9, “vdostats --verbose Output” will continue to be reported in future
releases. The remaining fields are primarily intended for software support and are subject to change in
future releases; management tools should not rely upon them. Management tools should also not rely
upon the order in which any of the statistics are reported.
Item Description
Data blocks used The number of physical blocks currently in use by a VDO volume to store data.
Overhead blocks used The number of physical blocks currently in use by a VDO volume to store VDO
metadata.
Physical blocks The total number of physical blocks allocated for a VDO volume.
Logical blocks The maximum number of logical blocks that can be mapped by a VDO volume.
1K-blocks The total number of 1K blocks allocated for a VDO volume (= physical volume size
* block size / 1024)
298
CHAPTER 29. VDO INTEGRATION
Item Description
1K-blocks used The total number of 1K blocks used on a VDO volume (= physical blocks used *
block size / 1024)
1K-blocks available The total number of 1K blocks available on a VDO volume (= physical blocks free
* block size / 1024)
Used percent The percentage of physical blocks used on a VDO volume (= used blocks /
allocated blocks * 100)
Saving percent The percentage of physical blocks saved on a VDO volume (= [logical blocks used
- physical blocks used] / logical blocks used)
Block map cache size The size of the block map cache, in bytes.
Write policy The active write policy (sync or async). This is configured via vdo
changeWritePolicy --writePolicy=auto|sync|async.
Completed recovery The number of times a VDO volume has recovered from an unclean shutdown.
count
Read-only recovery The number of times a VDO volume has been recovered from read-only mode (via
count vdo start --forceRebuild).
Operating mode Indicates whether a VDO volume is operating normally, is in recovery mode, or is
in read-only mode.
Recovery progress (%) Indicates online recovery progress, or N/A if the volume is not in recovery mode.
Compressed The number of compressed fragments that have been written since the VDO
fragments written volume was last restarted.
Compressed blocks The number of physical blocks of compressed data that have been written since
written the VDO volume was last restarted.
Compressed fragments The number of compressed fragments being processed that have not yet been
in packer written.
Slabs opened The total number of slabs from which blocks have ever been allocated.
Slabs reopened The number of times slabs have been re-opened since the VDO was started.
299
Storage Administration Guide
Item Description
Journal disk full count The number of times a request could not make a recovery journal entry because
the recovery journal was full.
Journal commits The number of times the recovery journal requested slab journal commits.
requested count
Journal entries batching The number of journal entry writes started minus the number of journal entries
written.
Journal entries started The number of journal entries which have been made in memory.
Journal entries writing The number of journal entries in submitted writes minus the number of journal
entries committed to storage.
Journal entries written The total number of journal entries for which a write has been issued.
Journal blocks batching The number of journal block writes started minus the number of journal blocks
written.
Journal blocks started The number of journal blocks which have been touched in memory.
Journal blocks writing The number of journal blocks written (with metadatata in active memory) minus
the number of journal blocks committed.
Journal entries written The total number of journal blocks for which a write has been issued.
Slab journal disk full The number of times an on-disk slab journal was full.
count
Slab journal flush count The number of times an entry was added to a slab journal that was over the flush
threshold.
Slab journal blocked The number of times an entry was added to a slab journal that was over the
count blocking threshold.
Slab journal blocks The number of slab journal block writes issued.
written
Slab journal tail busy The number of times write requests blocked waiting for a slab journal write.
count
300
CHAPTER 29. VDO INTEGRATION
Item Description
Slab summary blocks The number of slab summary block writes issued.
written
Block map dirty pages The number of dirty pages in the block map cache.
Block map clean pages The number of clean pages in the block map cache.
Block map free pages The number of free pages in the block map cache.
Block map failed pages The number of block map cache pages that have write errors.
Block map incoming The number of block map cache pages that are being read into the cache.
pages
Block map outgoing The number of block map cache pages that are being written.
pages
Block map cache The number of times a free page was not available when needed.
pressure
Block map read count The total number of block map page reads.
Block map write count The total number of block map page writes.
Block map failed reads The total number of block map read errors.
Block map failed writes The total number of block map write errors.
Block map reclaimed The total number of block map pages that were reclaimed.
Block map read outgoing The total number of block map reads for pages that were being written.
Block map found in The total number of block map cache hits.
cache
Block map discard The total number of block map requests that required a page to be discarded.
required
Block map wait for page The total number of requests that had to wait for a page.
Block map fetch required The total number of requests that required a page fetch.
301
Storage Administration Guide
Item Description
Block map flush count The total number of flushes issued by the block map.
Invalid advice PBN The number of times the index returned invalid advice
count
No space error count. The number of write requests which failed due to the VDO volume being out of
space.
Read only error count The number of write requests which failed due to the VDO volume being in read-
only mode.
512 byte emulation Indicates whether 512 byte emulation is on or off for the volume.
Current VDO IO The number of I/O requests the VDO is current processing.
requests in progress.
Maximum VDO IO The maximum number of simultaneous I/O requests the VDO has processed.
requests in progress
Dedupe advice valid The number of times deduplication advice was correct.
Dedupe advice stale The number of times deduplication advice was incorrect.
Dedupe advice timeouts The number of times deduplication queries timed out.
Flush out The number of flush requests submitted by VDO to the underlying storage.
302
CHAPTER 29. VDO INTEGRATION
Item Description
Bios in... Bios in partial... These statistics count the number of bios in each category with a given flag. The
Bios out... Bios meta... categories are:
Bios journal... Bios page
bios in: The number of block I/O requests received by VDO.
cache... Bios out
completed... Bio meta bios in partial: The number of partial block I/O requests received by
completed... Bios journal VDO. Applies only to 512-byte emulation mode.
completed... Bios page
cache completed... Bios bios out: The number of non-metadata block I/O requests submitted by
acknowledged... Bios VDO to the storage device.
acknowledged partial...
bios meta: The number of metadata block I/O requests submitted by
Bios in progress... VDO to the storage device.
bios page cache: The number of block map I/O requests submitted by
VDO to the storage device.
bios page cache completed: The number of block map I/O requests
completed by the storage device.
bios in progress: The number of bios submitted to the VDO which have
not yet been acknowledged.
read: The number of non-write bios (bios without the REQ_WRITE flag
set)
write: The number of write bios (bios with the REQ_WRITE flag set)
Read cache accesses The number of times VDO searched the read cache.
303
Storage Administration Guide
There are files in the statistics directory in addition to the ones listed in the table below. These
additional statistics files are not guaranteed to be supported in future releases.
File Description
dataBlocksUsed The number of physical blocks currently in use by a VDO volume to store data.
physicalBlocks The total number of physical blocks allocated for a VDO volume.
logicalBlocks The maximum number of logical blocks that can be mapped by a VDO volume.
304
CHAPTER 30. VDO EVALUATION
30.1. INTRODUCTION
VDO is software that provides inline block-level deduplication, compression, and thin provisioning
capabilities for primary storage. VDO installs within the Linux device mapper framework, where it takes
ownership of existing physical block devices and remaps these to new, higher-level block devices with
data-efficiency properties. Specifically, VDO can multiply the effective capacity of these devices by ten or
more. These benefits require additional system resources, so it is therefore necessary to measure
VDO's impact on system performance.
Storage vendors undoubtedly have existing in-house test plans and expertise that they use to evaluate
new storage products. Since the VDO layer helps to identify deduplication and compression, different
tests may be required. An effective test plan requires studying the VDO architecture and exploring these
items:
Failure to consider such factors up front has created situations that have invalidated certain tests and
required customers to repeat testing and data collection efforts.
Help engineers identify configuration settings that elicit optimal responses from the test device
The test results will help Red Hat engineers assist in understanding VDO's behavior when integrated into
specific storage environments. OEMs will understand how to design their deduplication and compression
capable devices, and also how their customers can tune their applications to best use those devices.
Be aware that the procedures in this document are designed to provide conditions under which VDO can
be most realistically evaluated. Altering test procedures or parameters may invalidate results. Red Hat
Sales Engineers are available to offer guidance when modifying test plans.
305
Storage Administration Guide
Before evaluating VDO, it is important to consider the host system configuration, VDO configuration, and
the workloads that will be used during testing. These choices will affect benchmarking both in terms of
data optimization (space efficiency) and performance (bandwidth and latency). Items that should be
considered when developing test plans are listed in the following sections.
Linux kernel version. Note that Red Hat Enterprise Linux 7 provides only one Linux kernel
version.
Packages installed.
30.2.3. Workloads
Types of tools used to generate test data
VDO volumes may need to be re-created in between certain tests to ensure that each test is performed
on the same disk environment. Read more about this in the testing section.
For the system requirements of VDO, see Section 29.2, “System Requirements”.
306
CHAPTER 30. VDO EVALUATION
Flexible I/O Tester version 2.08 or higher; available from the fio package
System Configuration
Disable frequency scaling if possible using the BIOS configuration or the Linux cpupower
utility.
Enable Turbo mode if possible to achieve maximum throughput. Turbo mode introduces
some variability in test results, but performance will meet or exceed that of testing without
Turbo.
Linux Configuration
For disk-based solutions, Linux offers several I/O scheduler algorithms to handle multiple
read/write requests as they are queued. By default, Red Hat Enterprise Linux uses the CFQ
(completely fair queuing) scheduler, which arranges requests in a way that improves
rotational disk (hard disk) access in many situations. We instead suggest using the Deadline
scheduler for rotational disks, having found that it provides better throughput and latency in
Red Hat lab testing. Change the device settings as follows:
For flash-based solutions, the noop scheduler demonstrates superior random access
throughput and latency in Red Hat lab testing. Change the device settings as follows:
File systems (ext4, XFS, etc.) may have unique impacts on performance; they often skew
performance measurements, making it harder to isolate VDO's impact on the results. If
reasonable, we recommend measuring performance on the raw block device. If this is not
possible, format the device using the file system that would be used in the target implementation.
The Red Hat test plan was written to operate with a default VDO configuration. When developing new
tests, some of the VDO parameters listed in the next section must be adjusted.
307
Storage Administration Guide
High Load
Perhaps the most important strategy for producing optimal performance is determining the best I/O
queue depth, a characteristic that represents the load on the storage system. Most modern storage
systems perform optimally with high I/O depth. VDO's performance is best demonstrated with many
concurrent requests.
VDO might operate with either of two write policies, synchronous or asynchronous. By default, VDO
automatically chooses the appropriate write policy for your underlying storage device.
When testing performance, you need to know which write policy VDO selected. The following command
shows the write policy of your VDO volume:
For more information on write policies, see the section called “Overview of VDO Write Policies” and
Section 29.4.2, “Selecting VDO Write Modes”.
Metadata Caching
VDO maintains a table of mappings from logical block addresses to physical block addresses, and VDO
must look up the relevant mapping when accessing any particular block. By default, VDO allocates
128 MB of metadata cache in DRAM to support efficient access to 100 GB of logical space at a time. The
test plan generates workloads appropriate to this configuration option.
Working sets larger than the configured cache size will require additional I/Os to service requests, in
which case performance degradation will occur. If additional memory is available, the block map cache
should be made larger. If the working set is larger than what the block map cache can hold in memory,
additional I/O hover head can occur to lookup associated block map pages.
VDO's thread configuration must be tuned to achieve optimal performance. Review the VDO Integration
Guide for information on how to modify these settings when creating a VDO volume. Contact your
Red Hat Sales Engineer to discuss how to design a test to find the optimal setting.
Data Content
Because VDO performs deduplication and compression, test data sets must be chosen to effectively
exercise these capabilities.
1. If a 4 KB block has never been written, VDO will not perform I/O to the storage and will
immediately respond with a zero block.
2. If a 4 KB block has been written but contains all zeros, VDO will not perform I/O to the storage
and will immediately respond with a zero block.
308
CHAPTER 30. VDO EVALUATION
This behavior results in very fast read performance when there is no data to read. This makes it
imperative that read tests prefill with actual data.
Test Environment
The test cases in the next section make the following assumptions about the test environment:
The target block device (for example, /dev/sdb) is larger than 512 GB.
VDO is installed.
The following information should be recorded at the start of each test in order to ensure that the test
environment is fully understood:
A complete list of installed packages, as obtained from the rpm -qa command.
Installed memory and the amount available after the base OS is running (available in
/proc/meminfo).
Name of the Physical Volume and the Volume Group created for use with VDO (pvs and vgs
listings).
File system used when formatting the VDO volume (if any).
Contents of /etc/vdoconf.yaml.
309
Storage Administration Guide
Workloads
Effectively testing VDO requires the use of data sets that simulate real world workloads. The data sets
should provide a balance between data that can be deduplicated and/or compressed and data that
cannot in order to demonstrate performance under different conditions.
There are several tools that can synthetically generate data with repeatable characteristics. Two utilities
in particular, VDbench and fio, are recommended for use during testing.
This guide uses fio. Understanding the arguments is critical to a successful evaluation:
--size The quantity of data fio will send to the target per job (see 100 GB
numjobs below).
--numjobs The number of jobs that fio will create to run the benchmark. 1 (HDD)
Each job sends the amount of data specified by the --size 2 (SSD)
parameter.
The first job sends data to the device at the offset specified
by the --offset parameter. Subsequent jobs write the
same region of the disk (overwriting) unless the
--offset_increment parameter is provided, which will
offset each job from where the previous job began by that
value. To achieve peak performance on flash at least two
jobs are recommended. One job is typically enough to
saturate rotational disk (HDD) throughput.
--thread Instructs fio jobs to be run in threads rather than being forked, <N/A>
which may provide better performance by limiting context
switching.
--ioengine There are several I/O engines available in Linux that are able libaio
to be tested using fio. Red Hat testing uses the asynchronous
unbuffered engine ( libaio ). If you are interested in another
engine, discuss that with your Red Hat Sales Engineer.
310
CHAPTER 30. VDO EVALUATION
To test the VDO async mode on top of synchronous storage, create an asynchronous
volume using the --writePolicy=async option:
To test the VDO sync mode on top of synchronous storage, create a synchronous volume
using the --writePolicy=sync option:
For XFS:
311
Storage Administration Guide
# mkfs.xfs -K /dev/mapper/vdo0
For ext4:
# mkdir /mnt/VDOVolume
# mount /dev/mapper/vdo0 /mnt/VDOVolume && \
chmod a+rwx /mnt/VDOVolume
2. Read the data from the VDO volume and write it to another location not on the VDO volume:
3. Compare the two files using diff, which should report that the files are the same:
5. Compare the third file to the second file. This should report that the files are the same:
# umount /mnt/VDOVolume
2. Run the command to remove the VDO volume vdo0 from the system:
3. Verify that the volume has been removed. There should be no listing in vdo list for the VDO
partition:
312
CHAPTER 30. VDO EVALUATION
4. Measure Deduplication
1. Create and mount a VDO volume following Section 30.3.1, “Configuring a VDO Test Volume”.
2. Create 10 directories on the VDO volume named vdo1 through vdo10 to hold 10 copies of the
test data set:
$ mkdir /mnt/VDOVolume/vdo{01..10}
3. Examine the amount of disk space used according to the file system:
$ df -h /mnt/VDOVolume
4. Run the following command and record the values. "Data blocks used" is the number of blocks
used by user data on the physical device running under VDO. "Logical blocks used" is the
number of blocks used before optimization. It will be used as the starting point for measurements
5. Create a data source file in the top level of the VDO volume
6. Re-examine the amount of used physical disk space in use. This should show an increase in the
number of blocks used corresponding to the file just written:
$ df -h /mnt/VDOVolume
313
Storage Administration Guide
$ for i in {01..10}; do
cp /mnt/VDOVolume/sourcefile /mnt/VDOVolume/vdo$i
done
8. Once again, check the amount of physical disk space used (data blocks used). This number
should be similar to the result of step 6 above, with only a slight increase due to file system
journaling and metadata:
$ df -h /mnt/VDOVolume
9. Subtract this new value of the space used by the file system from the value found before writing
the test data. This is the amount of space consumed by this test from the file system's
perspective.
Note:In the following table, values have been converted to MB/GB. vdostats "blocks" are 4,096
B.
314
CHAPTER 30. VDO EVALUATION
5. Measure Compression
1. Create a VDO volume of at least 10 GB of physical and logical size. Add options to disable
deduplication and enable compression:
2. Inspect VDO statistics before transfer; make note of data blocks used and logical blocks used
(both should be zero):
For XFS:
# mkfs.xfs -K /dev/mapper/vdo0
For ext4:
# mkdir /mnt/VDOVolume
# mount /dev/mapper/vdo0 /mnt/VDOVolume && \
chmod a+rwx /mnt/VDOVolume
6. Inspect VDO statistics again. Logical blocks used — data blocks used is the number of 4 KB
blocks saved by compression for the file system alone. VDO optimizes file system overhead as
well as actual user data:
7. Copy the contents of /lib to the VDO volume. Record the total size:
...
sent 152508960 bytes received 60448 bytes 61027763.20 bytes/sec
total size is 152293104 speedup is 1.00
315
Storage Administration Guide
9. Inspect VDO statistics once again. Observe the logical and data blocks used:
Logical blocks used - data blocks used represents the amount of space used (in units of
4 KB blocks) for the copy of your /lib files.
The total size (from the table in the section called “4. Measure Deduplication”) - (logical
blocks used-data blocks used * 4096) = bytes saved by compression.
1. Create and mount a VDO volume following Section 30.3.1, “Configuring a VDO Test Volume”.
2. Repeat the experiments in the section called “4. Measure Deduplication” and the section called
“5. Measure Compression” without removing the volume. Observe changes to space savings in
vdostats.
Thin provisioning allows a logical or virtual storage space to be larger than the underlying physical
storage. Applications such as file systems benefit from running on the larger virtual layer of storage, and
data-efficiency techniques such as data deduplication reduce the number of physical data blocks needed
to store all of the data. To benefit from these storage savings, the physical storage layer needs to know
when application data has been deleted.
Traditional file systems did not have to inform the underlying storage when data was deleted. File
systems that work with thin provisioned storage send TRIM or DISCARD commands to inform the storage
system when a logical block is no longer required. These commands can be sent whenever a block is
deleted using the discard mount option, or these commands can be sent in a controlled manner by
running utilities such as fstrim that tell the file system to detect which logical blocks are unused and
send the information to the storage system in the form of a TRIM or DISCARD command.
1. Create and mount a new VDO logical volume following Section 30.3.1, “Configuring a VDO Test
Volume”.
2. Trim the file system to remove any unneeded blocks (this may take a long time):
# fstrim /mnt/VDOVolume
$ df -m /mnt/VDOVolume
to see how much capacity is used in the file system, and run vdostats to see how many physical
and logical data blocks are being used.
316
CHAPTER 30. VDO EVALUATION
4. Create a 1 GB file with non-duplicate data in the file system running on top of VDO:
and then collect the same data. The file system should have used an additional 1 GB, and the
data blocks used and logical blocks used have increased similarly.
5. Run fstrim /mnt/VDOVolume and confirm that this has no impact after creating a new file.
$ rm /mnt/VDOVolume/file
Check and record the parameters. The file system is aware that a file has been deleted, but
there has been no change to the number of physical or logical blocks because the file deletion
has not been communicated to the underlying storage.
7. Run fstrim /mnt/VDOVolume and record the same parameters. fstrim looks for free
blocks in the file system and sends a TRIM command to the VDO volume for unused addresses,
which releases the associated logical blocks, and VDO processes the TRIM to release the
underlying physical blocks.
Step File Space Used (MB) Data Blocks Used Logical Blocks Used
Initial
Add 1 GB File
Run fstrim
Delete 1 GB File
Run fstrim
From this exercise, the TRIM process is needed so the underlying storage can have an accurate
knowledge of capacity utilization. fstrim is a command line tool that analyzes many blocks at once for
greater efficiency. An alternative method is to use the file system discard option when mounting. The
discard option will update the underlying storage after each file system block is deleted, which can slow
throughput but provides for great utilization awareness. It is also important to understand that the need to
TRIM or DISCARD unused blocks is not unique to VDO; any thin-provisioned storage system has the
same challenge
317
Storage Administration Guide
latency for your appliance. VDO uses a 4 KB sector size rather than the traditional 512 B used on legacy
storage devices. The larger sector size allows it to support higher-capacity storage, improve
performance, and match the cache buffer size used by most operating systems.
1. Perform four-corner testing at 4 KB I/O, and I/O depth of 1, 8, 16, 32, 64, 128, 256, 512, 1024:
* Prefill any areas that may be read during the read test by performing a write fio job first
2. Record throughput and latency at each data point, and then graph.
The result is a graph as shown below. Points of interest are the behavior across the range and the points
of inflection where increased I/O depth proves to provide diminishing throughput gains. Likely, sequential
access and random access will peak at different values, but it may be different for all types of storage
configurations. In Figure 30.1, “I/O Depth Analysis” notice the "knee" in each performance curve. Marker
1 identifies the peak sequential throughput at point X, and marker 2 identifies peak random 4 KB
throughput at point Z.
This particular appliance does not benefit from sequential 4 KB I/O depth > X. Beyond that
depth, there are diminishing bandwidth bandwidth gains, and average request latency will
increase 1:1 for each additional I/O request.
This particular appliance does not benefit from random 4 KB I/O depth > Z. Beyond that depth,
there are diminishing bandwidth gains, and average request latency will increase 1:1 for each
additional I/O request.
318
CHAPTER 30. VDO EVALUATION
Figure 30.2, “Latency Response of Increasing I/O for Random Writes” shows an example of the random
write latency after the "knee" of the curve in Figure 30.1, “I/O Depth Analysis”. Benchmarking practice
should test at these points for maximum throughput that incurs the least response time penalty. As we
move forward in the test plan for this example appliance, we will collect additional data with I/O depth =
Z
1. Perform four-corner testing at fixed I/O depth, with varied block size (powers of 2) over the range
8 KB to 1 MB. Remember to prefill any areas to be read and to recreate volumes between
tests.
2. Set the I/O Depth to the value determined in Section 30.4.1, “Phase 1: Effects of I/O Depth,
Fixed 4 KB Blocks”.
319
Storage Administration Guide
3. Record throughput and latency at each data point, and then graph.
There are several points of interest that you may find in the results. In this example:
Sequential writes reach a peak throughput at request size Y. This curve demonstrates how
applications that are configurable or naturally dominated by certain request sizes may perceive
performance. Larger request sizes often provide more throughput because 4 KB I/Os may
benefit from merging.
Sequential reads reach a similar peak throughput at point Z. Remember that after these peaks,
overall latency before the I/O completes will increase with no additional throughput. It would be
wise to tune the device to not accept I/Os larger than this size.
Random reads achieve peak throughput at point X. Some devices may achieve near-sequential
throughput rates at large request size random accesses, while others suffer more penalty when
varying from purely sequential access.
Random writes achieve peak throughput at point Y. Random writes involve the most interaction
of a deduplication device, and VDO achieves high performance especially when request sizes
and/or I/O depths are large.
The results from this test Figure 30.3, “Request Size vs. Throughput Analysis and Key Inflection Points”
help in understanding the characteristics of the storage device and the user experience for specific
applications. Consult with a Red Hat Sales Engineer to determine if there may be further tuning needed
to increase performance at different request sizes.
Figure 30.3. Request Size vs. Throughput Analysis and Key Inflection Points
320
CHAPTER 30. VDO EVALUATION
1. Perform four-corner testing at fixed I/O depth, varied block size (powers of 2) over the 8 KB to
256 KB range, and set read percentage at 10% increments, beginning with 0%. Remember to
prefill any areas to be read and to recreate volumes between tests.
2. Set the I/O Depth to the value determined in Section 30.4.1, “Phase 1: Effects of I/O Depth,
Fixed 4 KB Blocks”.
3. Record throughput and latency at each data point, and then graph.
Figure 30.4, “Performance Is Consistent across Varying Read/Write Mixes” shows an example of how
VDO may respond to I/O loads:
Performance (aggregate) and latency (aggregate) are relatively consistent across the range of mixing
reads and writes, trending from the lower max write throughput to the higher max read throughput.
This behavior may vary with different storage, but the important observation is that the performance is
consistent under varying loads and/or that you can understand performance expectation for applications
that demonstrate specific read/write mixes. If you discover any unexpected results, Red Hat Sales
Engineers will be able to help you understand if it is VDO or the storage device itself that needs
modification.
Note: Systems that do not exhibit a similar response consistency often signify a sub-optimal
configuration. Contact your Red Hat Sales Engineer if this occurs.
321
Storage Administration Guide
The goal of these final tests is to understand how the system with VDO behaves when deployed in a real
application environment. If possible, use real applications and use the knowledge learned so far;
consider limiting the permissible queue depth on your appliance, and if possible tune the application to
issue requests with those block sizes most beneficial to VDO performance.
Request sizes, I/O loads, read/write patterns, etc., are generally hard to predict, as they will vary by
application use case (i.e., filers vs. virtual desktops vs. database), and applications often vary in the
types of I/O based on the specific operation or due to multi-tenant access.
The final test shows general VDO performance in a mixed environment. If more specific details are
known about your expected environment, test those settings as well.
Record throughput and latency at each data point, and then graph (Figure 30.5, “Mixed Environment
Performance”).
A detailed description of the test environment; see the section called “Test Environment” for
specifics
The actions that were being performed at the time of the error
322
CHAPTER 30. VDO EVALUATION
The result of sosreport, which will capture data describing the entire Linux environment
30.6. CONCLUSION
Going through this or any other well-structured evaluation plan is an important step in integrating VDO
into any storage system. The evaluation process is important to understanding performance and
catching any potential compatibility issues. The collection of results from this evaluation not only
demonstrates deduplication and compression, but also provides a performance profile of your system
implementing VDO. The results help determine whether the results achieved in real applications are as
expected and plausible or whether they fall short of expectations. Finally, we can also use these results
to help predict the kinds of applications that will operate favorably with VDO.
323
Storage Administration Guide
SCSI DECODER
The SCSI decoder is designed to decode SCSI error messages in the /log/* files or log file snippets,
as these error messages can be hard to understand for the user.
Use the SCSI decoder to individually diagnose each SCSI error message and get solutions to resolve
problems efficiently.
Use the File System Layout Calculator to generate a command that creates a file system with provided
parameters on the specified RAID storage. Copy the generated command and execute it as root to
create the required file system.
The LVM RAID Calculator generates a sequence of commands that create LVMs on a given RAID
storage. Copy and execute the generated commands one by one as root to create the required LVMs.
ISCSI HELPER
The iSCSI Helper provides a block-level storage over Internet Protocol (IP) networks, and enables the
use of storage pools within server virtualization.
Use the iSCSI Helper to generate a script that prepares the system for its role of an iSCSI target (server)
or an iSCSI initiator (client) configured according to the settings that you provide.
MULTIPATH HELPER
The Multipath Helper creates an optimal configuration for multipath devices on Red Hat
Enterprise Linux 5, 6, and 7. By following the steps, you can create advanced multipath configurations,
such as custom aliases or device blacklists.
324
APPENDIX A. RED HAT CUSTOMER PORTAL LABS RELEVANT TO STORAGE ADMINISTRATION
The Multipath Helper also provides the multipath.conf file for a review. When you achieve the
required configuration, download the installation script to run on your server.
NFS HELPER
The NFS Helper simplifies configuring a new NFS server or client. Follow the steps to specify the export
and mount options. Then, generate a downloadable NFS configuration script.
Hosts components including Host Bus Adapters (HBAs), local devices, and iSCSI devices on the
server side
You can either upload a sosreport compressed in the .xz, .gz, or .bz2 format, or extract a sosreport in a
directory that you then select as the source for a client-side analysis.
Described tools:
dump and restore: for backing up the ext2, ext3, and ext4 file systems.
tar and cpio: for archiving or restoring files and folders, especially when backing up the tape
drives.
rsync: for performing back-up operations and synchronizing files and directories between
locations.
dd: for copying files from a source to a destination block by block independently of the file
systems or operating systems involved.
Described scenarios:
Disaster recovery
Hardware migration
Incremental backup
Differential backup
325
Storage Administration Guide
326
INDEX
INDEX
Symbols
/boot/ directory, The /boot/ Directory
/dev/shm, df Command
/etc/fstab, Converting to an ext3 File System, Mounting NFS File Systems Using /etc/fstab,
Mounting a File System
/etc/fstab file
enabling disk quotas with, Enabling Quotas
/proc
/proc/devices, The /proc Virtual File System
/proc/filesystems, The /proc Virtual File System
/proc/mdstat, The /proc Virtual File System
/proc/mounts, The /proc Virtual File System
/proc/mounts/, The /proc Virtual File System
/proc/partitions, The /proc Virtual File System
/proc/devices
virtual file system (/proc), The /proc Virtual File System
/proc/filesystems
virtual file system (/proc), The /proc Virtual File System
/proc/mdstat
virtual file system (/proc), The /proc Virtual File System
/proc/mounts
virtual file system (/proc), The /proc Virtual File System
/proc/mounts/
virtual file system (/proc), The /proc Virtual File System
/proc/partitions
virtual file system (/proc), The /proc Virtual File System
A
adding paths to a storage device, Adding a Storage Device or Path
adding/removing
327
Storage Administration Guide
allocation features
ext4, The ext4 File System
XFS, The XFS File System
Anaconda support
RAID, RAID Support in the Anaconda Installer
autofs version 5
NFS, Improvements in autofs Version 5 over Version 4
B
backup/restoration
XFS, Backing Up and Restoring XFS File Systems
328
INDEX
Btrfs
File System, Btrfs (Technology Preview)
C
cache back end
FS-Cache, FS-Cache
cache setup
FS-Cache, Setting up a Cache
cache sharing
FS-Cache, Cache Sharing
cachefiles
FS-Cache, FS-Cache
cachefilesd
FS-Cache, Setting up a Cache
changing dev_loss_tmo
Fibre Channel
modifying link loss behavior, Fibre Channel
coherency data
FS-Cache, FS-Cache
329
Storage Administration Guide
commands
volume_key, volume_key Commands
configuration
discovery
iSCSI, iSCSI Discovery Configuration
creating
ext4, Creating an ext4 File System
XFS, Creating an XFS File System
D
DASD and zFCP devices on IBM System z
storage considerations during installation, DASD and zFCP Devices on IBM System Z
deployment
solid-state disks, Solid-State Disk Deployment Guidelines
deployment guidelines
solid-state disks, Solid-State Disk Deployment Guidelines
330
INDEX
Fibre Channel
modifying link loss behavior, Fibre Channel
dev_loss_tmo, changing
Fibre Channel
modifying link loss behavior, Fibre Channel
df, df Command
DHCP, configuring
diskless systems, Configuring DHCP for Diskless Clients
directories
/boot/, The /boot/ Directory
/dev/, The /dev/ Directory
/etc/, The /etc/ Directory
/mnt/, The /mnt/ Directory
/opt/, The /opt/ Directory
/proc/, The /proc/ Directory
/srv/, The /srv/ Directory
/sys/, The /sys/ Directory
/usr/, The /usr/ Directory
/var/, The /var/ Directory
disabling NOP-Outs
iSCSI configuration, iSCSI Root
331
Storage Administration Guide
discovery
iSCSI, iSCSI Discovery Configuration
diskless systems
DHCP, configuring, Configuring DHCP for Diskless Clients
exported file systems, Configuring an Exported File System for Diskless Clients
network booting service, Setting up a Remote Diskless System
remote diskless systems, Setting up a Remote Diskless System
required packages, Setting up a Remote Diskless System
tftp service, configuring, Configuring a tftp Service for Diskless Clients
dm-multipath
iSCSI configuration, iSCSI Settings with dm-multipath
dmraid
RAID, dmraid
drivers (native), Fibre Channel, Native Fibre Channel Drivers and Capabilities
332
INDEX
du, du Command
dump levels
XFS, Backup
E
e2fsck, Reverting to an Ext2 File System
e2image (other ext4 file system utilities)
ext4, Other ext4 File System Utilities
e2label
ext4, Other ext4 File System Utilities
enablind/disabling
write barriers, Enabling and Disabling Write Barriers
error messages
write barriers, Enabling and Disabling Write Barriers
ext2
reverting from ext3, Reverting to an Ext2 File System
ext3
converting from ext2, Converting to an ext3 File System
creating, Creating an ext3 File System
features, The ext3 File System
ext4
allocation features, The ext4 File System
creating, Creating an ext4 File System
debugfs (other ext4 file system utilities), Other ext4 File System Utilities
e2image (other ext4 file system utilities), Other ext4 File System Utilities
e2label, Other ext4 File System Utilities
333
Storage Administration Guide
e2label (other ext4 file system utilities), Other ext4 File System Utilities
file system types, The ext4 File System
fsync(), The ext4 File System
main features, The ext4 File System
mkfs.ext4, Creating an ext4 File System
mounting, Mounting an ext4 File System
nobarrier mount option, Mounting an ext4 File System
other file system utilities, Other ext4 File System Utilities
quota (other ext4 file system utilities), Other ext4 File System Utilities
resize2fs (resizing ext4), Resizing an ext4 File System
resizing, Resizing an ext4 File System
stride (specifying stripe geometry), Creating an ext4 File System
stripe geometry, Creating an ext4 File System
stripe-width (specifying stripe geometry), Creating an ext4 File System
tune2fs (mounting), Mounting an ext4 File System
write barriers, Mounting an ext4 File System
F
FCoE
configuring an Ethernet interface to use FCoE, Configuring a Fibre Channel over Ethernet
Interface
Fibre Channel over Ethernet, Configuring a Fibre Channel over Ethernet Interface
required packages, Configuring a Fibre Channel over Ethernet Interface
Fibre Channel
online storage, Fibre Channel
file system
FHS standard, FHS Organization
hierarchy, Overview of Filesystem Hierarchy Standard (FHS)
organization, FHS Organization
structure, File System Structure and Maintenance
File System
Btrfs, Btrfs (Technology Preview)
334
INDEX
findmnt (command)
listing mounts, Listing Currently Mounted File Systems
FS-Cache
bcull (cache cull limits settings), Setting Cache Cull Limits
brun (cache cull limits settings), Setting Cache Cull Limits
bstop (cache cull limits settings), Setting Cache Cull Limits
cache back end, FS-Cache
cache cull limits, Setting Cache Cull Limits
cache sharing, Cache Sharing
cachefiles, FS-Cache
cachefilesd, Setting up a Cache
coherency data, FS-Cache
indexing keys, FS-Cache
NFS (cache limitations with), Cache Limitations with NFS
NFS (using with), Using the Cache with NFS
performance guarantee, Performance Guarantee
setting up a cache, Setting up a Cache
statistical information (tracking), Statistical Information
tune2fs (setting up a cache), Setting up a Cache
fsync()
ext4, The ext4 File System
XFS, The XFS File System
G
GFS2
file system types, Global File System 2
gfs2.ko, Global File System 2
maximum size, Global File System 2
335
Storage Administration Guide
gquota/gqnoenforce
XFS, XFS Quota Management
H
Hardware RAID (see RAID)
hardware RAID controller drivers
RAID, Linux Hardware RAID Controller Drivers
host
Fibre Channel API, Fibre Channel API
I
I/O alignment and size, Storage I/O Alignment and Size
ATA standards, ATA
block device ioctls (userspace access), Block Device ioctls
Linux I/O stack, Storage I/O Alignment and Size
logical_block_size, Userspace Access
LVM, Logical Volume Manager
READ CAPACITY(16), SCSI
SCSI standards, SCSI
stacking I/O parameters, Stacking I/O Parameters
storage access parameters, Parameters for Storage Access
sysfs interface (userspace access), sysfs Interface
tools (for partitioning and other file system functions), Partition and File System Tools
userspace access, Userspace Access
336
INDEX
iface binding/unbinding
offload and interface binding
iSCSI, Binding/Unbinding an iface to a Portal
iface settings
offload and interface binding
iSCSI, Viewing Available iface Configurations
indexing keys
FS-Cache, FS-Cache
individual user
volume_key, Using volume_key as an Individual User
initiator implementations
offload and interface binding
iSCSI, Viewing Available iface Configurations
337
Storage Administration Guide
installer support
RAID, RAID Support in the Anaconda Installer
interconnects (scanning)
iSCSI, Scanning iSCSI Interconnects
introduction, Overview
iSCSI
discovery, iSCSI Discovery Configuration
configuration, iSCSI Discovery Configuration
record types, iSCSI Discovery Configuration
offload and interface binding, Configuring iSCSI Offload and Interface Binding
binding/unbinding an iface to a portal, Binding/Unbinding an iface to a Portal
iface (configuring for iSCSI offload), Configuring an iface for iSCSI Offload
iface configurations, viewing, Viewing Available iface Configurations
iface for software iSCSI, Configuring an iface for Software iSCSI
iface settings, Viewing Available iface Configurations
initiator implementations, Viewing Available iface Configurations
software iSCSI, Configuring an iface for Software iSCSI
viewing available iface configurations, Viewing Available iface Configurations
K
known issues
adding/removing
338
INDEX
L
lazy mount/unmount support (autofs version 5)
NFS, Improvements in autofs Version 5 over Version 4
levels
RAID, RAID Levels and Linear Support
linear RAID
RAID, RAID Levels and Linear Support
logging in
iSCSI targets, Logging in to an iSCSI Target
logical_block_size
I/O alignment and size, Userspace Access
LVM
I/O alignment and size, Logical Volume Manager
M
main features
ext4, The ext4 File System
XFS, The XFS File System
maximum size
GFS2, Global File System 2
339
Storage Administration Guide
mdraid
RAID, mdraid
mirroring
RAID, RAID Levels and Linear Support
mkfs.xfs
XFS, Creating an XFS File System
340
INDEX
native Fibre Channel drivers, Native Fibre Channel Drivers and Capabilities
network booting service
diskless systems, Setting up a Remote Diskless System
autofs
augmenting, Overriding or Augmenting Site Configuration Files
configuration, Configuring autofs
LDAP, Using LDAP to Store Automounter Maps
341
Storage Administration Guide
NOP-Out requests
modifying link loss
iSCSI configuration, NOP-Out Interval/Timeout
NOP-Outs (disabling)
iSCSI configuration, iSCSI Root
O
offline status
342
INDEX
Linux SCSI layer, Controlling the SCSI Command Timer and Device Status
online storage
Fibre Channel, Fibre Channel
overview, Online Storage Management
sysfs, Online Storage Management
overview, Overview
online storage, Online Storage Management
P
Parallel NFS
pNFS, pNFS
parity
RAID, RAID Levels and Linear Support
parted , Partitions
creating partitions, Creating a Partition
overview, Partitions
removing partitions, Removing a Partition
resizing partitions, Resizing a Partition with fdisk
selecting device, Viewing the Partition Table
table of commands, Partitions
viewing partition table, Viewing the Partition Table
343
Storage Administration Guide
partition table
viewing, Viewing the Partition Table
partitions
creating, Creating a Partition
formatting
mkfs , Formatting and Labeling the Partition
pquota/pqnoenforce
XFS, XFS Quota Management
Q
queue_if_no_path
iSCSI configuration, iSCSI Settings with dm-multipath
modifying link loss
iSCSI configuration, replacement_timeout
344
INDEX
quota management
XFS, XFS Quota Management
R
RAID
advanced RAID device creation, Creating Advanced RAID Devices
Anaconda support, RAID Support in the Anaconda Installer
configuring RAID sets, Configuring RAID Sets
dmraid, dmraid
dmraid (configuring RAID sets), dmraid
Hardware RAID, RAID Types
hardware RAID controller drivers, Linux Hardware RAID Controller Drivers
installer support, RAID Support in the Anaconda Installer
level 0, RAID Levels and Linear Support
level 1, RAID Levels and Linear Support
level 4, RAID Levels and Linear Support
level 5, RAID Levels and Linear Support
levels, RAID Levels and Linear Support
linear RAID, RAID Levels and Linear Support
mdadm (configuring RAID sets), mdadm
mdraid, mdraid
mirroring, RAID Levels and Linear Support
parity, RAID Levels and Linear Support
reasons to use, Redundant Array of Independent Disks (RAID)
Software RAID, RAID Types
striping, RAID Levels and Linear Support
subsystems of RAID, Linux RAID Subsystems
RDMA
NFS, Enabling NFS over RDMA (NFSoRDMA)
READ CAPACITY(16)
I/O alignment and size, SCSI
record types
discovery
iSCSI, iSCSI Discovery Configuration
345
Storage Administration Guide
remote port
Fibre Channel API, Fibre Channel API
replacement_timeout
modifying link loss
iSCSI configuration, SCSI Error Handler, replacement_timeout
replacement_timeoutM
iSCSI configuration, iSCSI Root
required packages
adding/removing
LUN (logical unit number), Adding/Removing a Logical Unit Through rescan-scsi-bus.sh
rescan-scsi-bus.sh
adding/removing
LUN (logical unit number), Adding/Removing a Logical Unit Through rescan-scsi-bus.sh
346
INDEX
rfc2307bis (autofs)
NFS, Using LDAP to Store Automounter Maps
running status
Linux SCSI layer, Controlling the SCSI Command Timer and Device Status
S
scanning interconnects
iSCSI, Scanning iSCSI Interconnects
SCSI standards
I/O alignment and size, SCSI
347
Storage Administration Guide
storage considerations during installation, Separate Partitions for /home, /opt, /usr/local
setting up a cache
FS-Cache, Setting up a Cache
SSM
System Storage Manager, System Storage Manager (SSM)
Back Ends, SSM Back Ends
Installation, Installing SSM
list command, Displaying Information about All Detected Devices
348
INDEX
stripe geometry
ext4, Creating an ext4 File System
striping
RAID, RAID Levels and Linear Support
RAID fundamentals, Redundant Array of Independent Disks (RAID)
su (mkfs.xfs sub-options)
XFS, Creating an XFS File System
349
Storage Administration Guide
subsystems of RAID
RAID, Linux RAID Subsystems
suspending
XFS, Suspending an XFS File System
sw (mkfs.xfs sub-options)
XFS, Creating an XFS File System
LVM2
creating, Creating an LVM2 Logical Volume for Swap
extending, Extending Swap on an LVM2 Logical Volume
reducing, Reducing Swap on an LVM2 Logical Volume
removing, Removing an LVM2 Logical Volume for Swap
system information
file systems, Gathering File System Information
/dev/shm, df Command
350
INDEX
T
targets
iSCSI, Logging in to an iSCSI Target
throughput classes
solid-state disks, Solid-State Disk Deployment Guidelines
transport
Fibre Channel API, Fibre Channel API
TRIM command
solid-state disks, Solid-State Disk Deployment Guidelines
troubleshooting
online storage, Troubleshooting Online Storage Configuration
tune2fs
converting to ext3 with, Converting to an ext3 File System
reverting to ext2 with, Reverting to an Ext2 File System
tune2fs (mounting)
ext4, Mounting an ext4 File System
U
udev rule (timeout)
351
Storage Administration Guide
uquota/uqnoenforce
XFS, XFS Quota Management
userspace access
I/O alignment and size, Userspace Access
V
var directory, The /var/ Directory
var/lib/rpm/ directory, Special Red Hat Enterprise Linux File Locations
var/spool/up2date/ directory, Special Red Hat Enterprise Linux File Locations
verifying if a device is blocked
Fibre Channel
modifying link loss behavior, Fibre Channel
version
what is new
autofs, Improvements in autofs Version 5 over Version 4
352
INDEX
volume_key
commands, volume_key Commands
individual user, Using volume_key as an Individual User
W
what's new
storage considerations during installation, Storage Considerations During Installation
write barriers
battery-backed write caches, Battery-Backed Write Caches
definition, Write Barriers
disabling write caches, Disabling Write Caches
enablind/disabling, Enabling and Disabling Write Barriers
error messages, Enabling and Disabling Write Barriers
ext4, Mounting an ext4 File System
high-end arrays, High-End Arrays
how write barriers work, How Write Barriers Work
importance of write barriers, Importance of Write Barriers
NFS, NFS
XFS, Write Barriers
WWID
persistent naming, World Wide Identifier (WWID)
X
XFS
allocation features, The XFS File System
backup/restoration, Backing Up and Restoring XFS File Systems
creating, Creating an XFS File System
cumulative mode (xfsrestore), Restoration
dump levels, Backup
expert mode (xfs_quota), XFS Quota Management
file system types, The XFS File System
fsync(), The XFS File System
gquota/gqnoenforce, XFS Quota Management
increasing file system size, Increasing the Size of an XFS File System
353
Storage Administration Guide
xfsdump
XFS, Backup
xfsprogs
XFS, Suspending an XFS File System
xfsrestore
XFS, Restoration
354
INDEX
xfs_admin
XFS, Other XFS File System Utilities
xfs_bmap
XFS, Other XFS File System Utilities
xfs_copy
XFS, Other XFS File System Utilities
xfs_db
XFS, Other XFS File System Utilities
xfs_freeze
XFS, Suspending an XFS File System
xfs_fsr
XFS, Other XFS File System Utilities
xfs_growfs
XFS, Increasing the Size of an XFS File System
xfs_info
XFS, Other XFS File System Utilities
xfs_mdrestore
XFS, Other XFS File System Utilities
xfs_metadump
XFS, Other XFS File System Utilities
xfs_quota
XFS, XFS Quota Management
xfs_repair
XFS, Repairing an XFS File System
355
Red Hat Enterprise Linux 7.0 Beta
System Administrators Guide
Jaromír Hradílek
Red Hat Engineering Content Services
jhradilek@redhat.com
Douglas Silas
Red Hat Engineering Content Services
silas@redhat.com
Martin Prpič
Red Hat Engineering Content Services
mprpic@redhat.com
Stephen Wadeley
Red Hat Engineering Content Services
swadeley@redhat.com
Eva Kopalová
Red Hat Engineering Content Services
ekopalova@redhat.com
Ella Lackey
Red Hat Engineering Content Services
dlackey@redhat.com
Tomáš Čapek
Red Hat Engineering Content Services
tcapek@redhat.com
Petr Kovář
Red Hat Engineering Content Services
pkovar@redhat.com
Miroslav Svoboda
Red Hat Engineering Content Services
msvoboda@redhat.com
Petr Bokoč
Red Hat Engineering Content Services
pbokoc@redhat.com
Peter Ondrejka
Red Hat Engineering Content Services
pondrejk@redhat.com
Eliška Slobodová
Red Hat Engineering Content Services
eslobodo@redhat.com
John Ha
Red Hat Engineering Content Services
Red Hat Engineering Content Services
Legal Notice
David O'Brien
Red Hat Engineering
Copyright Content
© 2014 Red Hat,Services
Inc.
Michael Hideo
This document is licensed by Red Hat under the Creative Commons Attribution-ShareAlike 3.0 Unported
Red Hat Engineering Content Services
License. If you distribute this document, or a modified version of it, you must provide attribution to Red
Hat,Domingo
Don Inc. and provide a link to the original. If the document is modified, all Red Hat trademarks must be
removed.
Red Hat Engineering Content Services
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section
4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo,
and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries.
Linux ® is the registered trademark of Linus Torvalds in the United States and other countries.
XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States
and/or other countries.
MySQL ® is a registered trademark of MySQL AB in the United States, the European Union and other
countries.
Node.js ® is an official trademark of Joyent. Red Hat Software Collections is not formally related to or
endorsed by the official Joyent Node.js open source or commercial project.
The OpenStack ® Word Mark and OpenStack Logo are either registered trademarks/service marks or
trademarks/service marks of the OpenStack Foundation, in the United States and other countries and
are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored
by the OpenStack Foundation, or the OpenStack community.
Table of Contents
.Preface
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
..........
1. Target Audience 17
2. About This Book 17
3. How to Read this Book 17
4. Document Conventions 20
4.1. Typographic Conventions 20
4.2. Pull-quote Conventions 21
4.3. Notes and Warnings 22
5. Feedback 22
6. Acknowledgments 23
. . . . I.. .Basic
Part . . . . . System
. . . . . . .Configuration
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
..........
.Chapter
. . . . . . .1.. .System
. . . . . . Locale
. . . . . . .and
. . . Keyboard
. . . . . . . . . Configuration
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
..........
1.1. Setting the System Locale 25
1.1.1. Displaying the Current Status 25
1.1.2. Listing Available Locales 26
1.1.3. Setting the Locale 26
1.2. Changing the Keyboard Layout 27
1.2.1. Displaying the Current Settings 27
1.2.2. Listing Available Keymaps 27
1.2.3. Setting the Keymap 27
1.3. Additional Resources 28
Installed Documentation 28
See Also 28
.Chapter
. . . . . . .2.. .Configuring
. . . . . . . . . . the
. . . .Date
. . . . and
. . . .Time
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
..........
2.1. Using the timedatectl Command 30
2.1.1. Displaying the Current Date and Time 30
2.1.2. Changing the Current Date 31
2.1.3. Changing the Current Time 31
2.1.4. Changing the Time Zone 32
2.1.5. Synchronizing the System Clock with a Remote Server 32
2.2. Using the date Command 33
2.2.1. Displaying the Current Date and Time 33
2.2.2. Changing the Current Date 34
2.2.3. Changing the Current Time 34
2.3. Additional Resources 35
Installed Documentation 35
See Also 35
.Chapter
. . . . . . .3.. .Managing
. . . . . . . . .Users
. . . . . and
. . . .Groups
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
..........
3.1. Introduction to Users and Groups 36
3.1.1. User Private Groups 36
3.1.2. Shadow Passwords 36
3.2. Using the User Manager Tool 37
3.2.1. Viewing Users and Groups 37
3.2.2. Adding a New User 38
3.2.3. Adding a New Group 39
3.2.4. Modifying User Properties 39
3.2.5. Modifying Group Properties 40
3.3. Using Command Line Tools 41
3.3.1. Adding a New User 41
1
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
.Chapter
. . . . . . .4.. .Gaining
. . . . . . .Privileges
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
..........
4.1. The su Command 47
4.2. The sudo Command 48
4.3. Additional Resources 49
Installed Documentation 49
Online Documentation 49
See Also 50
. . . . II.
Part . . Package
. . . . . . . . Management
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
..........
.Chapter
. . . . . . .5.. .Yum
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
..........
5.1. Checking For and Updating Packages 52
5.1.1. Checking For Updates 52
5.1.2. Updating Packages 53
Updating a Single Package 53
Updating All Packages and Their Dependencies 55
Updating Security-Related Packages 55
5.1.3. Preserving Configuration File Changes 55
5.2. Working with Packages 55
5.2.1. Searching Packages 55
Filtering the Results 56
5.2.2. Listing Packages 56
Listing Repositories 58
5.2.3. Displaying Package Information 58
Using yumdb 59
5.2.4. Installing Packages 60
5.2.5. Downloading Packages 64
5.2.6. Removing Packages 64
5.3. Working with Package Groups 65
5.3.1. Listing Package Groups 65
5.3.2. Installing a Package Group 67
5.3.3. Removing a Package Group 68
5.4. Working with Transaction History 68
5.4.1. Listing Transactions 68
5.4.2. Examining Transactions 72
5.4.3. Reverting and Repeating Transactions 74
5.4.4. Starting New Transaction History 74
5.5. Configuring Yum and Yum Repositories 75
5.5.1. Setting [main] Options 75
5.5.2. Setting [repository] Options 79
5.5.3. Using Yum Variables 81
5.5.4. Viewing the Current Configuration 82
5.5.5. Adding, Enabling, and Disabling a Yum Repository 83
Adding a Yum Repository 83
Enabling a Yum Repository 84
Disabling a Yum Repository 84
5.5.6. Creating a Yum Repository 85
5.6. Yum Plug-ins 85
2
Table of Contents
.Chapter
. . . . . . .6.. .PackageKit
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
..........
6.1. Updating Packages with Software Update 94
Setting the Update-Checking Interval 95
6.2. Using Add/Remove Software 95
6.2.1. Refreshing Software Sources (Yum Repositories) 96
6.2.2. Finding Packages with Filters 96
6.2.3. Installing and Removing Packages (and Dependencies) 98
6.2.4. Installing and Removing Package Groups 100
6.2.5. Viewing the Transaction Log 101
6.3. PackageKit Architecture 101
6.4. Additional Resources 102
Online Documentation 102
See Also 103
. . . . III.
Part . . .Infrastructure
. . . . . . . . . . . .Services
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
...........
.Chapter
. . . . . . .7.. .Managing
. . . . . . . . .Services
. . . . . . . with
. . . . .systemd
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
...........
7.1. Introduction to systemd 105
7.1.1. Main Features 105
7.1.2. Compatibility Changes 106
7.2. Managing System Services 107
7.2.1. Listing Services 108
7.2.2. Displaying Service Status 110
7.2.3. Starting a Service 111
7.2.4. Stopping a Service 111
7.2.5. Restarting a Service 112
7.2.6. Enabling a Service 112
7.2.7. Disabling a Service 113
7.3. Working with systemd Targets 114
7.3.1. Viewing the Default Target 115
7.3.2. Viewing the Current Target 116
7.3.3. Changing the Default Target 116
7.3.4. Changing the Current Target 117
7.3.5. Changing to Rescue Mode 117
7.3.6. Changing to Emergency Mode 118
7.4. Shutting Down, Suspending, and Hibernating the System 118
7.4.1. Shutting Down the System 119
7.4.2. Restarting the System 119
7.4.3. Suspending the System 119
7.4.4. Hibernating the System 120
7.5. Controlling systemd on a Remote Machine 120
7.6. Additional Resources 121
Installed Documentation 121
Online Documentation 121
3
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
.Chapter
. . . . . . .8.. .OpenSSH
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
...........
8.1. The SSH Protocol 123
8.1.1. Why Use SSH? 123
8.1.2. Main Features 124
8.1.3. Protocol Versions 124
8.1.4. Event Sequence of an SSH Connection 125
8.1.4.1. Transport Layer 125
8.1.4.2. Authentication 126
8.1.4.3. Channels 126
8.2. Configuring OpenSSH 126
8.2.1. Configuration Files 126
8.2.2. Starting an OpenSSH Server 128
8.2.3. Requiring SSH for Remote Connections 128
8.2.4. Using Key-based Authentication 128
8.2.4.1. Generating Key Pairs 129
8.2.4.2. Configuring ssh-agent 131
8.3. OpenSSH Clients 133
8.3.1. Using the ssh Utility 134
8.3.2. Using the scp Utility 135
8.3.3. Using the sftp Utility 135
8.4. More Than a Secure Shell 136
8.4.1. X11 Forwarding 136
8.4.2. Port Forwarding 137
8.5. Additional Resources 138
Installed Documentation 138
Online Documentation 138
See Also 138
.Chapter
. . . . . . .9.. .TigerVNC
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140
...........
9.1. VNC Server 140
9.1.1. Installing VNC Server 140
9.1.2. Configuring VNC Server 140
9.1.3. Starting VNC Server 141
9.1.3.1. Troubleshooting 141
9.1.4. Terminating VNC session 142
9.2. VNC Viewer 142
9.2.1. Connecting to VNC Server 142
9.2.1.1. Switching off firewall to enable VNC connection 143
9.2.2. Connecting to VNC Server using SSH 143
9.3. Additional Resources 143
. . . . IV.
Part . . .Servers
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 144
...........
.Chapter
. . . . . . .10.
. . .Web
. . . .Servers
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145
...........
10.1. The Apache HTTP Server 145
10.1.1. Notable Changes 145
10.1.2. Updating the Configuration 148
10.1.3. Running the httpd Service 148
10.1.3.1. Starting the Service 148
10.1.3.2. Stopping the Service 149
10.1.3.3. Restarting the Service 149
10.1.3.4. Verifying the Service Status 149
10.1.4. Editing the Configuration Files 150
10.1.5. Working with Modules 150
4
Table of Contents
.Chapter
. . . . . . .11.
. . .Mail
. . . .Servers
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
...........
11.1. Email Protocols 159
11.1.1. Mail Transport Protocols 159
11.1.1.1. SMTP 159
11.1.2. Mail Access Protocols 159
11.1.2.1. POP 160
11.1.2.2. IMAP 160
11.1.2.3. Dovecot 161
11.2. Email Program Classifications 162
11.2.1. Mail Transport Agent 162
11.2.2. Mail Delivery Agent 162
11.2.3. Mail User Agent 163
11.3. Mail Transport Agents 163
11.3.1. Postfix 163
11.3.1.1. The Default Postfix Installation 163
11.3.1.2. Basic Postfix Configuration 164
11.3.1.3. Using Postfix with LDAP 164
11.3.1.3.1. The /etc/aliases lookup example 165
11.3.2. Sendmail 165
11.3.2.1. Purpose and Limitations 165
11.3.2.2. The Default Sendmail Installation 166
11.3.2.3. Common Sendmail Configuration Changes 167
11.3.2.4. Masquerading 168
11.3.2.5. Stopping Spam 168
11.3.2.6. Using Sendmail with LDAP 169
11.3.3. Fetchmail 169
11.3.3.1. Fetchmail Configuration Options 170
11.3.3.2. Global Options 171
11.3.3.3. Server Options 171
11.3.3.4. User Options 172
11.3.3.5. Fetchmail Command Options 172
11.3.3.6. Informational or Debugging Options 172
11.3.3.7. Special Options 173
11.3.4. Mail Transport Agent (MTA) Configuration 173
11.4. Mail Delivery Agents 173
11.4.1. Procmail Configuration 174
11.4.2. Procmail Recipes 175
11.4.2.1. Delivering vs. Non-Delivering Recipes 175
11.4.2.2. Flags 176
11.4.2.3. Specifying a Local Lockfile 176
11.4.2.4. Special Conditions and Actions 176
11.4.2.5. Recipe Examples 177
11.4.2.6. Spam Filters 178
11.5. Mail User Agents 179
5
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
.Chapter
. . . . . . .12.
. . .Directory
. . . . . . . .Servers
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
...........
12.1. OpenLDAP 183
12.1.1. Introduction to LDAP 183
12.1.1.1. LDAP Terminology 183
12.1.1.2. OpenLDAP Features 184
12.1.1.3. OpenLDAP Server Setup 184
12.1.2. Installing the OpenLDAP Suite 185
12.1.2.1. Overview of OpenLDAP Server Utilities 185
12.1.2.2. Overview of OpenLDAP Client Utilities 186
12.1.2.3. Overview of Common LDAP Client Applications 187
12.1.3. Configuring an OpenLDAP Server 187
12.1.3.1. Changing the Global Configuration 188
12.1.3.2. Changing the Database-Specific Configuration 190
12.1.3.3. Extending Schema 192
12.1.4. Running an OpenLDAP Server 192
12.1.4.1. Starting the Service 192
12.1.4.2. Stopping the Service 192
12.1.4.3. Restarting the Service 193
12.1.4.4. Verifying the Service Status 193
12.1.5. Configuring a System to Authenticate Using OpenLDAP 193
12.1.5.1. Migrating Old Authentication Information to LDAP Format 193
12.1.6. Additional Resources 194
12.1.6.1. Installed Documentation 194
12.1.6.2. Useful Websites 195
12.1.6.3. Related Books 195
.Chapter
. . . . . . .13.
. . .File
. . . and
. . . . Print
. . . . .Servers
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197
...........
13.1. Samba 197
13.1.1. Introduction to Samba 197
13.1.1.1. Samba Features 197
13.1.2. Samba Daemons and Related Services 198
13.1.2.1. Samba Daemons 198
13.1.3. Connecting to a Samba Share 199
13.1.3.1. Command Line 200
13.1.3.2. Mounting the Share 200
13.1.4. Configuring a Samba Server 201
13.1.4.1. Graphical Configuration 201
13.1.4.2. Command Line Configuration 201
13.1.4.3. Encrypted Passwords 202
13.1.5. Starting and Stopping Samba 202
13.1.6. Samba Network Browsing 203
13.1.6.1. Domain Browsing 203
13.1.6.2. WINS (Windows Internet Name Server) 204
13.1.7. Samba Distribution Programs 204
13.1.8. Additional Resources 208
13.1.8.1. Installed Documentation 209
13.1.8.2. Related Books 209
13.1.8.3. Useful Websites 209
6
Table of Contents
.Chapter
. . . . . . .14.
. . .Configuring
. . . . . . . . . . NTP
. . . . Using
. . . . . .the
. . . chrony
. . . . . . .Suite
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232
...........
14.1. Introduction to the chrony Suite 232
14.1.1. Differences Between ntpd and chronyd 232
14.1.2. Choosing Between NTP Daemons 233
14.2. Understanding chrony and Its Configuration 233
14.2.1. Understanding chronyd 233
14.2.2. Understanding chronyc 233
14.2.3. Understanding the chrony Configuration Commands 233
14.2.4. Security with chronyc 237
14.3. Using chrony 239
14.3.1. Checking if chrony is Installed 239
14.3.2. Installing chrony 239
14.3.3. Checking the Status of chronyd 239
14.3.4. Starting chronyd 239
14.3.5. Stopping chronyd 239
14.3.6. Checking if chrony is Synchronized 240
14.3.6.1. Checking chrony Tracking 240
14.3.6.2. Checking chrony Sources 242
14.3.6.3. Checking chrony Source Statistics 243
14.3.7. Manually Adjusting the System Clock 244
14.4. Setting Up chrony for Different Environments 244
14.4.1. Setting Up chrony for a System Which is Infrequently Connected 244
14.4.2. Setting Up chrony for a System in an Isolated Network 245
7
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
.Chapter
. . . . . . .15.
. . .Configuring
. . . . . . . . . . NTP
. . . . Using
. . . . . .ntpd
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248
...........
15.1. Introduction to NTP 248
15.2. NTP Strata 248
15.3. Understanding NTP 249
15.4. Understanding the Drift File 250
15.5. UTC, Timezones, and DST 250
15.6. Authentication Options for NTP 251
15.7. Managing the Time on Virtual Machines 251
15.8. Understanding Leap Seconds 251
15.9. Understanding the ntpd Configuration File 252
15.10. Understanding the ntpd Sysconfig File 253
15.11. Disabling chrony 253
15.12. Checking if the NTP Daemon is Installed 254
15.13. Installing the NTP Daemon (ntpd) 254
15.14. Checking the Status of NTP 254
15.15. Configure the Firewall to Allow Incoming NTP Packets 254
15.15.1. Change the Firewall Settings 255
15.15.2. Open Ports in the Firewall for NTP Packets 255
15.16. Configure ntpdate Servers 255
15.17. Configure NTP 256
15.17.1. Configure Access Control to an NTP Service 256
15.17.2. Configure Rate Limiting Access to an NTP Service 257
15.17.3. Adding a Peer Address 257
15.17.4. Adding a Server Address 258
15.17.5. Adding a Broadcast or Multicast Server Address 258
15.17.6. Adding a Manycast Client Address 258
15.17.7. Adding a Broadcast Client Address 259
15.17.8. Adding a Manycast Server Address 259
15.17.9. Adding a Multicast Client Address 259
15.17.10. Configuring the Burst Option 259
15.17.11. Configuring the iburst Option 260
15.17.12. Configuring Symmetric Authentication Using a Key 260
15.17.13. Configuring the Poll Interval 260
15.17.14. Configuring Server Preference 260
15.17.15. Configuring the Time-to-Live for NTP Packets 261
15.17.16. Configuring the NTP Version to Use 261
15.18. Configuring the Hardware Clock Update 261
15.19. Configuring Clock Sources 261
15.20. Additional Resources 262
15.20.1. Installed Documentation 262
15.20.2. Useful Websites 262
.Chapter
. . . . . . .16.
. . .Configuring
. . . . . . . . . . PTP
. . . . Using
. . . . . .ptp4l
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263
...........
16.1. Introduction to PTP 263
16.1.1. Understanding PTP 263
16.1.2. Advantages of PTP 264
16.2. Using PTP 265
16.2.1. Checking for Driver and Hardware Support 265
16.2.2. Installing PTP 265
8
Table of Contents
. . . . V.
Part . . Monitoring
. . . . . . . . . . and
. . . . Automation
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273
...........
.Chapter
. . . . . . .17.
. . .System
. . . . . . Monitoring
. . . . . . . . . . Tools
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274
...........
17.1. Viewing System Processes 274
17.1.1. Using the ps Command 274
17.1.2. Using the top Command 275
17.1.3. Using the System Monitor Tool 276
17.2. Viewing Memory Usage 277
17.2.1. Using the free Command 277
17.2.2. Using the System Monitor Tool 278
17.3. Viewing CPU Usage 279
17.3.1. Using the System Monitor Tool 279
17.4. Viewing Block Devices and File Systems 280
17.4.1. Using the lsblk Command 280
17.4.2. Using the blkid Command 281
17.4.3. Using the findmnt Command 282
17.4.4. Using the df Command 283
17.4.5. Using the du Command 284
17.4.6. Using the System Monitor Tool 285
17.5. Viewing Hardware Information 285
17.5.1. Using the lspci Command 285
17.5.2. Using the lsusb Command 286
17.5.3. Using the lspcmcia Command 287
17.5.4. Using the lscpu Command 287
17.6. Monitoring Performance with Net-SNMP 288
17.6.1. Installing Net-SNMP 288
17.6.2. Running the Net-SNMP Daemon 289
17.6.2.1. Starting the Service 289
17.6.2.2. Stopping the Service 289
17.6.2.3. Restarting the Service 290
17.6.3. Configuring Net-SNMP 290
17.6.3.1. Setting System Information 290
17.6.3.2. Configuring Authentication 291
Configuring SNMP Version 2c Community 291
Configuring SNMP Version 3 User 291
17.6.4. Retrieving Performance Data over SNMP 292
17.6.4.1. Hardware Configuration 293
17.6.4.2. CPU and Memory Information 293
17.6.4.3. File System and Disk Information 295
17.6.4.4. Network Information 295
17.6.5. Extending Net-SNMP 296
17.6.5.1. Extending Net-SNMP with Shell Scripts 296
17.6.5.2. Extending Net-SNMP with Perl 298
9
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
.Chapter
. . . . . . .18.
. . .OpenLMI
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303
...........
18.1. About OpenLMI 303
18.1.1. Main Features 303
18.1.2. Management Capabilities 303
18.2. Installing OpenLMI 304
18.2.1. Installing OpenLMI on a Managed System 304
18.2.2. Installing OpenLMI on a Client System 305
18.3. Configuring SSL Certificates for OpenPegasus 305
18.3.1. Managing Self-signed Certificates 306
18.3.2. Managing Authority-signed Certificates with Identity Management (Recommended) 307
18.3.3. Managing Authority-signed Certificates Manually 308
18.4. Using LMIShell 310
18.4.1. Starting, Using, and Exiting LMIShell 310
Starting LMIShell in Interactive Mode 310
Using Tab Completion 310
Browsing History 310
Handling Exceptions 311
Configuring a Temporary Cache 311
Exiting LMIShell 311
Running an LMIShell Script 312
18.4.2. Connecting to a CIMOM 312
Connecting to a Remote CIMOM 312
Connecting to a Local CIMOM 312
Verifying a Connection to a CIMOM 313
18.4.3. Working with Namespaces 313
Listing Available Namespaces 313
Accessing Namespace Objects 314
18.4.4. Working with Classes 314
Listing Available Classes 315
Accessing Class Objects 315
Examining Class Objects 316
Listing Available Methods 317
Listing Available Properties 317
Listing and Viewing ValueMap Properties 318
Fetching a CIMClass Object 321
18.4.5. Working with Instances 321
Accessing Instances 321
Examining Instances 322
Creating New Instances 323
Deleting Individual Instances 324
Listing and Accessing Available Properties 325
Listing and Using Available Methods 326
Listing and Viewing ValueMap Parameters 328
Refreshing Instance Objects 330
Displaying MOF Representation 330
18.4.6. Working with Instance Names 331
Accessing Instance Names 331
Examining Instance Names 332
Creating New Instance Names 332
Listing and Accessing Key Properties 333
Converting Instance Names to Instances 334
18.4.7. Working with Associated Objects 334
Accessing Associated Instances 334
10
Table of Contents
.Chapter
. . . . . . .19.
. . .Viewing
. . . . . . .and
. . . .Managing
. . . . . . . . .Log
. . . .Files
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 353
...........
19.1. Locating Log Files 353
19.2. Basic Configuration of Rsyslog 353
19.2.1. Filters 354
19.2.2. Actions 357
Specifying Multiple Actions 362
19.2.3. Templates 362
Generating Dynamic File Names 363
Properties 363
Template Examples 364
19.2.4. Global Directives 366
19.2.5. Log Rotation 366
19.2.6. Using the New Configuration Format 367
19.2.7. Rulesets 368
19.2.8. Compatibility with syslogd 369
19.3. Working with Queues in Rsyslog 369
19.3.1. Defining Queues 370
Direct Queues 370
Disk Queues 371
In-memory Queues 371
Disk-Assisted In-memory Queues 372
19.3.2. Managing Queues 372
Limiting Queue Size 372
Discarding Messages 373
Using Timeframes 373
Configuring Worker Threads 373
Batch Dequeuing 374
Terminating Queues 374
19.4. Using Rsyslog Modules 374
19.4.1. Importing Text Files 375
19.4.2. Exporting Messages to a Database 376
19.4.3. Enabling Encrypted Transport 377
19.4.4. Using RELP 377
19.5. Interaction of Rsyslog and Journal 377
19.6. Structured Logging with Rsyslog 378
19.6.1. Importing Data from Journal 379
11
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
.Chapter
. . . . . . .20.
. . .Automating
. . . . . . . . . . System
. . . . . . .Tasks
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 392
...........
20.1. Cron and Anacron 392
20.1.1. Installing Cron and Anacron 392
20.1.2. Running the Crond Service 392
20.1.2.1. Starting and Stopping the Cron Service 393
20.1.2.2. Stopping the Cron Service 393
20.1.2.3. Restarting the Cron Service 393
20.1.3. Configuring Anacron Jobs 393
20.1.3.1. Examples of Anacron Jobs 394
20.1.4. Configuring Cron Jobs 395
20.1.5. Controlling Access to Cron 397
20.1.6. Black and White Listing of Cron Jobs 397
20.2. At and Batch 397
20.2.1. Installing At and Batch 398
20.2.2. Running the At Service 398
20.2.2.1. Starting and Stopping the At Service 398
20.2.2.2. Stopping the At Service 398
20.2.2.3. Restarting the At Service 399
20.2.3. Configuring an At Job 399
20.2.4. Configuring a Batch Job 400
20.2.5. Viewing Pending Jobs 400
20.2.6. Additional Command Line Options 400
20.2.7. Controlling Access to At and Batch 400
20.3. Additional Resources 401
.Chapter
. . . . . . .21.
. . .OProfile
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
...........
21.1. Overview of Tools 402
21.1.1. operf vs. opcontrol 403
operf 403
Legacy Mode 403
21.2. Using operf 404
21.2.1. Specifying the Kernel 404
21.2.2. Setting Events to Monitor 404
21.2.3. Categorization of Samples 406
12
Table of Contents
. . . . VI.
Part . . .Kernel,
. . . . . . Module
. . . . . . . and
. . . . Driver
. . . . . .Configuration
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 423
...........
.Chapter
. . . . . . .22.
. . .Working
. . . . . . . with
. . . . the
. . . .GRUB
. . . . . 2. .Boot
. . . . Loader
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 424
...........
22.1. Configuring the GRUB 2 Boot Loader 424
22.2. Customizing GRUB 2 Menu 425
22.2.1. Changing the Default Boot Entry 426
22.2.2. Editing an Entry 426
Kernel Parameters 426
22.2.3. Adding a new Entry 426
22.2.4. Using only a Custom Menu 427
22.3. GRUB 2 Password Protection 429
22.3.1. Setting Up Users and Password Protection, Identifying Menu Entries 429
22.3.2. Preserving the Setup after GRUB 2 Updates 429
22.3.3. Password Encryption 430
22.4. Re-Installing GRUB 2 431
22.4.1. Using the grub2-install Command 431
22.4.2. Removing and Re-Installing GRUB 2 431
22.5. GRUB 2 over Serial Console 432
22.5.1. Configuring GRUB 2 432
22.5.2. Using screen to Connect to the Serial Console 432
22.6. Terminal Menu Editing During Boot 432
22.6.1. Booting to Rescue Mode 433
22.6.2. Booting to Emergency Mode 433
22.6.3. Recovering Root Password 433
22.6.4. Lost Root Password 434
22.7. Additional Resources 435
.Chapter
. . . . . . .23.
. . .Manually
. . . . . . . .Upgrading
. . . . . . . . . the
. . . .Kernel
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436
...........
23.1. Overview of Kernel Packages 436
23.2. Preparing to Upgrade 437
23.3. Downloading the Upgraded Kernel 438
23.4. Performing the Upgrade 438
23.5. Verifying the Initial RAM Disk Image 439
13
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Verifying the Initial RAM Disk Image and Kernel on IBM eServer System i 440
23.6. Verifying the Boot Loader 441
.Chapter
. . . . . . .24.
. . .Working
. . . . . . . with
. . . . Kernel
. . . . . . Modules
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 442
...........
24.1. Listing Currently-Loaded Modules 442
24.2. Displaying Information About a Module 443
24.3. Loading a Module 446
24.4. Unloading a Module 446
24.5. Setting Module Parameters 447
24.6. Persistent Module Loading 448
24.7. Specific Kernel Module Capabilities 449
24.7.1. Using Multiple Ethernet Cards 449
24.7.2. Using Channel Bonding 449
24.7.2.1. Bonding Module Directives 450
24.8. Additional Resources 456
Manual Page Documentation 456
Installable and External Documentation 456
.RPM
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 457
...........
A.1. RPM Design Goals 458
A.2. Using RPM 459
A.2.1. Finding RPM Packages 459
A.2.2. Installing and Upgrading 459
A.2.2.1. Package Already Installed 460
A.2.2.2. Conflicting Files 461
A.2.2.3. Unresolved Dependency 461
A.2.3. Configuration File Changes 462
A.2.4. Uninstalling 462
A.2.5. Freshening 463
A.2.6. Querying 464
A.2.7. Verifying 464
A.3. Checking a Package's Signature 465
A.3.1. Importing Keys 466
A.3.2. Verifying Signature of Packages 466
A.4. Practical and Common Examples of RPM Usage 466
A.5. Additional Resources 468
A.5.1. Installed Documentation 468
A.5.2. Useful Websites 468
A.5.3. Related Books 469
.The
. . .X
. .Window
. . . . . . . System
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 470
...........
B.1. The X Server 470
B.2. Desktop Environments and Window Managers 470
B.2.1. Desktop Environments 471
B.2.2. Window Managers 471
B.3. X Server Configuration Files 472
B.3.1. The Structure of the Configuration 472
B.3.2. The xorg.conf.d Directory 473
B.3.3. The xorg.conf File 473
B.3.3.1. The InputClass section 473
B.3.3.2. The InputDevice section 474
B.3.3.3. The ServerFlags section 475
B.3.3.4. The ServerLayout Section 476
B.3.3.5. The Files section 477
B.3.3.6. The Monitor section 477
B.3.3.7. The Device section 478
14
Table of Contents
. . . . . . . . History
Revision . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484
...........
.Index
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484
...........
Symbols 484
A 484
B 485
C 486
D 486
E 486
F 487
G 488
H 489
I 489
K 489
L 491
M 492
N 493
O 493
P 495
R 499
S 500
T 503
U 503
V 504
W 505
X 505
Y 507
15
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
16
Preface
Preface
The System Administrator's Guide contains information on how to customize the Red Hat
Enterprise Linux 7 system to fit your needs. If you are looking for a comprehensive, task-oriented guide
for configuring and customizing your system, this is the manual for you.
Installing and managing packages using the graphical PackageKit and command line Yum package
managers
Configuring Apache HTTP Server, Postfix, Sendmail and other enterprise-class servers and
software
Gathering information about your system, including obtaining user-space crash data with the
Automatic Bug Reporting Tool
Working with kernel modules and upgrading the kernel
1. Target Audience
The System Administrator's Guide assumes you have a basic understanding of the Red Hat
Enterprise Linux operating system. If you need help with the installation of this system, refer to the
Red Hat Enterprise Linux 7 Installation Guide.
Chapter 1, System Locale and Keyboard Configuration documents how to configure the system
locale and how to change the default keyboard layout. Read this chapter if you need to change
the language of your system or switch to a different keyboard layout.
Chapter 2, Configuring the Date and Time covers the configuration of the system date and time.
Read this chapter if you need to change the date and time, or configure the system to
synchronize the clock with a remote server.
Chapter 3, Managing Users and Groups covers the management of users and groups in a
graphical user interface and on the command line. Read this chapter if you need to manage
users and groups on your system, or enable password aging.
Chapter 4, Gaining Privileges documents how to gain administrative privileges. Read this
chapter to learn how to use the su and sudo commands.
17
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Chapter 5, Yum describes the Yum package manager. Read this chapter for information on how
to search, install, update, and uninstall packages on the command line.
Chapter 6, PackageKit describes the PackageKit suite of graphical package management tools.
Read this chapter for information on how to search, install, update, and uninstall packages using
a graphical user interface.
Chapter 7, Managing Services with systemd provides an introduction to the systemd system and
service manager. Read this chapter to learn how to manage system services and systemd
targets on your machine, or how to shut down, restart, suspend, or hibernate your machine on
the command line.
Chapter 8, OpenSSH describes how to enable a remote login via the SSH protocol. It covers the
configuration of the sshd service, as well as a basic usage of the ssh, scp, sftp client utilities.
Read this chapter if you need a remote access to a machine.
Chapter 10, Web Servers focuses on the Apache HTTP Server 2.2, a robust, full-featured open
source web server developed by the Apache Software Foundation. Read this chapter if you
need to configure a web server on your system.
Chapter 11, Mail Servers reviews modern email protocols in use today, and some of the
programs designed to send and receive email, including Postfix, Sendmail, Fetchmail, and
Procmail. Read this chapter if you need to configure a mail server on your system.
Chapter 12, Directory Servers covers the installation and configuration of OpenLDAP 2.4, an
open source implementation of the LDAPv2 and LDAPv3 protocols. Read this chapter if you
need to configure a directory server on your system.
Chapter 13, File and Print Servers guides you through the installation and configuration of
Samba, an open source implementation of the Server Message Block (SMB) protocol, and
vsftpd, the primary FTP server shipped with Red Hat Enterprise Linux. Additionally, it explains
how to use the Printer Configuration tool to configure printers. Read this chapter if you need
to configure a file or print server on your system.
Chapter 14, Configuring NTP Using the chrony Suite covers the installation and configuration of
the chrony suite, a client and a server for the Network Time Protocol (NT P). Read this chapter
if you need to configure the system to synchronize the clock with a remote NT P server, or set up
an NT P server on this system.
Chapter 15, Configuring NTP Using ntpd covers the installation and configuration of the NT P
daemon, ntpd, for the Network Time Protocol (NT P). Read this chapter if you need to configure
the system to synchronize the clock with a remote NT P server, or set up an NT P server on this
18
Preface
Chapter 16, Configuring PTP Using ptp4l covers the installation and configuration of the
Precision Time Protocol application, ptp4l, an application for use with network drivers that
support the Precision Network Time Protocol (PT P). Read this chapter if you need to configure
the system to synchronize the system clock with a master PT P clock.
Chapter 17, System Monitoring Tools discusses applications and commands that can be used
to retrieve important information about the system. Read this chapter to learn how to gather
essential system information.
Chapter 18, OpenLMI documents OpenLMI, a common infrastructure for the management of
Linux systems. Read this chapter to learn how to use this infrastracture to monitor and manage
remote systems.
Chapter 19, Viewing and Managing Log Files describes the configuration of the rsyslog
daemon, and explains how to locate, view, and monitor log files. Read this chapter to learn how
to work with log files.
Chapter 20, Automating System Tasks provides an overview of the cron, at, and batch
utilities. Read this chapter to learn how to use these utilities to perform automated tasks.
Chapter 21, OProfile covers OProfile, a low overhead, system-wide performance monitoring
tool. Read this chapter for information on how to use OProfile on your system.
Chapter 22, Working with the GRUB 2 Boot Loader provides an introduction to GRUB 2 and
explains how to re-install and configure it on your system. Read this chapter if you need to
configure or interact with the GRUB 2 boot loader.
Chapter 23, Manually Upgrading the Kernel provides important information on how to manually
update a kernel package using the rpm command instead of yum . Read this chapter if you
cannot update a kernel package with the Yum package manager.
Chapter 24, Working with Kernel Modules explains how to display, query, load, and unload
kernel modules and their dependencies, and how to set module parameters. Additionally, it
covers specific kernel module capabilities such as using multiple Ethernet cards and using
channel bonding. Read this chapter if you need to work with kernel modules.
Appendix A, RPM
This appendix concentrates on the RPM Package Manager (RPM), an open packaging system
used by Red Hat Enterprise Linux, and the use of the rpm utility. Read this appendix if you need
to use rpm instead of yum .
19
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
used by Red Hat Enterprise Linux. Read this appendix if you need to adjust the configuration of
your X Window System.
4. Document Conventions
This manual uses several conventions to highlight certain words and phrases and draw attention to
specific pieces of information.
In PDF and paper editions, this manual uses typefaces drawn from the Liberation Fonts set. The
Liberation Fonts set is also used in HTML editions if the set is installed on your system. If not, alternative
but equivalent typefaces are displayed. Note: Red Hat Enterprise Linux 5 and later include the Liberation
Fonts set by default.
Mono-spaced Bold
Used to highlight system input, including shell commands, file names and paths. Also used to highlight
keys and key combinations. For example:
The above includes a file name, a shell command and a key, all presented in mono-spaced bold and all
distinguishable thanks to context.
Key combinations can be distinguished from an individual key by the plus sign that connects each part of
a key combination. For example:
The first example highlights a particular key to press. The second example highlights a key combination:
a set of three keys pressed simultaneously.
If source code is discussed, class names, methods, functions, variable names and returned values
mentioned within a paragraph will be presented as above, in m ono-spaced bold. For example:
File-related classes include filesystem for file systems, file for files, and dir for
directories. Each class has its own associated set of permissions.
Proportional Bold
This denotes words or phrases encountered on a system, including application names; dialog-box text;
labeled buttons; check-box and radio-button labels; menu titles and submenu titles. For example:
Choose System → Preferences → Mouse from the main menu bar to launch Mouse
Preferences. In the Buttons tab, select the Left-handed m ouse check box and click
Close to switch the primary mouse button from the left to the right (making the mouse
suitable for use in the left hand).
20
Preface
The above text includes application names; system-wide menu names and items; application-specific
menu names; and buttons and text found within a GUI interface, all presented in proportional bold and all
distinguishable by context.
Whether mono-spaced bold or proportional bold, the addition of italics indicates replaceable or variable
text. Italics denotes text you do not input literally or displayed text that changes depending on
circumstance. For example:
To connect to a remote machine using ssh, type ssh username@ domain.name at a shell
prompt. If the remote machine is exam ple.com and your username on that machine is
john, type ssh john@ exam ple.com .
The m ount -o rem ount file-system command remounts the named file system. For
example, to remount the /hom e file system, the command is m ount -o rem ount /hom e.
To see the version of a currently installed package, use the rpm -q package command. It
will return a result as follows: package-version-release.
Note the words in bold italics above: username, domain.name, file-system, package, version and
release. Each word is a placeholder, either for text you enter when issuing a command or for text
displayed by the system.
Aside from standard usage for presenting the title of a work, italics denotes the first use of a new and
important term. For example:
Source-code listings are also set in m ono-spaced rom an but add syntax highlighting as follows:
21
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
mutex_lock(&kvm->lock);
match = kvm_find_assigned_dev(&kvm->arch.assigned_dev_head,
assigned_dev->assigned_dev_id);
if (!match) {
printk(KERN_INFO "%s: device hasn't been assigned before, "
"so cannot be deassigned\n", __func__);
r = -EINVAL;
goto out;
}
kvm_deassign_device(kvm, match);
kvm_free_assigned_device(kvm, match);
out:
mutex_unlock(&kvm->lock);
return r;
}
Note
Notes are tips, shortcuts or alternative approaches to the task at hand. Ignoring a note should
have no negative consequences, but you might miss out on a trick that makes your life easier.
Important
Important boxes detail things that are easily missed: configuration changes that only apply to the
current session, or services that need restarting before an update will apply. Ignoring a box
labeled “Important” will not cause data loss but may cause irritation and frustration.
Warning
Warnings should not be ignored. Ignoring warnings will most likely cause data loss.
5. Feedback
If you find a typographical error in this manual, or if you have thought of a way to make this manual
better, we would love to hear from you! Please submit a report in Bugzilla against the product Red Hat
Enterprise Linux 7.
22
Preface
If you have a suggestion for improving the documentation, try to be as specific as possible when
describing it. If you have found an error, please include the section number and some of the surrounding
text so we can find it easily.
6. Acknowledgments
Certain portions of this text first appeared in the Deployment Guide, copyright © 2007 Red Hat, Inc.,
available at https://access.redhat.com/site/documentation/en-
US/Red_Hat_Enterprise_Linux/5/html/Deployment_Guide/index.html.
Section 17.6, “Monitoring Performance with Net-SNMP” is based on an article written by Michael Solberg.
The authors of this book would like to thank the following people for their valuable contributions: Adam
Tkáč, Andrew Fitzsimon, Andrius Benokraitis, Brian Cleary Edward Bailey, Garrett LeSage, Jeffrey
Fearn, Joe Orton, Joshua Wulf, Karsten Wade, Lucy Ringland, Marcela Mašláňová, Mark Johnson,
Michael Behm, Miroslav Lichvár, Radek Vokál, Rahul Kavalapara, Rahul Sundaram, Sandra Moore,
Zbyšek Mráz, Jan Včelák, Peter Hutterer and James Antill, among many others.
23
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
24
Chapter 1. System Locale and Keyboard Configuration
These settings can be done by modifying the /etc/locale.conf configuration file of with use or the
localectl utility. Also, you can use the graphic user interface to perform the task, for description of this
method, see .
The basic file format of /etc/locale.conf is a newline-separated list of variable assignments. For
example, German locale with English messages in /etc/locale.conf looks as follows:
LANG=de_DE.UTF-8
LC_MESSAGES=C
Here, the LC_MESSAGES option determines the locale used for diagnostic messages written to the
standard error output. To further specify locale settings in /etc/locale.conf, you can use several
other options, most relevant are summarized in Table 1.1, “Options configurable in /etc/locale.conf” See
the locale(7) manual page for detailed information on these options. Note that the LC_ALL option,
which represents all possible options, should not be configured in /etc/locale.conf.
Option Description
LANG Provides a default value for the system locale.
LC_COLLATE Changes the behavior of functions which compare
strings in the local alphabet.
LC_CTYPE Changes the behavior of the character handling
and classification functions and the multibyte
character functions.
LC_NUMERIC Describes the way numbers are usually printed,
with details such as decimal point versus decimal
comma.
LC_TIME Changes the display of the current time, 24-hour
versus 12-hour clock.
LC_MESSAGES Determines the locale used for diagnostic
messages written to the standard error output.
localectl status
25
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The output of the previous command lists the currently set locale, keyboard layout configured for the
console and for the X11 window system.
localectl list-locales
Imagine you want to select a specific English locale, but you are not sure if it is available on the
system. You can check that by listing all English locales with the following command:
output truncated
Replace locale with the locale name, found with list-locales. With this command, you can also set
options from Table 1.1, “Options configurable in /etc/locale.conf”
For example, if you want to set British English as your default locale, first find the name of this locale
by using list-locales. Then, as a root user, type the command in the following form:
26
Chapter 1. System Locale and Keyboard Configuration
localectl status
In the following output, you can see the keyboard layout configured for the virtual console and for the
X11 window system.
localectl list-keymaps
You can use grep to search the output of the previous command for a specific keymap name. There
are often multiple keymaps compatible with your currently set locale. For example, to find available
Czech keyboard layouts, type:
27
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Replace map with the name of keymap taken from the output of list-keym aps. Unless the --no-
convert option is passed, the selected setting is also applied to the default keyboard mapping of the
X11 window system, after converting it to the closest matching X11 keyboard mapping. This also applies
reversely, you can specify the both keymaps with the following command (as a root):
If you want your X11 layout to differ from the console layout, use the --no-convert option
With this option, the X11 keymap is specified without changing the previous console layout setting.
Imagine you want to use German keyboard layout in the graphical interface, but for console
operations you want to retain the US keymap. To do so, type (as a root):
Then you can verify if your setting was successful by checking the current status:
Apart from keyboard layout (map), three other options can specified:
Replace model with the keyboard model name, variant and options with keyboard variant and option
components, which can be used to enhance the keyboard behavior. These options are not set by
default. For more information on X11 Model, X11 Variant and X11 Options see kbd(4 ) man page.
Installed Documentation
localectl(1) — The manual page for the localectl command line utility documents how to use
this tool to configure the system locale and keyboard layout.
loadkeys(1) — The manual page for the loadkeys command provides more information on how to
use this tool to change the keyboard layout in a virtual console.
See Also
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
28
Chapter 1. System Locale and Keyboard Configuration
Chapter 7, Managing Services with systemd provides more information on systemd and documents
how to use the system ctl command to manage system services.
29
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
A real-time clock (RTC), commonly referred to as hardware clock, is typically an integrated circuit on
the system board that is completely independent on the current state of the operating system and
runs even when the computer is shut down.
A system clock, also known as software clock, is maintained by the kernel and its initial value is based
on the real-time clock. Once the system is booted and the system clock is initialized, the system clock
is completely independent of the real-time clock.
The real-time clock can use either local time or Coordinated Universal Time (UTC). If you configure the
real-time clock to use UTC, the system time is calculated by applying the offset for your time zone and if
applicable, also daylight saving time (DST). In comparison, local time represents the actual time in your
current time zone. In most cases, it is recommended that you use UTC.
Red Hat Enterprise Linux 7 offers two command line tools that can be used to configure and display
information about the system date and time: the tim edatectl utility, which is new in Red Hat
Enterprise Linux 7 and is part of systemd, and the traditional date command.
For information on how to display the current date and time in a custom format, see also Section 2.2,
“Using the date Command”.
timedatectl
This displays the local, universal, and RTC time, the currently used time zone, the status of the NTP
configuration, and additional information related to DST.
30
Chapter 2. Configuring the Date and Time
The following is an example output of the tim edatectl command on a system that does not use the
Network Time Protocol to synchronize the system clock with a remote server:
~]$ timedatectl
Local time: Mon 2013-09-16 19:30:24 CEST
Universal time: Mon 2013-09-16 17:30:24 UTC
Timezone: Europe/Prague (CEST, +0200)
NTP enabled: no
NTP synchronized: no
RTC in local TZ: no
DST active: yes
Last DST change: DST began at
Sun 2013-03-31 01:59:59 CET
Sun 2013-03-31 03:00:00 CEST
Next DST change: DST ends (the clock jumps one hour backwards) at
Sun 2013-10-27 02:59:59 CEST
Sun 2013-10-27 02:00:00 CET
Replace YYYY with a four-digit year, MM with a two-digit month, and DD with a two-digit day of the month.
To change the current date to 2 June 2013, run the following command as root:
Replace HH with an hour, MM with a minute, and SS with a second, all typed in a two-digit form.
By default, the system is configured to use UTC. To configure your system to maintain the clock in the
local time, run the tim edatectl command with the set-local-rtc option as root:
To configure your system to maintain the clock in the local time, replace boolean with yes. To configure
the system to use UTC, replace boolean with no (the default option).
31
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To change the current time to 11:26 p.m., run the following command as root:
timedatectl list-timezones
Replace time_zone with any of the values listed by the tim edatectl list-tim ezones command.
To identify which time zone is closest to your present location, use the tim edatectl command with
the list-tim ezones command line option. For example, to list all available time zones in Europe,
type:
To configure your system to synchronize the system clock with a remote NTP server, replace boolean
with yes (the default option). To disable this feature, replace boolean with no.
32
Chapter 2. Configuring the Date and Time
To enable automatic synchronization of the system clock with a remote server, type:
For information on how to change the time zone or enable automatic synchronization of the system clock
with a remote server, see Section 2.1, “Using the timedatectl Command”.
date
This displays the day of the week followed by the current date, local time, abbreviated time zone, and
year.
By default, the date command displays the local time. To display the time in UTC, run the command
with the --utc or -u command line option:
date --utc
You can also customize the format of the displayed information by providing the +"format" option on
the command line:
date +"format"
Replace format with one or more supported control sequences as illustrated in Example 2.6, “Displaying
the Current Date and Time”. See Table 2.1, “Commonly Used Control Sequences” for a list of the most
frequently used formatting options, or the date(1) manual page for a complete list of these options.
33
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To display the current date and time in UTC, type the following at a shell prompt:
Replace YYYY with a four-digit year, MM with a two-digit month, and DD with a two-digit day of the month.
To change the current date to 2 June 2013, run the following command as root:
34
Chapter 2. Configuring the Date and Time
Replace HH with an hour, MM with a minute, and SS with a second, all typed in a two-digit form.
By default, the date command sets the system clock in the local time. To set the system clock in UTC
instead, run the command with the --utc or -u command line option:
To change the current time to 11:26 p.m., run the following command as root:
Installed Documentation
tim edatectl(1) — The manual page for the tim edatectl command line utility documents how
to use this tool to query and change the system clock and its settings.
date(1) — The manual page for the date command provides a complete list of supported command
line options.
See Also
Chapter 1, System Locale and Keyboard Configuration documents how to configure the keyboard
layout.
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
Chapter 7, Managing Services with systemd provides more information on systemd and documents
how to use the system ctl command to manage system services.
35
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Each user is associated with a unique numerical identification number called a user ID (UID). Likewise,
each group is associated with a group ID (GID). A user who creates a file is also the owner and group
owner of that file. The file is assigned separate read, write, and execute permissions for the owner, the
group, and everyone else. The file owner can be changed only by root, and access permissions can be
changed by both the root user and file owner.
Additionally, Red Hat Enterprise Linux supports access control lists (ACLs) for files and directories which
allow permissions for specific users outside of the owner to be set. For more information about this
feature, refer to the Red Hat Enterprise Linux 7 Storage Administration Guide.
User private groups make it safe to set default permissions for a newly created file or directory, allowing
both the user and the group of that user to make modifications to the file or directory.
The setting which determines what permissions are applied to a newly created file or directory is called a
umask and is configured in the /etc/bashrc file. Traditionally on UNIX systems, the um ask is set to
022, which allows only the user who created the file or directory to make modifications. Under this
scheme, all other users, including members of the creator's group, are not allowed to make any
modifications. However, under the UPG scheme, this “group protection” is not necessary since every
user has their own private group.
The following is a list of the advantages shadow passwords have over the traditional way of storing
passwords on UNIX-based systems:
Shadow passwords improve system security by moving encrypted password hashes from the world-
readable /etc/passwd file to /etc/shadow, which is readable only by the root user.
Shadow passwords store information about password aging.
Shadow passwords allow the /etc/login.defs file to enforce security policies.
Most utilities provided by the shadow-utils package work properly whether or not shadow passwords are
enabled. However, since password aging information is stored exclusively in the /etc/shadow file, any
36
Chapter 3. Managing Users and Groups
commands which create or modify password aging information do not work. The following is a list of
utilities and commands that do not work without first enabling shadow passwords:
To find a specific user or group, type the first few letters of the name in the Search filter field and
either press Enter, or click the Apply filter button. You can also sort the items according to any of
the available columns by clicking the column header.
Red Hat Enterprise Linux reserves user and group IDs below 500 for system users and groups. By
default, the User Manager does not display the system users. To view all users and groups, select Edit
→ Preferences to open the Preferences dialog box, and clear the Hide system users and
groups checkbox.
37
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The Add New User dialog box allows you to provide information about the newly created user. In order
to create a user, enter the username and full name in the appropriate fields and then type the user's
password in the Password and Confirm Password fields. The password must be at least six
characters long.
It is advisable to use a much longer password, as this makes it more difficult for an intruder to
guess it and access the account without permission. It is also recommended that the password
not be based on a dictionary term: use a combination of letters, numbers and special characters.
The Login Shell pulldown list allows you to select a login shell for the user. If you are not sure which
shell to select, accept the default value of /bin/bash.
By default, the User Manager application creates the home directory for a new user in
/hom e/username/. You can choose not to create the home directory by clearing the Create hom e
directory checkbox, or change this directory by editing the content of the Hom e Directory text
box. Note that when the home directory is created, default configuration files are copied into it from the
/etc/skel/ directory.
38
Chapter 3. Managing Users and Groups
Red Hat Enterprise Linux uses a user private group (UPG) scheme. Whenever you create a new user, a
unique group with the same name as the user is created by default. If you do not want to create this
group, clear the Create a private group for the user checkbox.
To specify a user ID for the user, select Specify user ID m anually. If the option is not selected,
the next available user ID above 500 is assigned to the new user. Because Red Hat Enterprise Linux
reserves user IDs below 500 for system users, it is not advisable to manually assign user IDs 1–499.
Clicking the OK button creates the new user. To configure more advanced user properties, such as
password expiration, modify the user's properties after adding the user.
Click OK to create the group. The new group appears in the group list.
39
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
User Data — Shows the basic user information configured when you added the user. Use this tab
to change the user's full name, password, home directory, or login shell.
Account Info — Select Enable account expiration if you want the account to expire on a
certain date. Enter the date in the provided fields. Select Local password is locked to lock the
user account and prevent the user from logging into the system.
Password Info — Displays the date that the user's password last changed. To force the user to
change passwords after a certain number of days, select Enable password expiration and
enter a desired value in the Days before change required: field. The number of days before
the user's password expires, the number of days before the user is warned to change passwords,
and days before the account becomes inactive can also be changed.
Groups — Allows you to view and configure the Primary Group of the user, as well as other groups
that you want the user to be a member of.
40
Chapter 3. Managing Users and Groups
The Group Users tab displays which users are members of the group. Use this tab to add or remove
users from the group. Click OK to save your changes.
Table 3.1. Command line utilities for managing users and groups
Utilities Description
useradd, userm od, userdel Standard utilities for adding, modifying, and deleting user
accounts.
groupadd, groupm od, Standard utilities for adding, modifying, and deleting groups.
groupdel
gpasswd Standard utility for administering the /etc/group configuration
file.
pwck, grpck Utilities that can be used for verification of the password, group,
and associated shadow files.
pwconv, pwunconv Utilities that can be used for the conversion of passwords to
shadow passwords, or back from shadow passwords to standard
passwords.
41
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
…where options are command line options as described in Table 3.2, “useradd command line options”.
By default, the useradd command creates a locked user account. To unlock the account, run the
following command as root to assign a password:
passwd username
Optionally, you can set password aging policy. Refer to Red Hat Enterprise Linux 7 Security Guide for
information on how to enable password aging.
Option Description
-c 'comment' comment can be replaced with any string. This option is generally used
to specify the full name of a user.
-d home_directory Home directory to be used instead of default /hom e/username/.
-e date Date for the account to be disabled in the format YYYY-MM-DD.
-f days Number of days after the password expires until the account is
disabled. If 0 is specified, the account is disabled immediately after the
password expires. If -1 is specified, the account is not be disabled
after the password expires.
-g group_name Group name or group number for the user's default group. The group
must exist prior to being specified here.
-G group_list List of additional (other than default) group names or group numbers,
separated by commas, of which the user is a member. The groups
must exist prior to being specified here.
-m Create the home directory if it does not exist.
-M Do not create the home directory.
-N Do not create a user private group for the user.
-p password The password encrypted with crypt.
-r Create a system account with a UID less than 500 and without a home
directory.
-s User's login shell, which defaults to /bin/bash.
-u uid User ID for the user, which must be unique and greater than 499.
juan:x:501:501::/home/juan:/bin/bash
42
Chapter 3. Managing Users and Groups
juan:!!:14798:0:99999:7:::
Note
juan:x:501:
A group with the same name as a user is called a user private group. For more information on
user private groups, refer to Section 3.1.1, “User Private Groups”.
The line created in /etc/group has the following characteristics:
It begins with the group name juan.
An x appears in the password field indicating that the system is using shadow group
passwords.
The GID matches the one listed for user juan in /etc/passwd.
4. A new line for a group named juan is created in /etc/gshadow:
juan:!::
~]# ls -l /home
total 4
drwx------. 4 juan juan 4096 Mar 3 18:23 juan
43
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
This directory is owned by user juan and group juan. It has read, write, and execute privileges
only for the user juan. All other permissions are denied.
6. The files within the /etc/skel/ directory (which contain default user settings) are copied into the
new /hom e/juan/ directory:
At this point, a locked account called juan exists on the system. To activate it, the administrator must
next assign a password to the account using the passwd command and, optionally, set password aging
guidelines.
…where options are command line options as described in Table 3.3, “groupadd command line
options”.
Option Description
-f, --force When used with -g gid and gid already exists, groupadd will choose
another unique gid for the group.
-g gid Group ID for the group, which must be unique and greater than 499.
-K, --key key=value Override /etc/login.defs defaults.
-o, --non-unique Allow to create groups with duplicate.
-p, --password password Use this encrypted password for the new group.
-r Create a system group with a GID less than 500.
For example, a group of people need to work on files in the /opt/m yproject/ directory. Some people
are trusted to modify the contents of this directory, but not everyone.
44
Chapter 3. Managing Users and Groups
1. As root, create the /opt/m yproject/ directory by typing the following at a shell prompt:
mkdir /opt/myproject
groupadd myproject
3. Associate the contents of the /opt/m yproject/ directory with the m yproject group:
4. Allow users to create files within the directory, and set the setgid bit:
At this point, all members of the m yproject group can create and edit files in the /opt/m yproject/
directory without the administrator having to change file permissions every time users write new files. To
verify that the permissions have been set correctly, run the following command:
~]# ls -l /opt
total 4
drwxrwsr-x. 3 root myproject 4096 Mar 3 18:31 myproject
Installed Documentation
For information about various utilities for managing users and groups, refer to the following manual
pages:
useradd(8) — The manual page for the useradd command documents how to use it to create new
users.
userdel(8) — The manual page for the userdel command documents how to use it to delete
users.
userm od(8) — The manual page for the userm od command documents how to use it to modify
users.
groupadd(8) — The manual page for the groupadd command documents how to use it to create
new groups.
groupdel(8) — The manual page for the groupdel command documents how to use it to delete
groups.
groupm od(8) — The manual page for the groupm od command documents how to use it to modify
group membership.
gpasswd(1) — The manual page for the gpasswd command documents how to manage the
/etc/group file.
grpck(8) — The manual page for the grpck command documents how to use it to verify the
integrity of the /etc/group file.
45
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
pwck(8) — The manual page for the pwck command documents how to use it to verify the integrity of
the /etc/passwd and /etc/shadow files.
pwconv(8) — The manual page for the pwconv command documents how to use it to convert
standard passwords to shadow passwords.
pwunconv(8) — The manual page for the pwunconv command documents how to use it to convert
shadow passwords to standard passwords.
group(5) — The manual page for the /etc/group file documents how to use this file to define
system groups.
passwd(5) — The manual page for the /etc/passwd file documents how to use this file to define
user information.
shadow(5) — The manual page for the /etc/shadow file documents how to use this file to set
passwords and account expiration information for the system.
Online Documentation
Red Hat Enterprise Linux 7 Security Guide — The Security Guide for Red Hat Enterprise Linux 7
provides additional information how to ensure password security and secure the workstation by
enabling password aging and user account locking.
Red Hat Enterprise Linux 7 Storage Administration Guide — The Storage Administration Guide for
Red Hat Enterprise Linux 7 provides instructions on how to manage storage devices and file systems
on this system.
See Also
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
46
Chapter 4. Gaining Privileges
Refer to the Red Hat Enterprise Linux 7 Security Guide for more information on administrative controls,
potential dangers and ways to prevent data loss resulting from improper use of privileged access.
Once logged in via the su command, the user is the root user and has absolute administrative access to
the system [1] . In addition, once a user has become root, it is possible for them to use the su command
to change to any other user on the system without being prompted for a password.
Because this program is so powerful, administrators within an organization may wish to limit who has
access to the command.
One of the simplest ways to do this is to add users to the special administrative group called wheel. To
do this, type the following command as root:
In the previous command, replace <username> with the username you want to add to the wheel group.
You can also use the User Manager to modify group memberships, as follows. Note: you need
Administrator privileges to perform this procedure.
1. Click the System menu on the Panel, point to Administration and then click Users and Groups
to display the User Manager. Alternatively, type the command system -config-users at a shell
prompt.
2. Click the Users tab, and select the required user in the list of users.
3. Click Properties on the toolbar to display the User Properties dialog box (or choose Properties
on the File menu).
4. Click the Groups tab, select the check box for the wheel group, and then click OK.
Refer to Section 3.2, “Using the User Manager Tool” for more information about the User Manager.
After you add the desired users to the wheel group, it is advisable to only allow these specific users to
use the su command. To do this, you will need to edit the PAM configuration file for su:
/etc/pam .d/su. Open this file in a text editor and remove the comment (#) from the following line:
This change means that only members of the administrative group wheel can switch to another user
using the su command.
47
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Note
sudo <command>
In the above example, <command> would be replaced by a command normally reserved for the root user,
such as m ount.
The sudo command allows for a high degree of flexibility. For instance, only users listed in the
/etc/sudoers configuration file are allowed to use the sudo command and the command is executed
in the user's shell, not a root shell. This means the root shell can be completely disabled as shown in the
Red Hat Enterprise Linux 7 Security Guide.
Each successful authentication using the sudo is logged to the file /var/log/m essages and the
command issued along with the issuer's username is logged to the file /var/log/secure. Should you
require additional logging, use the pam _tty_audit module to enable TTY auditing for specified users
by adding the following line to your /etc/pam .d/system -auth file:
where pattern represents a comma-separated listing of users with an optional use of globs. For
example, the following configuration will enable TTY auditing for the root user and disable it for all other
users:
Another advantage of the sudo command is that an administrator can allow different users access to
specific commands based on their needs.
Administrators wanting to edit the sudo configuration file, /etc/sudoers, should use the visudo
command.
To give someone full administrative privileges, type visudo and add a line similar to the following in the
user privilege specification section:
This example states that the user, juan, can use sudo from any host and execute any command.
The example below illustrates the granularity possible when configuring sudo:
48
Chapter 4. Gaining Privileges
This example states that any user can issue the command /sbin/shutdown -h now as long as it is
issued from the console.
The man page for sudoers has a detailed listing of options for this file.
Important
There are several potential risks to keep in mind when using the sudo command. You can avoid
them by editing the /etc/sudoers configuration file using visudo as described above. Leaving
the /etc/sudoers file in its default state gives every user in the wheel group unlimited root
access.
By default, sudo stores the sudoer's password for a five minute timeout period. Any
subsequent uses of the command during this period will not prompt the user for a password.
This could be exploited by an attacker if the user leaves his workstation unattended and
unlocked while still being logged in. This behavior can be changed by adding the following line
to the /etc/sudoers file:
Defaults timestamp_timeout=<value>
where <value> is the desired timeout length in minutes. Setting the <value> to 0 causes
sudo to require a password every time.
If a sudoer's account is compromised, an attacker can use sudo to open a new shell with
administrative privileges:
sudo /bin/bash
Opening a new shell as root in this or similar fashion gives the attacker administrative access
for a theoretically unlimited amount of time, bypassing the timeout period specified in the
/etc/sudoers file and never requiring the attacker to input a password for sudo again until
the newly opened session is closed.
Installed Documentation
su(1) — The manual page for su provides information regarding the options available with this
command.
sudo(8) — The manual page for sudo includes a detailed description of this command lists options
available for customizing its behavior.
pam (8) — The manual page describing the use of Pluggable Authentication Modules (PAM) for Linux.
Online Documentation
49
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Red Hat Enterprise Linux 7 Security Guide — The Security Guide for Red Hat Enterprise Linux 7
provides a more in-depth look at potential security issues pertaining to setuid programs as well as
techniques used to alleviate these risks.
See Also
Chapter 3, Managing Users and Groups documents how to manage system users and groups in the
graphical user interface and on the command line.
[1] This access is still subject to the restrictions imposed by SELinux, if it is enabled.
50
Part II. Package Management
51
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Chapter 5. Yum
Yum is the Red Hat package manager that is able to query for information about available packages,
fetch packages from repositories, install and uninstall them, and update an entire system to the latest
available version. Yum performs automatic dependency resolution on packages you are updating,
installing, or removing, and thus is able to automatically determine, fetch, and install all available
dependent packages.
Yum can be configured with new, additional repositories, or package sources, and also provides many
plug-ins which enhance and extend its capabilities. Yum is able to perform many of the same tasks that
RPM can; additionally, many of the command line options are similar. Yum enables easy and simple
package management on a single machine or on groups of them.
Yum provides secure package management by enabling GPG (Gnu Privacy Guard; also known as
GnuPG) signature verification on GPG-signed packages to be turned on for all package
repositories (i.e. package sources), or for individual repositories. When signature verification is
enabled, Yum will refuse to install any packages not GPG-signed with the correct key for that
repository. This means that you can trust that the RPM packages you download and install on
your system are from a trusted source, such as Red Hat, and were not modified during transfer.
Refer to Section 5.5, “Configuring Yum and Yum Repositories” for details on enabling signature-
checking with Yum, or Section A.3, “Checking a Package's Signature” for information on working
with and verifying GPG-signed RPM packages in general.
Yum also enables you to easily set up your own repositories of RPM packages for download and
installation on other machines. When possible, Yum uses parallel download of multiple packages and
metadata to speed up downloading.
Learning Yum is a worthwhile investment because it is often the fastest way to perform system
administration tasks, and it provides capabilities beyond those provided by the PackageKit graphical
package management tools. Refer to Chapter 6, PackageKit for details on using PackageKit.
You must have superuser privileges in order to use yum to install, update or remove packages on
your system. All examples in this chapter assume that you have already obtained superuser
privileges by using either the su or sudo command.
yum check-update
52
Chapter 5. Yum
The packages in the above output are listed as having updates available. The first package in the list
is PackageKit, the graphical package manager. The line in the example output tells us:
The output also shows us that we can update the kernel (the kernel package), Yum and RPM
themselves (the yum and rpm packages), as well as their dependencies (such as the kernel-firmware,
rpm-libs, and rpm-python packages), all using yum .
53
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Dependencies Resolved
===========================================================================
Package Arch Version Repository Size
===========================================================================
Updating:
udev x86_64 147-2.15.el6 rhel 337 k
Transaction Summary
===========================================================================
Install 0 Package(s)
Upgrade 1 Package(s)
54
Chapter 5. Yum
yum always installs a new kernel in the same sense that RPM installs a new kernel when you use
the command rpm -i kernel. Therefore, you do not need to worry about the distinction
between installing and upgrading a kernel package when you use yum : it will do the right thing,
regardless of whether you are using the yum update or yum install command.
When using RPM, on the other hand, it is important to use the rpm -i kernel command
(which installs a new kernel) instead of rpm -u kernel (which replaces the current kernel).
Refer to Section A.2.2, “Installing and Upgrading” for more information on installing/upgrading
kernels with RPM.
Here, replace group_name with a name of the package group you wish to update. For more information
on package groups, see Section 5.3, “Working with Package Groups”.
Yum also offers the upgrade command that is equal to update with enabled obsoletes configuration
option (see Section 5.5.1, “Setting [main] Options”). By default, obsoletes is turned on in
/etc/yum .conf, which makes these two commands equivalent.
yum update
55
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The yum search command is useful for searching for packages you do not know the name of, but for
which you know a related term.
Be careful to escape the glob expressions when passing them as arguments to a yum command,
otherwise the Bash shell will interpret these expressions as pathname expansions, and potentially pass
all files in the current directory that match the global expressions to yum . To make sure the glob
expressions are passed to yum as intended, either:
To list installed and available packages that match inserted glob expressions use the following
command:
56
Chapter 5. Yum
Packages with various ABRT add-ons and plug-ins either begin with “abrt-addon-”, or “abrt-plugin-”.
To list these packages, type the following command at a shell prompt. Note how the wildcard
characters are escaped with a backslash character:
To list all packages installed on your system use the installed keyword. The rightmost column in the
output lists the repository from which the package was retrieved.
The following example shows how to list all installed packages that begin with “krb” followed by exactly
one character and a hyphen. This is useful when you want to list all versions of certain component as
these are distinguished by numbers. The entire glob expression is quoted to ensure proper
processing.
To list all packages in all enabled repositories that are available to install, use the command in the
following form:
57
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For instance, to list all available packages with names that contain “gstreamer” and then “plugin”, run
the following command:
Listing Repositories
To list the repository ID, name, and number of packages for each enabled repository on your system,
use the following command:
yum repolist
To list more information about these repositories, add the -v option. With this option enabled,
information including the file name, overall size, date of the last update, and base URL are displayed for
each listed repository. As an alternative, you can use the repoinfo command that produces the same
output.
yum repolist -v
yum repoinfo
To list both enabled and disabled repositories use the following command. A status column is added to
the output list to show which of the repositories are enabled.
By passing disabled as a first argument, you can reduce the command output to disabled repositories.
For further specification you can pass the ID or name of repositories or related glob_expressions as
arguments. Note that if there is an exact match between the repository ID or name and the inserted
argument, this repository is listed even if it does not pass the enabled or disabled filter.
58
Chapter 5. Yum
The yum info package_name command is similar to the rpm -q --info package_name command,
but provides as additional information the ID of the Yum repository the RPM package is found in (look for
the From repo: line in the output).
Using yumdb
You can also query the Yum database for alternative and useful information about a package by using
the following command:
This command provides additional information about a package, including the checksum of the package
(and algorithm used to produce it, such as SHA-256), the command given on the command line that was
invoked to install the package (if any), and the reason that the package is installed on the system (where
user indicates it was installed by the user, and dep means it was brought in as a dependency).
59
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For more information on the yum db command, refer to the yumdb(8) manual page.
You can also install multiple packages simultaneously by appending their names as arguments. To do
so, type as root:
If you are installing packages on a multilib system, such as an AMD64 or Intel64 machine, you can
specify the architecture of the package (as long as it is available in an enabled repository) by appending
.arch to the package name:
You can use glob expressions to quickly install multiple similarly-named packages. As root:
60
Chapter 5. Yum
Global expressions are useful when you want to install several packages with similar names. To install
all audacious plug-ins, use the command in the following form:
In addition to package names and glob expressions, you can also provide file names to yum install.
If you know the name of the binary you want to install, but not its package name, you can give yum
install the path name. As root, type:
yum then searches through its package lists, finds the package which provides /usr/sbin/nam ed, if
any, and prompts you as to whether you want to install it.
As you can see in the above examples, the yum install command does not require strictly defined
arguments. It can process various formats of package names and glob expressions, which makes
installation easier for users. On the other hand, it takes some time till yum parses the input correctly,
especially if you specify a large number of packages. To optimize the package search, you can use the
following commands to explicitly define how to parse the arguments:
With install-n, yum interprets name as exact name of the package. The install-na command tels
yum that the subsequent argument contains the package name and architecture divided by the dot
character. With install-nevra, yum will expect argument in the form name-epoch:version-
release.architecture. Similarly, you can use yum rem ove-n, yum rem ove-na, and yum
rem ove-nevra when searching for packages to be removed.
61
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
If you know you want to install the package that contains the nam ed binary, but you do not know
in which bin or sbin directory is the file installed, use the yum provides command with a glob
expression:
yum provides "* /file_name" is a common and useful trick to find the package(s) that
contain file_name.
62
Chapter 5. Yum
The following example provides an overview of installation with use of yum. Imagine you want to
download and install the latest version of the httpd package. To do so, execute as root:
Dependencies Resolved
After executing the above command, yum loads the necessary plug-ins and runs the transaction
check. In this case, httpd is already installed. Since the installed package is older than the latest
currently available version, it will be updated. The same applies to the httpd-tools package that httpd
depends on. Then, a transaction summary is displayed:
=============================================================================
===
Package Arch Version Repository
Size
=============================================================================
===
Updating:
httpd x86_64 2.4.6-13.el7 rhel-x86_64-server-7 1.2 M
Updating for dependencies:
httpd-tools x86_64 2.4.6-13.el7 rhel-x86_64-server-7 77 k
Transaction Summary
=============================================================================
===
Upgrade 1 Package (+1 Dependent package)
In this step yum prompts you to confirm the installation. Apart from y (yes) and N (no) options, you
can choose d (download only) to download the packages but not to install them directly. If you choose
y, the installation proceeds with the following messages until it is finished successfully.
63
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Updating : httpd-tools-2.4.6-13.el7.x86_64 1/4
Updating : httpd-2.4.6-13.el7.x86_64 2/4
Cleanup : httpd-2.4.6-12.el7.x86_64 3/4
Cleanup : httpd-tools-2.4.6-12.el7.x86_64 4/4
Verifying : httpd-2.4.6-13.el7.x86_64 1/4
Verifying : httpd-tools-2.4.6-13.el7.x86_64 2/4
Verifying : httpd-tools-2.4.6-12.el7.x86_64 3/4
Verifying : httpd-2.4.6-12.el7.x86_64 4/4
Updated:
httpd.x86_64 0:2.4.6-13.el7
Dependency Updated:
httpd-tools.x86_64 0:2.4.6-13.el7
Complete!
To install a previously-downloaded package from the local directory on your system, use the following
command:
...
Total size: 1.2 M
Is this ok [y/d/N]:
...
By choosing the d option, you tell yum to download the packages without installing them immediately.
You can install these packages later in off-line mode with the yum localinstall command or you
can share them with a different device. Downloaded packages are saved in one of the subdirectories of
the cache directory, by default /var/cache/yum /$basearch/$releasever/packages/ directory.
The downloading proceeds in background mode so that you can use yum for other operations in
parallel.
As when you install multiple packages, you can remove several at once by adding more package names
64
Chapter 5. Yum
to the command.
To remove totem, rhythmbox, and sound-juicer, type the following at a shell prompt:
package names
glob expressions
file lists
package provides
Yum is not able to remove a package without also removing packages which depend on it. This
type of operation can only be performed by RPM, is not advised, and can potentially leave your
system in a non-functioning state or cause applications to misbehave and/or crash. For further
information, refer to Section A.2.4, “Uninstalling” in the RPM chapter.
To list all package groups from yum repositories add the list option. You can filter the command output
by group names.
65
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Several optional arguments can be passed to this command, including hidden to list also groups not
marked as user visible, and ids to list group IDs. You can add language, environm ent,
installed, or available options to reduce the command output to specific group type.
To list mandatory and optional packages contained in a particular group, use the following command:
Group: LibreOffice
Group-Id: libreoffice
Description: LibreOffice Productivity Suite
Mandatory Packages:
=libreoffice-calc
libreoffice-draw
-libreoffice-emailmerge
libreoffice-graphicfilter
=libreoffice-impress
=libreoffice-math
=libreoffice-writer
+libreoffice-xsltfilter
Optional Packages:
libreoffice-base
libreoffice-pyuno
As you can see in the above example, the packages included in the package group can have different
states that are marked with the following symbols:
" - " — Package is not installed and it will not be installed as a part of the package group.
" + " — Package is not installed but it will be installed on next yum upgrade or yum group
upgrade.
" = " — Package is installed and it was installed as a part of the package group.
no symbol — Package is installed but it was installed outside of the package group. This means that
the yum group rem ove will not remove these packages.
These distinctions take place only when the group_com m and configuration parameter is set to
objects, which is the default setting. Set this parameter to a different value if you do not want yum to
track if a package was installed as a part of the group or separately, which will make "no symbol"
packages equivalent to "=" packages. Please note that the yum-cron package uses
group_com m and=sim ple as a default setting.
You can alter the above package states with use of the yum group m ark command. For example, yum
group m ark packages marks any given installed packages as members of a specified group. To
avoid installation of new packages on group update, use yum group m ark blacklist. Refer to yum
man page for more information on capabilities of yum group m ark.
66
Chapter 5. Yum
Note
You can identify an environmental group with use of the @^ prefix and a package group can be
marked with @. When using yum group list, info, install, or rem ove, pass
@group_name to specify a package group, @^group_name to specify an environmental group, or
group_name to include both.
Imagine you want to install a package group related to the KDE desktop environment, but you cannot
remember the exact name or id of the package group. To find the information, type:
You can install a package group by passing its full group name (without the groupid part) to the group
install command. As root, type:
You can also install by groupid. As root, execute the following command:
You can pass the groupid or quoted name to the install command if you prepend it with an @-
symbol, which tells yum that you want to perform group install. As root, type:
Replace group with the groupid or quoted group name. Similar logic applies to environmental groups:
67
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Example 5.16. Four equivalent ways of installing the KDE Desktop group
As mentioned before, you can use four alternative, but equivalent ways to install a package group. For
KDE Desktop, the commands look as follows:
Also, you can pass the groupid or quoted name to the rem ove command if you prepend it with an @-
symbol, which tells yum that you want to perform group rem ove. As root, type:
Replace group with the groupid or quoted group name. Similarly, you can replace an environmental
group:
Example 5.17. Four equivalent ways of removing the KDE Desktop group
Similarly to install, you can use four alternative, but equivalent ways to remove a package group. For
KDE Desktop, the commands look as follows:
68
Chapter 5. Yum
To display a list of twenty most recent transactions, as root, either run yum history with no additional
arguments, or type the following at a shell prompt:
To display only transactions in a given range, use the command in the following form:
You can also list only transactions regarding a particular package or packages. To do so, use the
command with a package name or a glob expression:
In the output of yum history list, the most recent transaction is displayed at the top of the list. To
display information about the five oldest transactions stored in the history data base, type:
All forms of the yum history list command produce tabular output with each row consisting of the
following columns:
69
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Symbol Description
< Before the transaction finished, the rpm db database was changed outside Yum.
> After the transaction finished, the rpm db database was changed outside Yum.
* The transaction failed to finish.
# The transaction finished successfully, but yum returned a non-zero exit code.
E The transaction finished successfully, but an error or a warning was displayed.
P The transaction finished successfully, but problems already existed in the rpm db
database.
s The transaction finished successfully, but the --skip-broken command line
option was used and certain packages were skipped.
To synchronize the rpm db or yum db database contents for any installed package with the currently
used rpm db or yum db database, type the following:
To display some overall statistics about the currently used history DB use the following command:
70
Chapter 5. Yum
Yum also allows you to display a summary of all past transactions. To do so, run the command in the
following form as root:
Similarly to the yum history list command, you can also display a summary of transactions
regarding a certain package or packages by supplying a package name or a glob expression:
All forms of the yum history sum m ary command produce simplified tabular output similar to the
output of yum history list.
As shown above, both yum history list and yum history sum m ary are oriented towards
transactions, and although they allow you to display only transactions related to a given package or
packages, they lack important details, such as package versions. To list transactions from the
perspective of a package, run the following command as root:
71
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For example, to trace the history of subscription-manager and related packages, type the following at
a shell prompt:
In this example, three packages were installed during the initial system installation: subscription-
manager, subscription-manager-firstboot, and subscription-manager-gnome. In the third transaction,
all these packages were updated from version 0.95.11 to version 0.95.17.
To examine a particular transaction or transactions in more detail, run the following command as root:
The id argument is optional and when you omit it, yum automatically uses the last transaction. Note that
when specifying more than one transaction, you can also use a range:
72
Chapter 5. Yum
The following is sample output for two transactions, each installing one new package:
You can also view additional information, such as what configuration options were used at the time of the
transaction, or from what repository and why were certain packages installed. To determine what
additional information is available for a certain transaction, type the following at a shell prompt as root:
Similarly to yum history info, when no id is provided, yum automatically uses the latest transaction.
Another way to refer to the latest transaction is to use the last keyword:
For the fourth transaction in the history, the yum history addon-info command provides the
following output:
history addon-info
In the output of the yum history addon-info command, three types of information are available:
config-m ain — global Yum options that were in use during the transaction. Refer to Section 5.5.1,
73
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To display selected type of additional information, run the following command as root:
Both commands also accept the last keyword to undo or repeat the latest transaction.
Note that both yum history undo and yum history redo commands only revert or repeat the
steps that were performed during a transaction. If the transaction installed a new package, the yum
history undo command will uninstall it, and if the transaction uninstalled a package the command will
again install it. This command also attempts to downgrade all updated packages to their previous
version, if these older packages are still available. If you need to restore the system to the state before
an update, consider using the fs-snapshot plug-in described in Section 5.6.3, “Working with Plug-ins”.
When managing several identical systems, Yum also allows you to perform a transaction on one of them,
store the transaction details in a file, and after a period of testing, repeat the same transaction on the
remaining systems as well. To store the transaction details to a file, type the following at a shell prompt
as root:
Once you copy this file to the target system, you can repeat the transaction by using the following
command as root:
You can configure load-transaction to ignore missing packages or rpmdb version. For more
information on these configuration options see the yum.conf man page.
This will create a new, empty database file in the /var/lib/yum /history/ directory. The old
74
Chapter 5. Yum
transaction history will be kept, but will not be accessible as long as a newer database file is present in
the directory.
set global Yum options by editing the [m ain] section of the /etc/yum .conf configuration file;
set options for individual repositories by editing the [repository] sections in /etc/yum .conf and
.repo files in the /etc/yum .repos.d/ directory;
use Yum variables in /etc/yum .conf and files in the /etc/yum .repos.d/ directory so that
dynamic version and architecture values are handled correctly;
add, enable, and disable Yum repositories on the command line; and,
set up your own custom Yum repository.
[main]
cachedir=/var/cache/yum/$basearch/$releasever
keepcache=0
debuglevel=2
logfile=/var/log/yum.log
exactarch=1
obsoletes=1
gpgcheck=1
plugins=1
installonly_limit=3
[comments abridged]
The following are the most commonly-used options in the [m ain] section:
assum eyes=value
The assum eyes option determines whether or not yum prompts for confirmation of critical
actions. Replace value with one of:
75
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
1 — Do not prompt for confirmation of critical yum actions. If assum eyes=1 is set, yum behaves
in the same way as the command line options -y and --assum eyes
cachedir=directory
Use this option to set the directory where Yum should store its cache and database files.
Replace directory with an absolute path to the directory By default, Yum's cache directory is
/var/cache/yum /$basearch/$releasever.
Refer to Section 5.5.3, “Using Yum Variables” for descriptions of the $basearch and
$releasever Yum variables.
debuglevel=value
This option specifies the detail of debugging output produced by yum . Here, value is an integer
between 1 and 10. Setting a higher debuglevel value causes yum to display more detailed
debugging output. debuglevel=0 disables debugging output, while debuglevel=2 is the
default.
exactarch=value
With this option, you can set yum to consider exact architecture when updating already installed
packages. Replace value with:
0 — Do not take into account the exact architecture when updating packages.
1 — (default). Consider the exact architecture when updating packages. With this setting, yum
does not install an i686 package to update an i386 package already installed on the system.
exclude=package_name [more_package_names]
The exclude option allows you to exclude packages by keyword during installation or updating.
Listing multiple packages for exclusion can be accomplished by quoting a space-delimited list of
packages. Shell glob expressions using wildcards (for example, * and ?) are allowed.
gpgcheck=value
Use the gpgcheck option to specify if yum should perform a GPG signature check on
packages. Replace value with:
1 — (default). Enable GPG signature-checking on all packages in all repositories, including local
package installation. With gpgcheck enabled, all packages' signatures are checked.
If this option is set in the [m ain] section of the /etc/yum .conf file, it sets the GPG-checking
rule for all repositories. However, you can also set gpgcheck=value for individual repositories
instead; that is, you can enable GPG-checking on one repository while disabling it on another.
Setting gpgcheck=value for an individual repository in its corresponding .repo file overrides
the default if it is present in /etc/yum .conf.
For more information on GPG signature-checking, refer to Section A.3, “Checking a Package's
Signature”.
76
Chapter 5. Yum
group_com m and=value
Use the group_com m and option to specify how the yum group install, yum group
upgrade, and yum group rem ove commands handle a package group. Replace value with:
sim ple — Install all members of a package group. Upgrade only previously installed packages,
but do not install packages that were added to the group in the meantime.
com pat — Similar to sim ple but yum upgrade also installs packages that were added to the
group since the previous upgrade.
objects — (default.) With this option, yum keeps track of the previously-installed groups and
distinguishes between packages installed as a part of the group and packages installed
separately. See Example 5.14, “Viewing information on the LibreOffice package group”
group_package_types=package_type [more_package_types]
Here you can specify which type of packages (optional, default or mandatory) is installed when
the yum group install command is called. The default and mandatory package types are
chosen by default.
history_record=value
With this option, you can setyum to record transaction history. Replace value with one of:
1 — (default). yum should record history entries for transactions. This operation takes certain
amount of disk space, and some extra time in the transactions, but it provides a lot of
information about past operations, which can be displayed with the yum history command.
history_record=1 is the default.
For more information on the yum history command, refer to Section 5.4, “Working with
Transaction History”.
yum uses history records to detect modifications to the rpmdb that have been done
outside of yum . In such case, yum displays a warning and automatically searches for
possible problems caused by altering rpmdb. With history_record turned off, yum is
not able to detect these changes and no automatic checks are performed.
If you add the installonlypkgs directive to /etc/yum .conf, you should ensure that you
list all of the packages that should be install-only, including any of those listed under the
installonlypkgs section of yum.conf(5). In particular, kernel packages should always be
listed in installonlypkgs (as they are by default), and installonly_lim it should
always be set to a value greater than 2 so that a backup kernel is always available in case the
77
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
installonly_lim it=value
This option sets how many packages listed in the installonlypkgs directive can be installed
at the same time. Replace value with an integer representing the maximum number of versions
that can be installed simultaneously for any single package listed in installonlypkgs.
The defaults for the installonlypkgs directive include several different kernel packages, so
be aware that changing the value of installonly_lim it also affects the maximum number
of installed versions of any single kernel package. The default value listed in /etc/yum .conf
is installonly_lim it=3, and it is not recommended to decrease this value, particularly
below 2.
keepcache=value
The keepcache option determines whether Yum keeps the cache of headers and packages
after successful installation. Here, value is one of:
0 — (default). Do not retain the cache of headers and packages after a successful installation.
logfile=file_name
To specify the location for logging output, replacefile_name with an absolute path to the file in
which yum should write its logging output. By default, yum logs to /var/log/yum .log.
m ax_connenctions=number
Here value stands for the maximum number of simultaneous connections, default is 5.
m ultilib_policy=value
The m ultilib_policy option sets the installation behavior if several architecture versions
are available for package install. Here, value stands for:
best — install the best-choice architecture for this system. For example, setting
m ultilib_policy=best on an AMD64 system causes yum to install 64-bit versions of all
packages.
all — always install every possible architecture for every package. For example, with
m ultilib_policy set to all on an AMD64 system, yum would install both the i586 and
AMD64 versions of a package, if both were available.
obsoletes=value
The obsoletes option enables the obsoletes process logic during updates.When one package
declares in its spec file that it obsoletes another package, the latter package is replaced by the
former package when the former package is installed. Obsoletes are declared, for example,
when a package is renamed. Replace value with one of:
1 — (default). Enable yum 's obsoletes processing logic when performing updates.
78
Chapter 5. Yum
plugins=value
This is a global switch to enable or disable yum plug-ins, value is one of:
Disabling all plug-ins is not advised because certain plug-ins provide important Yum
services. In particular, rhnplugin provides support for RHN Classic, and product-id
and subscription-manager plug-ins provide support for the certificate-based Content
Delivery Network (CDN). Disabling plug-ins globally is provided as a convenience
option, and is generally only recommended when diagnosing a potential problem with
Yum .
1 — (default). Enable all Yum plug-ins globally. With plugins=1, you can still disable a specific
Yum plug-in by setting enabled=0 in that plug-in's configuration file.
For more information about various Yum plug-ins, refer to Section 5.6, “Yum Plug-ins”. For
further information on controlling plug-ins, see Section 5.6.1, “Enabling, Configuring, and
Disabling Yum Plug-ins”.
reposdir=directory
Here, directory is an absolute path to the directory where .repo files are located. All .repo
files contain repository information (similar to the [repository] sections of /etc/yum .conf).
yum collects all repository information from .repo files and the [repository] section of the
/etc/yum .conf file to create a master list of repositories to use for transactions. If reposdir
is not set, yum uses the default directory /etc/yum .repos.d/.
retries=value
This option sets the number of times yum should attempt to retrieve a file before returning an
error. value is an integer 0 or greater. Setting value to 0 makes yum retry forever. The default
value is 10.
For a complete list of available [m ain] options, refer to the [m ain] OPT IONS section of the
yum.conf(5) manual page.
[repository]
name=repository_name
baseurl=repository_url
79
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
nam e=repository_name
Here, repository_name is a human-readable string describing the repository.
baseurl=repository_url
Replace repository_url with a URL to the directory where the repodata directory of a
repository is located:
baseurl=http://path/to/repo/releases/$releasever/server/$basearch/os/
Note that Yum always expands the $releasever, $arch, and $basearch variables in
URLs. For more information about Yum variables, refer to Section 5.5.3, “Using Yum Variables”.
enabled=value
This is a simple way to tell yum to use or ignore a particular repository, value is one of:
0 — Do not include this repository as a package source when performing updates and installs.
This is an easy way of quickly turning repositories on and off, which is useful when you desire a
single package from a repository that you do not want to enable for updates or installs.
Turning repositories on and off can also be performed by passing either the --
enablerepo=repo_name or --disablerepo=repo_name option to yum , or through the
Add/Rem ove Software window of the PackageKit utility.
async=value
Controls parallel downloading of repository packages. Here, value is one of:
auto — (default) parallel downloading is used if possible, which means that yum automatically
disables it for repositories created by plug-ins to avoid failures.
80
Chapter 5. Yum
Many more [repository] options exist, part of them has the same form and function as certain
[main] options. For a complete list, refer to the [repository] OPT IONS section of the yum.conf(5)
manual page.
#
# Red Hat Repositories
# Managed by (rhsm) subscription-manager
#
[red-hat-enterprise-linux-scalable-file-system-for-rhel-6-entitlement-rpms]
name = Red Hat Enterprise Linux Scalable File System (for RHEL 6 Entitlement)
(RPMs)
baseurl = https://cdn.redhat.com/content/dist/rhel/entitlement-
6/releases/$releasever/$basearch/scalablefilesystem/os
enabled = 1
gpgcheck = 1
gpgkey = file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
sslverify = 1
sslcacert = /etc/rhsm/ca/redhat-uep.pem
sslclientkey = /etc/pki/entitlement/key.pem
sslclientcert = /etc/pki/entitlement/11300387955690106.pem
[red-hat-enterprise-linux-scalable-file-system-for-rhel-6-entitlement-source-
rpms]
name = Red Hat Enterprise Linux Scalable File System (for RHEL 6 Entitlement)
(Source RPMs)
baseurl = https://cdn.redhat.com/content/dist/rhel/entitlement-
6/releases/$releasever/$basearch/scalablefilesystem/source/SRPMS
enabled = 0
gpgcheck = 1
gpgkey = file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
sslverify = 1
sslcacert = /etc/rhsm/ca/redhat-uep.pem
sslclientkey = /etc/pki/entitlement/key.pem
sslclientcert = /etc/pki/entitlement/11300387955690106.pem
[red-hat-enterprise-linux-scalable-file-system-for-rhel-6-entitlement-debug-
rpms]
name = Red Hat Enterprise Linux Scalable File System (for RHEL 6 Entitlement)
(Debug RPMs)
baseurl = https://cdn.redhat.com/content/dist/rhel/entitlement-
6/releases/$releasever/$basearch/scalablefilesystem/debug
enabled = 0
gpgcheck = 1
gpgkey = file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
sslverify = 1
sslcacert = /etc/rhsm/ca/redhat-uep.pem
sslclientkey = /etc/pki/entitlement/key.pem
sslclientcert = /etc/pki/entitlement/11300387955690106.pem
81
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
You can use and reference the following built-in variables in yum commands and in all Yum configuration
files (that is, /etc/yum .conf and all .repo files in the /etc/yum .repos.d/ directory):
$releasever
You can use this variable to reference the release version of Red Hat Enterprise Linux. Yum
obtains the value of $releasever from the distroverpkg=value line in the
/etc/yum .conf configuration file. If there is no such line in /etc/yum .conf, then yum infers
the correct value by deriving the version number from the redhat-release package.
$arch
You can use this variable to refer to the system's CPU architecture as returned when calling
Python's os.unam e() function. Valid values for $arch include: i586, i686 and x86_64 .
$basearch
You can use $basearch to reference the base architecture of the system. For example, i686
and i586 machines both have a base architecture of i386, and AMD64 and Intel64 machines
have a base architecture of x86_64 .
$YUM0-9
These ten variables are each replaced with the value of any shell environment variables with the
same name. If one of these variables is referenced (in /etc/yum .conf for example) and a
shell environment variable with the same name does not exist, then the configuration file
variable is not replaced.
To define a custom variable or to override the value of an existing one, create a file with the same name
as the variable (without the “$” sign) in the /etc/yum /vars/ directory, and add the desired value on its
first line.
For example, repository descriptions often include the operating system name. To define a new variable
called $osnam e, create a new file with “Red Hat Enterprise Linux” on the first line and save it as
/etc/yum /vars/osnam e:
Instead of “Red Hat Enterprise Linux 7”, you can now use the following in the .repo files:
name=$osname $releasever
yum-config-manager
To list the content of a different configuration section or sections, use the command in the following form:
yum-config-manager section…
82
Chapter 5. Yum
You can also use a glob expression to display the configuration of all matching sections:
yum-config-manager glob_expression…
To list all configuration options and their corresponding values for the main section, type the following
at a shell prompt:
When the system is registered with the certificate-based Red Hat Network, the Red Hat
Subscription Manager tools are used to manage repositories in the
/etc/yum .repos.d/redhat.repo file. For more information how to register a system with
Red Hat Network and use the Red Hat Subscription Manager tools to manage subscriptions,
refer to the Red Hat Subscription Management Guide.
Obtaining and installing software packages from unverified or untrusted software sources other
than Red Hat Network constitutes a potential security risk, and could lead to security, stability,
compatibility, and maintainability issues.
Yum repositories commonly provide their own .repo file. To add such a repository to your system and
83
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
…where repository is the unique repository ID (use yum repolist all to list available repository
IDs). Alternatively, you can use a glob expression to enable all matching repositories:
To enable repositories defined in the [exam ple], [exam ple-debuginfo], and [exam ple-
source]sections, type:
When successful, the yum -config-m anager --enable command displays the current repository
configuration.
84
Chapter 5. Yum
…where repository is the unique repository ID (use yum repolist all to list available repository
IDs). Similarly to yum -config-m anager --enable, you can use a glob expression to disable all
matching repositories at the same time:
When successful, the yum -config-m anager --disable command displays the current
configuration.
1. Install the createrepo package. To do so, type the following at a shell prompt as root:
2. Copy all packages that you want to have in your repository into one directory, such as
/m nt/local_repo/.
3. Change to this directory and run the following command:
This creates the necessary metadata for your Yum repository, as well as the sqlite database for
speeding up yum operations.
Compared to Red Hat Enterprise Linux 5, RPM packages for Red Hat Enterprise Linux 7
are compressed with the XZ lossless data compression format and can be signed with
newer hash algorithms like SHA-256. Consequently, it is not recommended to use the
createrepo command on Red Hat Enterprise Linux 5 to create the package metadata for
Red Hat Enterprise Linux 7. If you want to use createrepo on this system anyway, install
the python-hashlib package from EPEL (Extra Packages for Enterprise Linux) so that the
repodata can also use the SHA-256 hash algorithm.
Note that the plug-in names which follow Loaded plugins are the names you can provide to the --
disableplugins=plugin_name option.
85
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
plugins=1
Disabling all plug-ins is not advised because certain plug-ins provide important Yum services. In
particular, rhnplugin provides support for RHN Classic, and product-id and subscription-
manager plug-ins provide support for the certificate-based Content Delivery Network
(CDN). Disabling plug-ins globally is provided as a convenience option, and is generally only
recommended when diagnosing a potential problem with Yum .
Every installed plug-in has its own configuration file in the /etc/yum /pluginconf.d/ directory. You
can set plug-in specific options in these files. For example, here is the refresh-packagekit plug-in's
refresh-packagekit.conf configuration file:
[main]
enabled=1
Plug-in configuration files always contain a [m ain] section (similar to Yum's /etc/yum .conf file) in
which there is (or you can place if it is missing) an enabled= option that controls whether the plug-in is
enabled when you run yum commands.
If you disable all plug-ins by setting enabled=0 in /etc/yum .conf, then all plug-ins are disabled
regardless of whether they are enabled in their individual configuration files.
If you merely want to disable all Yum plug-ins for a single yum command, use the --noplugins option.
If you want to disable one or more Yum plug-ins for a single yum command, add the --
disableplugin=plugin_name option to the command. For example, to disable the presto plug-in
while updating a system, type:
The plug-in names you provide to the --disableplugin= option are the same names listed after the
Loaded plugins line in the output of any yum command. You can disable multiple plug-ins by
separating their names with commas. In addition, you can match multiple plug-in names or shorten long
ones by using glob expressions:
86
Chapter 5. Yum
Backup
fs-snapshot (yum-plugin-fs-snapshot)
The fs-snapshot plug-in extends Yum to create a snapshot of a file system before proceeding
with a transaction such as a system update or package removal. When you decide that the
changes made by the transaction are unwanted, this mechanism allows you to roll back to the
changes that are stored in a snapshot.
In order for the plug-in to work, the root file system (that is, /) must be on an LVM (Logical
Volume Manager) or Btrfs volume. To use the fs-snapshot plug-in on an LVM volume, take
the following steps:
1. Make sure that the volume group with the root file system has enough free extents. The
required size depends on the amount of changes to the original logical volume that is
expected during the life of the snapshot. The reasonable default is 50–80 % of the
original logical volume size.
To display detailed information about a particular volume group, run the vgdisplay
command in the following form as root:
vgdisplay volume_group
The number of free extents is listed on the Free PE / Size line of the output table.
2. If the volume group with the root file system does not have enough free extents, add a
new physical volume. To do this, login as a root user and run the pvcreate command
in the following form to initialize a physical volume for use with the Logical Volume
Manager:
pvcreate device
3. Then, use the vgextend command in the following form as root to add the physical
volume to the volume group:
enabled = 1
5. Remove the hash sign (#) from the beginning of the lvcreate_size_args line, and
adjust the number of logical extents which are allocated for a snapshot. For example, to
allocate 80 % of the size of the original logical volume, use:
lvcreate_size_args = -l 80%ORIGIN
87
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
lvremove /dev/volume_group/logical_volume_yum_timestamp
8. If you decide to revert the changes and restore the file system to a state that is saved in a
snapshot, take the following steps:
As root, run the command in the following form to merge a snapshot into its original
logical volume:
The lvconvert command will inform you that a restart is required in order for the
changes to take effect.
9. Restart the system as instructed. You can do so by typing the following at a shell prompt
as root:
reboot
To use the fs-snapshot plug-in on a Btrfs file system, take the following steps:
1. Run the desired yum command, and make sure fs-snapshot is included in the list of
loaded plug-ins (the Loaded plugins line) before you confirm the changes and
proceed with the transaction. The fs-snapshot plug-in displays a line in the following
form for each affected file system:
3. If you decide to revert the changes and restore a file system to a state that is saved in a
snapshot, take the following steps:
Determine the identifier of a particular snapshot by using the following command as
root:
88
Chapter 5. Yum
5. Restart the system. You can do so by typing the following at a shell prompt as root:
reboot
For more information on logical volume management, Btrfs, and file system snapshots, see the
Red Hat Enterprise Linux 7 Storage Administration Guide. For additional information about the
plug-in and its configuration, refer to the yum-fs-snapshot(1) and yum-fs-snapshot.conf(5)
manual pages.
89
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Directive Description
enabled=value Allows you to enable or disable the plug-in. The value must be
either 1 (enabled), or 0 (disabled). When installed, the plug-in is
enabled by default.
whitelists=directory Allows you to specify the directory in which the files with
supported kernel symbols are located. By default, the kabi plug-
in uses files provided by the kabi-whitelists package (that is, the
/lib/m odules/kabi/ directory).
enforce=value Allows you to enable or disable enforcing mode. The value
must be either 1 (enabled), or 0 (disabled). By default, this
option is commented out and the kabi plug-in only displays a
warning message.
presto (yum-presto)
The presto plug-in adds support to Yum for downloading delta RPM packages during updates,
from repositories which have presto metadata enabled. Delta RPMs contain only the
differences between the version of the package installed on the client requesting the RPM
package and the updated version in the repository.
Downloading a delta RPM is much quicker than downloading the entire updated package, and
can speed up updates considerably. Once the delta RPMs are downloaded, they must be rebuilt
to apply the difference to the currently-installed package and thus create the full, updated
package. This process takes CPU time on the installing machine. Using delta RPMs is therefore
a tradeoff between time-to-download, which depends on the network connection, and time-to-
rebuild, which is CPU-bound. Using the presto plug-in is recommended for fast machines and
systems with slower network connections, while slower machines on very fast connections
benefit more from downloading normal RPM packages, that is, by disabling presto.
refresh-packagekit (PackageKit-yum-plugin)
The refresh-packagekit plug-in updates metadata for PackageKit whenever yum is run. The
refresh-packagekit plug-in is installed by default.
yum-fastestmirror (yum-plugin-fastestmirror)
The yum-fastestmirror plug-in is designed to list mirrors by response speed before a download
begins. It chooses the closest mirror instead of using a random mirror from the mirrorlist, which
is default behavior. Your fastest mirror is recalculated once every 10 days by default, to force it
to update immediately, delete the /var/cache/yum /tim edhosts.txt cachefile.
yum-cron (yum-cron)
The yum-cron plug-in performs a yum update as a cron job. It provides methods to keep
repository metadata up to date, and to check for, download, and apply updates in scheduled
intervals. These operations are performed as background processes.
90
Chapter 5. Yum
Discovering information about and applying security updates easily and often is important to all
system administrators. For this reason Yum provides the security plug-in, which extends yum
with a set of highly-useful security-related commands, subcommands and options.
You can then use either yum update --security or yum update-m inim al --security
to update those packages which are affected by security advisories. Both of these commands
update all packages on the system for which a security advisory has been issued. yum
update-m inim al --security updates them to the latest packages which were released as
part of a security advisory, while yum update --security will update all packages affected
by a security advisory to the latest version of that package available.
...then yum update-m inim al --security will update you to kernel-2.6.30.8-32, and yum
update --security will update you to kernel-2.6.30.8-64. Conservative system
administrators probably want to use update-m inim al to reduce the risk incurred by updating
packages as much as possible.
Refer to the yum-security(8) manual page for usage details and further explanation of the
enhancements the security plug-in adds to yum .
protect-packages (yum-plugin-protect-packages)
The protect-packages plug-in prevents the yum package and all packages it depends on from
being deliberately or accidentally removed. This prevents many of the most important packages
necessary for your system to run from being removed. In addition, you can list more packages,
one per line, in the /etc/sysconfig/protected-packages file [2] (which you should create
if it does not exist), and protect-packages will extend protection-from-removal to those
packages as well.
System Registration
subscription-manager (subscription-manager)
The subscription-manager plug-in provides support for connecting to Red Hat Network.
91
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
This allows systems registered with Red Hat Network to update and install packages from
the certificate-based Content Delivery Network. The subscription-manager plug-in is installed
by default.
For more information how to manage product subscriptions and entitlements, refer to the Red
Hat Subscription Management Guide.
product-id (subscription-manager)
The product-id plug-in manages product identity certificates for products installed from the
Content Delivery Network. The product-id plug-in is installed by default.
Installed Documentation
yum (8) — The manual page for the yum command line utility provides a complete list of supported
options and commands.
yum db(8) — The manual page for the yum db command line utility documents how to use this tool to
query and, if necessary, alter the Yum database.
yum .conf(5) — The manual page named yum .conf documents available Yum configuration
options.
yum -utils(1) — The manual page named yum -utils lists and briefly describes additional utilities
for managing Yum configuration, manipulating repositories, and working with Yum database.
Online Documentation
Red Hat Enterprise Linux 7 Storage Administration Guide — The Storage Administration Guide for
Red Hat Enterprise Linux 7 provides instructions on how to manage storage devices and file systems
on this system.
Yum Guides — The Yum Guides page on the project home page provides links to further
documentation.
See Also
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
Chapter 6, PackageKit describes PackageKit, a suite of package management tools for the graphical
user interface.
Appendix A, RPM describes the RPM Package Manager (RPM), the packaging system used by Red
Hat Enterprise Linux.
[2] You can also place files with the extension .l i st in the /etc/sysco n f i g /p ro tected - p ackag es.d / directory (which you should
create if it does not exist), and list packages—one per line—in these files. protect-packages will protect these too.
92
Chapter 5. Yum
93
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Chapter 6. PackageKit
Red Hat provides PackageKit for viewing, managing, updating, installing and uninstalling packages
compatible with your system. PackageKit consists of several graphical interfaces that can be opened
from the GNOME panel menu, or from the Notification Area when PackageKit alerts you that updates are
available. For more information on PackageKit's architecture and available front ends, refer to
Section 6.3, “PackageKit Architecture”.
Clicking on the notification icon opens the Software Update window. Alternatively, you can open
Software Updates by clicking System → Administration → Software Update from the GNOME
panel, or running the gpk-update-viewer command at the shell prompt. In the Software Updates
window, all available updates are listed along with the names of the packages being updated (minus the
.rpm suffix, but including the CPU architecture), a short summary of the package, and, usually, short
descriptions of the changes the update provides. Any updates you do not wish to install can be de-
selected here by unchecking the checkbox corresponding to the update.
94
Chapter 6. PackageKit
The updates presented in the Software Updates window only represent the currently-installed
packages on your system for which updates are available; dependencies of those packages, whether
they are existing packages on your system or new ones, are not shown until you click Install
Updates.
PackageKit utilizes the fine-grained user authentication capabilities provided by the PolicyKit toolkit
whenever you request it to make changes to the system. Whenever you instruct PackageKit to update,
install or remove packages, you will be prompted to enter the superuser password before changes are
made to the system.
If you instruct PackageKit to update the kernel package, then it will prompt you after installation, asking
you whether you want to reboot the system and thereby boot into the newly-installed kernel.
95
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Entries which are checked in the Enabled column indicate that the corresponding repository will be
used to locate packages to satisfy all update and installation requests (including dependency resolution).
You can enable or disable any of the listed Yum repositories by selecting or clearing the checkbox. Note
that doing so causes PolicyKit to prompt you for superuser authentication.
The Enabled column corresponds to the enabled=<1 or 0> field in [repository] sections. When
you click the checkbox, PackageKit inserts the enabled=<1 or 0> line into the correct [repository]
section if it does not exist, or changes the value if it does. This means that enabling or disabling a
repository through the Software Sources window causes that change to persist after closing the
window or rebooting the system.
Note that it is not possible to add or remove Yum repositories through PackageKit.
Checking the box at the bottom of the Software Sources window causes PackageKit to display
source RPM, testing and debuginfo repositories as well. This box is unchecked by default.
After making a change to the available Yum repositories, click on System → Refresh package lists to
make sure your package list is up-to-date.
96
Chapter 6. PackageKit
many package searches. Four of the filters in the Filters drop-down menu are used to split results by
matching or not matching a single criterion. By default when PackageKit starts, these filters are all
unapplied (No filter), but once you do filter by one of them, that filter remains set until you either
change it or close PackageKit.
Because you are usually searching for available packages that are not installed on the system, click
Filters → Installed and select the Only available radio button.
Also, unless you require development files such as C header files, click Filters → Development and
select the Only end user files radio button. This filters out all of the <package_name>-devel packages
we are not interested in.
Figure 6.6. Filtering out development packages from the list of Find results
Graphical
Narrows the search to either applications which provide a GUI interface (Only graphical) or
those that do not. This filter is useful when browsing for GUI applications that perform a specific
function.
97
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Free
Search for packages which are considered to be free software. Refer to the Fedora Licensing
List for details on approved licenses.
The remaining filters can be enabled by selecting the checkboxes next to them:
Hide subpackages
Checking the Hide subpackages checkbox filters out generally-uninteresting packages that are
typically only dependencies of other packages that we want. For example, checking Hide
subpackages and searching for <package> would cause the following related packages to be
filtered out of the Find results (if it exists):
<package>-devel
<package>-libs
<package>-libs-devel
<package>-debuginfo
98
Chapter 6. PackageKit
Figure 6.7. Viewing and installing a package with PackageKit's Add/Remove Software window
When the checkbox next to a package or group is checked, then that item is already installed on the
system. Checking an unchecked box causes it to be marked for installation, which only occurs when the
Apply button is clicked. In this way, you can search for and select multiple packages or package groups
before performing the actual installation transactions. Additionally, you can remove installed packages by
unchecking the checked box, and the removal will occur along with any pending installations when
Apply is pressed. Dependency resolution, which may add additional packages to be installed or
removed, is performed after pressing Apply. PackageKit will then display a window listing those
additional packages to install or remove, and ask for confirmation to proceed.
Select screen and click the Apply button. You will then be prompted for the superuser password; enter
it, and PackageKit will install screen. After finishing the installation, PackageKit sometimes presents you
with a list of your newly-installed applications and offers you the choice of running them immediately.
Alternatively, you will remember that finding a package and selecting it in the Add/Rem ove Software
window shows you the Location of where in the GNOME menus its application shortcut is located,
which is helpful when you want to run it.
Once it is installed, you can run screen, a screen manager that allows you to have multiple logins on
one terminal, by typing screen at a shell prompt.
screen is a very useful utility, but we decide that we do not need it and we want to uninstall it.
Remembering that we need to change the Only available filter we recently used to install it to Only
installed in Filters → Installed, we search for screen again and uncheck it. The program did not
install any dependencies of its own; if it had, those would be automatically removed as well, as long as
they were not also dependencies of any other packages still installed on our system.
99
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
100
Chapter 6. PackageKit
Typing the name of a package in the top text entry field filters the list of transactions to those which
affected that package.
Figure 6.10. Viewing the log of package management transactions with the Software Log Viewer
Table 6.1, “PackageKit GUI windows, menu locations, and shell prompt commands” shows the name of
the GUI window, how to start the window from the GNOME desktop or from the Add/Rem ove
Software window, and the name of the command line application that opens that window.
101
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Table 6.1. PackageKit GUI windows, menu locations, and shell prompt commands
The packagekitd daemon runs outside the user session and communicates with the various graphical
front ends. The packagekitd daemon [3] communicates via the DBus system message bus with
another back end, which utilizes Yum's Python API to perform queries and make changes to the system.
On Linux systems other than Red Hat and Fedora, packagekitd can communicate with other back
ends that are able to utilize the native package manager for that system. This modular architecture
provides the abstraction necessary for the graphical interfaces to work with many different package
managers to perform essentially the same types of package management tasks. Learning how to use
the PackageKit front ends means that you can use the same familiar graphical interface across many
different Linux distributions, even when they utilize a native package manager other than Yum.
In addition, PackageKit's separation of concerns provides reliability in that a crash of one of the GUI
windows—or even the user's X Window session—will not affect any package management tasks being
supervised by the packagekitd daemon, which runs outside of the user session.
All of the front end graphical applications discussed in this chapter are provided by the gnom e-
packagekit package instead of by PackageKit and its dependencies.
Finally, PackageKit also comes with a console-based front end called pkcon.
Online Documentation
102
Chapter 6. PackageKit
PackageKit Home Page — The project home page provides more information about PackageKit.
PackageKit Frequently Asked Questions — The Frequently Asked Questions page for the PackageKit
software suite provides answers to TODO.
See Also
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
Chapter 5, Yum describes how to use the Yum package manager to search, install, update, and
uninstall packages on the command line.
Appendix A, RPM describes the RPM Package Manager (RPM), the packaging system used by Red
Hat Enterprise Linux.
[3] System daemons are typically long-running processes that provide services to the user or to other programs, and which are started, often
at boot time, by special initialization scripts (often shortened to init scripts). Daemons respond to the servi ce command and can be turned
on or off permanently by using the ch kco n f i g o n or ch kco n f i g o f f commands. They can typically be recognized by a “d” appended to
their name, such as the p ackag eki td daemon. Refer to Chapter 7, Managing Services with systemd for information about system services.
103
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
104
Chapter 7. Managing Services with systemd
Systemd introduces the concept of systemd units. These units are represented by unit configuration files
located in one of the directories listed in Table 7.2, “Systemd Unit Locations”, and encapsulate
information about system service, listening sockets, saved system state snapshots, and other objects
that are relevant to the init system. For a complete list of available systemd unit types, see Table 7.1,
“Available systemd Unit Types”.
Directory Description
/usr/lib/system d/system / Systemd units distributed with installed RPM packages.
/run/system d/system / Systemd units created at run time. This directory takes
precedence over the directory with installed service units.
/etc/system d/system / Systemd units created and managed by the system
administrator. This directory takes precedence over the
directory with runtime units.
105
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Socket-based activation — At boot time, systemd creates listening sockets for all system services that
support this type of activation, and passes the sockets to these services as soon as they are started.
This not only allows systemd to start services in parallel, but also makes it possible to restart a
service without losing any message sent to it while it is unavailable: the corresponding socket remains
accessible and all messages are queued.
Systemd uses socket units for socket-based activation.
Bus-based activation — System services that use D-Bus for inter-process communication can be
started on-demand the first time a client application attempts to communicate with them. Systemd
uses D-Bus service files for bus-based activation.
Device-based activation — System services that support device-based activation can be started on-
demand when a particular type of hardware is plugged in or becomes available. Systemd uses device
units for device-based activation.
Path-based activation — System services that support path-based activation can be started on-
demand when a particular file or directory changes its state. Systemd uses path units for path-based
activation.
System state snapshots — Systemd can temporarily save the current state of all units or restore a
previous state of the system from a dynamically created snapshot. To store the current state of the
system, systemd uses dynamically created snapshot units.
Mount and automount point management — Systemd monitors and manages mount and automount
points. Systemd uses mount units for mount points and automount units for automount points.
Aggressive parallelization — Because of the use of socket-based activation, systemd can start
system services in parallel as soon as all listening sockets are in place. In combination with system
services that support on-demand activation, parallel activation significantly reduces the time required
to boot the system.
Transactional unit activation logic — Before activating or deactivating a unit, systemd calculates its
dependencies, creates a temporary transaction, and verifies that this transaction is consistent. If a
transaction is inconsistent, systemd automatically attempts to correct it and remove non-essential
jobs from it before reporting an error.
Backwards compatibility with SysV init — Systemd fully supports SysV init scripts as described in the
Linux Standard Base Core Specification, which eases the upgrade path to systemd service units.
Systemd has only limited support for runlevels. It provides a number of target units that can be
directly mapped to these runlevels and for compatibility reasons, it is also distributed with the earlier
runlevel command. Not all systemd targets can be directly mapped to runlevels, however, and as
a consequence, this command may return N to indicate an unknown runlevel. It is recommended that
you avoid using the runlevel command if possible.
For more information about systemd targets and their comparison with runlevels, see Section 7.3,
“Working with systemd Targets”.
The system ctl utility does not support custom commands. In addition to standard commands such
as start, stop, and status, authors of SysV init scripts could implement support for any number of
arbitrary commands in order to provide additional functionality. For example, the init script for
iptables in Red Hat Enterprise Linux 6 could be executed with the panic command, which
immediately enabled panic mode and reconfigured the system to start dropping all incoming and
outgoing packets. This is not supported in systemd and the system ctl only accepts documented
commands.
106
Chapter 7. Managing Services with systemd
For more information about the system ctl utility and its comparison with the earlier service utility,
see Section 7.2, “Managing System Services”.
The system ctl utility does not communicate with services that have not been started by systemd.
When systemd starts a system service, it stores the ID of its main process in order to keep track of it.
The system ctl utility then uses this PID to query and manage the service. Consequently, if a user
starts a particular daemon directly on the command line, system ctl is unable to determine its
current status or stop it.
Systemd stops only running services. Previously, when the shutdown sequence was initiated, Red
Hat Enterprise Linux 6 and earlier releases of the system used symbolic links located in the
/etc/rc0.d/ directory to stop all available system services regardless of their status. With systemd,
only running services are stopped on shutdown.
System services are unable to read from the standard input stream. When systemd starts a service, it
connects its standard input to /dev/null to prevent any interaction with the user.
System services do not inherit any context (such as the HOME and PAT H environment variables) from
the invoking user and their session. Each service runs in a clean execution context.
Systemd reads dependency information encoded in the Linux Standard Base (LSB) header and
interprets it at run time.
All operations on service units are subject to a timeout of 5 minutes to prevent a malfunctioning
service from freezing the system.
For a detailed list of compatibility changes introduced with systemd, see the Migration Planning Guide for
Red Hat Enterprise Linux 7. For a comparison of systemd with SysV init and Upstart, see the upstream
documentation.
Service units end with the .service file extension and serve a similar purpose as init scripts. To view,
start, stop, restart, enable, or disable system services, use the system ctl command as described in
Table 7.3, “Comparison of the service Utility with systemctl ”, Table 7.4, “Comparison of the chkconfig
Utility with systemctl”, and in the section below. The service and chkconfig commands are still
available in the system and work as expected, but are only included for compatibility reasons and should
be avoided.
107
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Note
For clarity, all examples in the rest of this section use full unit names with the .service file
extension, for example:
When working with system services, it is possible to omit this file extension to reduce typing: when
the system ctl utility encounters a unit name without a file extension, it automatically assumes it
is a service unit. The following command is equivalent to the one above:
chkconfig --list system ctl list-unit-files --type Lists all services and
service checks if they are
enabled.
108
Chapter 7. Managing Services with systemd
For each service unit, this command displays its full name (UNIT ) followed by a note whether the unit
has been loaded (LOAD), its high-level (ACT IVE) and low-level (SUB) unit activation state, and a short
description (DESCRIPT ION).
By default, the system ctl list-units command displays only active units. If you want to list all
loaded units regardless of their state, run this command with the --all or -a command line option:
You can also list all available service units to see if they are enabled. To do so, type:
For each service unit, this command displays its full name (UNIT FILE) followed by information whether
the service unit is enabled or not (ST AT E). For information on how to determine the status of individual
service units, see Section 7.2.2, “Displaying Service Status”.
To list all currently loaded service units, run the following command:
46 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'
To list all installed service units to determine if they are enabled, type:
109
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Replace name with the name of the service unit you want to inspect (for example, gdm ). This command
displays the name of the selected service unit followed by its short description, one or more fields
described in Table 7.5, “Available Service Unit Information”, and if it is executed by the root user, also
the most recent log entries.
Field Description
Loaded Information whether the service unit has been loaded, the absolute
path to the unit file, and a note whether the unit is enabled.
Active Information whether the service unit is running followed by a time
stamp.
Main PID The PID of the corresponding system service followed by its name.
Status Additional information about the corresponding system service.
Process Additional information about related processes.
CGroup Additional information about related Control Groups.
To only verify that a particular service unit is running, run the following command:
Note that both system ctl is-active and system ctl is-enabled return an exit status of 0 if at
least one of the specified service units is running or enabled. For information on how to list all currently
loaded service units, see Section 7.2.1, “Listing Services”.
110
Chapter 7. Managing Services with systemd
The service unit for the GNOME Display Manager is named gdm .service. To determine the current
status of this service unit, type the following at a shell prompt:
Replace name with the name of the service unit you want to start (for example, gdm ). This command
starts the selected service unit in the current session. For information on how to enable a service unit to
be started at boot time, see Section 7.2.6, “Enabling a Service”. For information on how to determine the
status of a certain service unit, see Section 7.2.2, “Displaying Service Status”.
The service unit for the Apache HTTP Server is named httpd.service. To activate this service unit
and start the httpd daemon in the current session, run the following command as root:
Replace name with the name of the service unit you want to stop (for example, bluetooth). This
command stops the selected service unit in the current session. For information on how to disable a
service unit and prevent it from being started at boot time, see Section 7.2.7, “Disabling a Service”. For
information on how to determine the status of a certain service unit, see Section 7.2.2, “Displaying
Service Status”.
111
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The service unit for the bluetoothd daemon is named bluetooth.service. To deactivate this
service unit and stop the bluetoothd daemon in the current session, run the following command as
root:
Replace name with the name of the service unit you want to restart (for example, httpd). This command
stops the selected service unit in the current session and immediately starts it again. Importantly, if the
selected service unit is not running, this command starts it too. To tell systemd to restart a service unit
only if the corresponding service is already running, run the following command as root:
Certain system services also allow you to reload their configuration without interrupting their execution.
To do so, type as root:
Note that system services that do not support this feature ignore this command altogether. For
convenience, the system ctl command also supports the reload-or-restart and reload-or-
try-restart commands that restart such services instead. For information on how to determine the
status of a certain service unit, see Section 7.2.2, “Displaying Service Status”.
In order to prevent users from encountering unnecessary error messages or partially rendered web
pages, the Apache HTTP Server allows you to edit and reload its configuration without the need to
restart it and interrupt actively processed requests. To do so, type the following at a shell prompt as
root:
Replace name with the name of the service unit you want to enable (for example, httpd). This command
112
Chapter 7. Managing Services with systemd
reads the [Install] section of the selected service unit and creates appropriate symbolic links to the
/usr/lib/system d/system /name.service file in the /etc/system d/system / directory. This
command does not, however, rewrite links that already exist. If you want to ensure that the symbolic links
are re-created, use the following command as root:
This command disables the selected service unit and immediately enables it again. For information on
how to determine whether a certain service unit is enabled to start at boot time, see Section 7.2.2,
“Displaying Service Status”. For information on how to start a service in the current session, see
Section 7.2.3, “Starting a Service”.
To configure the Apache HTTP Server to start automatically at boot time, run the following command
as root:
Replace name with the name of the service unit you want to disable (for example, bluetooth). This
command reads the [Install] section of the selected service unit and removes appropriate symbolic
links to the /usr/lib/system d/system /name.service file from the /etc/system d/system /
directory. In addition, you can mask any service unit to prevent it from being started manually or by
another service. To do so, run the following command as root:
This command replaces the /etc/system d/system /name.service file with a symbolic link to
/dev/null, rendering the actual unit file inaccessible to systemd. To revert this action and unmask a
service unit, type as root:
For information on how to determine whether a certain service unit is enabled to start at boot time, see
Section 7.2.2, “Displaying Service Status”. For information on how to stop a service in the current
session, see Section 7.2.4, “Stopping a Service”.
113
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Example 7.4, “Stopping a Service” illustrates how to stop the bluetooth.service unit in the current
session. To prevent this service unit from starting at boot time, type the following at a shell prompt as
root:
Systemd targets are represented by target units. Target units end with the .target file extension and
their only purpose is to group together other systemd units through a chain of dependencies. For
example, the graphical.target unit, which is used to start a graphical session, starts system
services such as the GNOME Display Manager (gdm .service) or Accounts Service (accounts-
daem on.service) and also activates the m ulti-user.target unit. Similarly, the m ulti-
user.target unit starts other essential system services such as NetworkManager
(NetworkManager.service) or D-Bus (dbus.service) and activates another target unit named
basic.target.
Red Hat Enterprise Linux 7 is distributed with a number of predefined targets that are more or less
similar to the standard set of runlevels from the previous releases of this system. For compatibility
reasons, it also provides aliases for these targets that directly map them to SysV runlevels. Table 7.6,
“Comparison of SysV Runlevels with systemd Targets” provides a complete list of SysV runlevels and
their corresponding systemd targets.
114
Chapter 7. Managing Services with systemd
To view, change, or configure systemd targets, use the system ctl utility as described in Table 7.7,
“Comparison of SysV init Commands with systemctl” and in the sections below. The runlevel and
telinit commands are still available in the system and work as expected, but are only included for
compatibility reasons and should be avoided.
systemctl get-default
This command resolves the symbolic link located at /etc/system d/system /default.target and
displays the result. For information on how to change the default target, see Section 7.3.3, “Changing the
Default Target”. For information on how to list all currently loaded target units, see Section 7.3.2,
“Viewing the Current Target”.
115
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For each target unit, this commands displays its full name (UNIT ) followed by a note whether the unit
has been loaded (LOAD), its high-level (ACT IVE) and low-level (SUB) unit activation state, and a short
description (DESCRIPT ION).
By default, the system ctl list-units command displays only active units. If you want to list all
loaded units regardless of their state, run this command with the --all or -a command line option:
See Section 7.3.1, “Viewing the Default Target” for information on how to display the default target. For
information on how to change the current target, see Section 7.3.4, “Changing the Current Target”.
To list all currently loaded target units, run the following command:
17 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'.
116
Chapter 7. Managing Services with systemd
Replace name with the name of the target unit you want to use by default (for example, m ulti-user).
This command replaces the /etc/system d/system /default.target file with a symbolic link to
/usr/lib/system d/system /name.target, where name is the name of the target unit you want to
use. For information on how to change the current target, see Section 7.3.4, “Changing the Current
Target”.
To configure the system to use the m ulti-user.target unit by default, run the following command
as root:
Replace name with the name of the target unit you want to use (for example, m ulti-user). This
command starts the target unit named name and all dependent units, and immediately stops all others.
For information on how to change the default target, see Section 7.3.3, “Changing the Default Target”.
For information on how to list all currently loaded target units, see Section 7.3.4, “Changing the Current
Target”.
To turn off the graphical user interface and change to the m ulti-user.target unit in the current
session, run the following command as root:
To change the current target and enter rescue mode in the current session, type the following at a shell
prompt as root:
systemctl rescue
117
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
This command is similar to system ctl isolate rescue.target, but it also sends an informative
message to all users that are currently logged into the system. To prevent systemd from sending this
message, run this command with the --no-wall command line option:
For information on how to enter emergency mode, see Section 7.3.6, “Changing to Emergency Mode”.
To enter rescue mode in the current session, run the following command as root:
To change the current target and enter emergency mode, type the following at a shell prompt as root:
systemctl emergency
This command is similar to system ctl isolate em ergency.target, but it also sends an
informative message to all users that are currently logged into the system. To prevent systemd from
sending this message, run this command with the --no-wall command line option:
For information on how to enter rescue mode, see Section 7.3.5, “Changing to Rescue Mode”.
To enter emergency mode without sending a message to all users that are currently logged into the
system, run the following command as root:
118
Chapter 7. Managing Services with systemd
Table 7.8, “Comparison of Power Management Commands with systemctl” are still available in the
system for compatibility reasons, but it is advised that you use system ctl when possible.
systemctl poweroff
To shut down and halt the system without powering off the machine, run the following command as
root:
systemctl halt
By default, running either of these commands causes systemd to send an informative message to all
users that are currently logged into the system. To prevent systemd from sending this message, run the
selected command with the --no-wall command line option, for example:
systemctl reboot
By default, this command causes systemd to send an informative message to all users that are currently
logged into the system. To prevent systemd from sending this message, run this command with the --
no-wall command line option:
systemctl suspend
This command saves the system state in RAM and with the exception of the RAM module, powers off
119
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
most of the devices in the machine. When you turn the machine back on, the system then restores its
state from RAM without having to boot again. Because the system state is saved in RAM and not on the
hard disk, restoring the system from suspend mode is significantly faster than restoring it from
hibernation, but as a consequence, a suspended system state is also vulnerable to power outages.
For information on how to hibernate the system, see Section 7.4.4, “Hibernating the System”.
systemctl hibernate
This command saves the system state on the hard disk drive and powers off the machine. When you
turn the machine back on, the system then restores its state from the saved data without having to boot
again. Because the system state is saved on the hard disk and not in RAM, the machine does not have
to maintain electrical power to the RAM module, but as a consequence, restoring the system from
hibernation is significantly slower than restoring it from suspend mode.
To hibernate and suspend the system, run the following command as root:
systemctl hybrid-sleep
For information on how to suspend the system, see Section 7.4.3, “Suspending the System”.
Replace user_name with the name of the remote user, host_name with the machine's host name, and
com m and with any of the system ctl commands described above. Note that the remote machine must
be configured to allow the selected user remote access over the SSH protocol. For more information on
how to configure an SSH server, see Chapter 8, OpenSSH.
To log in to a remote machine named server-01.exam ple.com as the root user and determine
the current status of the httpd.service unit, type the following at a shell prompt:
120
Chapter 7. Managing Services with systemd
Installed Documentation
system ctl(1) — The manual page for the system ctl command line utility provides a complete list
of supported options and commands.
system d(1) — The manual page for the system d system and service manager provides more
information about its concepts and documents available command line options and environment
variables, supported configuration files and directories, recognized signals, and available kernel
options.
system d.unit(5) — The manual page named system d.unit provides in-depth information about
systemd unit files and documents all available configuration options.
system d.service(5) — The manual page named system d.service documents the format of
service unit files.
system d.target(5) — The manual page named system d.target documents the format of
target unit files.
Online Documentation
Red Hat Enterprise Linux 7 Networking Guide — The Networking Guide for Red Hat Enterprise Linux
7 documents relevant information regarding the configuration and administration of network
interfaces, networks, and network services in this system. It provides an introduction to the
hostnam ectl utility and explains how to use it to view and set host names on the command line,
both locally and remotely.
Red Hat Enterprise Linux 7 Desktop Migration and Administration Guide — The Desktop Migration
and Administration Guide for Red Hat Enterprise Linux 7 documents the migration planning,
deployment, configuration, and administration of the GNOME 3 desktop on this system. It introduces
the logind service, enumerates its most significant features, and explains how to use the
loginctl utility to list active sessions and enable multi-seat support.
Red Hat Enterprise Linux 7 SELinux User's and Administrator's Guide — The SELinux User's and
Administrator's Guide for Red Hat Enterprise Linux 7 describes the basic principles of SELinux and
documents in detail how to configure and use SELinux with various services such as the Apache
HTTP Server, Postfix, PostgreSQL, or OpenShift. It explains how to configure SELinux access
permissions for system services managed by systemd.
Red Hat Enterprise Linux 7 Installation Guide — The Installation Guide for Red Hat Enterprise Linux 7
documents how to install the system on AMD64 and Intel 64 systems, 64-bit IBM Power Systems
servers, and IBM System z. It also covers advanced installation methods such as Kickstart
installations, PXE installations, and installations over the VNC protocol. In addition, it describes
common post-installation tasks and explains how to troubleshoot installation problems, including
detailed instructions on how to boot into rescue mode or recover the root password.
Red Hat Enterprise Linux 7 Security Guide — The Security Guide for Red Hat Enterprise Linux 7
assists users and administrators in learning the processes and practices of securing their
workstations and servers against local and remote intrusion, exploitation, and malicious activity. It
also explains how to secure critical system services.
systemd Home Page — The project home page provides more information about systemd.
121
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
See Also
Chapter 1, System Locale and Keyboard Configuration documents how to manage the system locale
and keyboard layouts. It explains how to use the localectl utility to view the current locale, list
available locales, and set the system locale on the command line, as well as to view the current
keyboard layout, list available keymaps, and enable a particular keyboard layout on the command
line.
Chapter 2, Configuring the Date and Time documents how to manage the system date and time. It
explains the difference between a real-time clock and system clock and describes how to use the
tim edatectl utility to display the current settings of the system clock, configure the date and time,
change the time zone, and synchronize the system clock with a remote server.
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
Chapter 8, OpenSSH describes how to configure an SSH server and how to use the ssh, scp, and
sftp client utilities to access it.
Chapter 19, Viewing and Managing Log Files provides an introduction to journald. It describes the
journal, introduces the journald service, and documents how to use the journalctl utility to
view log entries, enter live view mode, and filter log entries. In addition, this chapter describes how to
give non-root users access to system logs and enable persistent storage for log files.
122
Chapter 8. OpenSSH
Chapter 8. OpenSSH
SSH (Secure Shell) is a protocol which facilitates secure communications between two systems using a
client/server architecture and allows users to log in to server host systems remotely. Unlike other remote
communication protocols, such as FT P or T elnet, SSH encrypts the login session, rendering the
connection difficult for intruders to collect unencrypted passwords.
The ssh program is designed to replace older, less secure terminal applications used to log in to remote
hosts, such as telnet or rsh. A related program called scp replaces older programs designed to copy
files between hosts, such as rcp. Because these older applications do not encrypt passwords
transmitted between the client and the server, avoid them whenever possible. Using secure methods to
log in to remote systems decreases the risks for both the client system and the remote host.
Red Hat Enterprise Linux includes the general OpenSSH package (openssh) as well as the OpenSSH
server (openssh-server) and client (openssh-clients) packages. Note, the OpenSSH packages
require the OpenSSL package (openssl) which installs several important cryptographic libraries,
enabling OpenSSH to provide encrypted communications.
This attack is usually performed using a packet sniffer, a rather common network utility that
captures each packet flowing through the network, and analyzes its content.
This attack can be performed using a technique known as DNS poisoning, or via so-called IP
spoofing. In the first case, the intruder uses a cracked DNS server to point client systems to a
maliciously duplicated host. In the second case, the intruder sends falsified network packets that
appear to be from a trusted host.
Both techniques intercept potentially sensitive information and, if the interception is made for hostile
reasons, the results can be disastrous. If SSH is used for remote shell login and file copying, these
security threats can be greatly diminished. This is because the SSH client and server use digital
signatures to verify their identity. Additionally, all communication between the client and server systems is
encrypted. Attempts to spoof the identity of either side of a communication does not work, since each
packet is encrypted using a key known only by the local and remote systems.
123
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To ensure maximum security for your connection, it is recommended that only SSH version 2-
compatible servers and clients are used whenever possible.
124
Chapter 8. OpenSSH
1. A cryptographic handshake is made so that the client can verify that it is communicating with the
correct server.
2. The transport layer of the connection between the client and remote host is encrypted using a
symmetric cipher.
3. The client authenticates itself to the server.
4. The remote client interacts with the remote host over the encrypted connection.
Once an SSH client contacts a server, key information is exchanged so that the two systems can
correctly construct the transport layer. The following steps occur during this exchange:
During the key exchange, the server identifies itself to the client with a unique host key. If the client has
never communicated with this particular server before, the server's host key is unknown to the client and
it does not connect. OpenSSH gets around this problem by accepting the server's host key. This is done
after the user is notified and has both accepted and verified the new host key. In subsequent
connections, the server's host key is checked against the saved version on the client, providing
confidence that the client is indeed communicating with the intended server. If, in the future, the host key
no longer matches, the user must remove the client's saved version before a connection can occur.
It is possible for an attacker to masquerade as an SSH server during the initial contact since the
local system does not know the difference between the intended server and a false one set up by
an attacker. To help prevent this, verify the integrity of a new SSH server by contacting the server
administrator before connecting for the first time or in the event of a host key mismatch.
SSH is designed to work with almost any kind of public key algorithm or encoding format. After an initial
key exchange creates a hash value used for exchanges and a shared secret value, the two systems
immediately begin calculating new keys and algorithms to protect authentication and future data sent
over the connection.
After a certain amount of data has been transmitted using a given key and algorithm (the exact amount
depends on the SSH implementation), another key exchange occurs, generating another set of hash
values and a new shared secret value. Even if an attacker is able to determine the hash and shared
secret value, this information is only useful for a limited period of time.
125
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
8.1.4.2. Authentication
Once the transport layer has constructed a secure tunnel to pass information between the two systems,
the server tells the client the different authentication methods supported, such as using a private key-
encoded signature or typing a password. The client then tries to authenticate itself to the server using
one of these supported methods.
SSH servers and clients can be configured to allow different types of authentication, which gives each
side the optimal amount of control. The server can decide which encryption methods it supports based
on its security model, and the client can choose the order of authentication methods to attempt from the
available options.
8.1.4.3. Channels
After a successful authentication over the SSH transport layer, multiple channels are opened via a
technique called multiplexing [4] . Each of these channels handles communication for different terminal
sessions and for forwarded X11 sessions.
Both clients and servers can create a new channel. Each channel is then assigned a different number on
each end of the connection. When the client attempts to open a new channel, the clients sends the
channel number along with the request. This information is stored by the server and is used to direct
communication to that channel. This is done so that different types of sessions do not affect one another
and so that when a given session ends, its channel can be closed without disrupting the primary SSH
connection.
Channels also support flow-control, which allows them to send and receive data in an orderly fashion. In
this way, data is not sent over the channel until the client receives a message that the channel is open.
The client and server negotiate the characteristics of each channel automatically, depending on the type
of service the client requests and the way the user is connected to the network. This allows great
flexibility in handling different types of remote connections without having to change the basic
infrastructure of the protocol.
126
Chapter 8. OpenSSH
File Description
/etc/ssh/m oduli Contains Diffie-Hellman groups used for the Diffie-Hellman key
exchange which is critical for constructing a secure transport
layer. When keys are exchanged at the beginning of an SSH
session, a shared, secret value is created which cannot be
determined by either party alone. This value is then used to
provide host authentication.
/etc/ssh/ssh_config The default SSH client configuration file. Note that it is
overridden by ~/.ssh/config if it exists.
/etc/ssh/sshd_config The configuration file for the sshd daemon.
/etc/ssh/ssh_host_dsa_key The DSA private key used by the sshd daemon.
/etc/ssh/ssh_host_dsa_key.pu The DSA public key used by the sshd daemon.
b
/etc/ssh/ssh_host_key The RSA private key used by the sshd daemon for version 1
of the SSH protocol.
/etc/ssh/ssh_host_key.pub The RSA public key used by the sshd daemon for version 1 of
the SSH protocol.
/etc/ssh/ssh_host_rsa_key The RSA private key used by the sshd daemon for version 2
of the SSH protocol.
/etc/ssh/ssh_host_rsa_key.pu The RSA public key used by the sshd daemon for version 2 of
b the SSH protocol.
File Description
~/.ssh/authorized_keys Holds a list of authorized public keys for servers. When the
client connects to a server, the server authenticates the client
by checking its signed public key stored within this file.
~/.ssh/id_dsa Contains the DSA private key of the user.
~/.ssh/id_dsa.pub The DSA public key of the user.
~/.ssh/id_rsa The RSA private key used by ssh for version 2 of the SSH
protocol.
~/.ssh/id_rsa.pub The RSA public key used by ssh for version 2 of the SSH
protocol.
~/.ssh/identity The RSA private key used by ssh for version 1 of the SSH
protocol.
~/.ssh/identity.pub The RSA public key used by ssh for version 1 of the SSH
protocol.
~/.ssh/known_hosts Contains DSA host keys of SSH servers accessed by the user.
This file is very important for ensuring that the SSH client is
connecting the correct SSH server.
For information concerning various directives that can be used in the SSH configuration files, refer to the
ssh_config(5) and sshd_config(5) manual pages.
127
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To start the sshd daemon in the current session, type the following at a shell prompt as root:
To stop the running sshd daemon in the current session, use the following command as root:
If you want the daemon to start automatically at the boot time, type as root:
This enables the service for all runlevels. For more information on how to manage system services in
Red Hat Enterprise Linux, see Chapter 7, Managing Services with systemd.
Note that if you reinstall the system, a new set of identification keys will be created. As a result, clients
who had connected to the system with any of the OpenSSH tools before the reinstall will see the
following message:
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
To prevent this, you can backup the relevant files from the /etc/ssh/ directory (see Table 8.1,
“System-wide configuration files” for a complete list), and restore them whenever you reinstall the
system.
For information on how to configure the vsftpd service, see Section 13.2, “FTP”. To learn how to
manage system services in Red Hat Enterprise Linux 7, read Chapter 7, Managing Services with
systemd.
PasswordAuthentication no
128
Chapter 8. OpenSSH
To be able to use ssh, scp, or sftp to connect to the server from a client machine, generate an
authorization key pair by following the steps below. Note that keys must be generated for each user
separately.
Red Hat Enterprise Linux 7 uses SSH Protocol 2 and RSA keys by default (see Section 8.1.3, “Protocol
Versions” for more information).
If you complete the steps as root, only root will be able to use the keys.
If you reinstall your system and want to keep previously generated key pair, backup the ~/.ssh/
directory. After reinstalling, copy it back to your home directory. This process can be done for all
users on your system, including root.
2. Press Enter to confirm the default location (that is, ~/.ssh/id_rsa) for the newly created key.
3. Enter a passphrase, and confirm it by entering it again when prompted to do so. For security
reasons, avoid using the same password as you use to log in to your account.
After this, you will be presented with a message similar to this:
129
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To generate a DSA key pair for version 2 of the SSH protocol, follow these steps:
2. Press Enter to confirm the default location (that is, ~/.ssh/id_dsa) for the newly created key.
3. Enter a passphrase, and confirm it by entering it again when prompted to do so. For security
reasons, avoid using the same password as you use to log in to your account.
After this, you will be presented with a message similar to this:
To generate an RSA key pair for version 1 of the SSH protocol, follow these steps:
130
Chapter 8. OpenSSH
2. Press Enter to confirm the default location (that is, ~/.ssh/identity) for the newly created
key.
3. Enter a passphrase, and confirm it by entering it again when prompted to do so. For security
reasons, avoid using the same password as you use to log in to your account.
After this, you will be presented with a message similar to this:
Refer to Section 8.2.4.2, “Configuring ssh-agent” for information on how to set up your system to
remember the passphrase.
The private key is for your personal use only, and it is important that you never give it to anyone.
To save your passphrase during your GNOME session, follow these steps:
1. Make sure you have the openssh-askpass package installed. If not, refer to Section 5.2.4,
“Installing Packages” for more information on how to install new packages in Red Hat
Enterprise Linux.
2. Select System → Preferences → Startup Applications from the panel. The Startup
131
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Applications Preferences will be started, and the tab containing a list of available startup
programs will be shown by default.
3. Click the Add button on the right, and enter /usr/bin/ssh-add in the Com m and field.
4. Click Add and make sure the checkbox next to the newly added item is selected.
132
Chapter 8. OpenSSH
5. Log out and then log back in. A dialog box will appear prompting you for your passphrase. From
this point on, you should not be prompted for a password by ssh, scp, or sftp.
To save your passphrase for a certain shell prompt, use the following command:
~]$ ssh-add
Enter passphrase for /home/john/.ssh/id_rsa:
Note that when you log out, your passphrase will be forgotten. You must execute the command each
time you log in to a virtual console or a terminal window.
133
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
ssh hostname
For example, to log in to a remote machine named penguin.exam ple.com , type the following at a
shell prompt:
This will log you in with the same username you are using on a local machine. If you want to specify a
different one, use a command in the command in the following form:
ssh username@hostname
The first time you initiate a connection, you will be presented with a message similar to this:
Type yes to confirm. You will see a notice that the server has been added to the list of known hosts, and
a prompt asking for your password:
If the SSH server's host key changes, the client notifies the user that the connection cannot
proceed until the server's host key is deleted from the ~/.ssh/known_hosts file. To do so, open
the file in a text editor, and remove a line containing the remote machine name at the beginning.
Before doing this, however, contact the system administrator of the SSH server to verify the
server is not compromised.
After entering the password, you will be provided with a shell prompt for the remote machine.
Alternatively, the ssh program can be used to execute a command on the remote machine without
logging in to a shell prompt:
134
Chapter 8. OpenSSH
For example, the /etc/redhat-release file provides information about the Red Hat Enterprise Linux
version. To view the contents of this file on penguin.exam ple.com , type:
After you enter the correct password, the username will be displayed, and you will return to your local
shell prompt.
To transfer a local file to a remote system, use a command in the following form:
Multiple files can be specified at once. To transfer the contents of .vim /plugin/ to the same directory
on the remote machine penguin.exam ple.com , type the following command:
To transfer a remote file to the local system, use the following syntax:
For instance, to download the .vim rc configuration file from the remote machine, type:
sftp username@hostname
135
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For example, to log in to a remote machine named penguin.exam ple.com with john as a
username, type:
After you enter the correct password, you will be presented with a prompt. The sftp utility accepts a set
of commands similar to those used by ftp (see Table 8.3, “A selection of available sftp commands”).
Command Description
ls [directory] List the content of a remote directory. If none is supplied, a
current working directory is used by default.
cd directory Change the remote working directory to directory.
m kdir directory Create a remote directory.
rm dir path Remove a remote directory.
put localfile [remotefile] Transfer localfile to a remote machine.
get remotefile [localfile] Transfer remotefile from a remote machine.
For a complete list of available commands, refer to the sftp(1) manual page.
ssh -Y username@hostname
For example, to log in to a remote machine named penguin.exam ple.com with john as a
username, type:
When an X program is run from the secure shell prompt, the SSH client and server create a new secure
channel, and the X program data is sent over that channel to the client machine transparently.
X11 forwarding can be very useful. For example, X11 forwarding can be used to create a secure,
interactive session of the Printer Configuration utility. To do this, connect to the server using ssh and
type:
136
Chapter 8. OpenSSH
The Printer Configuration Tool will appear, allowing the remote user to safely configure printing on the
remote system.
Port forwarding works by mapping a local port on the client to a remote port on the server. SSH can map
any port from the server to any port on the client. Port numbers do not need to match for this technique
to work.
Setting up port forwarding to listen on ports below 1024 requires root level access.
To create a TCP/IP port forwarding channel which listens for connections on the localhost, use a
command in the following form:
For example, to check email on a server called m ail.exam ple.com using POP3 through an encrypted
connection, use the following command:
Once the port forwarding channel is in place between the client machine and the mail server, direct a
POP3 mail client to use port 1100 on the localhost to check for new email. Any requests sent to port
1100 on the client system will be directed securely to the m ail.exam ple.com server.
If m ail.exam ple.com is not running an SSH server, but another machine on the same network is,
SSH can still be used to secure part of the connection. However, a slightly different command is
necessary:
In this example, POP3 requests from port 1100 on the client machine are forwarded through the SSH
connection on port 22 to the SSH server, other.exam ple.com . Then, other.exam ple.com
connects to port 110 on m ail.exam ple.com to check for new email. Note that when using this
technique, only the connection between the client system and other.exam ple.com SSH server is
secure.
Port forwarding can also be used to get information securely through network firewalls. If the firewall is
configured to allow SSH traffic via its standard port (that is, port 22) but blocks access to other ports, a
connection between two hosts using the blocked ports is still possible by redirecting their communication
over an established SSH connection.
137
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Using port forwarding to forward connections in this manner allows any user on the client system
to connect to that service. If the client system becomes compromised, the attacker also has
access to forwarded services.
System administrators concerned about port forwarding can disable this functionality on the
server by specifying a No parameter for the AllowT cpForwarding line in
/etc/ssh/sshd_config and restarting the sshd service.
Installed Documentation
sshd(8) — The manual page for the sshd daemon documents available command line options and
provides a complete list of supported configuration files and directories.
ssh(1) — The manual page for the ssh client application provides a complete list of available
command line options and supported configuration files and directories.
scp(1) — The manual page for the scp utility provides a more detailed description of this utility and
its usage.
sftp(1) — The manual page for the sftp utility.
ssh-keygen(1) — The manual page for the ssh-keygen utility documents in detail how to use it to
generate, manage, and convert authentication keys used by ssh.
ssh_config(5) — The manual page named ssh_config documents available SSH client
configuration options.
sshd_config(5) — The manual page named sshd_config provides a full description of available
SSH daemon configuration options.
Online Documentation
OpenSSH Home Page — The OpenSSH home page containing further documentation, frequently
asked questions, links to the mailing lists, bug reports, and other useful resources.
OpenSSL Home Page — The OpenSSL home page containing further documentation, frequently
asked questions, links to the mailing lists, and other useful resources.
See Also
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
Chapter 7, Managing Services with systemd provides more information on systemd and documents
how to use the system ctl command to manage system services.
[4] A multiplexed connection consists of several signals being sent over a shared, common medium. With SSH, different channels are sent
over a common secure connection.
138
Chapter 8. OpenSSH
139
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Chapter 9. TigerVNC
T igerVNC (Tiger Virtual Network Computing) is a system of graphical desktop sharing which allows you
to remotely control other computers.
T igerVNC works on the client-server network: a server shares its output (vncserver) and a client
(vncviewer) connects to the server.
Note
Unlike in previous Red Hat Enterprise Linux distributions, current T igerVNC uses the system d
system management daemon for its configuration. The /etc/sysconfig/vncserver
configuration file has been replaced by /lib/system d/system /vncserver@ .service
If you desire to use your TigerVNC as the client as well, run the command, which installs the server
component along with the client:
# cp /lib/systemd/system/vncserver@.service
/lib/systemd/system/vncserver@:3.service
140
Chapter 9. TigerVNC
User=joe
ExecStart=/sbin/runuser -l joe -c "/usr/bin/vncserver %i -geometry
1280x1024"
# systemctl daemon-reload
5. Set the password for the user or users defined in the configuration file.
# vncpasswd user
Password:
Verify:
Repeat the procedure to set the password for other user or users:
# su - user2
Important
The stored password is not encrypted securely; anyone who has access to the password
file can find the plain-text password.
You can also enable the service to start automatically at system start. Every time you log in, vncserver
is automatically started. As root, run
At this point, other users are able to use the vncviewer program to connect to your server using the
display number and password defined.
9.1.3.1. Troubleshooting
If the vncserver does not start, you should verify whether the respective port is open.
141
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
2. If not, update iptables by adding the following line into the /etc/sysconfig/iptables file:
3. Save the file, then restart iptables and verify that the port is active by running:
Or, when your operation system is on, you can stop the service by running the following command :
For operating the vncviewer, there is a pop-up menu containing entries which perform various actions
such as switching in and out of full-screen mode or quitting the viewer. Alternatively, you can operate
vncviewer through the terminal; there is a list of parameters vncviewer can be used with which you
obtain by typing vncviewer -h on the command line.
142
Chapter 9. TigerVNC
For example, with the IP address 192.168.0.4, display number 3, and machine name joe, the
command looks as follows:
# /etc/init.d/ebtables save
# /etc/init.d/ebtables stop
vncviewer(1)
The VNC viewer manual pages.
passwd(1)
The VNC password manual pages.
143
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
144
Chapter 10. Web Servers
There are important differences between the Apache HTTP Server 2.4 and version 2.2, and if you are
upgrading from a previous release of Red Hat Enterprise Linux, you will need to update the httpd
service configuration accordingly. This section reviews some of the newly added features, outlines
important changes, and guides you through the update of older configuration files.
is replaced by
apachectl graceful
The command:
is replaced by
apachectl configtest
The system d unit file for httpd has different behavior from the init script as follows:
Private /tmp
To enhance system security, the system d unit file runs the httpd daemon using a private
/tm p directory, separate to the system /tm p directory.
Configuration Layout
145
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Configuration files which load modules are now placed in the /etc/httpd/conf.m odules.d
directory. Packages, such as php, which provide additional loadable modules for httpd will
place a file in this directory. Any configuration files in the conf.m odules.d are processed
before the main body of httpd.conf. Configuration files in the /etc/httpd/conf.d
directory are now processed after the main body of httpd.conf.
Some additional configuration files are provided by the httpd package itself:
/etc/httpd/conf.d/autoindex.conf
/etc/httpd/conf.d/userdir.conf
/etc/httpd/conf.d/welcome.conf
Default Configuration
A minimal default httpd.conf is now provided by default. Many common configuration
settings, such as T im eout or KeepAlive are no longer explicitly configured in the default
configuration; hard-coded settings will be used instead, by default. The hard-coded default
settings for all configuration directives are specified in the manual.
Configuration Changes
A number of backwards-incompatible changes to the httpd configuration syntax were made
which will require changes if migrating an existing configuration from httpd 2.2 to httpd 2.4.
Processing Model
In previous releases of Red Hat Enterprise Linux, different multi-processing models (MPM) were
made available as different httpd binaries: the forked model, “prefork”, as /usr/sbin/httpd,
and the thread-based model “worker” as /usr/sbin/httpd.worker.
In Red Hat Enterprise Linux 7, only a single httpd binary is used, and three MPMs are
available as loadable modules: worker, prefork (default), and event. The configuration file
/etc/httpd/conf.m odules.d/00-m pm .conf can be changed to select which of the three
MPM modules is loaded.
Packaging Changes
The LDAP authentication and authorization modules are now provided in a separate sub-
package mod_ldap. The new module mod_session and associated helper modules are
provided in a new sub-package, mod_session. The new modules mod_proxy_html and
mod_xml2enc are provided in a new sub-package, mod_proxy_html.
146
Chapter 10. Web Servers
Packaged content provided with httpd has been moved from /var/www/ to
/usr/share/httpd/:
/usr/share/httpd/icons/
/usr/share/httpd/manual/
/usr/share/httpd/error/
suexec
To improve system security, the suexec binary is no longer installed setuid root; instead, it
has file system capability bits set which allow a more restrictive set of permissions. In
conjunction with this change, the suexec binary no longer uses the
/var/log/httpd/suexec.log logfile. Instead, log messages are sent to syslog; by default
these will appear in the /var/log/secure log file.
Module Interface
Due to changes to the httpd module interface, httpd 2.4 is not compatible with third-party
binary modules built against httpd 2.2. Such modules will need to be adjusted as necessary for
the httpd 2.4 module interface, and then rebuilt. A detailed list of the API changes in version
2.4 is available here: http://httpd.apache.org/docs/2.4/developer/new_api_2_4.html.
The apxs binary used to build modules from source has moved from /usr/sbin/apxs to
/usr/bin/apxs.
Removed modules
147
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
mod_perl
mod_perl is not officially supported with httpd 2.4 by upstream.
mod_authz_ldap
httpd 2.4 provides LDAP support internally using mod_authnz_ldap.
1. Make sure all module names are correct, since they may have changed. Adjust the LoadModule
directive for each module that has been renamed.
2. Recompile all third party modules before attempting to load them. This typically means
authentication and authorization modules.
3. If you use the m od_userdir module, make sure the UserDir directive indicating a directory
name (typically public_htm l) is provided.
4. If you use the Apache HTTP Secure Server, edit the /etc/httpd/conf.d/ssl.conf to enable
the Secure Sockets Layer (SSL) protocol.
Note that you can check the configuration for possible errors by using the following command:
For more information on upgrading the Apache HTTP Server configuration from version 2.0 to 2.2, refer
to http://httpd.apache.org/docs/2.2/upgrading.html.
For more information on the concept of runlevels and how to manage system services in Red Hat
Enterprise Linux in general, refer to Chapter 7, Managing Services with systemd.
148
Chapter 10. Web Servers
If you want the service to start automatically at the boot time, use the following command:
If running the Apache HTTP Server as a secure server, a password may be required after the
machine boots if using an encrypted private SSL key.
To prevent the service from starting automatically at the boot time, type:
This stops the running httpd service and immediately starts it again. Use this command after
installing or removing a dynamically loaded module such as PHP.
2. To only reload the configuration, type:
This causes the running httpd service to reload its configuration file. Any requests being currently
processed will be interrupted, which may cause a client browser to display an error message or
render a partial page.
3. To reload the configuration without affecting active requests, type:
This cause the running httpd service to reload its configuration file. Any requests being currently
processed will use the old configuration.
For more information on how to manage system services in Red Hat Enterprise Linux 7, see Chapter 7,
Managing Services with systemd.
149
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Path Description
/etc/httpd/conf/httpd.c The main configuration file.
onf
/etc/httpd/conf.d/ An auxiliary directory for configuration files that are included in the
main configuration file.
Although the default configuration should be suitable for most situations, it is a good idea to become at
least familiar with some of the more important configuration options. Note that for any changes to take
effect, the web server has to be restarted first. Refer to Section 10.1.3.3, “Restarting the Service” for
more information on how to restart the httpd service.
To check the configuration for possible errors, type the following at a shell prompt:
To make the recovery from mistakes easier, it is recommended that you make a copy of the original file
before editing it.
Once you are finished, restart the web server to reload the configuration. Refer to Section 10.1.3.3,
“Restarting the Service” for more information on how to restart the httpd service.
150
Chapter 10. Web Servers
This package contains the include files, the header files, and the APache eXtenSion (apxs) utility
required to compile a module.
Once written, you can build the module with the following command:
If the build was successful, you should be able to load the module the same way as any other module
that is distributed with the Apache HTTP Server.
To create a name-based virtual host, find the virtual host container provided in
/etc/httpd/conf/httpd.conf as an example, remove the hash sign (that is, #) from the beginning
of each line, and customize the options according to your requirements as shown in Example 10.2,
“Sample virtual host configuration”.
NameVirtualHost penguin.example.com:80
<VirtualHost penguin.example.com:80>
ServerAdmin webmaster@penguin.example.com
DocumentRoot /www/docs/penguin.example.com
ServerName penguin.example.com:80
ErrorLog logs/penguin.example.com-error_log
CustomLog logs/penguin.example.com-access_log common
</VirtualHost>
Note that ServerNam e must be a valid DNS name assigned to the machine. The <VirtualHost>
container is highly customizable, and accepts most of the directives available within the main server
configuration. Directives that are not supported within this container include User and Group, which
were replaced by SuexecUserGroup.
If you configure a virtual host to listen on a non-default port, make sure you update the Listen
directive in the global settings section of the /etc/httpd/conf/httpd.conf file accordingly.
To activate a newly created virtual host, the web server has to be restarted first. Refer to
Section 10.1.3.3, “Restarting the Service” for more information on how to restart the httpd service.
151
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
both privacy and data integrity. The Apache HTTP Server in combination with m od_ssl, a module that
uses the OpenSSL toolkit to provide the SSL/TLS support, is commonly referred to as the SSL server.
Unlike a regular HTTP connection that can be read and possibly modified by anybody who is able to
intercept it, the use of m od_ssl prevents any inspection or modification of the transmitted content. This
section provides basic information on how to enable this module in the Apache HTTP Server
configuration, and guides you through the process of generating private keys and self-signed certificates.
To provide secure communications using SSL, an SSL server must use a digital certificate signed by a
Certificate Authority (CA). The certificate lists various attributes of the server (that is, the server
hostname, the name of the company, its location, etc.), and the signature produced using the CA's
private key. This signature ensures that a particular certificate authority has issued the certificate, and
that the certificate has not been modified in any way.
When a web browser establishes a new SSL connection, it checks the certificate provided by the web
server. If the certificate does not have a signature from a trusted CA, or if the hostname listed in the
certificate does not match the hostname used to establish the connection, it refuses to communicate with
the server and usually presents a user with an appropriate error message.
By default, most web browsers are configured to trust a set of widely used certificate authorities.
Because of this, an appropriate CA should be chosen when setting up a secure server, so that target
users can trust the connection, otherwise they will be presented with an error message, and will have to
accept the certificate manually. Since encouraging users to override certificate errors can allow an
attacker to intercept the connection, you should use a trusted CA whenever possible. For more
information on this, see Table 10.2, “CA lists for most common web browsers”.
When setting up an SSL server, you need to generate a certificate request and a private key, and then
send the certificate request, proof of the company's identity, and payment to a certificate authority. Once
the CA verifies the certificate request and your identity, it will send you a signed certificate you can use
with your server. Alternatively, you can create a self-signed certificate that does not contain a CA
signature, and thus should be used for testing purposes only.
152
Chapter 10. Web Servers
This will create the m od_ssl configuration file at /etc/httpd/conf.d/ssl.conf, which is included in
the main Apache HTTP Server configuration file by default. For the module to be loaded, restart the
httpd service as described in Section 10.1.3.3, “Restarting the Service”.
In either of the above cases, you will need to obtain a new certificate. For more information on this topic,
refer to Section 10.1.7.4, “Generating a New Key and Certificate”.
If you wish to use an existing key and certificate, move the relevant files to the
/etc/pki/tls/private/ and /etc/pki/tls/certs/ directories respectively. You can do so by
typing the following commands:
SSLCertificateFile /etc/pki/tls/certs/hostname.crt
SSLCertificateKeyFile /etc/pki/tls/private/hostname.key
To load the updated configuration, restart the httpd service as described in Section 10.1.3.3,
“Restarting the Service”.
Example 10.3. Using a key and certificate from the Red Hat Secure Web Server
~]# mv /etc/httpd/conf/httpsd.key
/etc/pki/tls/private/penguin.example.com.key
~]# mv /etc/httpd/conf/httpsd.crt /etc/pki/tls/certs/penguin.example.com.crt
This package provides a set of tools to generate and manage SSL certificates and private keys, and
includes genkey, the Red Hat Keypair Generation utility that will guide you through the key generation
process.
153
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
If the server already has a valid certificate and you are replacing it with a new one, specify a
different serial number. This ensures that client browsers are notified of this change, update to
this new certificate as expected, and do not fail to access the page. To create a new certificate
with a custom serial number, use the following command instead of genkey:
~]# openssl req -x509 -new -set_serial number -key hostname.key -out
hostname.crt
If there already is a key file for a particular hostname in your system, genkey will refuse to start.
In this case, remove the existing file using the following command:
~]# rm /etc/pki/tls/private/hostname.key
To run the utility, use the genkey command followed by the appropriate hostname (for example,
penguin.exam ple.com ):
To complete the key and certificate creation, take the following steps:
1. Review the target locations in which the key and certificate will be stored.
Use the T ab key to select the Next button, and press Enter to proceed to the next screen.
2. Using the Up and down arrow keys, select the suitable key size. Note that while the large key
increases the security, it also increases the response time of your server. The NIST recommends
154
Chapter 10. Web Servers
Once finished, use the T ab key to select the Next button, and press Enter to initiate the random
bits generation process. Depending on the selected key size, this may take some time.
3. Decide whether you wish to send a certificate request to a certificate authority.
Use the T ab key to select Yes to compose a certificate request, or No to generate a self-signed
certificate. Then press Enter to confirm your choice.
4. Using the Spacebar key, enable ([* ]) or disable ([ ]) the encryption of the private key.
155
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Use the T ab key to select the Next button, and press Enter to proceed to the next screen.
5. If you have enabled the private key encryption, enter an adequate passphrase. Note that for
security reasons, it is not displayed as you type, and it must be at least five characters long.
Use the T ab key to select the Next button, and press Enter to proceed to the next screen.
Entering the correct passphrase is required in order for the server to start. If you lose it, you
will need to generate a new key and certificate.
156
Chapter 10. Web Servers
Use the T ab key to select the Next button, and press Enter to finish the key generation.
7. If you have previously enabled the certificate request generation, you will be prompted to send it to
a certificate authority.
Once generated, add the key and certificate locations to the /etc/httpd/conf.d/ssl.conf
configuration file:
SSLCertificateFile /etc/pki/tls/certs/hostname.crt
SSLCertificateKeyFile /etc/pki/tls/private/hostname.key
Finally, restart the httpd service as described in Section 10.1.3.3, “Restarting the Service”, so that the
updated configuration is loaded.
157
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
m an httpd
The manual page for the httpd service containing the complete list of its command line
options.
m an genkey
The manual page for genkey containing the full documentation on its usage.
http://www.modssl.org/
The official website for the mod_ssl module.
http://www.openssl.org/
The OpenSSL home page containing further documentation, frequently asked questions, links
to the mailing lists, and other useful resources.
158
Chapter 11. Mail Servers
The first network transfer of an electronic mail message file took place in 1971 when a computer
engineer named Ray Tomlinson sent a test message between two machines via ARPANET—the
precursor to the Internet. Communication via email soon became very popular, comprising 75 percent of
ARPANET's traffic in less than two years.
Today, email systems based on standardized network protocols have evolved into some of the most
widely used services on the Internet. Red Hat Enterprise Linux offers many advanced applications to
serve and access email.
This chapter reviews modern email protocols in use today, and some of the programs designed to send
and receive email.
To enable this process, a variety of standard network protocols allow different machines, often running
different operating systems and using different email programs, to send and receive email.
The following protocols discussed are the most commonly used in the transfer of email.
11.1.1.1. SMTP
The primary purpose of SMTP is to transfer email between mail servers. However, it is critical for email
clients as well. To send email, the client sends the message to an outgoing mail server, which in turn
contacts the destination mail server for delivery. For this reason, it is necessary to specify an SMTP
server when configuring an email client.
Under Red Hat Enterprise Linux, a user can configure an SMTP server on the local machine to handle
mail delivery. However, it is also possible to configure remote SMTP servers for outgoing mail.
One important point to make about the SMTP protocol is that it does not require authentication. This
allows anyone on the Internet to send email to anyone else or even to large groups of people. It is this
characteristic of SMTP that makes junk email or spam possible. Imposing relay restrictions limits random
users on the Internet from sending email through your SMTP server, to other servers on the internet.
Servers that do not impose such restrictions are called open relay servers.
Red Hat Enterprise Linux provides the Postfix and Sendmail SMTP programs.
159
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Post Office Protocol (POP) and the Internet Message Access Protocol (IMAP).
11.1.2.1. POP
The default POP server under Red Hat Enterprise Linux is Dovecot and is provided by the dovecot
package.
In order to use Dovecot, first ensure the dovecot package is installed on your system by
running, as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
When using a POP server, email messages are downloaded by email client applications. By default, most
POP email clients are automatically configured to delete the message on the email server after it has
been successfully transferred, however this setting usually can be changed.
POP is fully compatible with important Internet messaging standards, such as Multipurpose Internet Mail
Extensions (MIME), which allow for email attachments.
POP works best for users who have one system on which to read email. It also works well for users who
do not have a persistent connection to the Internet or the network containing the mail server.
Unfortunately for those with slow network connections, POP requires client programs upon authentication
to download the entire content of each message. This can take a long time if any messages have large
attachments.
APOP — POP3 with MDS (Monash Directory Service) authentication. An encoded hash of the user's
password is sent from the email client to the server rather then sending an unencrypted password.
KPOP — POP3 with Kerberos authentication.
RPOP — POP3 with RPOP authentication. This uses a per-user ID, similar to a password, to
authenticate POP requests. However, this ID is not encrypted, so RPOP is no more secure than
standard POP.
For added security, it is possible to use Secure Socket Layer (SSL) encryption for client authentication
and data transfer sessions. This can be enabled by using the pop3s service, or by using the stunnel
application. For more information on securing email communication, refer to Section 11.5.1, “Securing
Communication”.
11.1.2.2. IMAP
The default IMAP server under Red Hat Enterprise Linux is Dovecot and is provided by the dovecot
package. Refer to Section 11.1.2.1, “POP” for information on how to install Dovecot.
When using an IMAP mail server, email messages remain on the server where users can read or delete
them. IMAP also allows client applications to create, rename, or delete mail directories on the server to
160
Chapter 11. Mail Servers
IMAP is particularly useful for users who access their email using multiple machines. The protocol is also
convenient for users connecting to the mail server via a slow connection, because only the email header
information is downloaded for messages until opened, saving bandwidth. The user also has the ability to
delete messages without viewing or downloading them.
For convenience, IMAP client applications are capable of caching copies of messages locally, so the user
can browse previously read messages when not directly connected to the IMAP server.
IMAP, like POP, is fully compatible with important Internet messaging standards, such as MIME, which
allow for email attachments.
For added security, it is possible to use SSL encryption for client authentication and data transfer
sessions. This can be enabled by using the im aps service, or by using the stunnel program. For more
information on securing email communication, refer to Section 11.5.1, “Securing Communication”.
Other free, as well as commercial, IMAP clients and servers are available, many of which extend the
IMAP protocol and provide additional functionality.
11.1.2.3. Dovecot
The im ap-login and pop3-login processes which implement the IMAP and POP3 protocols are
spawned by the master dovecot daemon included in the dovecot package. The use of IMAP and POP is
configured through the /etc/dovecot/dovecot.conf configuration file; by default dovecot runs
IMAP and POP3 together with their secure versions using SSL. To configure dovecot to use POP,
complete the following steps:
1. Edit the /etc/dovecot/dovecot.conf configuration file to make sure the protocols variable
is uncommented (remove the hash sign (#) at the beginning of the line) and contains the pop3
argument. For example:
When the protocols variable is left commented out, dovecot will use the default values
specified for this variable.
2. Make that change operational for the current session by running the following command:
3. Make that change operational after the next reboot by running the command:
Please note that dovecot only reports that it started the IMAP server, but also starts the
POP3 server.
Unlike SMT P, both IMAP and POP3 require connecting clients to authenticate using a username and
password. By default, passwords for both protocols are passed over the network unencrypted.
161
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
While the delivery of messages between machines may seem rather straightforward, the entire process
of deciding if a particular MTA can or should accept a message for delivery is quite complicated. In
addition, due to problems from spam, use of a particular MTA is usually restricted by the MTA's
configuration or the access configuration for the network on which the MTA resides.
Many modern email client programs can act as an MTA when sending email. However, this action should
not be confused with the role of a true MTA. The sole reason email client programs are capable of
sending email like an MTA is because the host running the application does not have its own MTA. This
is particularly true for email client programs on non-UNIX-based operating systems. However, these
client programs only send outbound messages to an MTA they are authorized to use and do not directly
deliver the message to the intended recipient's email server.
Since Red Hat Enterprise Linux offers two MTAs—Postfix and Sendmail—email client programs are often
not required to act as an MTA. Red Hat Enterprise Linux also includes a special purpose MTA called
Fetchmail.
For more information on Postfix, Sendmail, and Fetchmail, refer to Section 11.3, “Mail Transport Agents”.
Any program that actually handles a message for delivery to the point where it can be read by an email
client application can be considered an MDA. For this reason, some MTAs (such as Sendmail and
Postfix) can fill the role of an MDA when they append new email messages to a local user's mail spool
file. In general, MDAs do not transport messages between systems nor do they provide a user interface;
MDAs distribute and sort messages on the local machine for an email client application to access.
162
Chapter 11. Mail Servers
MUAs may be graphical, such as Evolution, or have simple text-based interfaces, such as pine.
You can also use the following command to enable the desired service:
For more information on how to manage system services in Red Hat Enterprise Linux 7, see Chapter 7,
Managing Services with systemd.
11.3.1. Postfix
Originally developed at IBM by security expert and programmer Wietse Venema, Postfix is a Sendmail-
compatible MTA that is designed to be secure, fast, and easy to configure.
To improve security, Postfix uses a modular design, where small processes with limited privileges are
launched by a master daemon. The smaller, less privileged processes perform very specific tasks related
to the various stages of mail delivery and run in a change rooted environment to limit the effects of
attacks.
Configuring Postfix to accept network connections from hosts other than the local computer takes only a
few minor changes in its configuration file. Yet for those with more complex needs, Postfix provides a
variety of configuration options, as well as third party add-ons that make it a very versatile and full-
featured MTA.
The configuration files for Postfix are human readable and support upward of 250 directives. Unlike
Sendmail, no macro processing is required for changes to take effect and the majority of the most
commonly used options are described in the heavily commented files.
Postfix stores its configuration files in the /etc/postfix/ directory. The following is a list of the more
commonly used files:
163
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
access — Used for access control, this file specifies which hosts are allowed to connect to Postfix.
m ain.cf — The global Postfix configuration file. The majority of configuration options are specified
in this file.
m aster.cf — Specifies how Postfix interacts with various processes to accomplish mail delivery.
transport — Maps email addresses to relay hosts.
The aliases file can be found in the /etc/ directory. This file is shared between Postfix and Sendmail.
It is a configurable list required by the mail protocol that describes user ID aliases.
The default /etc/postfix/m ain.cf file does not allow Postfix to accept network connections
from a host other than the local computer. For instructions on configuring Postfix as a server for
other clients, refer to Section 11.3.1.2, “Basic Postfix Configuration”.
Restart the postfix service after changing any options in the configuration files under the
/etc/postfix directory in order for those changes to take effect:
Edit the /etc/postfix/m ain.cf file with a text editor, such as vi.
Uncomment the m ydom ain line by removing the hash sign (#), and replace domain.tld with the
domain the mail server is servicing, such as exam ple.com .
Uncomment the m yorigin = $m ydom ain line.
Uncomment the m yhostnam e line, and replace host.domain.tld with the hostname for the
machine.
Uncomment the m ydestination = $m yhostnam e, localhost.$m ydom ain line.
Uncomment the m ynetworks line, and replace 168.100.189.0/28 with a valid network setting for
hosts that can connect to the server.
Uncomment the inet_interfaces = all line.
Comment the inet_interfaces = localhost line.
Restart the postfix service.
Once these steps are complete, the host accepts outside emails for delivery.
Postfix has a large assortment of configuration options. One of the best ways to learn how to configure
Postfix is to read the comments within the /etc/postfix/m ain.cf configuration file. Additional
resources including information about Postfix configuration, SpamAssassin integration, or detailed
descriptions of the /etc/postfix/m ain.cf parameters are available online at http://www.postfix.org/.
164
Chapter 11. Mail Servers
maintain it.
Create a /etc/postfix/ldap-aliases.cf file if you do not have one created already and make
sure it contains the following:
server_host = ldap.example.com
search_base = dc=example, dc=com
where ldap.example.com, example, and com are parameters that need to be replaced with
specification of an existing available LDAP server.
11.3.2. Sendmail
Sendmail's core purpose, like other MTAs, is to safely transfer email among hosts, usually using the
SMT P protocol. However, Sendmail is highly configurable, allowing control over almost every aspect of
how email is handled, including the protocol used. Many system administrators elect to use Sendmail as
their MTA due to its power and scalability.
It is beyond the scope of this section to go into all that Sendmail should or could be configured to do.
With literally hundreds of different options and rule sets, entire volumes have been dedicated to helping
explain everything that can be done and how to fix things that go wrong. Refer to the Section 11.6,
“Additional Resources” for a list of Sendmail resources.
This section reviews the files installed with Sendmail by default and reviews basic configuration changes,
including how to stop unwanted email (spam) and how to extend Sendmail with the Lightweight Directory
Access Protocol (LDAP).
165
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
In order to configure Sendmail, ensure the sendmail-cf package is installed on your system by running,
as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing Packages”.
Before using Sendmail, the default MTA has to be switched from Postfix. For more information how to
switch the default MTA refer to Section 11.3, “Mail Transport Agents”.
Sendmail's lengthy and detailed configuration file is /etc/m ail/sendm ail.cf. Avoid editing the
sendm ail.cf file directly. To make configuration changes to Sendmail, edit the
/etc/m ail/sendm ail.m c file, back up the original /etc/m ail/sendm ail.cf, and use the
following alternatives to generate a new configuration file:
Use the included makefile in /etc/m ail/ to create a new /etc/m ail/sendm ail.cf
configuration file:
All other generated files in /etc/m ail (db files) will be regenerated if needed. The old makemap
commands are still usable. The make command is automatically used whenever you start or restart
the sendm ail service.
More information on configuring Sendmail can be found in Section 11.3.2.3, “Common Sendmail
Configuration Changes”.
Various Sendmail configuration files are installed in the /etc/m ail/ directory including:
access — Specifies which systems can use Sendmail for outbound email.
dom aintable — Specifies domain name mapping.
local-host-nam es — Specifies aliases for the host.
m ailertable — Specifies instructions that override routing for particular domains.
virtusertable — Specifies a domain-specific form of aliasing, allowing multiple virtual domains to
be hosted on one machine.
Several of the configuration files in /etc/m ail/, such as access, dom aintable, m ailertable and
virtusertable, must actually store their information in database files before Sendmail can use any
configuration changes. To include any changes made to these configurations in their database files, run
the following command, as root:
where <name> represents the name of the configuration file to be updated. You may also restart the
sendm ail service for the changes to take effect by running:
166
Chapter 11. Mail Servers
For example, to have all emails addressed to the exam ple.com domain delivered to bob@ other-
exam ple.com , add the following line to the virtusertable file:
@example.com bob@other-example.com
Sendmail will create an updated virtusertable.db file containing the new configuration.
Before changing the sendm ail.cf file, it is a good idea to create a backup copy.
To add the desired functionality to Sendmail, edit the /etc/m ail/sendm ail.m c file as root. Once you
are finished, restart the sendm ail service and, if the m4 package is installed, the m 4 macro processor
will automatically generate a new sendm ail.cf configuration file:
The default sendm ail.cf file does not allow Sendmail to accept network connections from any
host other than the local computer. To configure Sendmail as a server for other clients, edit the
/etc/m ail/sendm ail.m c file, and either change the address specified in the Addr= option of
the DAEMON_OPT IONS directive from 127.0.0.1 to the IP address of an active network device
or comment out the DAEMON_OPT IONS directive all together by placing dnl at the beginning of
the line. When finished, regenerate /etc/m ail/sendm ail.cf by restarting the service
The default configuration which ships with Red Hat Enterprise Linux works for most SMT P-only sites.
However, it does not work for UUCP (UNIX-to-UNIX Copy Protocol) sites. If using UUCP mail transfers,
the /etc/m ail/sendm ail.m c file must be reconfigured and a new /etc/m ail/sendm ail.cf file
must be generated.
Consult the /usr/share/sendm ail-cf/README file before editing any files in the directories under
the /usr/share/sendm ail-cf directory, as they can affect the future configuration of the
/etc/m ail/sendm ail.cf file.
167
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
11.3.2.4. Masquerading
One common Sendmail configuration is to have a single machine act as a mail gateway for all machines
on the network. For instance, a company may want to have a machine called m ail.exam ple.com that
handles all of their email and assigns a consistent return address to all outgoing mail.
In this situation, the Sendmail server must masquerade the machine names on the company network so
that their return address is user@ exam ple.com instead of user@ host.exam ple.com .
FEATURE(always_add_domain)dnl
FEATURE(`masquerade_entire_domain')dnl
FEATURE(`masquerade_envelope')dnl
FEATURE(`allmasquerade')dnl
MASQUERADE_AS(`bigcorp.com.')dnl
MASQUERADE_DOMAIN(`bigcorp.com.')dnl
MASQUERADE_AS(bigcorp.com)dnl
After generating a new sendm ail.cf using the m 4 macro processor, this configuration makes all mail
from inside the network appear as if it were sent from bigcorp.com .
Sendmail makes it relatively easy to block new spamming techniques being employed to send junk email.
It even blocks many of the more usual spamming methods by default. Main anti-spam features available
in sendmail are header checks, relaying denial (default from version 8.9), access database and sender
information checks.
For example, forwarding of SMT P messages, also called relaying, has been disabled by default since
Sendmail version 8.9. Before this change occurred, Sendmail directed the mail host (x.edu) to accept
messages from one party (y.com ) and sent them to a different party (z.net). Now, however, Sendmail
must be configured to permit any domain to relay mail through the server. To configure relay domains,
edit the /etc/m ail/relay-dom ains file and restart Sendmail
However, many times users are bombarded with spam from other servers throughout the Internet. In
these instances, Sendmail's access control features available through the /etc/m ail/access file can
be used to prevent connections from unwanted hosts. The following example illustrates how this file can
be used to both block and specifically allow access to the Sendmail server:
This example shows that any email sent from badspam m er.com is blocked with a 550 RFC-821
compliant error code, with a message sent back to the spammer. Email sent from the
tux.badspam m er.com sub-domain, is accepted. The last line shows that any email sent from the
10.0.*.* network can be relayed through the mail server.
Because the /etc/m ail/access.db file is a database, use the m akem ap command to update any
changes. Do this using the following command as root:
168
Chapter 11. Mail Servers
Message header analysis allows you to reject mail based on header contents. SMT P servers store
information about an email's journey in the message header. As the message travels from one MTA to
another, each puts in a Received header above all the other Received headers. It is important to
note that this information may be altered by spammers.
The above examples only represent a small part of what Sendmail can do in terms of allowing or
blocking access. Refer to the /usr/share/sendm ail-cf/README for more information and
examples.
Since Sendmail calls the Procmail MDA when delivering mail, it is also possible to use a spam filtering
program, such as SpamAssassin, to identify and file spam for users. Refer to Section 11.4.2.6, “Spam
Filters” for more information about using SpamAssassin.
However, Sendmail supports a much greater integration with LDAP, where it uses LDAP to replace
separately maintained files, such as /etc/aliases and /etc/m ail/virtusertables, on different
mail servers that work together to support a medium- to enterprise-level organization. In short, LDAP
abstracts the mail routing level from Sendmail and its separate configuration files to a powerful LDAP
cluster that can be leveraged by many different applications.
The current version of Sendmail contains support for LDAP. To extend the Sendmail server using LDAP,
first get an LDAP server, such as OpenLDAP, running and properly configured. Then edit the
/etc/m ail/sendm ail.m c to include the following:
LDAPROUTE_DOMAIN('yourdomain.com')dnl
FEATURE('ldap_routing')dnl
Advanced configuration
This is only for a very basic configuration of Sendmail with LDAP. The configuration can differ
greatly from this depending on the implementation of LDAP, especially when configuring several
Sendmail machines to use a common LDAP server.
Consult /usr/share/sendm ail-cf/README for detailed LDAP routing configuration
instructions and examples.
Next, recreate the /etc/m ail/sendm ail.cf file by running the m 4 macro processor and again
restarting Sendmail. Refer to Section 11.3.2.3, “Common Sendmail Configuration Changes” for
instructions.
11.3.3. Fetchmail
169
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Fetchmail is an MTA which retrieves email from remote servers and delivers it to the local MTA. Many
users appreciate the ability to separate the process of downloading their messages located on a remote
server from the process of reading and organizing their email in an MUA. Designed with the needs of
dial-up users in mind, Fetchmail connects and quickly downloads all of the email messages to the mail
spool file using any number of protocols, including POP3 and IMAP. It can even forward email messages
to an SMT P server, if necessary.
In order to use Fetchmail, first ensure the fetchmail package is installed on your system by
running, as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
Fetchmail is configured for each user through the use of a .fetchm ailrc file in the user's home
directory. If it does not already exist, create the .fetchm ailrc file in your home directory
Using preferences in the .fetchm ailrc file, Fetchmail checks for email on a remote server and
downloads it. It then delivers it to port 25 on the local machine, using the local MTA to place the email in
the correct user's spool file. If Procmail is available, it is launched to filter the email and place it in a
mailbox so that it can be read by an MUA.
global options — Gives Fetchmail instructions that control the operation of the program or provide
settings for every connection that checks for email.
server options — Specifies necessary information about the server being polled, such as the
hostname, as well as preferences for specific email servers, such as the port to check or number of
seconds to wait before timing out. These options affect every user using that server.
user options — Contains information, such as username and password, necessary to authenticate
and check for email using a specified email server.
Global options appear at the top of the .fetchm ailrc file, followed by one or more server options,
each of which designate a different email server that Fetchmail should check. User options follow server
options for each user account checking that email server. Like server options, multiple user options may
be specified for use with a particular server as well as to check multiple email accounts on the same
server.
Server options are called into service in the .fetchm ailrc file by the use of a special option verb,
poll or skip, that precedes any of the server information. The poll action tells Fetchmail to use this
server option when it is run, which checks for email using the specified user options. Any server options
after a skip action, however, are not checked unless this server's hostname is specified when Fetchmail
170
Chapter 11. Mail Servers
is invoked. The skip option is useful when testing configurations in the .fetchm ailrc file because it
only checks skipped servers when specifically invoked, and does not affect any currently working
configurations.
poll mail.domain2.com
user 'user5' there with password 'secret2' is user1 here
user 'user7' there with password 'secret3' is user1 here
In this example, the global options specify that the user is sent email as a last resort (postm aster
option) and all email errors are sent to the postmaster instead of the sender (bouncem ail option). The
set action tells Fetchmail that this line contains a global option. Then, two email servers are specified,
one set to check using POP3, the other for trying various protocols to find one that works. Two users are
checked using the second server option, but all email found for any user is sent to user1's mail spool.
This allows multiple mailboxes to be checked on multiple servers, while appearing in a single MUA inbox.
Each user's specific information begins with the user action.
Users are not required to place their password in the .fetchm ailrc file. Omitting the with
password '<password>' section causes Fetchmail to ask for a password when it is launched.
Fetchmail has numerous global, server, and local options. Many of these options are rarely used or only
apply to very specific situations. The fetchm ail man page explains each option in detail, but the most
common ones are listed in the following three sections.
171
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
email on all configured servers. This option is generally used for email servers where the user rarely
receives messages.
port <port-number> — Replace <port-number> with the port number. This value overrides the
default port number for the specified protocol.
proto <protocol> — Replace <protocol> with the protocol, such as pop3 or im ap, to use
when checking for messages on the server.
tim eout <seconds> — Replace <seconds> with the number of seconds of server inactivity after
which Fetchmail gives up on a connection attempt. If this value is not set, a default of 300 seconds is
assumed.
fetchall — Orders Fetchmail to download all messages in the queue, including messages that
have already been viewed. By default, Fetchmail only pulls down new messages.
fetchlim it <number> — Replace <number> with the number of messages to be retrieved
before stopping.
flush — Deletes all previously viewed messages in the queue before retrieving new messages.
lim it <max-number-bytes> — Replace <max-number-bytes> with the maximum size in bytes
that messages are allowed to be when retrieved by Fetchmail. This option is useful with slow network
links, when a large message takes too long to download.
password '<password>' — Replace <password> with the user's password.
preconnect "<command>" — Replace <command> with a command to be executed before
retrieving messages for the user.
postconnect "<command>" — Replace <command> with a command to be executed after
retrieving messages for the user.
ssl — Activates SSL encryption.
user "<username>" — Replace <username> with the username used by Fetchmail to retrieve
messages. This option must precede all other user options.
There may be times when it is desirable to run the fetchm ail command with other options for a
particular purpose. It is possible to issue command options to temporarily override a .fetchm ailrc
setting that is causing an error, as any options specified at the command line override configuration file
options.
--configdum p — Displays every possible option based on information from .fetchm ailrc and
Fetchmail defaults. No email is retrieved for any users when using this option.
-s — Executes Fetchmail in silent mode, preventing any messages, other than errors, from
appearing after the fetchm ail command.
172
Chapter 11. Mail Servers
-v — Executes Fetchmail in verbose mode, displaying every communication between Fetchmail and
remote email servers.
-V — Displays detailed version information, lists its global options, and shows settings to be used with
each user, including the email protocol and authentication method. No email is retrieved for any users
when using this option.
-a — Fetchmail downloads all messages from the remote email server, whether new or previously
viewed. By default, Fetchmail only downloads new messages.
-k — Fetchmail leaves the messages on the remote email server after downloading them. This
option overrides the default behavior of deleting messages after downloading them.
-l <max-number-bytes> — Fetchmail does not download any messages over a particular size
and leaves them on the remote email server.
--quit — Quits the Fetchmail daemon process.
More commands and .fetchm ailrc options can be found in the fetchm ail man page.
Even if a user does not plan to send email from the system, some automated tasks or system programs
might use the m ail command to send email containing log messages to the root user of the local
system.
Red Hat Enterprise Linux 7 provides two MTAs: Postfix and Sendmail. If both are installed, Postfix is the
default MTA.
This section details only Procmail. For information on the m ail command, consult its man page (m an
m ail).
Procmail delivers and filters email as it is placed in the mail spool file of the localhost. It is powerful,
gentle on system resources, and widely used. Procmail can play a critical role in delivering email to be
read by email client applications.
Procmail can be invoked in several different ways. Whenever an MTA places an email into the mail spool
file, Procmail is launched. Procmail then filters and files the email for the MUA and quits. Alternatively, the
MUA can be configured to execute Procmail any time a message is received so that messages are
moved into their correct mailboxes. By default, the presence of /etc/procm ailrc or of a
~/.procm ailrc file (also called an rc file) in the user's home directory invokes Procmail whenever an
MTA receives a new message.
173
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
By default, no system-wide rc files exist in the /etc/ directory and no .procm ailrc files exist in any
user's home directory. Therefore, to use Procmail, each user must construct a .procm ailrc file with
specific environment variables and rules.
Whether Procmail acts upon an email message depends upon whether the message matches a
specified set of conditions or recipes in the rc file. If a message matches a recipe, then the email is
placed in a specified file, is deleted, or is otherwise processed.
When Procmail starts, it reads the email message and separates the body from the header information.
Next, Procmail looks for a /etc/procm ailrc file and rc files in the /etc/procm ailrcs directory for
default, system-wide, Procmail environmental variables and recipes. Procmail then searches for a
.procm ailrc file in the user's home directory. Many users also create additional rc files for Procmail
that are referred to within the .procm ailrc file in their home directory.
These environmental variables usually appear at the beginning of the ~/.procm ailrc file in the
following format:
<env-variable>="<value>"
In this example, <env-variable> is the name of the variable and <value> defines the variable.
There are many environment variables not used by most Procmail users and many of the more
important environment variables are already defined by a default value. Most of the time, the following
variables are used:
DEFAULT — Sets the default mailbox where messages that do not match any recipes are placed.
The default DEFAULT value is the same as $ORGMAIL.
INCLUDERC — Specifies additional rc files containing more recipes for messages to be checked
against. This breaks up the Procmail recipe lists into individual files that fulfill different roles, such as
blocking spam and managing email lists, that can then be turned off or on by using comment
characters in the user's ~/.procm ailrc file.
For example, lines in a user's .procm ailrc file may look like this:
To turn off Procmail filtering of email lists but leaving spam control in place, comment out the first
INCLUDERC line with a hash sign (#).
LOCKSLEEP — Sets the amount of time, in seconds, between attempts by Procmail to use a
particular lockfile. The default is 8 seconds.
LOCKT IMEOUT — Sets the amount of time, in seconds, that must pass after a lockfile was last
modified before Procmail assumes that the lockfile is old and can be deleted. The default is 1024
seconds.
LOGFILE — The file to which any Procmail information or error messages are written.
MAILDIR — Sets the current working directory for Procmail. If set, all other Procmail paths are
relative to this directory.
ORGMAIL — Specifies the original mailbox, or another place to put the messages if they cannot be
placed in the default or recipe-required location.
174
Chapter 11. Mail Servers
Other important environmental variables are pulled from the shell, such as LOGNAME, which is the login
name; HOME, which is the location of the home directory; and SHELL, which is the default shell.
A comprehensive explanation of all environments variables, as well as their default values, is available in
the procm ailrc man page.
The first two characters in a Procmail recipe are a colon and a zero. Various flags can be placed after
the zero to control how Procmail processes the recipe. A colon after the <flags> section specifies that
a lockfile is created for this message. If a lockfile is created, the name can be specified by replacing
<lockfile-name>.
A recipe can contain several conditions to match against the message. If it has no conditions, every
message matches the recipe. Regular expressions are placed in some conditions to facilitate message
matching. If multiple conditions are used, they must all match for the action to be performed. Conditions
are checked based on the flags set in the recipe's first line. Optional special characters placed after the
asterisk character (* ) can further control the condition.
The <action-to-perform> argument specifies the action taken when the message matches one of the
conditions. There can only be one action per recipe. In many cases, the name of a mailbox is used here
to direct matching messages into that file, effectively sorting the email. Special action characters may
also be used before the action is specified. Refer to Section 11.4.2.4, “Special Conditions and Actions”
for more information.
175
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
delivering recipe covers any other actions, such as a nesting block. A nesting block is a set of actions,
contained in braces { }, that are performed on messages which match the recipe's conditions. Nesting
blocks can be nested inside one another, providing greater control for identifying and performing actions
on messages.
When messages match a delivering recipe, Procmail performs the specified action and stops comparing
the message against any other recipes. Messages that match non-delivering recipes continue to be
compared against other recipes.
11.4.2.2. Flags
Flags are essential to determine how or if a recipe's conditions are compared to a message. The
following flags are commonly used:
A — Specifies that this recipe is only used if the previous recipe without an A or a flag also matched
this message.
a — Specifies that this recipe is only used if the previous recipe with an A or a flag also matched this
message and was successfully completed.
B — Parses the body of the message and looks for matching conditions.
b — Uses the body in any resulting action, such as writing the message to a file or forwarding it. This
is the default behavior.
c — Generates a carbon copy of the email. This is useful with delivering recipes, since the required
action can be performed on the message and a copy of the message can continue being processed
in the rc files.
D — Makes the egrep comparison case-sensitive. By default, the comparison process is not case-
sensitive.
E — While similar to the A flag, the conditions in the recipe are only compared to the message if the
immediately preceding recipe without an E flag did not match. This is comparable to an else action.
e — The recipe is compared to the message only if the action specified in the immediately preceding
recipe fails.
f — Uses the pipe as a filter.
H — Parses the header of the message and looks for matching conditions. This is the default
behavior.
h — Uses the header in a resulting action. This is the default behavior.
w — Tells Procmail to wait for the specified filter or program to finish, and reports whether or not it
was successful before considering the message filtered.
W — Is identical to w except that "Program failure" messages are suppressed.
For a detailed list of additional flags, refer to the procm ailrc man page.
Alternatively, specify the name of the local lockfile to be used with this recipe after the colon.
176
Chapter 11. Mail Servers
The following characters may be used after the asterisk character (* ) at the beginning of a recipe's
condition line:
! — In the condition line, this character inverts the condition, causing a match to occur only if the
condition does not match the message.
< — Checks if the message is under a specified number of bytes.
> — Checks if the message is over a specified number of bytes.
! — In the action line, this character tells Procmail to forward the message to the specified email
addresses.
$ — Refers to a variable set earlier in the rc file. This is often used to set a common mailbox that is
referred to by various recipes.
| — Starts a specified program to process the message.
{ and } — Constructs a nesting block, used to contain additional recipes to apply to matching
messages.
If no special character is used at the beginning of the action line, Procmail assumes that the action line is
specifying the mailbox in which to write the message.
The best way to develop the skills to build Procmail recipe conditions stems from a strong understanding
of regular expressions combined with looking at many examples built by others. A thorough explanation
of regular expressions is beyond the scope of this section. The structure of Procmail recipes and useful
sample Procmail recipes can be found at various places on the Internet (such as
http://www.iki.fi/era/procmail/links.html). The proper use and adaptation of regular expressions can be
derived by viewing these recipe examples. In addition, introductory information about basic regular
expression rules can be found in the grep man page.
The following simple examples demonstrate the basic structure of Procmail recipes and can provide the
foundation for more intricate constructions.
A basic recipe may not even contain conditions, as is illustrated in the following example:
:0: new-mail.spool
The first line specifies that a local lockfile is to be created but does not specify a name, so Procmail uses
the destination file name and appends the value specified in the LOCKEXT environment variable. No
condition is specified, so every message matches this recipe and is placed in the single spool file called
new-m ail.spool, located within the directory specified by the MAILDIR environment variable. An MUA
can then view messages in this file.
A basic recipe, such as this, can be placed at the end of all rc files to direct messages to a default
location.
The following example matched messages from a specific email address and throws them away.
177
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
With this example, any messages sent by spam m er@ dom ain.com are sent to the /dev/null device,
deleting them.
Be certain that rules are working as intended before sending messages to /dev/null for
permanent deletion. If a recipe inadvertently catches unintended messages, and those messages
disappear, it becomes difficult to troubleshoot the rule.
A better solution is to point the recipe's action to a special mailbox, which can be checked from
time to time to look for false positives. Once satisfied that no messages are accidentally being
matched, delete the mailbox and direct the action to send the messages to /dev/null.
The following recipe grabs email sent from a particular mailing list and places it in a specified folder.
Any messages sent from the tux-lug@ dom ain.com mailing list are placed in the tuxlug mailbox
automatically for the MUA. Note that the condition in this example matches the message if it has the
mailing list's email address on the From , Cc, or T o lines.
Consult the many Procmail online resources available in Section 11.6, “Additional Resources” for more
detailed and powerful recipes.
This is particularly true when Procmail is used in conjunction with SpamAssassin. When used together,
these two applications can quickly identify spam emails, and sort or destroy them.
SpamAssassin uses header analysis, text analysis, blacklists, a spam-tracking database, and self-
learning Bayesian spam analysis to quickly and accurately identify and tag spam.
In order to use SpamAssassin, first ensure the spamassassin package is installed on your
system by running, as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
The easiest way for a local user to use SpamAssassin is to place the following line near the top of the
~/.procm ailrc file:
INCLUDERC=/etc/mail/spamassassin/spamassassin-default.rc
The /etc/m ail/spam assassin/spam assassin-default.rc contains a simple Procmail rule that
activates SpamAssassin for all incoming email. If an email is determined to be spam, it is tagged in the
178
Chapter 11. Mail Servers
header as such and the title is prepended with the following pattern:
*****SPAM*****
The message body of the email is also prepended with a running tally of what elements caused it to be
diagnosed as spam.
To file email tagged as spam, a rule similar to the following can be used:
This rule files all email tagged in the header as spam into a mailbox called spam .
Since SpamAssassin is a Perl script, it may be necessary on busy servers to use the binary
SpamAssassin daemon (spam d) and the client application (spamc). Configuring SpamAssassin this
way, however, requires root access to the host.
To start the SpamAssassin daemon when the system is booted, use an initscript utility, such as the
Services Configuration Tool (system -config-services), to turn on the spam assassin service.
Refer to Chapter 7, Managing Services with systemd for more information about starting and stopping
services.
To configure Procmail to use the SpamAssassin client application instead of the Perl script, place the
following line near the top of the ~/.procm ailrc file. For a system-wide configuration, place it in
/etc/procm ailrc:
INCLUDERC=/etc/mail/spamassassin/spamassassin-spamc.rc
The remainder of this section focuses on securing communication between a client and a server.
Like any other service that flows over a network unencrypted, important email information, such as
usernames, passwords, and entire messages, may be intercepted and viewed by users on the network.
Additionally, since the standard POP and IMAP protocols pass authentication information unencrypted, it
is possible for an attacker to gain access to user accounts by collecting usernames and passwords as
they are passed over the network.
179
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
SSL is easy to enable on the client-side, often done with the click of a button in the MUA's configuration
window or via an option in the MUA's configuration file. Secure IMAP and POP have known port numbers
(993 and 995, respectively) that the MUA uses to authenticate and download messages.
First, create an SSL certificate. This can be done in two ways: by applying to a Certificate Authority (CA)
for an SSL certificate or by creating a self-signed certificate.
Self-signed certificates should be used for testing purposes only. Any server used in a production
environment should use an SSL certificate granted by a CA.
To create a self-signed SSL certificate for IMAP or POP, change to the /etc/pki/dovecot/ directory,
edit the certificate parameters in the /etc/pki/dovecot/dovecot-openssl.cnf configuration file
as you prefer, and type the following commands, as root:
Once finished, make sure you have the following configurations in your /etc/dovecot/conf.d/10-
ssl.conf file:
ssl_cert = </etc/pki/dovecot/certs/dovecot.pem
ssl_key = </etc/pki/dovecot/private/dovecot.pem
Alternatively, the stunnel command can be used as an SSL encryption wrapper around the standard,
non-secure connections to IMAP or POP services.
The stunnel utility uses external OpenSSL libraries included with Red Hat Enterprise Linux to provide
strong cryptography and to protect the network connections. It is recommended to apply to a CA to
obtain an SSL certificate, but it is also possible to create a self-signed certificate.
In order to use stunnel, first ensure the stunnel package is installed on your system by running,
as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
180
Chapter 11. Mail Servers
To create a self-signed SSL certificate, change to the /etc/pki/tls/certs/ directory, and type the
following command:
Once the certificate is generated, create an stunnel configuration file, for example
/etc/stunnel/m ail.conf, with the following content:
cert = /etc/pki/tls/certs/stunnel.pem
[pop3s]
accept = 995
connect = 110
[imaps]
accept = 993
connect = 143
Once you start stunnel with the created configuration file using the stunnel
/etc/stunnel/m ail.conf command, it will be possible to use an IMAP or a POP email client and
connect to the email server using SSL encryption.
For more information on stunnel, refer to the stunnel man page or the documents in the
/usr/share/doc/stunnel-<version-number> / directory, where <version-number> is the version
number of stunnel.
181
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
email.
procm ailrc — Explains the rc file format used to construct recipes.
procm ailex — Gives a number of useful, real-world examples of Procmail recipes.
procm ailsc — Explains the weighted scoring technique used by Procmail to match a particular
recipe to a message.
/usr/share/doc/spam assassin-<version-number>/ — Contains a large amount of
information pertaining to SpamAssassin. Replace <version-number> with the version number of
the spam assassin package.
182
Chapter 12. Directory Servers
12.1. OpenLDAP
LDAP (Lightweight Directory Access Protocol) is a set of open protocols used to access centrally stored
information over a network. It is based on the X.500 standard for directory sharing, but is less complex
and resource-intensive. For this reason, LDAP is sometimes referred to as “X.500 Lite”.
Like X.500, LDAP organizes information in a hierarchical manner using directories. These directories can
store a variety of information such as names, addresses, or phone numbers, and can even be used in a
manner similar to the Network Information Service (NIS), enabling anyone to access their account from
any machine on the LDAP enabled network.
LDAP is commonly used for centrally managed users and groups, user authentication, or system
configuration. It can also serve as a virtual phone directory, allowing users to easily access contact
information for other users. Additionally, it can refer a user to other LDAP servers throughout the world,
and thus provide an ad-hoc global repository of information. However, it is most frequently used within
individual organizations such as universities, government departments, and private companies.
This section covers the installation and configuration of OpenLDAP 2.4, an open source implementation
of the LDAPv2 and LDAPv3 protocols.
The OpenLDAP suite in Red Hat Enterprise Linux 7 no longer uses OpenSSL. Instead, it uses the
Mozilla implementation of Network Security Services (NSS). OpenLDAP continues to work with
existing certificates, keys, and other TLS configuration. For more information on how to configure
it to use Mozilla certificate and key database, refer to How do I use TLS/SSL with Mozilla NSS.
The LDAP server supports several database systems, which gives administrators the flexibility to choose
the best suited solution for the type of information they are planning to serve. Because of a well-defined
client Application Programming Interface (API), the number of applications able to communicate with an
LDAP server is numerous, and increasing in both quantity and quality.
entry
A single unit within an LDAP directory. Each entry is identified by its unique Distinguished Name
(DN).
attribute
Information directly associated with an entry. For example, if an organization is represented as
183
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
an LDAP entry, attributes associated with this organization might include an address, a fax
number, etc. Similarly, people can be represented as entries with common attributes such as
personal telephone number or email address.
An attribute can either have a single value, or an unordered space-separated list of values.
While certain attributes are optional, others are required. Required attributes are specified using
the objectClass definition, and can be found in schema files located in the
/etc/openldap/slapd.d/cn=config/cn=schem a/ directory.
The assertion of an attribute and its corresponding value is also referred to as a Relative
Distinguished Name (RDN). Unlike distinguished names that are unique globally, a relative
distinguished name is only unique per entry.
LDIF
The LDAP Data Interchange Format (LDIF) is a plain text representation of an LDAP entry. It
takes the following form:
The optional id is a number determined by the application that is used to edit the entry. Each
entry can contain as many attribute_type and attribute_value pairs as needed, as long
as they are all defined in a corresponding schema file. A blank line indicates the end of an entry.
LDAPv3 Support — Many of the changes in the protocol since LDAP version 2 are designed to make
LDAP more secure. Among other improvements, this includes the support for Simple Authentication
and Security Layer (SASL), Transport Layer Security (TLS), and Secure Sockets Layer (SSL)
protocols.
LDAP Over IPC — The use of inter-process communication (IPC) enhances security by eliminating
the need to communicate over a network.
IPv6 Support — OpenLDAP is compliant with Internet Protocol version 6 (IPv6), the next generation
of the Internet Protocol.
LDIFv1 Support — OpenLDAP is fully compliant with LDIF version 1.
Updated C API — The current C API improves the way programmers can connect to and use LDAP
directory servers.
Enhanced Standalone LDAP Server — This includes an updated access control system, thread
pooling, better tools, and much more.
1. Install the OpenLDAP suite. Refer to Section 12.1.2, “Installing the OpenLDAP Suite” for more
information on required packages.
2. Customize the configuration as described in Section 12.1.3, “Configuring an OpenLDAP Server”.
3. Start the slapd service as described in Section 12.1.4, “Running an OpenLDAP Server”.
184
Chapter 12. Directory Servers
Package Description
openldap A package containing the libraries necessary to run the OpenLDAP
server and client applications.
openldap-clients A package containing the command line utilities for viewing and
modifying directories on an LDAP server.
openldap-servers A package containing both the services and utilities to configure and
run an LDAP server. This includes the Standalone LDAP Daemon,
slapd.
openldap-servers-sql A package containing the SQL support module.
compat-openldap A package containing the OpenLDAP compatibility libraries.
Additionally, the following packages are commonly used along with the LDAP server:
Package Description
nss-pam-ldapd A package containing nslcd, a local LDAP name service that
allows a user to perform local LDAP queries.
mod_ldap A package containing the m od_authnz_ldap and m od_ldap
modules. The m od_authnz_ldap module is the LDAP
authorization module for the Apache HTTP Server. This module can
authenticate users' credentials against an LDAP directory, and can
enforce access control based on the user name, full DN, group
membership, an arbitrary attribute, or a complete filter string. The
m od_ldap module contained in the same package provides a
configurable shared memory cache, to avoid repeated directory
access across many HTTP requests, and also support for SSL/TLS.
To install these packages, use the yum command in the following form:
For example, to perform the basic LDAP server installation, type the following at a shell prompt:
Note that you must have superuser privileges (that is, you must be logged in as root) to run this
command. For more information on how to install new packages in Red Hat Enterprise Linux, refer to
Section 5.2.4, “Installing Packages”.
185
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To perform administrative tasks, the openldap-servers package installs the following utilities along with
the slapd service:
Command Description
slapacl Allows you to check the access to a list of attributes.
slapadd Allows you to add entries from an LDIF file to an LDAP directory.
slapauth Allows you to check a list of IDs for authentication and authorization
permissions.
slapcat Allows you to pull entries from an LDAP directory in the default
format and save them in an LDIF file.
slapdn Allows you to check a list of Distinguished Names (DNs) based on
available schema syntax.
slapindex Allows you to re-index the slapd directory based on the current
content. Run this utility whenever you change indexing options in
the configuration file.
slappasswd Allows you to create an encrypted user password to be used with
the ldapm odify utility, or in the slapd configuration file.
slapschem a Allows you to check the compliance of a database with the
corresponding schema.
slaptest Allows you to check the LDAP server configuration.
For a detailed description of these utilities and their usage, refer to the corresponding manual pages as
referred to in Section 12.1.6.1, “Installed Documentation”.
Although only root can run slapadd, the slapd service runs as the ldap user. Because of
this, the directory server is unable to modify any files created by slapadd. To correct this issue,
after running the slapd utility, type the following at a shell prompt:
To preserve the data integrity, stop the slapd service before using slapadd, slapcat, or
slapindex. You can do so by typing the following at a shell prompt:
For more information on how to start, stop, restart, and check the current status of the slapd
service, see Section 12.1.4, “Running an OpenLDAP Server”.
186
Chapter 12. Directory Servers
Command Description
ldapadd Allows you to add entries to an LDAP directory, either from a file, or
from standard input. It is a symbolic link to ldapm odify -a.
ldapcom pare Allows you to compare given attribute with an LDAP directory entry.
ldapdelete Allows you to delete entries from an LDAP directory.
ldapexop Allows you to perform extended LDAP operations.
ldapm odify Allows you to modify entries in an LDAP directory, either from a file,
or from standard input.
ldapm odrdn Allows you to modify the RDN value of an LDAP directory entry.
ldappasswd Allows you to set or change the password for an LDAP user.
ldapsearch Allows you to search LDAP directory entries.
ldapurl Allows you to compose or decompose LDAP URLs.
ldapwhoam i Allows you to perform a whoam i operation on an LDAP server.
With the exception of ldapsearch, each of these utilities is more easily used by referencing a file
containing the changes to be made rather than typing a command for each entry to be changed within
an LDAP directory. The format of such a file is outlined in the man page for each utility.
Path Description
/etc/openldap/ldap.conf The configuration file for client applications that use the OpenLDAP
libraries. This includes ldapadd, ldapsearch, Evolution, etc.
/etc/openldap/slapd.d/ The directory containing the slapd configuration.
Note that OpenLDAP no longer reads its configuration from the /etc/openldap/slapd.conf file.
Instead, it uses a configuration database located in the /etc/openldap/slapd.d/ directory. If you
have an existing slapd.conf file from a previous installation, you can convert it to the new format by
running the following command:
The slapd configuration consists of LDIF entries organized in a hierarchical directory structure, and the
recommended way to edit these entries is to use the server utilities described in Section 12.1.2.1,
“Overview of OpenLDAP Server Utilities”.
187
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
An error in an LDIF file can render the slapd service unable to start. Because of this, it is
strongly advised that you avoid editing the LDIF files within the /etc/openldap/slapd.d/
directly.
olcAllows
The olcAllows directive allows you to specify which features to enable. It takes the following
form:
olcAllows: feature…
Option Description
bind_v2 Enables the acceptance of LDAP version 2 bind requests.
bind_anon_cred Enables an anonymous bind when the Distinguished Name (DN) is
empty.
bind_anon_dn Enables an anonymous bind when the Distinguished Name (DN) is
not empty.
update_anon Enables processing of anonymous update operations.
proxy_authz_anon Enables processing of anonymous proxy authorization control.
olcConnMaxPending
The olcConnMaxPending directive allows you to specify the maximum number of pending
requests for an anonymous session. It takes the following form:
olcConnMaxPending: number
olcConnMaxPending: 100
188
Chapter 12. Directory Servers
olcConnMaxPendingAuth
The olcConnMaxPendingAuth directive allows you to specify the maximum number of
pending requests for an authenticated session. It takes the following form:
olcConnMaxPendingAuth: number
olcConnMaxPendingAuth: 1000
olcDisallows
The olcDisallows directive allows you to specify which features to disable. It takes the
following form:
olcDisallows: feature…
Option Description
bind_anon Disables the acceptance of anonymous bind requests.
bind_sim ple Disables the simple bind authentication mechanism.
tls_2_anon Disables the enforcing of an anonymous session when the
STARTTLS command is received.
tls_authc Disallows the STARTTLS command when authenticated.
olcDisallows: bind_anon
olcIdleT im eout
The olcIdleT im eout directive allows you to specify how many seconds to wait before
closing an idle connection. It takes the following form:
olcIdleTimeout: number
189
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
olcIdleTimeout: 180
olcLogFile
The olcLogFile directive allows you to specify a file in which to write log messages. It takes
the following form:
olcLogFile: file_name
olcLogFile: /var/log/slapd.log
olcReferral
The olcReferral option allows you to specify a URL of a server to process the request in
case the server is not able to handle it. It takes the following form:
olcReferral: URL
olcReferral: ldap://root.openldap.org
olcWriteT im eout
The olcWriteT im eout option allows you to specify how many seconds to wait before closing
a connection with an outstanding write request. It takes the following form:
olcWriteTimeout
olcWriteTimeout: 180
190
Chapter 12. Directory Servers
olcReadOnly
The olcReadOnly directive allows you to use the database in a read-only mode. It takes the
following form:
olcReadOnly: boolean
It accepts either T RUE (enable the read-only mode), or FALSE (enable modifications of the
database). The default option is FALSE.
olcReadOnly: TRUE
olcRootDN
The olcRootDN directive allows you to specify the user that is unrestricted by access controls
or administrative limit parameters set for operations on the LDAP directory. It takes the following
form:
olcRootDN: distinguished_name
olcRootDN: cn=root,dn=example,dn=com
olcRootPW
The olcRootPW directive allows you to set a password for the user that is specified using the
olcRootDN directive. It takes the following form:
olcRootPW: password
It accepts either a plain text string, or a hash. To generate a hash, type the following at a shell
prompt:
~]$ slappaswd
New password:
Re-enter new password:
{SSHA}WczWsyPEnMchFf1GRTweq2q7XJcvmSxD
191
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
olcRootPW: {SSHA}WczWsyPEnMchFf1GRTweq2q7XJcvmSxD
olcSuffix
The olcSuffix directive allows you to specify the domain for which to provide information. It
takes the following form:
olcSuffix: domain_name
It accepts a fully qualified domain name (FQDN). The default option is dc=m y-
dom ain,dc=com .
olcSuffix: dc=example,dc=com
To configure the service to start automatically at the boot time, use the following command as root:
192
Chapter 12. Directory Servers
To prevent the service from starting automatically at the boot time, type as root:
This stops the service and immediately starts it again. Use this command to reload the configuration.
For detailed instructions on how to configure applications to use LDAP for authentication, see the Red
Hat Enterprise Linux 7 Authentication Guide.
This will install the scripts to the /usr/share/m igrationtools/ directory. Once installed, edit the
/usr/share/m igrationtools/m igrate_com m on.ph file and change the following lines to reflect
the correct domain, for example:
# Default base
$DEFAULT_BASE = "dc=example,dc=com";
Alternatively, you can specify the environment variables directly on the command line. For example, to
run the m igrate_all_online.sh script with the default base set to dc=exam ple,dc=com , type:
193
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To decide which script to run in order to migrate the user database, refer to Table 12.8, “Commonly used
LDAP migration scripts”.
For more information on how to use these scripts, refer to the README and the m igration-
tools.txt files in the /usr/share/doc/m igrationtools-version/ directory.
/usr/share/doc/openldap-servers-version/guide.htm l
A copy of the OpenLDAP Software Administrator's Guide.
/usr/share/doc/openldap-servers-version/README.schem a
A README file containing the description of installed schema files.
Additionally, there is also a number of manual pages that are installed with the openldap, openldap-
servers, and openldap-clients packages:
Client Applications
Server Applications
194
Chapter 12. Directory Servers
Administrative Applications
Configuration Files
m an ldap.conf — Describes the format and options available within the configuration file
for LDAP clients.
m an slapd-config — Describes the format and options available within the configuration
directory.
http://www.kingsmountain.com/ldapRoadmap.shtml
Jeff Hodges' LDAP Roadmap & FAQ containing links to several useful resources and emerging
news concerning the LDAP protocol.
http://www.ldapman.org/articles/
A collection of articles that offer a good introduction to LDAP, including methods to design a
directory tree and customizing directory structures.
http://www.padl.com/
A website of developers of several useful LDAP tools.
Understanding and Deploying LDAP Directory Services by Tim Howes et al.; Macmillan
195
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Technical Publishing.
A book covering LDAP design principles, as well as its deployment in a production environment.
196
Chapter 13. File and Print Servers
13.1. Samba
Samba is an open source implementation of the Server Message Block (SMB) protocol. It allows the
networking of Microsoft Windows®, Linux, UNIX, and other operating systems together, enabling access
to Windows-based file and printer shares. Samba's use of SMB allows it to appear as a Windows server
to Windows clients.
In order to use Samba, first ensure the samba package is installed on your system by running, as
root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
The ability to join an Active Directory domain by means of the Lightweight Directory Access Protocol
(LDAP) and Kerberos
Built in Unicode support for internationalization
Support for all recent Microsoft Windows server and client versions to connect to Samba servers
without needing local registry hacking
Two new documents developed by the Samba.org team, which include a 400+ page reference
manual, and a 300+ page implementation and integration manual. For more information about these
published titles, refer to Section 13.1.8.2, “Related Books”.
Serve directory trees and printers to Linux, UNIX, and Windows clients
Assist in network browsing (with or without NetBIOS)
Authenticate Windows domain logins
Provide Windows Internet Name Service (WINS) name server resolution
Act as a Windows NT®-style Primary Domain Controller (PDC)
Act as a Backup Domain Controller (BDC) for a Samba-based PDC
Act as an Active Directory domain member server
Join a Windows NT/2000/2003/2008 PDC
197
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
sm bd
The sm bd server daemon provides file sharing and printing services to Windows clients. In addition, it is
responsible for user authentication, resource locking, and data sharing through the SMB protocol. The
default ports on which the server listens for SMB traffic are T CP ports 139 and 4 4 5.
nm bd
The nm bd server daemon understands and replies to NetBIOS name service requests such as those
produced by SMB/Common Internet File System (CIFS) in Windows-based systems. These systems
include Windows 95/98/ME, Windows NT, Windows 2000, Windows XP, and LanManager clients. It also
participates in the browsing protocols that make up the Windows Network Neighborhood view. The
default port that the server listens to for NMB traffic is UDP port 137.
winbindd
The winbind service resolves user and group information on a server running Windows NT, 2000,
2003 or Windows Server 2008. This makes Windows user / group information understandable by UNIX
platforms. This is achieved by using Microsoft RPC calls, Pluggable Authentication Modules (PAM), and
the Name Service Switch (NSS). This allows Windows NT domain users to appear and operate as UNIX
users on a UNIX machine. Though bundled with the Samba distribution, the winbind service is
controlled separately from the sm b service.
The winbindd daemon is controlled by the winbind service and does not require the sm b service to
be started in order to operate. winbindd is also used when Samba is an Active Directory member, and
may also be used on a Samba domain controller (to implement nested groups and/or interdomain trust).
Because winbind is a client-side service used to connect to Windows NT-based servers, further
discussion of winbind is beyond the scope of this chapter.
For information on how to configure winbind for authentication, see the Red Hat Enterprise Linux 7
Authentication Guide.
198
Chapter 13. File and Print Servers
You may refer to Section 13.1.7, “Samba Distribution Programs” for a list of utilities included in the
Samba distribution.
As shown in Figure 13.1, “SMB Workgroups in Nautilus”, an icon appears for each available SMB
workgroup or domain on the network.
Double-click one of the workgroup/domain icons to view a list of computers within the workgroup/domain.
199
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
As you can see from Figure 13.2, “SMB Machines in Nautilus”, an icon exists for each machine within the
workgroup. Double-click on an icon to view the Samba shares on the machine. If a username and
password combination is required, you are prompted for them.
Alternately, you can also specify the Samba server and sharename in the Location: bar for Nautilus
using the following syntax (replace <servername> and <sharename> with the appropriate values):
smb://<servername>/<sharename>
To connect to a Samba share from a shell prompt, type the following command:
Replace <hostname> with the hostname or IP address of the Samba server you want to connect to,
<sharename> with the name of the shared directory you want to browse, and <username> with the
Samba username for the system. Enter the correct password or press Enter if no password is required
for the user.
If you see the sm b:\> prompt, you have successfully logged in. Once you are logged in, type help for
a list of commands. If you wish to browse the contents of your home directory, replace sharename with
your username. If the -U switch is not used, the username of the current user is passed to the Samba
server.
200
Chapter 13. File and Print Servers
Sometimes it is useful to mount a Samba share to a directory so that the files in the directory can be
treated as if they are part of the local file system.
To mount a Samba share to a directory, create a directory to mount it to (if it does not already exist), and
execute the following command as root:
This command mounts <sharename> from <servername> in the local directory /mnt/point/.
The mount.cifs utility is a separate RPM (independent from Samba). In order to use mount.cifs,
first ensure the cifs-utils package is installed on your system by running, as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
Note that the cifs-utils package also contains the cifs.upcall binary called by the kernel in order to
perform kerberized CIFS mounts. For more information on cifs.upcall, refer to m an
cifs.upcall.
Some CIFS servers require plain text passwords for authentication. Support for plain text
password authentication can be enabled using the following command:
201
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To specify the Windows workgroup and a brief description of the Samba server, edit the following lines in
your /etc/sam ba/sm b.conf file:
workgroup = WORKGROUPNAME
server string = BRIEF COMMENT ABOUT SERVER
Replace WORKGROUPNAME with the name of the Windows workgroup to which this machine should belong.
The BRIEF COMMENT ABOUT SERVER is optional and is used as the Windows comment about the Samba
system.
To create a Samba share directory on your Linux system, add the following section to your
/etc/sam ba/sm b.conf file (after modifying it to reflect your needs and your system):
[sharename]
comment = Insert a comment here
path = /home/share/
valid users = tfox carole
public = no
writable = yes
printable = no
create mask = 0765
The above example allows the users tfox and carole to read and write to the directory
/hom e/share, on the Samba server, from a Samba client.
To set up a domain member server, you must first join the domain or Active Directory using the
net join command before starting the sm b service.
To stop the server, type the following command in a shell prompt, as root:
The restart option is a quick way of stopping and then starting Samba. This is the most reliable way to
make configuration changes take effect after editing the configuration file for Samba. Note that the
restart option starts the daemon even if it was not running originally.
To restart the server, type the following command in a shell prompt, as root:
202
Chapter 13. File and Print Servers
The condrestart (conditional restart) option only starts sm b on the condition that it is currently
running. This option is useful for scripts, because it does not start the daemon if it is not running.
When the /etc/sam ba/sm b.conf file is changed, Samba automatically reloads it after a few
minutes. Issuing a manual restart or reload is just as effective.
A manual reload of the /etc/sam ba/sm b.conf file can be useful in case of a failed automatic reload
by the sm b service. To ensure that the Samba server configuration file is reloaded without restarting the
service, type the following command, as root:
By default, the sm b service does not start automatically at boot time. To configure Samba to start at boot
time, type the following at a shell prompt as root:
See Chapter 7, Managing Services with systemd for more information regarding these tools.
Network browsing capabilities require NetBIOS over T CP/IP. NetBIOS-based networking uses broadcast
(UDP) messaging to accomplish browse list management. Without NetBIOS and WINS as the primary
method for T CP/IP hostname resolution, other methods such as static files (/etc/hosts) or DNS, must
be used.
A domain master browser collates the browse lists from local master browsers on all subnets so that
browsing can occur between workgroups and subnets. Also, the domain master browser should
preferably be the local master browser for its own subnet.
For subnets that do not include the Windows server PDC, a Samba server can be implemented as a
local master browser. Configuring the /etc/sam ba/sm b.conf file for a local master browser (or no
browsing at all) in a domain controller environment is the same as workgroup configuration (see
Section 13.1.4, “Configuring a Samba Server”).
203
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
In a mixed NT/2000/2003/2008 server and Samba environment, it is recommended that you use the
Microsoft WINS capabilities. In a Samba-only environment, it is recommended that you use only one
Samba server for WINS.
The following is an example of the /etc/sam ba/sm b.conf file in which the Samba server is serving as
a WINS server:
[global]
wins support = Yes
Using WINS
All servers (including Samba) should connect to a WINS server to resolve NetBIOS names.
Without WINS, browsing only occurs on the local subnet. Furthermore, even if a domain-wide list
is somehow obtained, hosts cannot be resolved for the client without WINS.
findsm b <subnet_broadcast_address>
The findsm b program is a Perl script which reports information about SMB-aware systems on a specific
subnet. If no subnet is specified the local subnet is used. Items displayed include IP address, NetBIOS
name, workgroup or domain name, operating system, and version.
The following example shows the output of executing findsm b as any valid user on a system:
~]$ findsmb
IP ADDR NETBIOS NAME WORKGROUP/OS/VERSION
------------------------------------------------------------------
10.1.59.25 VERVE [MYGROUP] [Unix] [Samba 3.0.0-15]
10.1.59.26 STATION22 [MYGROUP] [Unix] [Samba 3.0.2-7.FC1]
10.1.56.45 TREK +[WORKGROUP] [Windows 5.0] [Windows 2000 LAN Manager]
10.1.57.94 PIXEL [MYGROUP] [Unix] [Samba 3.0.0-15]
10.1.57.137 MOBILE001 [WORKGROUP] [Windows 5.0] [Windows 2000 LAN Manager]
10.1.57.141 JAWS +[KWIKIMART] [Unix] [Samba 2.2.7a-security-rollup-fix]
10.1.56.159 FRED +[MYGROUP] [Unix] [Samba 3.0.0-14.3E]
10.1.59.192 LEGION *[MYGROUP] [Unix] [Samba 2.2.7-security-rollup-fix]
10.1.56.205 NANCYN +[MYGROUP] [Unix] [Samba 2.2.7a-security-rollup-fix]
net
The net utility is similar to the net utility used for Windows and MS-DOS. The first argument is used to
204
Chapter 13. File and Print Servers
specify the protocol to use when executing a command. The <protocol> option can be ads, rap, or
rpc for specifying the type of server connection. Active Directory uses ads, Win9x/NT3 uses rap, and
Windows NT4/2000/2003/2008 uses rpc. If the protocol is omitted, net automatically tries to determine
it.
The following example displays a list the available shares for a host named wakko:
The following example displays a list of Samba users for a host named wakko:
nm blookup
The nm blookup program resolves NetBIOS names into IP addresses. The program broadcasts its
query on the local subnet until the target machine replies.
The following example displays the IP address of the NetBIOS name trek:
pdbedit
pdbedit <options>
The pdbedit program manages accounts located in the SAM database. All back ends are supported
including sm bpasswd, LDAP, and the tdb database library.
205
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
rpcclient
The rpcclient program issues administrative commands using Microsoft RPCs, which provide access
to the Windows administration graphical user interfaces (GUIs) for systems management. This is most
often used by advanced users that understand the full complexity of Microsoft RPCs.
206
Chapter 13. File and Print Servers
sm bcacls
The sm bcacls program modifies Windows ACLs on files and directories shared by a Samba server or a
Windows server.
sm bclient
The sm bclient program is a versatile UNIX client which provides functionality similar to ftp.
sm bcontrol
sm bcontrol -i <options>
The sm bcontrol program sends control messages to running sm bd, nm bd, or winbindd daemons.
Executing sm bcontrol -i runs commands interactively until a blank line or a 'q' is entered.
sm bpasswd
The sm bpasswd program manages encrypted passwords. This program can be run by a superuser to
change any user's password as well as by an ordinary user to change their own Samba password.
sm bspool
The sm bspool program is a CUPS-compatible printing interface to Samba. Although designed for use
with CUPS printers, sm bspool can work with non-CUPS printers as well.
sm bstatus
sm bstatus <options>
The sm bstatus program displays the status of current connections to a Samba server.
sm btar
sm btar <options>
The sm btar program performs backup and restores of Windows-based share files and directories to a
local tape archive. Though similar to the tar command, the two are not compatible.
testparm
The testparm program checks the syntax of the /etc/sam ba/sm b.conf file. If your
/etc/sam ba/sm b.conf file is in the default location (/etc/sam ba/sm b.conf) you do not need to
specify the location. Specifying the hostname and IP address to the testparm program verifies that the
207
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
hosts.allow and host.deny files are configured correctly. The testparm program also displays a
summary of your /etc/sam ba/sm b.conf file and the server's role (stand-alone, domain, etc.) after
testing. This is convenient when debugging as it excludes comments and concisely presents information
for experienced administrators to read.
For example:
~]$ testparm
Load smb config files from /etc/samba/smb.conf
Processing section "[homes]"
Processing section "[printers]"
Processing section "[tmp]"
Processing section "[html]"
Loaded services file OK.
Server role: ROLE_STANDALONE
Press enter to see a dump of your service definitions
<enter>
# Global parameters
[global]
workgroup = MYGROUP
server string = Samba Server
security = SHARE
log file = /var/log/samba/%m.log
max log size = 50
socket options = TCP_NODELAY SO_RCVBUF=8192 SO_SNDBUF=8192
dns proxy = No
[homes]
comment = Home Directories
read only = No
browseable = No
[printers]
comment = All Printers
path = /var/spool/samba
printable = Yes
browseable = No
[tmp]
comment = Wakko tmp
path = /tmp
guest only = Yes
[html]
comment = Wakko www
path = /var/www/html
force user = andriusb
force group = users
read only = No
guest only = Yes
wbinfo
wbinfo <options>
The wbinfo program displays information from the winbindd daemon. The winbindd daemon must
be running for wbinfo to work.
208
Chapter 13. File and Print Servers
In order to use the Samba documentation, first ensure the samba-doc package is installed on
your system by running, as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
The Official Samba-3 HOWTO-Collection by John H. Terpstra and Jelmer R. Vernooij; Prentice Hall
— The official Samba-3 documentation as issued by the Samba development team. This is more of a
reference guide than a step-by-step guide.
Samba-3 by Example by John H. Terpstra; Prentice Hall — This is another official release issued by
the Samba development team which discusses detailed examples of OpenLDAP, DNS, DHCP, and
printing configuration files. This has step-by-step related information that helps in real-world
implementations.
Using Samba, 2nd Edition by Jay Ts, Robert Eckstein, and David Collier-Brown; O'Reilly — A good
resource for novice to advanced users, which includes comprehensive reference material.
http://www.samba.org/ — Homepage for the Samba distribution and all official documentation created
by the Samba development team. Many resources are available in HTML and PDF formats, while
others are only available for purchase. Although many of these links are not Red Hat Enterprise Linux
specific, some concepts may apply.
http://samba.org/samba/archives.html — Active email lists for the Samba community. Enabling digest
mode is recommended due to high levels of list activity.
Samba newsgroups — Samba threaded newsgroups, such as gmane.org, that use the NNTP
protocol are also available. This an alternative to receiving mailing list emails.
13.2. FTP
The File Transfer Protocol (FT P) is one of the oldest and most commonly used protocols found on the
209
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Internet today. Its purpose is to reliably transfer files between computer hosts on a network without
requiring the user to log directly in to the remote host or to have knowledge of how to use the remote
system. It allows users to access files on remote systems using a standard set of simple commands.
This section outlines the basics of the FT P protocol and introduces vsftpd, the primary FT P server
shipped with Red Hat Enterprise Linux.
The following chapters include information on how to configure vsftpd, the primary FT P server shipped
with Red Hat Enterprise Linux, to establish connections secured by SSL and how to secure an FT P
server with the help of SELinux. A good substitute for FTP is sftp from the OpenSSH suite of tools. For
information about configuring OpenSSH and about the SSH protocol in general, refer to Chapter 8,
OpenSSH.
Unlike most protocols used on the Internet, FT P requires multiple network ports to work properly. When
an FT P client application initiates a connection to an FT P server, it opens port 21 on the server —
known as the command port. This port is used to issue all commands to the server. Any data requested
from the server is returned to the client via a data port. The port number for data connections, and the
way in which data connections are initialized, vary depending upon whether the client requests the data
in active or passive mode.
active mode
Active mode is the original method used by the FT P protocol for transferring data to the client
application. When an active-mode data transfer is initiated by the FT P client, the server opens a
connection from port 20 on the server to the IP address and a random, unprivileged port
(greater than 1024 ) specified by the client. This arrangement means that the client machine
must be allowed to accept connections over any port above 1024 . With the growth of insecure
networks, such as the Internet, the use of firewalls for protecting client machines is now
prevalent. Because these client-side firewalls often deny incoming connections from active-
mode FT P servers, passive mode was devised.
passive mode
Passive mode, like active mode, is initiated by the FT P client application. When requesting data
from the server, the FT P client indicates it wants to access the data in passive mode and the
server provides the IP address and a random, unprivileged port (greater than 1024 ) on the
server. The client then connects to that port on the server to download the requested
information.
While passive mode does resolve issues for client-side firewall interference with data
connections, it can complicate administration of the server-side firewall. You can reduce the
number of open ports on a server by limiting the range of unprivileged ports on the FT P server.
This also simplifies the process of configuring firewall rules for the server. Refer to the vsftpd
Configuration Files and Options chapter of the Red Hat Enterprise Linux 7 Administrator's
Reference Guide for more information about limiting passive ports.
210
Chapter 13. File and Print Servers
Strong separation of privileged and non-privileged processes — Separate processes handle different
tasks, and each of these processes runs with the minimal privileges required for the task.
Tasks requiring elevated privileges are handled by processes with the minimal privilege necessary —
By taking advantage of compatibilities found in the libcap library, tasks that usually require full root
privileges can be executed more safely from a less privileged process.
Most processes run in a chroot jail — Whenever possible, processes are change-rooted to the
directory being shared; this directory is then considered a chroot jail. For example, if the
/var/ftp/ directory is the primary shared directory, vsftpd reassigns /var/ftp/ to the new root
directory, known as /. This disallows any potential malicious hacker activities for any directories not
contained in the new root directory.
Use of these security practices has the following effect on how vsftpd deals with requests:
The parent process runs with the least privileges required — The parent process dynamically
calculates the level of privileges it requires to minimize the level of risk. Child processes handle direct
interaction with the FT P clients and run with as close to no privileges as possible.
All operations requiring elevated privileges are handled by a small parent process — Much like the
Apache HT T P Server, vsftpd launches unprivileged child processes to handle incoming
connections. This allows the privileged, parent process to be as small as possible and handle
relatively few tasks.
All requests from unprivileged child processes are distrusted by the parent process —
Communication with child processes is received over a socket, and the validity of any information
from child processes is checked before being acted on.
Most interactions with FTP clients are handled by unprivileged child processes in a chroot jail —
Because these child processes are unprivileged and only have access to the directory being shared,
any crashed processes only allow the attacker access to the shared files.
This command stops and immediately starts the vsftpd service, which is the most efficient way to make
configuration changes take effect after editing the configuration file for this FT P server. Alternatively, you
211
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
can use the following command to restart the vsftpd service only if it is already running:
By default, the vsftpd service does not start automatically at boot time. To configure the vsftpd
service to start at boot time, type the following at a shell prompt as root:
For more information on how to manage system services in Red Hat Enterprise Linux 7, see Chapter 7,
Managing Services with systemd.
To do this, first assign all relevant IP addresses to network devices or alias network devices on the
system. For more information about configuring network devices, device aliases, and additional
information about network configuration scripts, refer to the Red Hat Enterprise Linux 7 Networking
Guide.
Next, the DNS server for the FT P domains must be configured to reference the correct machine. For
information about BIND, the DNS protocol implementation used in Red Hat Enterprise Linux, and its
configuration files, refer to the Red Hat Enterprise Linux 7 Networking Guide.
For vsftpd to answer requests on different IP addresses, multiple copies of the daemon must be
running. To facilitate launching multiple instances of the vsftpd daemon, a special systemd service unit
(vsftpd@ .service) for launching vsftpd as an instantiated service is supplied in the vsftpd package.
In order to make use of this service unit, a separate vsftpd configuration file for each required instance
of the FT P server must be created and placed in the /etc/vsftpd/ directory. Note that each of these
configuration files must have a unique name (such as /etc/vsftpd/vsftpd-site-2.conf) and must
be readable and writable only by the root user.
Within each configuration file for each FT P server listening on an IPv4 network, the following directive
must be unique:
listen_address=N.N.N.N
Replace N.N.N.N with a unique IP address for the FT P site being served. If the site is using IPv6, use
the listen_address6 directive instead.
Once there are multiple configuration files present in the /etc/vsftpd/ directory, individual instances
of the vsftpd daemon can be started by executing the following command as root:
In the above command, replace configuration-file-name with the unique name of the requested
server's configuration file, such as vsftpd-site-2. Note that the configuration file's .conf extension
should not be included in the command.
212
Chapter 13. File and Print Servers
If you wish to start several instances of the vsftpd daemon at once, you can make use of a systemd
target unit file (vsftpd.target), which is supplied in the vsftpd package. This systemd target causes
an independent vsftpd daemon to be launched for each available vsftpd configuration file in the
/etc/vsftpd/ directory. Execute the following command as root to enable the target:
The above command configures the systemd service manager to launch the vsftpd service (along with
the configured vsftpd server instances) at boot time. To start the service immediately, without
rebooting the system, execute the following command as root:
Refer to Section 7.3, “Working with systemd Targets” for more information on how to use systemd
targets to manage services.
anon_root
local_root
vsftpd_log_file
xferlog_file
For a detailed list of directives that can be used in the configuration file of the vsftpd daemon, refer to
the vsftpd Configuration Options chapter of the Red Hat Enterprise Linux 7 Administrator's Reference
Guide.
Set the ssl_enable configuration directive in the vsftpd.conf file to YES to turn on SSL support.
The default settings of other SSL-related directives that become automatically active when the
ssl_enable option is enabled provide for a reasonably well-configured SSL set up. This includes,
among other things, the requirement to use the T LS v1 protocol for all connections or forcing all non-
anonymous logins to use SSL for sending passwords and data transfers.
Refer to vsftpd.conf(5) for other SSL-related configuration directives for fine-tuning the use of SSL
by vsftpd. Also, see the vsftpd Configuration Options chapter of the Red Hat Enterprise Linux 7
Administrator's Reference Guide for a description of other commonly used vsftpd.conf configuration
directives.
213
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For example, in order to be able to share files anonymously, the public_content_t label must be
assigned to the files and directories to be shared. You can do this using the chcon command as root:
In the above command, replace /path/to/directory with the path to the directory to which you wish to
assign the label. Similarly, if you want to set up a directory for uploading files, you need to assign that
particular directory the public_content_rw_t label. In addition to that, the
allow_ftpd_anon_write SELinux Boolean option must be set to 1. Use the setsebool command
as root to do that:
If you want local users to be able to access their home directories through FT P, which is the default
setting on Red Hat Enterprise Linux 7, the ftp_hom e_dir Boolean option needs to be set to 1. If
vsftpd is to be allowed to run in standalone mode, which is also enabled by default on Red Hat
Enterprise Linux 7, the ftpd_is_daem on option needs to be set to 1 as well.
Refer to ftpd_selinux(8) for more information, including examples of other useful labels and
Boolean options, on how to configure the SELinux policy pertaining to FT P. Also, see the Red Hat
Enterprise Linux 7 SELinux User's and Administrator's Guide for more detailed information about
SELinux in general.
Configuration Files
m an vsftpd.conf — Contains a detailed list of options available within the
configuration file for vsftpd.
m an 5 hosts_access — Describes the format and options available within the T CP
wrappers configuration files: hosts.allow and hosts.deny.
214
Chapter 13. File and Print Servers
http://vsftpd.beasts.org/ — The vsftpd project page is a great place to locate the latest
documentation and to contact the author of the software.
http://slacksite.com/other/ftp.html — This website provides a concise explanation of the
differences between active and passive-mode FT P.
Red Hat Enterprise Linux 7 Networking Guide — The Networking Guide for Red Hat
Enterprise Linux 7 documents relevant information regarding the configuration and
administration of network interfaces, networks, and network services in this system. It
provides an introduction to the hostnam ectl utility and explains how to use it to view and
set host names on the command line, both locally and remotely.
Red Hat Enterprise Linux 7 SELinux User's and Administrator's Guide — The SELinux User's
and Administrator's Guide for Red Hat Enterprise Linux 7 describes the basic principles of
SELinux and documents in detail how to configure and use SELinux with various services
such as the Apache HTTP Server, Postfix, PostgreSQL, or OpenShift. It explains how to
configure SELinux access permissions for system services managed by systemd.
Red Hat Enterprise Linux 7 Security Guide — The Security Guide for Red Hat Enterprise
Linux 7 assists users and administrators in learning the processes and practices of securing
their workstations and servers against local and remote intrusion, exploitation, and malicious
activity. It also explains how to secure critical system services.
RFC 0959 — The original Request for Comments (RFC) of the FT P protocol from the IETF.
RFC 1123 — The small FT P-related section extends and clarifies RFC 0959.
RFC 2228 — FT P security extensions. vsftpd implements the small subset needed to
support TLS and SSL connections.
RFC 2389 — Proposes FEAT and OPT S commands.
RFC 2428 — IPv6 support.
The tool is based on the Common Unix Printing System (CUPS). If you upgraded the system from a
previous Red Hat Enterprise Linux version that used CUPS, the upgrade process preserved the
configured printers.
You can perform the same and additional operations on printers directly from the CUPS web
application or command line. To access the application, in a web browser, go to
http://localhost:631/. For CUPS manuals refer to the links on the Hom e tab of the web site.
215
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
On the panel, click System → Administration → Printing, or run the system -config-printer
command from the command line to start the tool.
The Printer Configuration window depicted in Figure 13.3, “Printer Configuration window”
appears.
If you are setting up a local printer connected with USB, the printer is discovered and added
automatically. You will be prompted to confirm the packages to be installed and provide the root
password. Local printers connected with other port types and network printers need to be set up
manually.
1. Start the Printer Configuration tool (refer to Section 13.3.1, “Starting the Printer Configuration
Tool”).
2. Go to Server → New → Printer.
3. In the Authenticate dialog box, type the root user password and confirm.
4. Select the printer connection type and provide its details in the area on the right.
1. Open the New Printer dialog (refer to Section 13.3.2, “Starting Printer Setup”).
2. If the device does not appear automatically, select the port to which the printer is connected in the
list on the left (such as Serial Port #1 or LPT #1).
3. On the right, enter the connection properties:
for Other
216
Chapter 13. File and Print Servers
4. Click Forward.
5. Select the printer model. Refer to Section 13.3.8, “Selecting the Printer Model and Finishing” for
details.
1. Open the New Printer dialog (refer to Section 13.3.1, “Starting the Printer Configuration Tool”).
2. In the list on the left, select Network Printer → AppSocket/HP JetDirect.
3. On the right, enter the connection settings:
Hostnam e
217
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
4. Click Forward.
5. Select the printer model. Refer to Section 13.3.8, “Selecting the Printer Model and Finishing” for
details.
If a firewall is enabled on the printer server, then the firewall must be configured to allow incoming TCP
connections on port 631. Note that the CUPS browsing protocol allows client machines to discover
shared CUPS queues automatically. To enable this, the firewall on the client machine must be configured
to allow incoming UDP packets on port 631.
1. Open the New Printer dialog (refer to Section 13.3.2, “Starting Printer Setup”).
218
Chapter 13. File and Print Servers
2. In the list of devices on the left, select Network Printer and Internet Printing Protocol (ipp) or
Internet Printing Protocol (https).
3. On the right, enter the connection settings:
Host
The hostname of the IPP printer.
Queue
The queue name to be given to the new queue (if the box is left empty, a name based on
the device node will be used).
1. Open the New Printer dialog (refer to Section 13.3.2, “Starting Printer Setup”).
2. In the list of devices on the left, select Network Printer → LPD/LPR Host or Printer.
3. On the right, enter the connection settings:
219
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Host
The hostname of the LPD/LPR printer or host.
Optionally, click Probe to find queues on the LPD host.
Queue
The queue name to be given to the new queue (if the box is left empty, a name based on
the device node will be used).
1. Open the New Printer dialog (refer to Section 13.3.2, “Starting Printer Setup”).
2. In the list on the left, select Network Printer → Windows Printer via SAMBA.
3. Enter the SMB address in the sm b:// field. Use the format computer name/printer share. In
Figure 13.8, “Adding a SMB printer”, the computer name is dellbox and the printer share is
r2.
220
Chapter 13. File and Print Servers
4. Click Browse to see the available workgroups/domains. To display only queues of a particular
host, type in the host name (NetBios name) and click Browse.
5. Select either of the options:
A. Prom pt user if authentication is required: username and password are
collected from the user when printing a document.
B. Set authentication details now: provide authentication information now so it is not
required later. In the Usernam e field, enter the username to access the printer. This user
must exist on the SMB system, and the user must have permission to access the printer. The
default user name is typically guest for Windows servers, or nobody for Samba servers.
6. Enter the Password (if required) for the user specified in the Usernam e field.
Samba printer usernames and passwords are stored in the printer server as unencrypted
files readable by root and lpd. Thus, other users that have root access to the printer server
can view the username and password you use to access the Samba printer.
As such, when you choose a username and password to access a Samba printer, it is
advisable that you choose a password that is different from what you use to access your
local Red Hat Enterprise Linux system.
If there are files shared on the Samba print server, it is recommended that they also use a
password different from what is used by the print queue.
221
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
7. Click Verify to test the connection. Upon successful verification, a dialog box appears confirming
printer share accessibility.
8. Click Forward.
9. Select the printer model. Refer to Section 13.3.8, “Selecting the Printer Model and Finishing” for
details.
Follow this procedure to provide the printer driver and finish the installation:
1. In the window displayed after the automatic driver detection has failed, select one of the following
options:
A. Select a Printer from database — the system chooses a driver based on the
selected make of your printer from the list of Makes. If your printer model is not listed, choose
Generic.
B. Provide PPD file — the system uses the provided PostScript Printer Description (PPD) file
for installation. A PPD file may also be delivered with your printer as being normally provided by
the manufacturer. If the PPD file is available, you can choose this option and use the browser
bar below the option description to select the PPD file.
C. Search for a printer driver to download — enter the make and model of your
printer into the Make and m odel field to search on OpenPrinting.org for the appropriate
packages.
222
Chapter 13. File and Print Servers
2. Depending on your previous choice provide details in the area displayed below:
Printer brand for the Select printer from database option.
PPD file location for the Provide PPD file option.
Printer make and model for the Search for a printer driver to download option.
3. Click Forward to continue.
4. If applicable for your option, window shown in Figure 13.10, “Selecting a printer model” appears.
Choose the corresponding model in the Models column on the left.
On the right, the recommended printed driver is automatically selected; however, you can
select another available driver. The print driver processes the data that you want to print
into a format the printer can understand. Since a local printer is attached directly to your
computer, you need a printer driver to process the data that is sent to the printer.
5. Click Forward.
6. Under the Describe Printer enter a unique name for the printer in the Printer Nam e field.
223
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The printer name can contain letters, numbers, dashes (-), and underscores (_); it must not
contain any spaces. You can also use the Description and Location fields to add further
printer information. Both fields are optional, and may contain spaces.
7. Click Apply to confirm your printer configuration and add the print queue if the settings are
correct. Click Back to modify the printer configuration.
8. After the changes are applied, a dialog box appears allowing you to print a test page. Click Yes to
print a test page now. Alternatively, you can print a test page later as described in Section 13.3.9,
“Printing a Test Page”.
224
Chapter 13. File and Print Servers
To set the default printer, right-click the printer in the printer list and click the Set as Default button in the
context menu.
You can modify printer settings such as make and model, print a test page, change the device location
(URI), and more.
You can select the printer states, configure the Error Policy of the printer (you can decide to abort
the print job, retry, or stop it if an error occurs).
You can also create a banner page (a page that describes aspects of the print job such as the originating
printer, the username from the which the job originated, and the security status of the document being
printed): click the Starting Banner or Ending Banner drop-menu and choose the option that best
describes the nature of the print jobs (such as topsecret, classified, or confidential).
Finally, make sure that the firewall allows incoming TCP connections to port 631 (that is Network Printing
Server (IPP) in system-config-firewall).
225
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
226
Chapter 13. File and Print Servers
227
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
228
Chapter 13. File and Print Servers
During the printing process, the Printer Status icon appears in the Notification Area on the panel.
To check the status of a print job, click the Printer Status, which displays a window similar to
Figure 13.18, “GNOME Print Status”.
To cancel, hold, release, reprint or authenticate a print job, select the job in the GNOME Print Status
and on the Job menu, click the respective command.
To view the list of print jobs in the print spool from a shell prompt, type the command lpstat -o. The
last few lines look similar to the following:
229
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
$ lpstat -o
Charlie-60 twaugh 1024 Tue 08 Feb 2011 16:42:11 GMT
Aaron-61 twaugh 1024 Tue 08 Feb 2011 16:42:44 GMT
Ben-62 root 1024 Tue 08 Feb 2011 16:45:42 GMT
If you want to cancel a print job, find the job number of the request with the command lpstat -o and
then use the command cancel job number. For example, cancel 60 would cancel the print job in
Example 13.1, “Example of lpstat -o output”. You can not cancel print jobs that were started by other
users with the cancel command. However, you can enforce deletion of such job by issuing the cancel
-U root job_number command. To prevent such canceling change the printer operation policy to
Authenticated to force root authentication.
You can also print a file directly from a shell prompt. For example, the command lp sam ple.txt prints
the text file sam ple.txt. The print filter determines what type of file it is and converts it into a format the
printer can understand.
m an cancel
The manual page for the command line utility to remove print jobs from the print queue.
m an m page
The manual page for the command line utility to print multiple pages on one sheet of paper.
m an cupsd
The manual page for the CUPS printer daemon.
m an cupsd.conf
The manual page for the CUPS printer daemon configuration file.
m an classes.conf
The manual page for the class configuration file for CUPS.
m an lpstat
The manual page for the lpstat command, which displays status information about classes,
jobs, and printers.
230
Chapter 13. File and Print Servers
http://www.cups.org/
Documentation, FAQs, and newsgroups about CUPS.
231
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The user space daemon updates the system clock running in the kernel. The system clock can keep time
by using various clock sources. Usually, the Time Stamp Counter (TSC) is used. The TSC is a CPU
register which counts the number of cycles since it was last reset. It is very fast, has a high resolution,
and there are no interrupts.
There is a choice between the daemons ntpd and chronyd, which are available from the repositories
in the ntp and chrony packages respectively. This section describes the use of the chrony suite of
utilities to update the system clock on systems that do not fit into the conventional permanently
networked, always on, dedicated server category.
chronyd can work well when external time references are only intermittently accessible whereas
ntpd needs regular polling of time reference to work well.
chronyd can perform well even when the network is congested for longer periods of time.
chronyd can usually synchronize the clock faster and with better time accuracy.
chronyd quickly adapts to sudden changes in the rate of the clock, for example, due to changes in
the temperature of the crystal oscillator, whereas ntpd may need a long time to settle down again.
chronyd in the default configuration never steps the time after the clock has been synchronized at
system start, in order not to upset other running programs. ntpd can be configured to never step the
time too, but it has to use a different means of adjusting the clock, which has some disadvantages.
chronyd can adjust the rate of the clock on a Linux system in a larger range, which allows it to
operate even on machines with a broken or unstable clock. For example, on some virtual machines.
chronyd provides support for isolated networks where the only method of time correction is manual
entry. For example, by the administrator looking at a clock. chronyd can look at the errors corrected
at different updates to estimate the rate at which the computer gains or loses time, and use this
estimate to trim the computer clock subsequently.
chronyd provides support to work out the rate of gain or loss of the real-time clock, the hardware
232
Chapter 14. Configuring NTP Using the chrony Suite
clock, that maintains the time when the computer is turned off. It can use this data when the system
boots to set the system time using an adjusted value of the time taken from the real-time clock. This
is, at time of writing, only available in Linux.
ntpd fully supports NT P version 4 (RFC 5905), including broadcast, multicast, manycast clients and
servers, and the orphan mode. It also supports extra authentication schemes based on public-key
cryptography (RFC 5906). chronyd uses NT P version 3 (RFC 1305), which is compatible with
version 4.
ntpd includes drivers for many reference clocks whereas chronyd relies on other programs, for
example gpsd, to access the data from the reference clocks.
233
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
allow
Optionally specify a host, subnet, or network from which to allow NT P connections to a machine
acting as NT P server. The default is not to allow connections.
Examples:
1. allow server1.example.com
Use this form to specify a particular host, by its host name, to be allowed access.
2. allow 192.0.2.0/24
3. allow 2001:db8::/32
cmdallow
This is similar to the allow directive (see section allow), except that it allows control access
(rather than NT P client access) to a particular subnet or host. (By “control access” is meant that
chronyc can be run on those hosts and successfully connect to chronyd on this computer.)
The syntax is identical. There is also a cm ddeny all directive with similar behavior to the
cm dallow all directive.
dumpdir
Path to the directory to save the measurement history across restarts of chronyd (assuming
no changes are made to the system clock behavior whilst it is not running). If this capability is to
be used (via the dum ponexit command in the configuration file, or the dum p command in
chronyc), the dum pdir command should be used to define the directory where the
measurement histories are saved.
dumponexit
If this command is present, it indicates that chronyd should save the measurement history for
each of its time sources recorded whenever the program exits. (See the dum pdir command
above).
local
The local keyword is used to allow chronyd to appear synchronized to real time (from the
viewpoint of clients polling it), even if it has no current synchronization source. This option is
normally used on computers in an isolated network, where several computers are required to
synchronize to one other, this being the “master” which is kept vaguely in line with real time by
manual input.
local stratum 10
A large value of 10 indicates that the clock is so many hops away from a reference clock that its
234
Chapter 14. Configuring NTP Using the chrony Suite
time is fairly unreliable. Put another way, if the computer ever has access to another computer
which is ultimately synchronized to a reference clock, it will almost certainly be at a stratum less
than 10. Therefore, the choice of a high value like 10 for the local command prevents the
machine’s own time from ever being confused with real time, were it ever to leak out to clients
that have visibility of real servers.
log
The log command indicates that certain information is to be logged. It accepts the following
options:
measurements
This option logs the raw NT P measurements and related information to a file called
m easurem ents.log.
statistics
This option logs information about the regression processing to a file called
statistics.log.
tracking
This option logs changes to the estimate of the system’s gain or loss rate, and any
slews made, to a file called tracking.log.
rtc
This option logs information about the system’s real-time clock.
refclocks
This option logs the raw and filtered reference clock measurements to a file called
refclocks.log.
tempcomp
This option logs the temperature measurements and system rate compensations to a
file called tem pcom p.log.
The log files are written to the directory specified by the logdir command. An example of the
command is:
logdir
This directive allows the directory where log files are written to be specified. An example of the
use of this directive is:
logdir /var/log/chrony
makestep
235
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Normally chronyd will cause the system to gradually correct any time offset, by slowing down
or speeding up the clock as required. In certain situations, the system clock may be so far adrift
that this slewing process would take a very long time to correct the system clock. This directive
forces chronyd to step system clock if the adjustment is larger than a threshold value, but only
if there were no more clock updates since chronyd was started than a specified limit (a
negative value can be used to disable the limit). This is particularly useful when using reference
clocks, because the initstepslew directive only works with NT P sources.
makestep 1000 10
This would step the system clock if the adjustment is larger than 1000 seconds, but only in the
first ten clock updates.
maxchange
This directive sets the maximum allowed offset corrected on a clock update. The check is
performed only after the specified number of updates to allow a large initial adjustment of the
system clock. When an offset larger than the specified maximum occurs, it will be ignored for
the specified number of times and then chronyd will give up and exit (a negative value can be
used to never exit). In both cases a message is sent to syslog.
maxchange 1000 1 2
After the first clock update, chronyd will check the offset on every clock update, it will ignore
two adjustments larger than 1000 seconds and exit on another one.
maxupdateskew
One of chronyd's tasks is to work out how fast or slow the computer’s clock runs relative to its
reference sources. In addition, it computes an estimate of the error bounds around the
estimated value. If the range of error is too large, it probably indicates that the measurements
have not settled down yet, and that the estimated gain or loss rate is not very reliable. The
m axupdateskew parameter allows the threshold for determining whether an estimate may be
so unreliable that it should not be used. By default, the threshold is 1000 ppm. The format of the
syntax is:
maxupdateskew skew-in-ppm
Typical values for skew-in-ppm might be 100 for a dial-up connection to servers over a
telephone line, and 5 or 10 for a computer on a LAN. It should be noted that this is not the only
means of protection against using unreliable estimates. At all times, chronyd keeps track of
both the estimated gain or loss rate, and the error bound on the estimate. When a new estimate
is generated following another measurement from one of the sources, a weighted combination
algorithm is used to update the master estimate. So if chronyd has an existing highly-reliable
master estimate and a new estimate is generated which has large error bounds, the existing
master estimate will dominate in the new master estimate.
noclientlog
This directive, which takes no arguments, specifies that client accesses are not to be logged.
236
Chapter 14. Configuring NTP Using the chrony Suite
Normally they are logged, allowing statistics to be reported using the clients command in
chronyc.
reselectdist
When chronyd selects synchronization source from available sources, it will prefer the one
with minimum synchronization distance. However, to avoid frequent reselecting when there are
sources with similar distance, a fixed distance is added to the distance for sources that are
currently not selected. This can be set with the reselectdist option. By default, the distance
is 100 microseconds.
reselectdist dist-in-seconds
stratumweight
The stratum weight directive sets how much distance should be added per stratum to the
synchronization distance when chronyd selects the synchronization source from available
sources.
stratumweight dist-in-seconds
By default, dist-in-seconds is 1 second. This usually means that sources with lower stratum
will be preferred to sources with higher stratum even when their distance is significantly worse.
Setting stratum weight to 0 makes chronyd ignore stratum when selecting the source.
rtcfile
The rtcfile directive defines the name of the file in which chronyd can save parameters
associated with tracking the accuracy of the system’s real-time clock (RTC). The format of the
syntax is:
rtcfile /var/lib/chrony/rtc
chronyd saves information in this file when it exits and when the writertc command is
issued in chronyc. The information saved is the RTC’s error at some epoch, that epoch (in
seconds since January 1 1970), and the rate at which the RTC gains or loses time. Not all real-
time clocks are supported as their code is system-specific. Note that if this directive is used then
real-time clock should not be manually adjusted as this would interfere with chrony's need to
measure the rate at which the real-time clock drifts if it was adjusted at random intervals.
rtcsync
The rtcsync directive is present in the /etc/chrony.conf file by default. This will inform the
kernel the system clock is kept synchronized and the kernel will update the real-time clock every
11 minutes.
237
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
chronyc should be limited. Passwords can be specified in the key file, written in ASCII or HEX, to restrict
the use of chronyc. One of the entries is used to restrict the use of operational commands and is
referred to as the command key. In the default configuration, a random command key is generated
automatically on start. It should not be necessary to specify or alter it manually.
Other entries in the key file can be used as NT P keys to authenticate packets received from remote NT P
servers or peers. The two sides need to share a key with identical ID, hash type and password in their
key file. This requires manually creating the keys and copying them over a secure medium, such as SSH.
If the key ID was, for example, 10 then the systems that act as clients must have a line in their
configuration files in the following format:
The location of the key file is specified in the /etc/chrony.conf file. The default entry in the
configuration file is:
keyfile /etc/chrony.keys
The command key number is specified in /etc/chrony.conf using the com m andkey directive, it is
the key chronyd will use for authentication of user commands. The directive in the configuration file
takes the following form:
commandkey 1
An example of the format of the default entry in the key file, /etc/chrony.keys, for the command key
is:
1 SHA1 HEX:A6CFC50C9C93AB6E5A19754C246242FC5471BCDF
Where 1 is the key ID, SHA1 is the hash function to use, HEX is the format of the key, and
A6CFC50C9C93AB6E5A19754 C24 624 2FC54 71BCDF is the key randomly generated when chronyd
was started for the first time. The key can be given in hexidecimal or ASCII format (the default).
A manual entry in the key file, used to authenticate packets from certain NT P servers or peers, can be as
simple as the following:
20 foobar
Were 20 is the key ID and foobar is the secret authentication key. The default hash is MD5, and ASCII
is the default format for the key.
By default, chronyd is configured to listen for commands only from localhost (127.0.0.1 and ::1)
on port 323. To access chronyd remotely with chronyc, any bindcm daddress directives in the
/etc/chrony.conf file should be removed to enable listening on all interfaces and the cm dallow
directive should be used to allow commands from the remote IP address, network, or subnet. In addition,
port 323 has to be opened in the firewall in order to connect from a remote system. Note that the allow
directive is for NT P access whereas the cm dallow directive is to enable the receiving of remote
commands. It is possible to make these changes temporarily using chronyc running locally. Edit the
configuration file to make persistent changes.
The communication between chronyc and chronyd is done over UDP, so it needs to be authorized
before issuing operational commands. To authorize, use the authhash and password commands as
238
Chapter 14. Configuring NTP Using the chrony Suite
follows:
If chronyc is used to configure the local chronyd, the -a option will run the authhash and password
commands automatically.
Only the following commands can be used without providing a password: activity , authhash , dns ,
exit , help , password , quit , rtcdata , sources , sourcestats , tracking , waitsync .
The default location for the chrony daemon is /usr/sbin/chronyd. The command line utility will be
installed to /usr/bin/chronyc.
The default location for the chrony daemon is /usr/sbin/chronyd. The command line utility will be
installed to /usr/bin/chronyc.
To ensure chronyd starts automatically at system start, issue the following command as root:
239
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To prevent chronyd from starting automatically at system start, issue the following command as root:
Reference ID
This is the reference ID and name (or IP address) if available, of the server to which the
computer is currently synchronized. If this is 127.127.1.1 it means the computer is not
synchronized to any external source and that you have the “local” mode operating (via the local
command in chronyc, or the local directive in the /etc/chrony.conf file (see section
local)).
Stratum
The stratum indicates how many hops away from a computer with an attached reference clock
we are. Such a computer is a stratum-1 computer, so the computer in the example is two hops
away (that is to say, a.b.c is a stratum-2 and is synchronized from a stratum-1).
Ref time
This is the time (UTC) at which the last measurement from the reference source was
processed.
System time
In normal operation, chronyd never steps the system clock, because any jump in the timescale
can have adverse consequences for certain application programs. Instead, any error in the
system clock is corrected by slightly speeding up or slowing down the system clock until the
240
Chapter 14. Configuring NTP Using the chrony Suite
error has been removed, and then returning to the system clock’s normal speed. A
consequence of this is that there will be a period when the system clock (as read by other
programs using the gettim eofday() system call, or by the date command in the shell) will be
different from chronyd's estimate of the current true time (which it reports to NT P clients when
it is operating in server mode). The value reported on this line is the difference due to this effect.
Last offset
This is the estimated local offset on the last clock update.
RMS offset
This is a long-term average of the offset value.
Frequency
The “frequency” is the rate by which the system’s clock would be would be wrong if chronyd
was not correcting it. It is expressed in ppm (parts per million). For example, a value of 1ppm
would mean that when the system’s clock thinks it has advanced 1 second, it has actually
advanced by 1.000001 seconds relative to true time.
Residual freq
This shows the “residual frequency” for the currently selected reference source. This reflects
any difference between what the measurements from the reference source indicate the
frequency should be and the frequency currently being used. The reason this is not always zero
is that a smoothing procedure is applied to the frequency. Each time a measurement from the
reference source is obtained and a new residual frequency computed, the estimated accuracy
of this residual is compared with the estimated accuracy (see skew next) of the existing
frequency value. A weighted average is computed for the new frequency, with weights
depending on these accuracies. If the measurements from the reference source follow a
consistent trend, the residual will be driven to zero over time.
Skew
This is the estimated error bound on the frequency.
Root delay
This is the total of the network path delays to the stratum-1 computer from which the computer
is ultimately synchronized. In certain extreme situations, this value can be negative. (This can
arise in a symmetric peer arrangement where the computers’ frequencies are not tracking each
other and the network delay is very short relative to the turn-around time at each computer.)
Root dispersion
This is the total dispersion accumulated through all the computers back to the stratum-1
computer from which the computer is ultimately synchronized. Dispersion is due to system clock
resolution, statistical measurement variations etc.
Leap status
This is the leap status, which can be Normal, Insert second, Delete second or Not synchronized.
241
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
S
This column indicates the state of the sources. “*” indicates the source to which chronyd is
currently synchronized. “+” indicates acceptable sources which are combined with the selected
source. “-” indicates acceptable sources which are excluded by the combining algorithm. “?”
indicates sources to which connectivity has been lost or whose packets do not pass all tests. “x”
indicates a clock which chronyd thinks is is a falseticker (that is to say, its time is inconsistent
with a majority of other sources). “~” indicates a source whose time appears to have too much
variability. The “?” condition is also shown at start-up, until at least 3 samples have been
gathered from it.
Name/IP address
This shows the name or the IP address of the source, or reference ID for reference clocks.
Stratum
This shows the stratum of the source, as reported in its most recently received sample. Stratum
1 indicates a computer with a locally attached reference clock. A computer that is synchronized
to a stratum 1 computer is at stratum 2. A computer that is synchronized to a stratum 2
computer is at stratum 3, and so on.
Poll
This shows the rate at which the source is being polled, as a base-2 logarithm of the interval in
seconds. Thus, a value of 6 would indicate that a measurement is being made every 64
seconds. chronyd automatically varies the polling rate in response to prevailing conditions.
Reach
This shows the source’s reachability register printed as octal number. The register has 8 bits
and is updated on every received or missed packet from the source. A value of 377 indicates
that a valid reply was received for all from the last eight transmissions.
LastRx
242
Chapter 14. Configuring NTP Using the chrony Suite
This column shows how long ago the last sample was received from the source. This is normally
in seconds. The letters m , h, d or y indicate minutes, hours, days or years. A value of 10 years
indicates there were no samples received from this source yet.
Last sample
This column shows the offset between the local clock and the source at the last measurement.
The number in the square brackets shows the actual measured offset. This may be suffixed by
ns (indicating nanoseconds), us (indicating microseconds), m s (indicating milliseconds), or s
(indicating seconds). The number to the left of the square brackets shows the original
measurement, adjusted to allow for any slews applied to the local clock since. The number
following the +/- indicator shows the margin of error in the measurement. Positive offsets
indicate that the local clock is fast of the source.
NP
This is the number of sample points currently being retained for the server. The drift rate and
current offset are estimated by performing a linear regression through these points.
NR
This is the number of runs of residuals having the same sign following the last regression. If this
number starts to become too small relative to the number of samples, it indicates that a straight
line is no longer a good fit to the data. If the number of runs is too low, chronyd discards older
samples and re-runs the regression until the number of runs becomes acceptable.
Span
This is the interval between the oldest and newest samples. If no unit is shown the value is in
seconds. In the example, the interval is 46 minutes.
Frequency
This is the estimated residual frequency for the server, in parts per million. In this case, the
243
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
computer’s clock is estimated to be running 1 part in 109 slow relative to the server.
Freq Skew
This is the estimated error bounds on Freq (again in parts per million).
Offset
This is the estimated offset of the source.
Std Dev
This is the estimated sample standard deviation.
~]# chronyc
chrony> password commandkey-password
200 OK
chrony> makestep
200 OK
Where commandkey-password is the command key or password stored in the key file.
The real-time clock should not be manually adjusted if the rtcfile directive is used as this would
interfere with chrony's need to measure the rate at which the real-time clock drifts if it was adjusted at
random intervals.
If chronyc is used to configure the local chronyd, the -a will run the authhash and password
commands automatically. This means that the interactive session illustrated above can be replaced by:
chronyc -a makestep
driftfile /var/lib/chrony/drift
commandkey 1
keyfile /etc/chrony.keys
The command key ID is generated at install time and should correspond with the com m andkey value in
the key file, /etc/chrony.keys.
1. Using your editor running as root, add the addresses of four NT P servers as follows:
244
Chapter 14. Configuring NTP Using the chrony Suite
The offline option can be useful in preventing systems from trying to activate connections. The
chrony daemon will wait for chronyc to inform it that the system is connected to the network or
Internet.
On the system selected to be the master, using a text editor running as root, edit the
/etc/chrony.conf as follows:
driftfile /var/lib/chrony/drift
commandkey 1
keyfile /etc/chrony.keys
initstepslew 10 client1 client3 client6
local stratum 8
manual
allow 192.0.2.0
Where 192.0.2.0 is the network or subnet address from which the clients are allowed to connect.
On the systems selected to be direct clients of the master, using a text editor running as root, edit the
/etc/chrony.conf as follows:
server master
driftfile /var/lib/chrony/drift
logdir /var/log/chrony
log measurements statistics tracking
keyfile /etc/chrony.keys
commandkey 24
local stratum 10
initstepslew 20 master
allow 192.0.2.123
Where 192.0.2.123 is the address of the master, and m aster is the host name of the master. These
client will resynchronize the master if it restarts.
On the client systems which are not to be direct clients of the master, the /etc/chrony.conf file
should be the same except that the local and allow directives should be omitted.
245
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To make changes using the command line utility chronyc in interactive mode, enter the following
command as root:
~]# chronyc
chronyc must run as root if some of the restricted commands are to be used.
chronyc>
The utility can also be invoked in non-interactive command mode if called together with a command as
follows:
Where hostname is the hostnam e of a system running chronyd to connect to in order to allow remote
administration from that host. The default is to connect to the daemon on the localhost.
Where port is the port in use for controlling and monitoring by the instance of chronyd to be connected
to.
Note that commands issued at the chrony command prompt are not persistent. Only commands in the
configuration file are persistent.
From the remote systems, the system administrator can issue commands after first using the password
command, preceded by the authhash command if the key used a hash different from MD5, at the
chronyc command prompt as follows:
The password or hash associated with the command key for a remote system is best obtained by SSH.
That is to say, an SSH connection should be established to the remote machine and the ID of the
command key from /etc/chrony.conf and the command key in /etc/chrony.keys memorized or
stored securely for the duration of the session.
246
Chapter 14. Configuring NTP Using the chrony Suite
chronyc(1) man page — Describes the chronyc command-line interface tool including commands
and command options.
chronyd(1) man page — Describes the chronyd daemon including commands and command
options.
247
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Accurate time keeping is important for a number of reasons in IT. In networking for example, accurate
time stamps in packets and logs are required. Logs are used to investigate service and security issues
and so timestamps made on different systems must be made by synchronized clocks to be of real value.
As systems and networks become increasingly faster, there is a corresponding need for clocks with
greater accuracy and resolution. In some countries there are legal obligations to keep accurately
synchronized clocks. Please see www.ntp.org for more information. In Linux systems, NT P is
implemented by a daemon running in user space. The default NT P user space daemon in Red Hat
Enterprise Linux 7 is chronyd. It must be disabled if you want to use the ntpd daemon. See
Chapter 14, Configuring NTP Using the chrony Suite for information on chrony.
The user space daemon updates the system clock, which is a software clock running in the kernel. Linux
uses a software clock as its system clock for better resolution than the typical embedded hardware clock
referred to as the “Real Time Clock” (RTC). See the rtc(4 ) and hwclock(8) man pages for
information on hardware clocks. The system clock can keep time by using various clock sources. Usually,
the Time Stamp Counter (TSC) is used. The TSC is a CPU register which counts the number of cycles
since it was last reset. It is very fast, has a high resolution, and there are no interrupts. On system start,
the system clock reads the time and date from the RTC. The time kept by the RTC will drift away from
actual time by up to 5 minutes per month due to temperature variations. Hence the need for the system
clock to be constantly synchronized with external time references. When the system clock is being
synchronized by ntpd, the kernel will in turn update the RTC every 11 minutes automatically.
Note that by default NT P clients act as servers for those systems in the stratum below them.
248
Chapter 15. Configuring NTP Using ntpd
Stratum 0:
Atomic Clocks and their signals broadcast over Radio and GPS
These signals can be received by dedicated devices and are usually connected by RS-232 to a
system used as an organizational or site-wide time server.
Stratum 1:
Computer with radio clock, GPS clock, or atomic clock attached
Stratum 2:
Reads from stratum 1; Serves to lower strata
Stratum 3:
Reads from stratum 2; Serves to lower strata
Stratum n+1:
Reads from stratum n; Serves to lower strata
Stratum 15:
Reads from stratum 14; This is the lowest stratum.
This process continues down to Stratum 15 which is the lowest valid stratum. The label Stratum 16 is
used to indicated an unsynchronized state.
This implementation of NT P enables sub-second accuracy to be achieved. Over the Internet, accuracy to
10s of milliseconds is normal. On a Local Area Network (LAN), 1 ms accuracy is possible under ideal
conditions. This is because clock drift is now accounted and corrected for, which was not done in earlier,
simpler, time protocol systems. A resolution of 233 picoseconds is provided by using 64-bit timestamps:
32-bits for seconds, 32-bits for fractional seconds.
NT P represents the time as a count of the number of seconds since 00:00 (midnight) 1 January, 1900
GMT. As 32-bits is used to count the seconds, this means the time will “roll over” in 2036. However NT P
works on the difference between timestamps so this does not present the same level of problem as other
implementations of time protocols have done. If a hardware clock accurate to better than 68 years is
available at boot time then NT P will correctly interpret the current date. The NT P4 specification provides
249
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
for an “Era Number” and an “Era Offset” which can be used to make software more robust when dealing
with time lengths of more than 68 years. Note, please do not confuse this with the Unix Year 2038
problem.
The NT P protocol provides additional information to improve accuracy. Four timestamps are used to
allow the calculation of round-trip time and server response time. In order for a system in its role as NT P
client to synchronize with a reference time server, a packet is sent with an “originate timestamp”. When
the packet arrives, the time server adds a “receive timestamp”. After processing the request for time and
date information and just before returning the packet, it adds a “transmit timestamp”. When the returning
packet arrives at the NT P client, a “receive timestamp” is generated. The client can now calculate the
total round trip time and by subtracting the processing time derive the actual traveling time. By assuming
the outgoing and return trips take equal time, the single-trip delay in receiving the NT P data is calculated.
The full NT P algorithm is much more complex then presented here.
Each packet containing time information received is not immediately acted upon, but is subject to
validation checks and then used together with several other samples to arrive at a reasonably good
estimate of the time. This is then compared to the system clock to determine the time offset, that is to
say, the difference between the system clock's time and what ntpd has determined the time should be.
The system clock is adjusted slowly, at most at a rate of 0.5ms per second, to reduce this offset by
changing the frequency of the counter being used. It will take at least 2000 seconds to adjust the clock
by 1 second using this method. This slow change is referred to as slewing and cannot go backwards. If
the time offset of the clock is more than 128ms (the default setting), ntpd can “step” the clock forwards
or backwards. If the time offset at system start is greater than 1000 seconds then the user, or an
installation script, should make a manual adjustment. See Chapter 2, Configuring the Date and Time.
With the -g option to the ntpd command (used by default), any offset at system start will be corrected,
but during normal operation only offsets of up to 1000 seconds will be corrected.
Some software may fail or produce an error if the time is changed backwards. For systems that are
sensitive to step changes in the time, the threshold can be changed to 600s instead of 128ms using the
-x option (unrelated to the -g option). Using the -x option to increase the stepping limit from 0.128s to
600s has a drawback because a different method of controlling the clock has to be used. It disables the
kernel clock discipline and may have a negative impact on the clock accuracy. The -x option can be
added to the /etc/sysconfig/ntpd configuration file.
250
Chapter 15. Configuring NTP Using ntpd
The operation of ntpd is explained in more detail in the man page ntpd(8). The resources section lists
useful sources of information. See Section 15.20, “Additional Resources”.
An attacker on the network can attempt to disrupt a service by sending NT P packets with incorrect time
information. On systems using the public pool of NT P servers, this risk is mitigated by having more than
three NT P servers in the list of public NT P servers in /etc/ntp.conf. If only one time source is
compromised or spoofed, ntpd will ignore that source. You should conduct a risk assessment and
consider the impact of incorrect time on your applications and organization. If you have internal time
sources you should consider steps to protect the network over which the NT P packets are distributed. If
you conduct a risk assessment and conclude that the risk is acceptable, and the impact to your
applications minimal, then you can choose not to use authentication.
The broadcast and multicast modes require authentication by default. If you have decided to trust the
network then you can disable authentication by using disable auth directive in the ntp.conf file.
Alternatively, authentication needs to be configured by using SHA1 or MD5 symmetric keys, or by public
(asymmetric) key cryptography using the Autokey scheme. The Autokey scheme for asymmetric
cryptography is explained in the ntp_auth(8) man page and the generation of keys is explained in
ntp-keygen(8). To implement symmetric key cryptography, see Section 15.17.12, “Configuring
Symmetric Authentication Using a Key” for an explanation of the key option.
251
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
of Stratum 1 servers because NT P transmits information about pending leap seconds and applies them
automatically.
The configuration commands are explained briefly later in this chapter, see Section 15.17, “Configure
NTP”, and more verbosely in the ntp.conf(5) man page.
Here follows a brief explanation of the contents of the default configuration file:
The driftfile entry
A path to the drift file is specified, the default entry on Red Hat Enterprise Linux is:
driftfile /var/lib/ntp/drift
If you change this be certain that the directory is writable by ntpd. The file contains one value
used to adjust the system clock frequency after every system or service start. See
Understanding the Drift File for more information.
The nom odify options prevents any changes to the configuration. The notrap option
prevents ntpdc control message protocol traps. The nopeer option prevents a peer
association being formed. The noquery option prevents ntpq and ntpdc queries, but not time
queries, from being answered. The ntpq and ntpdc queries can be used in amplification
attacks (see CVE-2013-5211 for more details), do not remove the noquery option from the
restrict default command on publicly accessible systems.
Addresses within the range 127.0.0.0/8 range are sometimes required by various processes
or applications. As the "restrict default" line above prevents access to everything not explicitly
allowed, access to the standard loopback address for IPv4 and IPv6 is permitted by means of
the following lines:
Hosts on the local network are not permitted because of the "restrict default" line above. To
change this, for example to allow hosts from the 192.0.2.0/24 network to query the time and
statistics but nothing more, a line in the following format is required:
252
Chapter 15. Configuring NTP Using ntpd
To allow unrestricted access from a specific host, for example 192.0.2.250/24 , a line in the
following format is required:
restrict 192.0.2.250
Note
When the DHCP client program, dhclient, receives a list of NT P servers from the DHCP server, it
adds them to ntp.conf and restarts the service. To disable that feature, add PEERNT P=no to
/etc/sysconfig/network.
The -g option enables ntpd to ignore the offset limit of 1000s and attempt to synchronize the time even
if the offset is larger than 1000s, but only on system start. Without that option ntpd will exit if the time
offset is greater than 1000s. It will also exit after system start if the service is restarted and the offset is
greater than 1000s even with the -g option.
253
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
NT P is implemented by means of the daemon or service ntpd, which is contained within the ntp
package.
To obtain a brief status report from ntpd, issue the following command:
~]$ ntpstat
unsynchronised
time server re-starting
polling server every 64 s
~]$ ntpstat
synchronised to NTP server (10.5.26.10) at stratum 2
time correct to within 52 ms
polling server every 1024 s
Check if the firewall is configured to allow incoming NT P traffic for clients using the graphical Firewall
254
Chapter 15. Configuring NTP Using ntpd
Configuration tool.
To start the graphical firewall-config tool, press the Super key to enter the Activities Overview, type
firewall and then press Enter. The firewall-config tool appears. You will be prompted for your user
password.
To start the graphical firewall configuration tool using the command line, enter the following command as
root user:
~]# firewall-config
The Firewall Configuration window opens. Note, this command can be run as normal user but
you will then be prompted for the root password from time to time.
Look for the word “Connected” in the lower left corner. This indicates that the firewall-config tool is
connected to the user space daemon, firewalld.
Note
When making changes to the firewall settings in Runtim e Configuration mode, your
selection takes immediate effect when you set or clear the check box associated with the service.
You should keep this in mind when working on a system that may be in use by other users.
When making changes to the firewall settings in Perm anent Configuration mode, your
selection will only take effect when you reload the firewall or the system restarts. You can use the
reload icon below the File menu, or click the Options menu and select Reload Firewall.
Enter the port number 123 and select udp from the drop-down list.
The ntpdate service in Red Hat Enterprise Linux 7 is mostly useful only when used alone without
ntpd. With systemd, which starts services in parallel, enabling the ntpdate service will not ensure that
other services started after it will have correct time unless they specify an ordering dependency on on
tim e-sync.target, which is provided by the ntpdate service. The ntp-wait service (in the ntp-perl
subpackage) provides the tim e-sync target for the ntpd service. In order to ensure a service starts
255
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
with correct time, add After=tim e-sync.target to the service and enable one of the services which
provide the target (ntpdate, sntp, or ntp-wait if ntpd is enabled). Some services on Red Hat
Enterprise Linux 7 have the dependency included by default ( for example, dhcpd, dhcpd6, and
crond).
To check if the ntpdate service is enabled to run at system start, issue the following command:
To enable the service to run at system start, issue the following command as root:
restrict option
ignore — All packets will be ignored, including ntpq and ntpdc queries.
kod — a “Kiss-o'-death” packet is to be sent to reduce unwanted queries.
lim ited — do not respond to time service requests if the packet violates the rate limit default
values or those specified by the discard command. ntpq and ntpdc queries are not affected. For
more information on the discard command and the default values, see Section 15.17.2, “Configure
Rate Limiting Access to an NTP Service”.
lowpriotrap — traps set by matching hosts to be low priority.
256
Chapter 15. Configuring NTP Using ntpd
To configure rate limit access to not respond at all to a query, the respective restrict command has to
have the lim ited option. If ntpd should reply with a KoD packet, the restrict command needs to
have both lim ited and kod options.
The ntpq and ntpdc queries can be used in amplification attacks (see CVE-2013-5211 for more
details), do not remove the noquery option from the restrict default command on publicly
accessible systems.
average — specifies the minimum average packet spacing to be permitted, it accepts an argument
in log2 seconds. The default value is 3 (23 equates to 8 seconds).
m inim um — specifies the minimum packet spacing to be permitted, it accepts an argument in log2
seconds. The default value is 1 (21 equates to 2 seconds).
m onitor — specifies the discard probability for packets once the permitted rate limits have been
exceeded. The default value is 3000 seconds. This option is intended for servers that receive 1000 or
more requests per second.
discard average 4
257
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
peer address
where address is an IP unicast address or a DNS resolvable name. The address must only be that of a
system known to be a member of the same stratum. Peers should have at least one time source that is
different to each other. Peers are normally systems under the same administrative control.
server address
where address is an IP unicast address or a DNS resolvable name. The address of a remote reference
server or local reference clock from which packets are to be received.
The broadcast and multicast modes require authentication by default. See Section 15.6, “Authentication
Options for NTP”.
broadcast address
This command configures a system to act as an NT P broadcast server. The address used must be a
broadcast or a multicast address. Broadcast address implies the IPv4 address 255.255.255.255. By
default, routers do not pass broadcast messages. The multicast address can be an IPv4 Class D
address, or an IPv6 address. The IANA has assigned IPv4 multicast address 224 .0.1.1 and IPv6
address FF05::101 (site local) to NT P. Administratively scopedIPv4 multicast addresses can also be
used, as described in RFC 2365 Administratively Scoped IP Multicast.
manycastclient address
where address is an IP multicast address from which packets are to be received. The client will send a
request to the address and select the best servers from the responses and ignore other servers. NT P
communication then uses unicast associations, as if the discovered NT P servers were listed in
ntp.conf.
This command configures a system to act as an NT P client. Systems can be both client and server at the
258
Chapter 15. Configuring NTP Using ntpd
same time.
broadcastclient
Enables the receiving of broadcast messages. Requires authentication by default. See Section 15.6,
“Authentication Options for NTP”.
This command configures a system to act as an NT P client. Systems can be both client and server at the
same time.
manycastserver address
Enables the sending of multicast messages. Where address is the address to multicast to. This should
be used together with authentication to prevent service disruption.
This command configures a system to act as an NT P server. Systems can be both client and server at
the same time.
multicastclient address
Enables the receiving of multicast messages. Where address is the address to subscribe to. This should
be used together with authentication to prevent service disruption.
This command configures a system to act as an NT P client. Systems can be both client and server at the
same time.
To increase the average quality of time offset statistics, add the following option to the end of a server
command:
259
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
burst
At every poll interval, send a burst of eight packets instead of one, when the server is responding. For
use with the server command to improve the average quality of the time offset calculations.
iburst
At every poll interval, send a burst of eight packets instead of one. When the server is not responding,
packets are sent 16s apart. When the server responds, packets are sent every 2s. For use with the
server command to improve the time taken for initial synchronization. This is now a default option in the
configuration file.
key number
where number is in the range 1 to 65534 inclusive. This option enables the use of a message
authentication code (MAC) in packets. This option is for use with the peer, server, broadcast, and
m anycastclient commands.
Options to change the default poll interval, where the interval in seconds will be calculated by raising 2 to
the power of value, in other words, the interval is expressed in log2 seconds. The default m inpoll
value is 6, 26 equates to 64s. The default value for m axpoll is 10, which equates to 1024s. Allowed
values are in the range 3 to 17 inclusive, which equates to 8s to 36.4h respectively. These options are
for use with the peer or server. Setting a shorter m axpoll may improve clock accuracy.
prefer
260
Chapter 15. Configuring NTP Using ntpd
Use this server for synchronization in preference to other servers of similar statistical quality. This option
is for use with the peer or server commands.
ttl value
Specify the time-to-live value to be used in packets sent by broadcast servers and multicast NT P servers.
Specify the maximum time-to-live value to use for the “expanding ring search” by a manycast client. The
default value is 127.
version value
Specify the version of NT P set in created NT P packets. The value can be in the range 1 to 4 . The default
is 4 .
SYNC_HWCLOCK=yes
To update the hardware clock from the system clock, issue the following command as root:
When the system clock is being synchronized by ntpd, the kernel will in turn update the RTC every 11
minutes automatically.
~]$ cd /sys/devices/system/clocksource/clocksource0/
clocksource0]$ cat available_clocksource
kvm-clock tsc hpet acpi_pm
clocksource0]$ cat current_clocksource
kvm-clock
In the above example, the kernel is using kvm-clock. This was selected at boot time as this is a virtual
machine.
To override the default clock source, add a line similar to the following in grub.conf:
261
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
clocksource=tsc
http://www.eecis.udel.edu/~mills/ntp.html
Network Time Synchronization Research Project.
http://www.eecis.udel.edu/~mills/ntp/html/manyopt.html
Information on Automatic Server Discovery in NT Pv4 .
262
Chapter 16. Configuring PTP Using ptp4l
The linuxptp package includes the ptp4l and phc2sys programs for clock synchronization. The ptp4l
program implements the PT P boundary clock and ordinary clock. With hardware time stamping, it is used
to synchronize the PT P hardware clock to the master clock, and with software time stamping it
synchronizes the system clock to the master clock. The phc2sys program is needed only with hardware
time stamping, for synchronizing the system clock to the PT P hardware clock on the network interface
card (NIC).
263
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
With hardware PT P support, the NIC has its own on-board clock, which is used to time stamp the
received and transmitted PT P messages. It is this on-board clock that is synchronized to the PT P
264
Chapter 16. Configuring PTP Using ptp4l
master, and the computer's system clock is synchronized to the PT P hardware clock on the NIC. With
software PT P support, the system clock is used to time stamp the PT P messages and it is synchronized
to the PT P master directly. Hardware PT P support provides better accuracy since the NIC can time
stamp the PT P packets at the exact moment they are sent and received while software PT P support
requires additional processing of the PT P packets by the operating system.
For software time stamping support, the parameters list should include:
For hardware time stamping support, the parameters list should include:
265
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Do not run more than one service to set the system clock's time at the same time. If you intend to serve
PT P time using NT P, see Section 16.7, “Serving PTP Time with NTP”.
Where eth3 is the interface you wish to configure. Below is example output from ptp4l when the PT P
clock on the NIC is synchronized to a master:
The master offset value is the measured offset from the master in nanoseconds. The s0, s1, s2 strings
indicate the different clock servo states: s0 is unlocked, s1 is clock step and s2 is locked. Once the
servo is in the locked state (s2), the clock will not be stepped (only slowly adjusted) unless the
pi_offset_const option is set to a positive value in the configuration file (described in the ptp4 l(8)
man page). The adj value is the frequency adjustment of the clock in parts per billion (ppb). The path
delay value is the estimated delay of the synchronization messages sent from the master in
nanoseconds. Port 0 is a Unix domain socket used for local PT P management. Port 1 is the eth3
interface (based on the example above.) INITIALIZING, LISTENING, UNCALIBRATED and SLAVE are
some of possible port states which change on the INITIALIZE, RS_SLAVE,
MASTER_CLOCK_SELECTED events. In the last state change message, the port state changed from
UNCALIBRATED to SLAVE indicating successful synchronization with a PT P master clock.
When running as a service, options are specified in the /etc/sysconfig/ptp4 l file. More information
on the different ptp4l options and the configuration file settings can be found in the ptp4 l(8) man
page.
By default, messages are sent to /var/log/m essages. However, specifying the -m option enables
logging to standard output which can be useful for debugging purposes.
266
Chapter 16. Configuring PTP Using ptp4l
The P2P mechanism is preferred as it reacts to changes in the network topology faster, and
may be more accurate in measuring the delay, than other mechanisms. The P2P mechanism
can only be used in topologies where each port exchanges PTP messages with at most one
other P2P port. It must be supported and used by all hardware, including transparent clocks, on
the communication path.
-E
The -E selects the end-to-end (E2E) delay measurement mechanism. This is the default.
-A
The -A enables automatic selection of the delay measurement mechanism.
The automatic option starts ptp4l in E2E mode. It will change to P2P mode if a peer delay
request is received.
Note
All clocks on a single PT P communication path must use the same mechanism to measure the
delay. A warning will be printed when a peer delay request is received on a port using the E2E
mechanism. A warning will be printed when a E2E delay request is received on a port using the
P2P mechanism.
No configuration file is read by default, so it needs to be specified at runtime with the -f option. For
example:
A configuration file equivalent to the -i eth3 -m -S options shown above would look as follows:
267
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Setting the -b option to zero limits the boundary to the locally running ptp4l instance. A larger boundary
value will retrieve the information also from PT P nodes further from the local clock. The retrievable
information includes:
268
Chapter 16. Configuring PTP Using ptp4l
command as root:
The -w option waits for the running ptp4l application to synchronize the PT P clock and then retrieves the
TAI to UTC offset from ptp4l.
Normally, PT P operates in the International Atomic Time (TAI) timescale, while the system clock is kept
in Coordinated Universal Time (UTC). The current offset between the TAI and UTC timescales is 35
seconds. The offset changes when leap seconds are inserted or deleted, which typically happens every
few years. The -O option needs to be used to set this offset manually when the -w is not used, as
follows:
Once the phc2sys servo is in a locked state, the clock will not be stepped, unless the -S option is used.
This means that the phc2sys program should be started after the ptp4l program has synchronized the
PT P hardware clock. However, with -w, it is not necessary to start phc2sys after ptp4l as it will wait for it
to synchronize the clock.
When running as a service, options are specified in the /etc/sysconfig/phc2sys file. More
information on the different phc2sys options can be found in the phc2sys(8) man page.
Note that the examples in this section assume the command is run on a slave system or slave port.
269
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For ptp4l there is also a directive, sum m ary_interval, to reduce the output and print only statistics,
as normally it will print a message every second or so. For example, to reduce the output to every 1024
seconds, add the following line to the /etc/ptp4 l.conf file:
summary_interval 10
270
Chapter 16. Configuring PTP Using ptp4l
To reduce the output from the phc2sys, it can be called it with the -u option as follows:
Where summary-updates is the number of clock updates to include in summary statistics. An example
follows:
Note
When the DHCP client program, dhclient, receives a list of NT P servers from the DHCP server, it
adds them to ntp.conf and restarts the service. To disable that feature, add PEERNT P=no to
/etc/sysconfig/network.
271
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
NT P to PT P synchronization in the opposite direction is also possible. When ntpd is used to synchronize
the system clock, ptp4l can be configured with the priority1 option (or other clock options included in
the best master clock algorithm) to be the grandmaster clock and distribute the time from the system
clock via PT P:
With hardware time stamping, phc2sys needs to be used to synchronize the PT P hardware clock to the
system clock:
To prevent quick changes in the PT P clock's frequency, the synchronization to the system clock can be
loosened by using smaller P (proportional) and I (integral) constants of the PI servo:
272
Part V. Monitoring and Automation
273
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To list all processes that are currently running on the system including processes owned by other users,
type the following at a shell prompt:
ps ax
For each listed process, the ps ax command displays the process ID (PID), the terminal that is
associated with it (T T Y), the current status (ST AT ), the cumulated CPU time (T IME), and the name of
the executable file (COMMAND). For example:
~]$ ps ax
PID TTY STAT TIME COMMAND
1 ? Ss 0:01 /sbin/init
2 ? S 0:00 [kthreadd]
3 ? S 0:00 [migration/0]
4 ? S 0:00 [ksoftirqd/0]
5 ? S 0:00 [migration/0]
6 ? S 0:00 [watchdog/0]
[output truncated]
To display the owner alongside each process, use the following command:
ps aux
Apart from the information provided by the ps ax command, ps aux displays the effective username of
the process owner (USER), the percentage of the CPU (%CPU) and memory (%MEM) usage, the virtual
memory size in kilobytes (VSZ), the non-swapped physical memory size in kilobytes (RSS), and the time
or date the process was started. For instance:
~]$ ps aux
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.1 19404 832 ? Ss Mar02 0:01 /sbin/init
root 2 0.0 0.0 0 0 ? S Mar02 0:00 [kthreadd]
root 3 0.0 0.0 0 0 ? S Mar02 0:00 [migration/0]
root 4 0.0 0.0 0 0 ? S Mar02 0:00 [ksoftirqd/0]
root 5 0.0 0.0 0 0 ? S Mar02 0:00 [migration/0]
root 6 0.0 0.0 0 0 ? R Mar02 0:00 [watchdog/0]
[output truncated]
You can also use the ps command in a combination with grep to see if a particular process is running.
For example, to determine if Emacs is running, type:
274
Chapter 17. System Monitoring Tools
For a complete list of available command line options, refer to the ps(1) manual page.
top
For each listed process, the top command displays the process ID (PID), the effective username of the
process owner (USER), the priority (PR), the nice value (NI), the amount of virtual memory the process
uses (VIRT ), the amount of non-swapped physical memory the process uses (RES), the amount of
shared memory the process uses (SHR), the percentage of the CPU (%CPU) and memory (%MEM) usage,
the cumulated CPU time (T IME+), and the name of the executable file (COMMAND). For example:
~]$ top
top - 02:19:11 up 4 days, 10:37, 5 users, load average: 0.07, 0.13, 0.09
Tasks: 160 total, 1 running, 159 sleeping, 0 stopped, 0 zombie
Cpu(s): 10.7%us, 1.0%sy, 0.0%ni, 88.3%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 760752k total, 644360k used, 116392k free, 3988k buffers
Swap: 1540088k total, 76648k used, 1463440k free, 196832k cached
Table 17.1, “Interactive top commands” contains useful interactive commands that you can use with top.
For more information, refer to the top(1) manual page.
275
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Command Description
Enter, Space Immediately refreshes the display.
h, ? Displays a help screen.
k Kills a process. You are prompted for the process ID and the signal to send
to it.
n Changes the number of displayed processes. You are prompted to enter the
number.
u Sorts the list by user.
M Sorts the list by memory usage.
P Sorts the list by CPU usage.
q Terminates the utility and returns to the shell prompt.
To start the System Monitor tool, either select Applications → System Tools → System Monitor from
the panel, or type gnom e-system -m onitor at a shell prompt. Then click the Processes tab to view
the list of running processes.
276
Chapter 17. System Monitoring Tools
For each listed process, the System Monitor tool displays its name (Process Nam e), current status
(Status), percentage of the CPU usage (% CPU), nice value (Nice), process ID (ID), memory usage
(Mem ory), the channel the process is waiting in (Waiting Channel), and additional details about the
session (Session). To sort the information by a specific column in ascending order, click the name of
that column. Click the name of the column again to toggle the sort between ascending and descending
order.
By default, the System Monitor tool displays a list of processes that are owned by the current user.
Selecting various options from the View menu allows you to:
stop a process,
continue running a stopped process,
end a process,
kill a process,
change the priority of a selected process, and
edit the System Monitor preferences, such as the refresh interval for the list of processes, or what
information to show.
You can also end a process by selecting it from the list and clicking the End Process button.
free
The free command provides information about both the physical memory (Mem ) and swap space
(Swap). It displays the total amount of memory (total), as well as the amount of memory that is in use
(used), free (free), shared (shared), in kernel buffers (buffers), and cached (cached). For
example:
277
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
~]$ free
total used free shared buffers cached
Mem: 760752 661332 99420 0 6476 317200
-/+ buffers/cache: 337656 423096
Swap: 1540088 283652 1256436
By default, free displays the values in kilobytes. To display the values in megabytes, supply the -m
command line option:
free -m
For instance:
~]$ free -m
total used free shared buffers cached
Mem: 742 646 96 0 6 309
-/+ buffers/cache: 330 412
Swap: 1503 276 1227
For a complete list of available command line options, refer to the free(1) manual page.
To start the System Monitor tool, either select Applications → System Tools → System Monitor from
the panel, or type gnom e-system -m onitor at a shell prompt. Then click the Resources tab to view
the system's memory usage.
278
Chapter 17. System Monitoring Tools
In the Mem ory and Swap History section, the System Monitor tool displays a graphical
representation of the memory and swap usage history, as well as the total amount of the physical
memory (Mem ory) and swap space (Swap) and how much of it is in use.
To start the System Monitor tool, either select Applications → System Tools → System Monitor from
the panel, or type gnom e-system -m onitor at a shell prompt. Then click the Resources tab to view
the system's CPU usage.
279
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
In the CPU History section, the System Monitor tool displays a graphical representation of the CPU
usage history and shows the percentage of how much CPU is currently in use.
lsblk
For each listed block device, the lsblk command displays the device name (NAME), major and minor
device number (MAJ:MIN), if the device is removable (RM), what is its size (SIZE), if the device is read-
only (RO), what type is it (T YPE), and where the device is mounted (MOUNT POINT ). For example:
280
Chapter 17. System Monitoring Tools
~]$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sr0 11:0 1 1024M 0 rom
vda 252:0 0 20G 0 rom
|-vda1 252:1 0 500M 0 part /boot
`-vda2 252:2 0 19.5G 0 part
|-vg_kvm-lv_root (dm-0) 253:0 0 18G 0 lvm /
`-vg_kvm-lv_swap (dm-1) 253:1 0 1.5G 0 lvm [SWAP]
By default, lsblk lists block devices in a tree-like format. To display the information as an ordinary list,
add the -l command line option:
lsblk -l
For instance:
~]$ lsblk -l
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sr0 11:0 1 1024M 0 rom
vda 252:0 0 20G 0 rom
vda1 252:1 0 500M 0 part /boot
vda2 252:2 0 19.5G 0 part
vg_kvm-lv_root (dm-0) 253:0 0 18G 0 lvm /
vg_kvm-lv_swap (dm-1) 253:1 0 1.5G 0 lvm [SWAP]
For a complete list of available command line options, refer to the lsblk(8) manual page.
blkid
For each listed block device, the blkid command displays available attributes such as its universally
unique identifier (UUID), file system type (T YPE), or volume label (LABEL). For example:
~]# blkid
/dev/vda1: UUID="7fa9c421-0054-4555-b0ca-b470a97a3d84" TYPE="ext4"
/dev/vda2: UUID="7IvYzk-TnnK-oPjf-ipdD-cofz-DXaJ-gPdgBW" TYPE="LVM2_member"
/dev/mapper/vg_kvm-lv_root: UUID="a07b967c-71a0-4925-ab02-aebcad2ae824"
TYPE="ext4"
/dev/mapper/vg_kvm-lv_swap: UUID="d7ef54ca-9c41-4de4-ac1b-4193b0c1ddb6"
TYPE="swap"
By default, the lsblk command lists all available block devices. To display information about a particular
device only, specify the device name on the command line:
blkid device_name
281
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
You can also use the above command with the -p and -o udev command line options to obtain more
detailed information. Note that root privileges are required to run this command:
For example:
For a complete list of available command line options, refer to the blkid(8) manual page.
findmnt
For each listed file system, the findm nt command displays the target mount point (T ARGET ), source
device (SOURCE), file system type (FST YPE), and relevant mount options (OPT IONS). For example:
~]$ findmnt
TARGET SOURCE FSTYPE OPTIONS
/ /dev/mapper/vg_kvm-lv_root ext4 rw,relatime,sec
|-/proc /proc proc rw,relatime
| |-/proc/bus/usb /proc/bus/usb usbfs rw,relatime
| `-/proc/sys/fs/binfmt_misc binfmt_m rw,relatime
|-/sys /sys sysfs rw,relatime,sec
|-/selinux selinuxf rw,relatime
|-/dev udev devtmpfs rw,relatime,sec
| `-/dev udev devtmpfs rw,relatime,sec
| |-/dev/pts devpts devpts rw,relatime,sec
| `-/dev/shm tmpfs tmpfs rw,relatime,sec
|-/boot /dev/vda1 ext4 rw,relatime,sec
|-/var/lib/nfs/rpc_pipefs sunrpc rpc_pipe rw,relatime
|-/misc /etc/auto.misc autofs rw,relatime,fd=
`-/net -hosts autofs rw,relatime,fd=
[output truncated]
By default, findm nt lists file systems in a tree-like format. To display the information as an ordinary list,
add the -l command line option:
findmnt -l
For instance:
282
Chapter 17. System Monitoring Tools
~]$ findmnt -l
TARGET SOURCE FSTYPE OPTIONS
/proc /proc proc rw,relatime
/sys /sys sysfs rw,relatime,seclabe
/dev udev devtmpfs rw,relatime,seclabe
/dev/pts devpts devpts rw,relatime,seclabe
/dev/shm tmpfs tmpfs rw,relatime,seclabe
/ /dev/mapper/vg_kvm-lv_root ext4 rw,relatime,seclabe
/selinux selinuxf rw,relatime
/dev udev devtmpfs rw,relatime,seclabe
/proc/bus/usb /proc/bus/usb usbfs rw,relatime
/boot /dev/vda1 ext4 rw,relatime,seclabe
/proc/sys/fs/binfmt_misc binfmt_m rw,relatime
/var/lib/nfs/rpc_pipefs sunrpc rpc_pipe rw,relatime
/misc /etc/auto.misc autofs rw,relatime,fd=7,pg
/net -hosts autofs rw,relatime,fd=13,p
[output truncated]
You can also choose to list only file systems of a particular type. To do so, add the -t command line
option followed by a file system type:
findmnt -t type
For a complete list of available command line options, refer to the findmnt(8) manual page.
df
For each listed file system, the df command displays its name (Filesystem ), size (1K-blocks or
Size), how much space is used (Used), how much space is still available (Available), the percentage
of space usage (Use%), and where is the file system mounted (Mounted on). For example:
~]$ df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/vg_kvm-lv_root 18618236 4357360 13315112 25% /
tmpfs 380376 288 380088 1% /dev/shm
/dev/vda1 495844 77029 393215 17% /boot
By default, the df command shows the partition size in 1 kilobyte blocks and the amount of used and
available disk space in kilobytes. To view the information in megabytes and gigabytes, supply the -h
command line option, which causes df to display the values in a human-readable format:
df -h
283
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
For instance:
~]$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_kvm-lv_root 18G 4.2G 13G 25% /
tmpfs 372M 288K 372M 1% /dev/shm
/dev/vda1 485M 76M 384M 17% /boot
For a complete list of available command line options, refer to the df(1) manual page.
du
For example:
~]$ du
14972 ./Downloads
4 ./.gnome2
4 ./.mozilla/extensions
4 ./.mozilla/plugins
12 ./.mozilla
15004 .
By default, the du command displays the disk usage in kilobytes. To view the information in megabytes
and gigabytes, supply the -h command line option, which causes the utility to display the values in a
human-readable format:
du -h
For instance:
~]$ du -h
15M ./Downloads
4.0K ./.gnome2
4.0K ./.mozilla/extensions
4.0K ./.mozilla/plugins
12K ./.mozilla
15M .
At the end of the list, the du command always shows the grand total for the current directory. To display
only this information, supply the -s command line option:
du -sh
For example:
~]$ du -sh
15M .
For a complete list of available command line options, refer to the du(1) manual page.
284
Chapter 17. System Monitoring Tools
To start the System Monitor tool, either select Applications → System Tools → System Monitor from
the panel, or type gnom e-system -m onitor at a shell prompt. Then click the File System s tab to
view a list of file systems.
For each listed file system, the System Monitor tool displays the source device (Device), target mount
point (Directory), and file system type (T ype), as well as its size (T otal) and how much space is
free (Free), available (Available), and used (Used).
lspci
~]$ lspci
00:00.0 Host bridge: Intel Corporation 82X38/X48 Express DRAM Controller
00:01.0 PCI bridge: Intel Corporation 82X38/X48 Express Host-Primary PCI Express
Bridge
00:1a.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller
#4 (rev 02)
00:1a.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller
#5 (rev 02)
00:1a.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller
#6 (rev 02)
[output truncated]
285
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
You can also use the -v command line option to display more verbose output, or -vv for very verbose
output:
lspci -v|-vv
For instance, to determine the manufacturer, model, and memory size of a system's video card, type:
~]$ lspci -v
[output truncated]
01:00.0 VGA compatible controller: nVidia Corporation G84 [Quadro FX 370] (rev
a1) (prog-if 00 [VGA controller])
Subsystem: nVidia Corporation Device 0491
Physical Slot: 2
Flags: bus master, fast devsel, latency 0, IRQ 16
Memory at f2000000 (32-bit, non-prefetchable) [size=16M]
Memory at e0000000 (64-bit, prefetchable) [size=256M]
Memory at f0000000 (64-bit, non-prefetchable) [size=32M]
I/O ports at 1100 [size=128]
Expansion ROM at <unassigned> [disabled]
Capabilities: <access denied>
Kernel driver in use: nouveau
Kernel modules: nouveau, nvidiafb
[output truncated]
For a complete list of available command line options, refer to the lspci(8) manual page.
lsusb
~]$ lsusb
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
[output truncated]
Bus 001 Device 002: ID 0bda:0151 Realtek Semiconductor Corp. Mass Storage Device
(Multicard Reader)
Bus 008 Device 002: ID 03f0:2c24 Hewlett-Packard Logitech M-UAL-96 Mouse
Bus 008 Device 003: ID 04b3:3025 IBM Corp.
You can also use the -v command line option to display more verbose output:
lsusb -v
For instance:
286
Chapter 17. System Monitoring Tools
~]$ lsusb -v
[output truncated]
For a complete list of available command line options, refer to the lsusb(8) manual page.
lspcmcia
For example:
~]$ lspcmcia
Socket 0 Bridge: [yenta_cardbus] (bus ID: 0000:15:00.0)
You can also use the -v command line option to display more verbose information, or -vv to increase
the verbosity level even further:
lspcmcia -v|-vv
For instance:
~]$ lspcmcia -v
Socket 0 Bridge: [yenta_cardbus] (bus ID: 0000:15:00.0)
Configuration: state: on ready: unknown
For a complete list of available command line options, refer to the pccardctl(8) manual page.
287
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
lscpu
For example:
~]$ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Thread(s) per core: 1
Core(s) per socket: 4
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 23
Stepping: 7
CPU MHz: 1998.000
BogoMIPS: 4999.98
Virtualization: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 3072K
NUMA node0 CPU(s): 0-3
For a complete list of available command line options, refer to the lscpu(1) manual page.
This section provides information on configuring the Net-SNMP agent to securely provide performance
data over the network, retrieving the data using the SNMP protocol, and extending the SNMP agent to
provide custom performance metrics.
288
Chapter 17. System Monitoring Tools
Package Provides
net-snmp The SNMP Agent Daemon and documentation. This package is required for
exporting performance data.
net-snmp-libs The netsnm p library and the bundled management information bases
(MIBs). This package is required for exporting performance data.
net-snmp-utils SNMP clients such as snm pget and snm pwalk. This package is required
in order to query a system's performance data over SNMP.
net-snmp-perl The m ib2c utility and the NetSNMP Perl module.
net-snmp-python An SNMP client library for Python.
To install any of these packages, use the yum command in the following form:
For example, to install the SNMP Agent Daemon and SNMP clients used in the rest of this section, type
the following at a shell prompt:
Note that you must have superuser privileges (that is, you must be logged in as root) to run this
command. For more information on how to install new packages in Red Hat Enterprise Linux, refer to
Section 5.2.4, “Installing Packages”.
To configure the service to be automatically started at boot time, use the following command:
To disable starting the service at boot time, use the following command:
289
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
This command stops the service and starts it again in quick succession. To only reload the configuration
without stopping the service, run the following command instead:
This section focuses on two common tasks: setting system information and configuring authentication.
For more information about available configuration directives, refer to the snmpd.conf(5) manual page.
Additionally, there is a utility in the net-snmp package named snm pconf which can be used to
interactively generate a valid agent configuration.
Note that the net-snmp-utils package must be installed in order to use the snm pwalk utility described in
this section.
For any changes to the configuration file to take effect, force the snm pd service to re-read the
configuration by running the following command as root:
By default, the sysNam e object is set to the hostname. The sysLocation and sysContact objects
can be configured in the /etc/snm p/snm pd.conf file by changing the value of the syslocation and
syscontact directives, for example:
290
Chapter 17. System Monitoring Tools
After making changes to the configuration file, reload the configuration and test it by running the
snm pwalk command again:
… where community is the community string to use, source is an IP address or subnet, and OID is the
SNMP tree to provide access to. For example, the following directive provides read-only access to the
system tree to a client using the community string “redhat” on the local machine:
To test the configuration, use the snm pwalk command with the -v and -c options.
291
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The rwuser directive (or rouser when the -ro command line option is supplied) that net-snm p-
create-v3-user adds to /etc/snm p/snm pd.conf has a similar format to the rwcom m unity and
rocom m unity directives:
… where user is a username and OID is the SNMP tree to provide access to. By default, the Net-SNMP
Agent Daemon allows only authenticated requests (the auth option). The noauth option allows you to
permit unauthenticated requests, and the priv option enforces the use of encryption. The authpriv
option specifies that requests must be authenticated and replies should be encrypted.
For example, the following line grants the user “admin” read-write access to the entire tree:
To test the configuration, create a .snm p directory in your user's home directory and a configuration file
named snm p.conf in that directory (~/.snm p/snm p.conf) with the following lines:
defVersion 3
defSecurityLevel authPriv
defSecurityName admin
defPassphrase redhatsnmp
The snm pwalk command will now use these authentication settings when querying the agent:
This section provides an overview of OIDs related to performance tuning available over SNMP. It
292
Chapter 17. System Monitoring Tools
assumes that the net-snmp-utils package is installed and that the user is granted access to the SNMP
tree as described in Section 17.6.3.2, “Configuring Authentication”.
OID Description
HOST -RESOURCES-MIB::hrSystem Contains general system information such as
uptime, number of users, and number of running
processes.
HOST -RESOURCES-MIB::hrStorage Contains data on memory and file system usage.
HOST -RESOURCES-MIB::hrDevices Contains a listing of all processors, network
devices, and file systems.
HOST -RESOURCES-MIB::hrSWRun Contains a listing of all running processes.
HOST -RESOURCES-MIB::hrSWRunPerf Contains memory and CPU statistics on the
process table from HOST-RESOURCES-
MIB::hrSWRun.
HOST -RESOURCES-MIB::hrSWInstalled Contains a listing of the RPM database.
There are also a number of SNMP tables available in the Host Resources MIB which can be used to
retrieve a summary of the available information. The following example displays HOST -RESOURCES-
MIB::hrFST able:
For more information about HOST -RESOURCES-MIB, see the /usr/share/snm p/m ibs/HOST -
RESOURCES-MIB.txt file.
293
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
More memory information is available under the UCD-SNMP-MIB::m em ory OID, which provides similar
data to the free command:
Load averages are also available in the UCD SNMP MIB. The SNMP table UCD-SNMP-MIB::laT able
has a listing of the 1, 5, and 15 minute load averages:
294
Chapter 17. System Monitoring Tools
Index Device NRead NWritten Reads Writes LA1 LA5 LA15 NReadX NWrittenX
...
25 sda 216886272 139109376 16409 4894 ? ? ? 216886272 139109376
26 sda1 2455552 5120 613 2 ? ? ? 2455552 5120
27 sda2 1486848 0 332 0 ? ? ? 1486848 0
28 sda3 212321280 139104256 15312 4871 ? ? ? 212321280 139104256
295
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
SNMP table with an entry for each interface on the system, the configuration of the interface, and various
packet counters for the interface. The following example shows the first few columns of ifT able on a
system with two physical network interfaces:
Network traffic is available under the OIDs IF-MIB::ifOutOctets and IF-MIB::ifInOctets. The
following SNMP queries will retrieve network traffic for each of the interfaces on this system:
A number of the applications that ship with Red Hat Enterprise Linux extend the Net-SNMP Agent to
provide application metrics over SNMP. There are several ways to extend the agent for custom
applications as well. This section describes extending the agent with shell scripts and Perl plug-ins. It
assumes that the net-snmp-utils and net-snmp-perl packages are installed, and that the user is granted
access to the SNMP tree as described in Section 17.6.3.2, “Configuring Authentication”.
296
Chapter 17. System Monitoring Tools
The Net-SNMP Agent also provides a built-in mechanism for checking the process table via the
proc directive. Refer to the snmpd.conf(5) manual page for more information.
The exit code of the following shell script is the number of httpd processes running on the system at a
given point in time:
#!/bin/sh
exit $NUMPIDS
To make this script available over SNMP, copy the script to a location on the system path, set the
executable bit, and add an extend directive to the /etc/snm p/snm pd.conf file. The format of the
extend directive is the following:
… where name is an identifying string for the extension, prog is the program to run, and args are the
arguments to give the program. For instance, if the above shell script is copied to
/usr/local/bin/check_apache.sh, the following directive will add the script to the SNMP tree:
Note that the exit code (“8” in this example) is provided as an INTEGER type and any output is provided
as a STRING type. To expose multiple metrics as integers, supply different arguments to the script using
the extend directive. For example, the following shell script can be used to determine the number of
processes matching an arbitrary string, and will also output a text string giving the number of processes:
297
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
#!/bin/sh
PATTERN=$1
NUMPIDS=`pgrep $PATTERN | wc -l`
The following /etc/snm p/snm pd.conf directives will give both the number of httpd PIDs as well as
the number of snm pd PIDs when the above script is copied to /usr/local/bin/check_proc.sh:
The following example shows the output of an snm pwalk of the nsExtendObjects OID:
Integer exit codes are limited to a range of 0–255. For values that are likely to exceed 256, either
use the standard output of the script (which will be typed as a string) or a different method of
extending the agent.
This last example shows a query for the free memory of the system and the number of httpd
processes. This query could be used during a performance test to determine the impact of the number of
processes on memory pressure:
298
Chapter 17. System Monitoring Tools
exposing custom objects. The net-snmp-perl package provides the NetSNMP::agent Perl module that
is used to write embedded Perl plug-ins on Red Hat Enterprise Linux.
The NetSNMP::agent Perl module provides an agent object which is used to handle requests for a
part of the agent's OID tree. The agent object's constructor has options for running the agent as a sub-
agent of snm pd or a standalone agent. No arguments are necessary to create an embedded agent:
The agent object has a register method which is used to register a callback function with a particular
OID. The register function takes a name, OID, and pointer to the callback function. The following
example will register a callback function named hello_handler with the SNMP Agent which will
handle requests under the OID .1.3.6.1.4 .1.8072.9999.9999:
$agent->register("hello_world", ".1.3.6.1.4.1.8072.9999.9999",
\&hello_handler);
The handler function will be called with four parameters, HANDLER, REGISTRATION_INFO,
REQUEST_INFO, and REQUESTS. The REQUESTS parameter contains a list of requests in the current call
and should be iterated over and populated with data. The request objects in the list have get and set
methods which allow for manipulating the OID and value of the request. For example, the following call
will set the value of a request object to the string “hello world”:
The handler function should respond to two types of SNMP requests: the GET request and the
GETNEXT request. The type of request is determined by calling the getMode method on the
request_info object passed as the third parameter to the handler function. If the request is a GET
request, the caller will expect the handler to set the value of the request object, depending on the OID
of the request. If the request is a GETNEXT request, the caller will also expect the handler to set the OID
of the request to the next available OID in the tree. This is illustrated in the following code example:
299
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
my $request;
my $string_value = "hello world";
my $integer_value = "8675309";
When getMode returns MODE_GET , the handler analyzes the value of the getOID call on the request
object. The value of the request is set to either string_value if the OID ends in “.1.0”, or set to
integer_value if the OID ends in “.1.1”. If the getMode returns MODE_GET NEXT , the handler
determines whether the OID of the request is “.1.0”, and then sets the OID and value for “.1.1”. If the
request is higher on the tree than “.1.0”, the OID and value for “.1.0” is set. This in effect returns the
“next” value in the tree so that a program like snm pwalk can traverse the tree without prior knowledge
of the structure.
The type of the variable is set using constants from NetSNMP::ASN. See the perldoc for
NetSNMP::ASN for a full list of available constants.
The entire code listing for this example Perl plug-in is as follows:
300
Chapter 17. System Monitoring Tools
#!/usr/bin/perl
sub hello_handler {
my ($handler, $registration_info, $request_info, $requests) = @_;
my $request;
my $string_value = "hello world";
my $integer_value = "8675309";
To test the plug-in, copy the above program to /usr/share/snm p/hello_world.pl and add the
following line to the /etc/snm p/snm pd.conf configuration file:
perl do "/usr/share/snmp/hello_world.pl"
The SNMP Agent Daemon will need to be restarted to load the new Perl plug-in. Once it has been
restarted, an snm pwalk should return the new data:
The snm pget should also be used to exercise the other mode of the handler:
301
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
302
Chapter 18. OpenLMI
1. System management agents — these agents are installed on a managed system and implement
an object model that is presented to a standard object broker. The initial agents implemented in
OpenLMI include storage configuration and network configuration, but later work will address
additional elements of system management. The system management agents are commonly
referred to as Common Information Model providers or CIM providers.
2. A standard object broker — the object broker manages system management agents and provides
an interface to them. The standard object broker is also known as a CIM Object Monitor or
CIMOM.
3. Client applications and scripts — the client applications and scripts call the system management
agents through the standard object broker.
The OpenLMI project complements existing management initiatives by providing a low-level interface
that can be used by scripts or system management consoles. Interfaces distributed with OpenLMI
include C, C++, Python, Java, and an interactive command line client, and all of them offer the same full
access to the capabilities implemented in each agent. This ensures that you always have access to
exactly the same capabilities no matter which programming interface you decide to use.
OpenLMI provides a standard interface for configuration, management, and monitoring of your local
and remote systems.
It allows you to configure, manage, and monitor production servers running on both physical and
virtual machines.
It is distributed with a collection of CIM providers that allow you to configure, manage, and monitor
storage devices and complex networks.
It allows you to call system management functions from C, C++, Python, and Java programs, and is
distributed with a command line interface.
It is free software based on open industry standards.
303
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
1. Install the tog-pegasus package by typing the following at a shell prompt as root:
This command installs the OpenPegasus CIMOM and all its dependencies to the system and
creates a user account for the pegasus user.
2. Install required CIM providers by running the following command as root:
This command installs the CIM providers for storage, network, service, account, and power
management. For a complete list of CIM providers distributed with Red Hat Enterprise Linux 7, see
Table 18.1, “Available CIM Providers”.
3. Edit the /etc/Pegasus/access.conf configuration file to customize the list of users that are
allowed to connect to the OpenPegasus CIMOM. By default, only the pegasus user is allowed to
access the CIMOM both remotely and locally. To activate this user account, run the following
command as root to set the user's password:
passwd pegasus
4. Start the OpenPegasus CIMOM by activating the tog-pegasus.service unit. To activate the
tog-pegasus.service unit in the current session, type the following at a shell prompt as root:
304
Chapter 18. OpenLMI
To configure the tog-pegasus.service unit to start automatically at boot time, type as root:
5. If you intend to interact with the managed system from a remote machine, enable TCP
communication on port 5989 (wbem -https). To open this port in the current session, run the
following command as root:
You can now connect to the managed system and interact with it by using the OpenLMI client tools as
described in Section 18.4, “Using LMIShell”. If you intend to perform OpenLMI operations directly on the
managed system, also complete the steps described in Section 18.2.2, “Installing OpenLMI on a Client
System”.
1. Install the openlmi-tools package by typing the following at a shell prompt as root:
This command installs LMIShell, an interactive client and interpreter for accessing CIM objects
provided by OpenPegasus, and all its dependencies to the system.
2. Configure SSL certificates for OpenPegasus as described in Section 18.3, “Configuring SSL
Certificates for OpenPegasus”.
You can now use the LMIShell client to interact with the managed system as described in Section 18.4,
“Using LMIShell”.
Configuring the OpenPegasus CIMOM to use HTTPS for communication is necessary to ensure secure
authentication. A Secure Sockets Layer (SSL) or Transport Layer Security (TLS) certificate is required on
the managed system to establish an encrypted channel.
305
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Self-signed certificates require less infrastructure to use, but are more difficult to both deploy to
clients and manage securely.
Authority-signed certificates are easier to deploy to clients once they are set up, but may require a
greater initial investment.
The default certificate and trust store locations on the file system are listed in Table 18.2, “Certificate and
Trust Store Locations”.
Important
If you modify any of the files mentioned in Table 18.2, “Certificate and Trust Store Locations”,
restart the tog-pegasus service to make sure it recognizes the new certificates. To restart the
service, type the following at a shell prompt as root:
For more information on how to manage system services in Red Hat Enterprise Linux 7, see
Chapter 7, Managing Services with systemd.
Important
The automatically generated self-signed certificates are valid by default for 10 years, but they
have no automatic-renewal capability. Any modification to these certificates will require manually
creating new certificates following guidelines provided by the OpenSSL or Mozilla NSS
documentation on the subject.
To configure client systems to trust the self-signed certificate, complete the following steps:
306
Chapter 18. OpenLMI
Replace hostname with the host name of the managed system. Note that this command only
works if the sshd service is running on the managed system and is configured to allow the root
user to log in to the system over the SSH protocol. For more information on how to install and
configure the sshd service and use the scp command to transfer files over the SSH protocol, see
Chapter 8, OpenSSH.
2. Verify the integrity of the certificate on the client system by comparing its checksum with the
checksum of the original file. To calculate the checksum of the /etc/Pegasus/client.pem file
on the managed system, run the following command as root on that system:
sha1sum /etc/Pegasus/client.pem
sha1sum /etc/pki/ca-trust/source/anchors/pegasus-hostname.pem
update-ca-trust extract
It is necessary to register the managed system to Identity Management; for client systems the
registration is optional.
1. Install the ipa-client package and register the system to Identity management as described in the
Red Hat Enterprise Linux 7 Linux Domain Identity Management Guide.
2. Copy the Identity Management signing certificate to the trusted store by typing the following
command as root:
cp /etc/ipa/ca.crt /etc/pki/ca-trust/source/anchors/ipa.crt
307
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
update-ca-trust extract
4. Register Pegasus as a service in the Identity Management domain by running the following
command as a privileged domain user:
To register the client system and update the trust store, follow the steps below.
1. Install the ipa-client package and register the system to Identity management as described in the
Red Hat Enterprise Linux 7 Linux Domain Identity Management Guide.
2. Copy the Identity Management signing certificate to the trusted store by typing the following
command as root: root:
cp /etc/ipa/ca.crt /etc/pki/ca-trust/source/anchors/ipa.crt
update-ca-trust extract
If the client system is not meant to be registered in Identity Managment, complete the following steps to
update the trust store.
1. Copy the /etc/ipa/ca.crt file securly from any other system joined to the same Identity
Management domain to the trusted store /etc/pki/ca-trust/source/anchors/ directory as
root.
2. Update the trust store by running the following command as root:
update-ca-trust extract
308
Chapter 18. OpenLMI
It is necessary to ensure that all of the clients trust the certificate of the authority that will be signing the
managed system certificates:
In case of a certificate authority trusted by default, it is not necessary to perform any particular steps
to accomplish this.
If the certificate authority is not trusted by default, the certificate has to be imported both on the client
and managed systems.
1. Copy the certificate to the trusted store by typing the following command as root:
cp /path/to/ca.crt /etc/pki/ca-trust/source/anchors/ca.crt
update-ca-trust extract
1. Create an SSL configuration file, which will store information about the certificate. The
/etc/Pegasus/ssl.cnf file should be modified similarly to the following example:
[ req ]
distinguished_name = req_distinguished_name
prompt = no
[ req_distinguished_name ]
C = US
ST = Massachusetts
L = Westford
O = Fedora
OU = Fedora OpenLMI
CN = hostname
Replace hostname with the fully qualified domain name of the managed system.
2. Generate a private key on the managed system by using the following command as root:
4. Send the /etc/Pegasus/server.csr file to the certificate authority for signing. The detailed
procedure of submitting the file depends on the particular certificate authority.
5. When the signed certificate is received from the certificate authority, save it as
/etc/Pegasus/server.pem .
6. Copy the certificate of the trusted authority to the Pegasus trust store to make sure that Pegasus is
capable of trusting its own certificate by running as root:
cp /path/to/ca.crt /etc/Pegasus/client.pem
After accomplishing all the described steps, the clients that trust the signing authority are able to
successfully communicate with the managed server's CIMOM.
309
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Important
Unlike the Identity Management solution, if the certificate expires and needs to be renewed, all of
the described manual steps have to be carried out again. It is recommended to renew the
certificates before they expire.
lmishell
By default, when LMIShell attempts to establish a connection with a CIMOM, it validates the server-side
certificate against the Certification Authorities trust store. To disable this validation, run the lm ishell
command with the --noverify or -n command line option:
lmishell --noverify
Browsing History
By default, LMIShell stores all commands you type at the interactive prompt in the
~/.lm ishell_history file. This allows you to browse the command history and re-use already
entered lines in interactive mode without the need to type them at the prompt again. To move backward
in the command history, press the Up Arrow key or the Ctrl+p key combination. To move forward in
the command history, press the Down Arrow key or the Ctrl+n key combination.
LMIShell also supports an incremental reverse search. To look for a particular line in the command
history, press Ctrl+r and start typing any part of the command. For example:
clear_history()
310
Chapter 18. OpenLMI
You can configure the number of lines that are stored in the command history by changing the value of
the history_length option in the ~/.lm ishellrc configuration file. In addition, you can change the
location of the history file by changing the value of the history_file option in this configuration file.
For example, to set the location of the history file to ~/.lm ishell_history and configure LMIShell to
store the maximum of 1000 lines in it, add the following lines to the ~/.lm ishellrc file:
history_file = "~/.lmishell_history"
history_length = 1000
Handling Exceptions
By default, the LMIShell interpreter handles all exceptions and uses return values. To disable this
behavior in order to handle all exceptions in the code, use the use_exceptions() function as follows:
use_exceptions()
use_exception(False)
You can permanently disable the exception handling by changing the value of the use_exceptions
option in the ~/.lm ishellrc configuration file to T rue:
use_exceptions = True
object_name.clear_cache()
To disable the temporary cache for a particular connection object, use the use_cache() method as
follows:
object_name.use_cache(False)
object_name.use_cache(True)
You can permanently disable the temporary cache for connection objects by changing the value of the
use_cache option in the ~/.lm ishellrc configuration file to False:
use_cache = False
Exiting LMIShell
To terminate the LMIShell interpreter and return to the shell prompt, press the Ctrl+d key combination
or issue the quit() function as follows:
311
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
> quit()
~]$
lmishell file_name
Replace file_name with the name of the script. To inspect an LMIShell script after its execution, also
specify the --interact or -i command line option:
Replace host_name with the host name of the managed system, user_name with the name of a user
that is allowed to connect to the OpenPegasus CIMOM running on that system, and password with the
user's password. If the password is omitted, LMIShell prompts the user to enter it. The function returns
an LMIConnection object.
To connect to the OpenPegasus CIMOM running on server.exam ple.com as user pegasus, type
the following at the interactive prompt:
To access CIM objects provided by a local CIMOM, create a connection object by using the connect()
function as follows:
connect(host_name)
312
Chapter 18. OpenLMI
Replace host_name with localhost, 127.0.0.1, or ::1. The function returns an LMIConnection
object or None.
To connect to the OpenPegasus CIMOM running on localhost as the root user, type the following
at the interactive prompt:
> c = connect("localhost")
>
To verify that a connection to a CIMOM has been established successfully, use the isinstance()
function as follows:
isinstance(object_name, LMIConnection)
Replace object_name with the name of the connection object. This function returns T rue if
object_name is an LMIConnection object, or False otherwise.
To verify that the c variable created in Example 18.1, “Connecting to a Remote CIMOM” contains an
LMIConnection object, type the following at the interactive prompt:
> c is None
False
>
313
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
object_name.print_namespaces()
Replace object_name with the name of the object to inspect. This method prints available namespaces
to standard output.
To get a list of available namespaces, access the object attribute nam espaces:
object_name.namespaces
To inspect the root namespace object of the c connection object created in Example 18.1,
“Connecting to a Remote CIMOM” and list all available namespaces, type the following at the
interactive prompt:
> c.root.print_namespaces()
cimv2
interop
PG_InterOp
PG_Internal
>
object_name.namespace_name
Replace object_name with the name of the object to inspect and namespace_name with the name of the
namespace to access. This returns an LMINam espace object.
To access the cim v2 namespace of the c connection object created in Example 18.1, “Connecting to
a Remote CIMOM” and assign it to a variable named ns, type the following at the interactive prompt:
> ns = c.root.cimv2
>
314
Chapter 18. OpenLMI
namespace_object.print_classes()
Replace namespace_object with the namespace object to inspect. This method prints available classes
to standard output.
namespace_object.classes()
To inspect the ns namespace object created in Example 18.5, “Accessing Namespace Objects” and
list all available classes, type the following at the interactive prompt:
> ns.print_classes()
CIM_CollectionInSystem
CIM_ConcreteIdentity
CIM_ControlledBy
CIM_DeviceSAPImplementation
CIM_MemberOfStatusCollection
...
>
namespace_object.class_name
Replace namespace_object with the name of the namespace object to inspect and class_name with
the name of the class to access.
315
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
class_object.classname
Replace class_object with the name of the class object to inspect. This returns a string representation
of the object name.
To get information about the namespace a class object belongs to, use:
class_object.namespace
class_object.doc()
To inspect the cls class object created in Example 18.7, “Accessing Class Objects” and display its
name and corresponding namespace, type the following at the interactive prompt:
> cls.classname
'LMI_IPNetworkConnection'
> cls.namespace
'root/cimv2'
>
> cls.doc()
Class: LMI_IPNetworkConnection
SuperClass: CIM_IPNetworkConnection
[qualifier] string UMLPackagePath: 'CIM::Network::IP'
316
Chapter 18. OpenLMI
class_object.print_methods()
Replace class_object with the name of the class object to inspect. This method prints available
methods to standard output.
class_object.methods()
To inspect the cls class object created in Example 18.7, “Accessing Class Objects” and list all
available methods, type the following at the interactive prompt:
> cls.print_methods()
RequestStateChange
>
class_object.print_properties()
Replace class_object with the name of the class object to inspect. This method prints available
properties to standard output.
class_object.properties()
317
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To inspect the cls class object created in Example 18.7, “Accessing Class Objects” and list all
available properties, type the following at the interactive prompt:
> cls.print_properties()
RequestedState
HealthState
StatusDescriptions
TransitioningToState
Generation
...
>
To list all available ValueMap properties of a particular class object, use the
print_valuem ap_properties() method as follows:
class_object.print_valuemap_properties()
Replace class_object with the name of the class object to inspect. This method prints available
ValueMap properties to standard output:
To get a list of available ValueMap properties, use the valuem ap_properties() method:
class_object.valuemap_properties()
318
Chapter 18. OpenLMI
To inspect the cls class object created in Example 18.7, “Accessing Class Objects” and list all
available ValueMap properties, type the following at the interactive prompt:
> cls.print_valuemap_properties()
RequestedState
HealthState
TransitioningToState
DetailedStatus
OperationalStatus
...
>
class_object.valuemap_propertyValues
To list all available constant values, use the print_values() method as follows:
class_object.valuemap_propertyValues.print_values()
This method prints available named constant values to standard output. You can also get a list of
available constant values by using the values() method:
class_object.valuemap_propertyValues.values()
319
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
> cls.RequestedStateValues.print_values()
Reset
NoChange
NotApplicable
Quiesce
Unknown
...
>
class_object.valuemap_propertyValues.constant_value_name
Replace constant_value_name with the name of the constant value. Alternatively, you can use the
value() method as follows:
class_object.valuemap_propertyValues.value("constant_value_name")
To determine the name of a particular constant value, use the value_nam e() method:
class_object.valuemap_propertyValues.value_name("constant_value")
320
Chapter 18. OpenLMI
Example 18.12, “Accessing ValueMap Properties” shows that the RequestedState property
provides a constant value named Reset. To access this named constant value, type the following at
the interactive prompt:
> cls.RequestedStateValues.Reset
11
> cls.RequestedStateValues.value("Reset")
11
>
> cls.RequestedStateValues.value_name(11)
u'Reset'
>
class_object.fetch()
Replace class_object with the name of the class object. Note that methods that require access to a
CIMClass object fetch it automatically.
Accessing Instances
To get a list of all available instances of a particular class object, use the instances() method as
follows:
class_object.instances()
Replace class_object with the name of the class object to inspect. This method returns a list of
LMIInstance objects.
To access the first instance of a class object, use the first_instance() method:
class_object.first_instance()
In addition to listing all instances or returning the first one, both instances() and first_instance()
support an optional argument to allow you to filter the results:
321
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
class_object.instances(criteria)
class_object.first_instance(criteria)
Replace criteria with a dictionary consisting of key-value pairs, where keys represent instance
properties and values represent required values of these properties.
To find the first instance of the cls class object created in Example 18.7, “Accessing Class Objects”
that has the Elem entNam e property equal to eth0 and assign it to a variable named device, type
the following at the interactive prompt:
Examining Instances
All instance objects store information about their class name and the namespace they belong to, as well
as detailed documentation about their properties and values. In addition, instance objects allow you to
retrieve a unique identification object.
To get the class name of a particular instance object, use the following syntax:
instance_object.classname
Replace instance_object with the name of the instance object to inspect. This returns a string
representation of the class name.
To get information about the namespace an instance object belongs to, use:
instance_object.namespace
instance_object.path
instance_object.doc()
322
Chapter 18. OpenLMI
To inspect the device instance object created in Example 18.14, “Accessing Instances” and display
its class name and the corresponding namespace, type the following at the interactive prompt:
> device.classname
u'LMI_IPNetworkConnection'
> device.namespace
'root/cimv2'
>
> device.doc()
Instance of LMI_IPNetworkConnection
[property] uint16 RequestedState = '12'
class_object.create_instance(properties)
Replace class_object with the name of the class object and properties with a dictionary that consists
of key-value pairs, where keys represent instance properties and values represent property values. This
method returns an LMIInstance object.
323
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The LMI_Group class represents system groups and the LMI_Account class represents user
accounts on the managed system. To use the ns namespace object created in Example 18.5,
“Accessing Namespace Objects”, create instances of these two classes for the system group named
pegasus and the user named lm ishell-user, and assign them to variables named group and
user, type the following at the interactive prompt:
To get an instance of the LMI_Identity class for the lm ishell-user user, type:
The LMI_Mem berOfGroup class represents system group membership. To use the
LMI_Mem berOfGroup class to add the lm ishell-user to the pegasus group, create a new
instance of this class as follows:
> ns.LMI_MemberOfGroup.create_instance({
... "Member" : identity.path,
... "Collection" : group.path})
LMIInstance(classname="LMI_MemberOfGroup", ...)
>
instance_object.delete()
Replace instance_object with the name of the instance object to delete. This method returns a
boolean. Note that after deleting an instance, its properties and methods become inaccessible.
The LMI_Account class represents user accounts on the managed system. To use the ns
namespace object created in Example 18.5, “Accessing Namespace Objects”, create an instance of
the LMI_Account class for the user named lm ishell-user, and assign it to a variable named
user, type the following at the interactive prompt:
To delete this instance and remove the lm ishell-user from the system, type:
> user.delete()
True
>
324
Chapter 18. OpenLMI
instance_object.print_properties()
Replace instance_object with the name of the instance object to inspect. This method prints available
properties to standard output.
instance_object.properties()
To inspect the device instance object created in Example 18.14, “Accessing Instances” and list all
available properties, type the following at the interactive prompt:
> device.print_properties()
RequestedState
HealthState
StatusDescriptions
TransitioningToState
Generation
...
>
To get the current value of a particular property, use the following syntax:
instance_object.property_name
instance_object.property_name = value
Replace value with the new value of the property. Note that in order to propagate the change to the
CIMOM, you must also execute the push() method:
instance_object.push()
This method returns a three-item tuple consisting of a return value, return value parameters, and an
325
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
error string.
To inspect the device instance object created in Example 18.14, “Accessing Instances” and display
the value of the property named System Nam e, type the following at the interactive prompt:
> device.SystemName
u'server.example.com'
>
instance_object.print_methods()
Replace instance_object with the name of the instance object to inspect. This method prints available
methods to standard output.
instance_object.methods()
To inspect the device instance object created in Example 18.14, “Accessing Instances” and list all
available methods, type the following at the interactive prompt:
> device.print_methods()
RequestStateChange
>
instance_object.method_name(
parameter=value,
...)
Replace instance_object with the name of the instance object to use, method_name with the name of
the method to call, parameter with the name of the parameter to set, and value with the value of this
parameter. Methods return a three-item tuple consisting of a return value, return value parameters, and
an error string.
326
Chapter 18. OpenLMI
Important
The PG_Com puterSystem class represents the system. To create an instance of this class by using
the ns namespace object created in Example 18.5, “Accessing Namespace Objects” and assign it to a
variable named sys, type the following at the interactive prompt:
The LMI_AccountManagem entService class implements methods that allow you to manage
users and groups in the system. To create an instance of this class and assign it to a variable named
acc, type:
To create a new user named lm ishell-user in the system, use the CreateAccount() method
as follows:
LMIShell support synchronous method calls: when you use a synchronous method, LMIShell waits for
the corresponding Job object to change its state to “finished” and then returns the return parameters of
this job. LMIShell is able to perform a synchronous method call if the given method returns an object of
one of the following classes:
LMI_StorageJob
LMI_SoftwareInstallationJob
LMI_NetworkJob
LMIShell first tries to use indications as the waiting method. If it fails, it uses a polling method instead.
instance_object.Syncmethod_name(
parameter=value,
...)
Replace instance_object with the name of the instance object to use, method_name with the name of
the method to call, parameter with the name of the parameter to set, and value with the value of this
parameter. All synchronous methods have the Sync prefix in their name and return a three-item tuple
327
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
consisting of the job's return value, job's return value parameters, and job's error string.
You can also force LMIShell to use only polling method. To do so, specify the PreferPolling
parameter as follows:
instance_object.Syncmethod_name(
PreferPolling=True
parameter=value,
...)
instance_object.method_name.print_valuemap_parameters()
Replace instance_object with the name of the instance object and method_name with the name of the
method to inspect. This method prints available ValueMap parameters to standard output.
To get a list of available ValueMap parameters, use the valuem ap_param eters() method:
instance_object.method_name.valuemap_parameters()
To inspect the acc instance object created in Example 18.21, “Using Methods” and list all available
ValueMap parameters of the CreateAccount() method, type the following at the interactive prompt:
> acc.CreateAccount.print_valuemap_parameters()
CreateAccount
>
instance_object.method_name.valuemap_parameterValues
To list all available constant values, use the print_values() method as follows:
328
Chapter 18. OpenLMI
This method prints available named constant values to standard output. You can also get a list of
available constant values by using the values() method:
instance_object.method_name.valuemap_parameterValues.values()
> acc.CreateAccount.CreateAccountValues.print_values()
Operationunsupported
Failed
Unabletosetpasswordusercreated
Unabletocreatehomedirectoryusercreatedandpasswordset
Operationcompletedsuccessfully
>
instance_object.method_name.valuemap_parameterValues.constant_value_name
Replace constant_value_name with the name of the constant value. Alternatively, you can use the
value() method as follows:
instance_object.method_name.valuemap_parameterValues.value("constant_value_name"
)
To determine the name of a particular constant value, use the value_nam e() method:
instance_object.method_name.valuemap_parameterValues.value_name("constant_value"
)
329
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Example 18.23, “Accessing ValueMap Parameters” shows that the CreateAccount ValueMap
parameter provides a constant value named Failed. To access this named constant value, type the
following at the interactive prompt:
> acc.CreateAccount.CreateAccountValues.Failed
2
> acc.CreateAccount.CreateAccountValues.value("Failed")
2
>
> acc.CreateAccount.CreateAccountValues.value_name(2)
u'Failed'
>
To update the properties and methods of a particular instance object, use the refresh() method as
follows:
instance_object.refresh()
Replace instance_object with the name of the object to refresh. This method returns a three-item
tuple consisting of a return value, return value parameter, and an error string.
To update the properties and methods of the device instance object created in Example 18.14,
“Accessing Instances”, type the following at the interactive prompt:
> device.refresh()
LMIReturnValue(rval=True, rparams=NocaseDict({}), errorstr='')
>
instance_object.tomof()
Replace instance_object with the name of the instance object to inspect. This method prints the MOF
representation of the object to standard output.
330
Chapter 18. OpenLMI
To display the MOF representation of the device instance object created in Example 18.14,
“Accessing Instances”, type the following at the interactive prompt:
> device.tomof()
instance of LMI_IPNetworkConnection {
RequestedState = 12;
HealthState = NULL;
StatusDescriptions = NULL;
TransitioningToState = 12;
...
class_object.instance_names()
Replace class_object with the name of the class object to inspect. This method returns a list of
LMIInstanceNam e objects.
To access the first instance name object of a class object, use the first_instance_nam e() method:
class_object.first_instance_name()
In addition to listing all instance name objects or returning the first one, both instance_nam es() and
first_instance_nam e() support an optional argument to allow you to filter the results:
class_object.instance_names(criteria)
class_object.first_instance_name(criteria)
Replace criteria with a dictionary consisting of key-value pairs, where keys represent key properties
and values represent required values of these key properties.
331
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To find the first instance name of the cls class object created in Example 18.7, “Accessing Class
Objects” that has the Nam e key property equal to eth0 and assign it to a variable named
device_nam e, type the following at the interactive prompt:
To get the class name of a particular instance name object, use the following syntax:
instance_name_object.classname
Replace instance_name_object with the name of the instance name object to inspect. This returns a
string representation of the class name.
To get information about the namespace an instance name object belongs to, use:
instance_name_object.namespace
To inspect the device_nam e instance name object created in Example 18.27, “Accessing Instance
Names” and display its class name and the corresponding namespace, type the following at the
interactive prompt:
> device_name.classname
u'LMI_IPNetworkConnection'
> device_name.namespace
'root/cimv2'
>
To create a new instance name of a class object, use the new_instance_nam e() method as follows:
class_object.new_instance_name(key_properties)
Replace class_object with the name of the class object and key_properties with a dictionary that
consists of key-value pairs, where keys represent key properties and values represent key property
values. This method returns an LMIInstanceNam e object.
332
Chapter 18. OpenLMI
The LMI_Account class represents user accounts on the managed system. To use the ns
namespace object created in Example 18.5, “Accessing Namespace Objects” and create a new
instance name of the LMI_Account class representing the lm ishell-user user on the managed
system, type the following at the interactive prompt:
instance_name_object.print_key_properties()
Replace instance_name_object with the name of the instance name object to inspect. This method
prints available key properties to standard output.
instance_name_object.key_properties()
To inspect the device_nam e instance name object created in Example 18.27, “Accessing Instance
Names” and list all available key properties, type the following at the interactive prompt:
> device_name.print_key_properties()
CreationClassName
SystemName
Name
SystemCreationClassName
>
To assign a list of these key properties to a variable named device_nam e_properties, type:
To get the current value of a particular key property, use the following syntax:
instance_name_object.key_property_name
333
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To inspect the device_nam e instance name object created in Example 18.27, “Accessing Instance
Names” and display the value of the key property named System Nam e, type the following at the
interactive prompt:
> device_name.SystemName
u'server.example.com'
>
instance_name_object.to_instance()
Replace instance_name_object with the name of the instance name object to convert. This method
returns an LMIInstance object.
To convert the device_nam e instance name object created in Example 18.27, “Accessing Instance
Names” to an instance object and assign it to a variable named device, type the following at the
interactive prompt:
instance_object.associators(
AssocClass=class_name,
ResultClass=class_name,
ResultRole=role,
IncludeQualifiers=include_qualifiers,
IncludeClassOrigin=include_class_origin,
PropertyList=property_list)
To access the first object associated with a particular instance object, use the first_associator()
method:
334
Chapter 18. OpenLMI
instance_object.first_associator(
AssocClass=class_name,
ResultClass=class_name,
ResultRole=role,
IncludeQualifiers=include_qualifiers,
IncludeClassOrigin=include_class_origin,
PropertyList=property_list)
Replace instance_object with the name of the instance object to inspect. You can filter the results by
specifying the following parameters:
AssocClass — Each returned object must be associated with the source object through an instance
of this class or one of its subclasses. The default value is None.
ResultClass — Each returned object must be either an instance of this class or one of its
subclasses, or it must be this class or one of its subclasses. The default value is None.
Role — Each returned object must be associated with the source object through an association in
which the source object plays the specified role. The name of the property in the association class
that refers to the source object must match the value of this parameter. The default value is None.
ResultRole — Each returned object must be associated with the source object through an
association in which the returned object plays the specified role. The name of the property in the
association class that refers to the returned object must match the value of this parameter. The
default value is None.
The LMI_StorageExtent class represents block devices available in the system. To use the ns
namespace object created in Example 18.5, “Accessing Namespace Objects”, create an instance of
the LMI_StorageExtent class for the block device named /dev/vda, and assign it to a variable
named vda, type the following at the interactive prompt:
To get a list of all disk partitions on this block device and assign it to a variable named
vda_partitions, use the associators() method as follows:
335
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
instance_object.associator_names(
AssocClass=class_name,
ResultClass=class_name,
Role=role,
ResultRole=role)
To access the first associated instance name of a particular instance object, use the
first_associator_nam e() method:
instance_object.first_associator_name(
AssocClass=class_object,
ResultClass=class_object,
Role=role,
ResultRole=role)
Replace instance_object with the name of the instance object to inspect. You can filter the results by
specifying the following parameters:
AssocClass — Each returned name identifies an object that must be associated with the source
object through an instance of this class or one of its subclasses. The default value is None.
ResultClass — Each returned name identifies an object that must be either an instance of this
class or one of its subclasses, or it must be this class or one of its subclasses. The default value is
None.
Role — Each returned name identifies an object that must be associated with the source object
through an association in which the source object plays the specified role. The name of the property
in the association class that refers to the source object must match the value of this parameter. The
default value is None.
ResultRole — Each returned name identifies an object that must be associated with the source
object through an association in which the returned named object plays the specified role. The name
of the property in the association class that refers to the returned object must match the value of this
parameter. The default value is None.
To use the vda instance object created in Example 18.33, “Accessing Associated Instances”, get a list
of its associated instance names, and assign it to a variable named vda_partitions, type:
336
Chapter 18. OpenLMI
instance_object.references(
ResultClass=class_name,
Role=role,
IncludeQualifiers=include_qualifiers,
IncludeClassOrigin=include_class_origin,
PropertyList=property_list)
To access the first association object that refers to a particular target object, use the
first_reference() method:
instance_object.first_reference(
... ResultClass=class_name,
... Role=role,
... IncludeQualifiers=include_qualifiers,
... IncludeClassOrigin=include_class_origin,
... PropertyList=property_list)
>
Replace instance_object with the name of the instance object to inspect. You can filter the results by
specifying the following parameters:
ResultClass — Each returned object must be either an instance of this class or one of its
subclasses, or it must be this class or one of its subclasses. The default value is None.
Role — Each returned object must refer to the target object through a property with a name that
matches the value of this parameter. The default value is None.
337
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To access the first association object that refers to an LMI_BindsT oLANEndpoint object and
assign it to a variable named bind, type:
You can now use the Dependent property to access the dependent LMI_IPProtocolEndpoint
class that represents the IP address of the corresponding network interface device:
> ip = bind.Dependent.to_instance()
> print ip.IPv4Address
192.168.122.1
>
instance_object.reference_names(
ResultClass=class_name,
Role=role)
To access the first association instance name of a particular instance object, use the
first_reference_nam e() method:
instance_object.first_reference_name(
ResultClass=class_name,
Role=role)
Replace instance_object with the name of the instance object to inspect. You can filter the results by
specifying the following parameters:
ResultClass — Each returned object name identifies either an instance of this class or one of its
subclasses, or this class or one of its subclasses. The default value is None.
Role — Each returned object identifies an object that refers to the target instance through a property
with a name that matches the value of this parameter. The default value is None.
338
Chapter 18. OpenLMI
To use the lan_endpoint instance object created in Example 18.35, “Accessing Association
Instances”, access the first association instance name that refers to an LMI_BindsT oLANEndpoint
object, and assign it to a variable named bind, type:
You can now use the Dependent property to access the dependent LMI_IPProtocolEndpoint
class that represents the IP address of the corresponding network interface device:
> ip = bind.Dependent.to_instance()
> print ip.IPv4Address
192.168.122.1
>
Subscribing to Indications
To subscribe to an indication, use the subscribe_indication() method as follows:
connection_object.subscribe_indication(
QueryLanguage="WQL",
Query='SELECT * FROM CIM_InstModification',
Name="cpu",
CreationNamespace="root/interop",
SubscriptionCreationClassName="CIM_IndicationSubscription",
FilterCreationClassName="CIM_IndicationFilter",
FilterSystemCreationClassName="CIM_ComputerSystem",
FilterSourceNamespace="root/cimv2",
HandlerCreationClassName="CIM_IndicationHandlerCIMXML",
HandlerSystemCreationClassName="CIM_ComputerSystem",
Destination="http://host_name:5988")
Alternatively, you can use a shorter version of the method call as follows:
connection_object.subscribe_indication(
Query='SELECT * FROM CIM_InstModification',
Name="cpu",
Destination="http://host_name:5988")
Replace connection_object with a connection object and host_name with the host name of the
system you want to deliver the indications to.
By default, all subscriptions created by the LMIShell interpreter are automatically deleted when the
interpreter terminates. To change this behavior, pass the Perm anent=T rue keyword parameter to the
subscribe_indication() method call. This will prevent LMIShell from deleting the subscription.
339
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To use the c connection object created in Example 18.1, “Connecting to a Remote CIMOM” and
subscribe to an indication named cpu, type the following at the interactive prompt:
> c.subscribe_indication(
... QueryLanguage="WQL",
... Query='SELECT * FROM CIM_InstModification',
... Name="cpu",
... CreationNamespace="root/interop",
... SubscriptionCreationClassName="CIM_IndicationSubscription",
... FilterCreationClassName="CIM_IndicationFilter",
... FilterSystemCreationClassName="CIM_ComputerSystem",
... FilterSourceNamespace="root/cimv2",
... HandlerCreationClassName="CIM_IndicationHandlerCIMXML",
... HandlerSystemCreationClassName="CIM_ComputerSystem",
... Destination="http://server.example.com:5988")
LMIReturnValue(rval=True, rparams=NocaseDict({}), errorstr='')
>
connection_object.print_subscribed_indications()
Replace connection_object with the name of the connection object to inspect. This method prints
subscribed indications to standard output.
connection_object.subscribed_indications()
To inspect the c connection object created in Example 18.1, “Connecting to a Remote CIMOM” and
list all subscribed indications, type the following at the interactive prompt:
> c.print_subscribed_indications()
>
340
Chapter 18. OpenLMI
connection_object.unsubscribe_indication(indication_name)
Replace connection_object with the name of the connection object and indication_name with the
name of the indication to delete.
connection_object.unsubscribe_all_indications()
To use the c connection object created in Example 18.1, “Connecting to a Remote CIMOM” and
unsubscribe from the indication created in Example 18.37, “Subscribing to Indications”, type the
following at the interactive prompt:
> c.unsubscribe_indication('cpu')
LMIReturnValue(rval=True, rparams=NocaseDict({}), errorstr='')
>
The first argument of the handler is an Lm iIndication object, which contains a list of methods and
objects exported by the indication. Other parameters are user specific: those arguments need to be
specified when adding a handler to the listener.
In the example above, the add_handler() method call uses a special string with eight “X” characters.
These characters are replaced with a random string that is generated by listeners in order to avoid a
possible handler name collision. To use the random string, start the indication listener first and then
subscribe to an indication so that the Destination property of the handler object contains the following
value: schema://host_name/random_string.
341
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The following script illustrates how to write a handler that monitors a managed system located at
192.168.122.1 and calls the indication_callback() function whenever a new user account
is created:
#!/usr/bin/lmishell
import sys
from time import sleep
from lmi.shell.LMIUtil import LMIPassByRef
from lmi.shell.LMIIndicationListener import LMIIndicationListener
listener.start()
print c.subscribe_indication(
Name=unique_name,
Query="SELECT * FROM LMI_AccountInstanceCreationIndication WHERE
SOURCEINSTANCE ISA LMI_Account",
Destination="192.168.122.1:65500"
)
try:
while True:
sleep(60)
except KeyboardInterrupt:
sys.exit(0)
342
Chapter 18. OpenLMI
Replace host_name with the host name of the managed system, user_name with the name of user that
is allowed to connect to OpenPegasus CIMOM running on that system, and password with the user's
password.
To list all available services on the managed machine along with information whether the service has
been started (T RUE) or stopped (FALSE) and the status string, use the following code snippet:
To list only the services that are enabled by default, use this code snippet:
cls = ns.LMI_Service
for service in cls.instances():
if service.EnabledDefault == cls.EnabledDefaultValues.Enabled:
print service.Name
Note that the value of the EnabledDefault property is equal to 2 for enabled services and 3 for
disabled services.
To start and stop the cups service and to see its current status, use the following code snippet:
343
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To enable and disable the cups service and to display its EnabledDefault property, use the
following code snippet:
344
Chapter 18. OpenLMI
To list all IP adresses associated with the eth0 network interface, use the following code snippet:
This code snippet uses the LMI_IPProtocolEndpoint class associated with a given
LMI_IPNetworkConnection class.
for rsap in
device.associators(AssocClass="LMI_NetworkRemoteAccessAvailableToElement",
ResultClass="LMI_NetworkRemoteServiceAccessPoint"):
if rsap.AccessContext ==
ns.LMI_NetworkRemoteServiceAccessPoint.AccessContextValues.DefaultGateway:
print "Default Gateway: %s" % rsap.AccessInfo
To get a list of DNS servers, the object model needs to be traversed as follows:
There can be more possible paths to get to the Rem oteServiceAccessPath and entries can be
duplicated. The following code snippet uses the set() function to remove duplicate entries from the
list of DNS servers:
345
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
dnsservers = set()
for ipendpoint in device.associators(AssocClass="LMI_NetworkSAPSAPDependency",
ResultClass="LMI_IPProtocolEndpoint"):
for dnsedpoint in
ipendpoint.associators(AssocClass="LMI_NetworkSAPSAPDependency",
ResultClass="LMI_DNSProtocolEndpoint"):
for rsap in
dnsedpoint.associators(AssocClass="LMI_NetworkRemoteAccessAvailableToElement",
ResultClass="LMI_NetworkRemoteServiceAccessPoint"):
if rsap.AccessContext ==
ns.LMI_NetworkRemoteServiceAccessPoint.AccessContextValues.DNSServer:
dnsservers.add(rsap.AccessInfo)
print "DNS:", ", ".join(dnsservers)
To create a new setting with a static IPv4 and stateless IPv6 configuration for network interface eth0,
use the following code snippet:
capability = ns.LMI_IPNetworkConnectionCapabilities.first_instance({
'ElementName': 'eth0' })
result = capability.LMI_CreateIPSetting(Caption='eth0 Static',
IPv4Type=capability.LMI_CreateIPSetting.IPv4TypeValues.Static,
IPv6Type=capability.LMI_CreateIPSetting.IPv6TypeValues.Stateless)
setting = result.rparams["SettingData"].to_instance()
for settingData in
setting.associators(AssocClass="LMI_OrderedIPAssignmentComponent"):
if setting.ProtocolIFType ==
ns.LMI_IPAssignmentSettingData.ProtocolIFTypeValues.IPv4:
# Set static IPv4 address
settingData.IPAddresses = ["192.168.1.100"]
settingData.SubnetMasks = ["255.255.0.0"]
settingData.GatewayAddresses = ["192.168.1.1"]
settingData.push()
This code snippet creates a new setting by calling the LMI_CreateIPSetting() method on the
instance of LMI_IPNetworkConnectionCapabilities, which is associated with
LMI_IPNetworkConnection through LMI_IPNetworkConnectionElem entCapabilities. It
also uses the push() method to modify the setting.
346
Chapter 18. OpenLMI
The Mode parameter affects how the setting is applied. The most commonly used values of this
parameter are as follows:
In addition to the c and ns variables, these examples use the following variable definitions:
MEGABYTE = 1024*1024
storage_service = ns.LMI_StorageConfigurationService.first_instance()
filesystem_service = ns.LMI_FileSystemConfigurationService.first_instance()
347
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To create a new volume group located in /dev/m yGroup/ that has three members and the default
extent size of 4 MB, use the following code snippet:
To create two logical volumes with the size of 100 MB, use this code snippet:
348
Chapter 18. OpenLMI
To create an ext3 file system on logical volume lv from Example 18.48, “Creating a Logical Volume”,
use the following code snippet:
FileSystemType=filesystem_service.LMI_CreateFileSystem.FileSystemTypeValues.EXT3
,
InExtents=[lv])
To mount the file system created in Example 18.49, “Creating a File System”, use the following code
snippet:
mount_service = ns.LMI_MountConfigurationService.first_instance()
(rc, out, err) = mount_service.SyncCreateMount(
FileSystemType='ext3',
Mode=32768, # just mount
FileSystem=fs,
MountPoint='/mnt/test',
FileSystemSpec=lv.Name)
To list all block devices known to the system, use the following code snippet:
devices = ns.CIM_StorageExtent.instances()
for device in devices:
if lmi_isinstance(device, ns.CIM_Memory):
# Memory and CPU caches are StorageExtents too, do not print them
continue
print device.classname,
print device.DeviceID,
print device.Name,
print device.BlockSize*device.NumberOfBlocks
349
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To display basic CPU information such as the CPU name, the number of processor cores, and the
number of hardware threads, use the following code snippet:
cpu = ns.LMI_Processor.first_instance()
cpu_cap = cpu.associators(ResultClass="LMI_ProcessorCapabilities")[0]
print cpu.Name
print cpu_cap.NumberOfProcessorCores
print cpu_cap.NumberOfHardwareThreads
To display basic information about memory modules such as their individual sizes, use the following
code snippet:
mem = ns.LMI_Memory.first_instance()
for i in mem.associators(ResultClass="LMI_PhysicalMemory"):
print i.Name
To display basic information about the machine such as its manufacturer or its model, use the
following code snippet:
chassis = ns.LMI_Chassis.first_instance()
print chassis.Manufacturer
print chassis.Model
To list all PCI devices known to the system, use the following code snippet:
To install OpenLMI Scripts on your system, type the following at a shell prompt:
This command installs the Python modules and the lm i utility in the ~/.local/ directory. To extend
350
Chapter 18. OpenLMI
the functionality of the lm i utility, install additional OpenLMI modules by using the following command:
For a complete list of available modules, see the Python website. For more information about OpenLMI
Scripts, see the official OpenLMI Scripts documentation.
Installed Documentation
lmishell(1) — The manual page for the lm ishell client and interpreter provides detailed information
about its execution and usage.
Online Documentation
Red Hat Enterprise Linux 7 Networking Guide — The Networking Guide for Red Hat Enterprise Linux
7 documents relevant information regarding the configuration and administration of network
interfaces and network services on this system.
Red Hat Enterprise Linux 7 Storage Administration Guide — The Storage Administration Guide for
Red Hat Enterprise Linux 7 provides instructions on how to manage storage devices and file systems
on this system.
Red Hat Enterprise Linux 7 Power Management Guide — The Power Management Guide for Red
Hat Enterprise Linux 7 explains how to manage power consumption of this system effectively. It
discusses different techniques that lower power consumption for both servers and laptops, and
explains how each technique affects the overall performance of the system.
Red Hat Enterprise Linux 7 Linux Domain Identity Management Guide — The Linux Domain Identity
Management Guide for Red Hat Enterprise Linux 7 covers all aspects of installing, configuring, and
managing IPA domains, including both servers and clients. The guide is intended for IT and systems
administrators.
FreeIPA Documentation — The FreeIPA Documentation serves as a main user documentation for
using the FreeIPA Identity Management project.
OpenSSL Home Page — The OpenSSL home page provides an overview of the OpenSSL project.
Mozilla NSS Documentation — The Mozilla NSS Documentation serves as a main user
documentation for using the Mozilla NSS project.
See Also
Chapter 3, Managing Users and Groups documents how to manage system users and groups in the
graphical user interface and on the command line.
Chapter 5, Yum describes how to use the Yum package manager to search, install, update, and
uninstall packages on the command line.
Chapter 6, PackageKit describes PackageKit, a suite of package management tools for the graphical
user interface.
Chapter 7, Managing Services with systemd provides an introduction to system d and documents
how to use the system ctl command to manage system services, configure systemd targets, and
execute power management commands.
Chapter 8, OpenSSH describes how to configure an SSH server and how to use the ssh, scp, and
351
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
352
Chapter 19. Viewing and Managing Log Files
Some log files are controlled by a daemon called rsyslogd. The rsyslogd daemon is an enhanced
replacement for previous syslogd, and provides extended filtering, various configuration options, input
and output modules, support for transportation via the T CP or UDP protocols. A list of log files maintained
by rsyslogd can be found in the /etc/rsyslog.conf configuration file. Most log files are located in
the /var/log/ directory.
Log files can also be managed by the journald daemon – a component of system d. The journald
daemon captures Syslog messages, kernel log messages, initial RAM disk and early boot messages as
well as messages written to standard output and standard error output of all services, indexes them and
makes this available to the user. The native journal file format, which is a structured and indexed binary
file, improves searching and provides faster operation, and it also stores meta data information like
timestamps or user IDs. Log files produced by journald are by default not persistent, log files are
stored only in memory or a small ring-buffer in the /run/log/journal/ directory. The amount of
logged data depends on free memory, when you reach the capacity limit, the oldest entries are deleted.
However, this setting can be altered – see Section 19.8.5, “Enabling Persistent Storage”. For more
information on Journal see Section 19.8, “Using the Journal”.
By default, these two logging tools coexist on your system. The additional structured data that is added
to messages by the journald daemon that is also the primary tool for troubleshooting. Data acquired
by journald are forwarded into the /run/system d/journal/syslog socket that may be used by
rsyslogd to process the data further. However, rsyslog does the actual integration by default via the
im journal input module, thus avoiding the aforementioned socket. You can also transfer data in the
opposite direction, from rsyslogd to journald with use of om journal module. See Section 19.5,
“Interaction of Rsyslog and Journal” for further information. The integration allows to maintain text-based
logs in a consistent format to assure compatibility with possible applications or configurations dependent
on rsyslogd. Also, you can maintain rsyslog messages in a structured format (see Section 19.6,
“Structured Logging with Rsyslog”).
You may notice multiple files in the /var/log/ directory with numbers after them (for example, cron-
20100906). These numbers represent a timestamp that has been added to a rotated log file. Log files
are rotated so their file sizes do not become too large. The logrotate package contains a cron task
that automatically rotates log files according to the /etc/logrotate.conf configuration file and the
configuration files in the /etc/logrotate.d/ directory.
353
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
19.2.1. Filters
A rule is specified by a filter part, which selects a subset of syslog messages, and an action part, which
specifies what to do with the selected messages. To define a rule in your /etc/rsyslog.conf
configuration file, define both, a filter and an action, on one line and separate them with one or more
spaces or tabs.
rsyslog offers various ways to filter syslog messages according to selected properties. The available
filtering methods can be divided into Facility/Priority-based, Property-based, and Expression-based
filters.
Facility/Priority-based filters
The most used and well-known way to filter syslog messages is to use the facility/priority-based
filters which filter syslog messages based on two conditions: facility and priority separated by a
comma. To create a selector, use the following syntax:
FACILITY.PRIORITY
where:
FACILITY specifies the subsystem that produces a specific syslog message. For example,
the m ail subsystem handles all mail-related syslog messages. FACILITY can be
represented by one of the following keywords: auth, authpriv, cron, daem on, kern,
lpr, m ail, news, syslog, user, ftp, uucp, and local0 through local7.
PRIORITY specifies a priority of a syslog message. PRIORITY can be represented by one of
the following keywords (or by a number): debug (0), info (1), notice (2), warning (3),
err (4), crit (5), alert (6), and em erg (7).
The aforementioned syntax selects syslog messages with the defined or higher priority. By
preceding any priority keyword with an equal sign (=), you specify that only syslog messages
with the specified priority will be selected. All other priorities will be ignored. Conversely,
preceding a priority keyword with an exclamation mark (!) selects all syslog messages
except those with the defined priority.
In addition to the keywords specified above, you may also use an asterisk (* ) to define all
facilities or priorities (depending on where you place the asterisk, before or after the comma).
Specifying the priority keyword none serves for facilities with no given priorities. Both facility and
priority conditions are case-insensitive.
To define multiple facilities and priorities, separate them with a comma (,). To define multiple
selectors on one line, separate them with a semi-colon (;). Note that each selector in the
selector field is capable of overwriting the preceding ones, which can exclude some priorities
from the pattern.
354
Chapter 19. Viewing and Managing Log Files
The following are a few examples of simple facility/priority-based filters that can be specified
in /etc/rsyslog.conf. To select all kernel syslog messages with any priority, add the
following text into the configuration file:
kern.*
To select all mail syslog messages with priority crit and higher, use this form:
mail.crit
To select all cron syslog messages except those with the info or debug priority, set the
configuration in the following form:
cron.!info,!debug
Property-based filters
Property-based filters let you filter syslog messages by any property, such as timegenerated
or syslogtag. For more information on properties, refer to Section 19.2.3, “Properties”. You
can compare each of the specified properties to a particular value using one of the compare-
operations listed in Table 19.1, “Property-based compare-operations”. Both property names and
compare operations are case-sensitive.
Property-based filter must start with a colon (:). To define the filter, use the following syntax:
where:
355
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Compare-operation Description
contains Checks whether the provided string matches any part of
the text provided by the property. To perform case-
insensitive comparisons, use contains_i.
isequal Compares the provided string against all of the text
provided by the property. These two values must be
exactly equal to match.
startswith Checks whether the provided string is found exactly at
the beginning of the text provided by the property. To
perform case-insensitive comparisons, use
startswith_i.
regex Compares the provided POSIX BRE (Basic Regular
Expression) regular expression against the text provided
by the property.
ereregex Compares the provided POSIX ERE (Extended Regular
Expression) regular expression against the text provided
by the property.
isempty Checks if the property is empty. The value is discarded.
This is especially useful when working with normalized
data, where some fields may be populated based on
normalization result.
The following are a few examples of property-based filters that can be specified in
/etc/rsyslog.conf. To select syslog messages which contain the string error in their
message text, use:
The following filter selects syslog messages received from the hostname host1:
To select syslog messages which do not contain any mention of the words fatal and
error with any or no text between them (for example, fatal lib error), type:
Expression-based filters
Expression-based filters select syslog messages according to defined arithmetic, Boolean or
string operations. Expression-based filters use rsyslog's own scripting language called
RainerScript to build complex filters. See Section 19.10, “Online Documentation” for the syntax
definition of this script along with examples of various expression-based filters. Also RainerScript
is a basis for rsyslog's new configuration format, see Section 19.2.6, “Using the New
Configuration Format”
356
Chapter 19. Viewing and Managing Log Files
where:
With expression-based filters, you can nest the conditions by using a script enclosed in curly
braces as in Example 19.3, “Expression-based Filters”. The script allows you to use
facility/priority-based filters inside the expression. On the other hand, property-based filters are
not recommended here. RainerScript supports regular expressions with specialized functions
re_m atch() and re_extract()
The following expression contains two nested conditions. The log files created by a program
called prog1 are split into two files based on the presence of the "test" string in the message.
19.2.2. Actions
Actions specify what is to be done with the messages filtered out by an already-defined selector. The
following are some of the actions you can define in your rule:
FILTER PATH
where FILTER stands for user-specified selector and PATH is a path of a target file.
For instance, the following rule is comprised of a selector that selects all cron syslog messages
and an action that saves them into the /var/log/cron.log log file:
357
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
cron.* /var/log/cron.log
By default, the log file is synchronized every time a syslog message is generated. Use a dash
mark (-) as a prefix of the file path you specified to omit syncing:
FILTER -PATH
Note that you might lose information if the system terminates right after a write attempt.
However, this setting can save some performance, especially if you run programs that produce
very verbose log messages.
Your specified file path can be either static or dynamic. Static files are represented by a fixed file
path as was shown in the example above. Dynamic file paths can differ according to the
received message. Dynamic file paths are represented by a template and a question mark (?)
prefix:
FILTER ?DynamicFile
where DynamicFile is a name of a predefined template that modifies output paths. You can
use the dash prefix (-) to disable syncing, also you can use multiple templates separated by
colon (;). For more information on templates, refer to Section 19.2.3, “Generating Dynamic File
Names”.
If the file you specified is an existing terminal or /dev/console device, syslog messages are
sent to standard output (using special terminal-handling) or your console (using special
/dev/console-handling) when using the X Window System, respectively.
@[(zNUMBER)]HOST:[PORT]
where:
The at sign (@ ) indicates that the syslog messages are forwarded to a host using the UDP
protocol. To use the T CP protocol, use two at signs with no space between them (@ @ ).
The optional zNUMBER setting enables zlib compression for syslog messages. The NUMBER
attribute specifies the level of compression (from 1 – lowest to 9 – maximum). Compression
gain is automatically checked by rsyslogd, messages are compressed only if there is any
compression gain and messages below 60 bytes are never compressed.
The HOST attribute specifies the host which receives the selected syslog messages.
The PORT attribute specifies the host machine's port.
When specifying an IPv6 address as the host, enclose the address in square brackets ([, ]).
358
Chapter 19. Viewing and Managing Log Files
The following are some examples of actions that forward syslog messages over the network
(note that all actions are preceded with a selector that selects all messages with any priority).
To forward messages to 192.168.0.1 via the UDP protocol, type:
*.* @192.168.0.1
*.* @@example.com:18
The following compresses messages with zlib (level 9 compression) and forwards them to
2001::1 using the UDP protocol
*.* @(z9)[2001::1]
Output channels
Output channels are primarily used to specify the maximum size a log file can grow to. This is
very useful for log file rotation (for more information see Section 19.2.5, “Log Rotation”. An
output channel is basically a collection of information about the output action. Output channels
are defined by the $outchannel directive. To define an output channel in
/etc/rsyslog.conf, use the following syntax:
where:
To use the defined output channel can as an action inside a rule, type:
FILTER :omfile:$NAME
359
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The following output shows a simple log rotation through the use of an output channel. First,
the output channel is defined via the $outchannel directive:
and then it is used in a rule that selects every syslog message with any priority and executes
the previously-defined output channel on the acquired syslog messages:
*.* :omfile:$log_rotation
Once the limit (in the example 100 MB) is hit, the /hom e/joe/log_rotation_script is
executed. This script can contain anything from moving the file into a different folder, editing
specific content out of it, or simply removing it.
Executing a program
rsyslog lets you execute a program for selected syslog messages and uses the system () call
to execute the program in shell. To specify a program to be executed, prefix it with a caret
character (^). Consequently, specify a template that formats the received message and passes
it to the specified executable as a one line parameter (for more information on templates, refer
to Section 19.2.3, “Templates”).
In the following example, any syslog message with any priority is selected, formatted with the
template template and passed as a parameter to the test-program program, which is then
executed with the provided parameter:
*.* ^test-program;template
360
Chapter 19. Viewing and Managing Log Files
When accepting messages from any host, and using the shell execute action, you may
be vulnerable to command injection. An attacker may try to inject and execute his
commands in the program you specified to be executed in your action. To avoid any
possible security threats, thoroughly consider the use of the shell execute action.
:PLUGIN:DB_HOST,DB_NAME,DB_USER,DB_PASSWORD;[TEMPLATE]
where:
The PLUGIN calls the specified plug-in that handles the database writing (for example, the
om m ysql plug-in).
The DB_HOST attribute specifies the database hostname.
The DB_NAME attribute specifies the name of the database.
The DB_USER attribute specifies the database user.
The DB_PASSWORD attribute specifies the password used with the aforementioned database
user.
The TEMPLATE attribute specifies an optional use of a template that modifies the syslog
message. For more information on templates, refer to Section 19.2.3, “Templates”.
Currently, rsyslog provides support for MySQL and PostgreSQL databases only. In
order to use the MySQL and PostgreSQL database writer functionality, install the
rsyslog-mysql and rsyslog-pgsql packages, respectively. Also, make sure you load the
appropriate modules in your /etc/rsyslog.conf configuration file:
For more information on rsyslog modules, refer to Section 19.4, “Using Rsyslog
Modules”.
Alternatively, you may use a generic database interface provided by the om libdb
module (supports: Firebird/Interbase, MS SQL, Sybase, SQLLite, Ingres, Oracle, mSQL).
FILTER ~
The discard action is mostly used to filter out messages before carrying on any further
processing. It can be effective if you want to omit some repeating messages that would
361
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
processing. It can be effective if you want to omit some repeating messages that would
otherwise fill the log files. The results of discard action depend on where in the configuration file
it is specified, for the best results place these actions on top of the actions list. Please note that
once a message has been discarded there is no way to retrieve it in later configuration file lines.
For instance, the following rule discards any cron syslog messages:
cron.* ~
FILTER ACTION
& ACTION
& ACTION
Specifying multiple actions improves the overall performance of the desired outcome since the specified
selector has to be evaluated only once.
In the following example, all kernel syslog messages with the critical priority (crit) are send to user
joe, processed by the template temp and passed on to the test-program executable, and
forwarded to 192.168.0.1 via the UDP protocol.
kern.=crit joe
& ^test-program;temp
& @192.168.0.1
Any action can be followed by a template that formats the message. To specify a template, suffix an
action with a semicolon (;) and specify the name of the template. For more information on templates,
refer to Section 19.2.3, “Templates”.
Using templates
A template must be defined before it is used in an action, otherwise it is ignored. In other words,
template definitions should always precede rule definitions in /etc/rsyslog.conf.
19.2.3. Templates
Any output that is generated by rsyslog can be modified and formatted according to your needs with the
use of templates. To create a template use the following syntax in /etc/rsyslog.conf:
where:
$template is the template directive that indicates that the text following it, defines a template.
TEMPLATE_NAME is the name of the template. Use this name to refer to the template.
362
Chapter 19. Viewing and Managing Log Files
Anything between the two quotation marks ("…") is the actual template text. Within this text, can
escape special characters, such as \n for new line or \r for carriage return. Other characters, such
as % or ", have to be escaped in case you want to those characters literally.
The text specified within two percent signs (%) specifies a property that allows you to access specific
contents of a syslog message. For more information on properties, refer to Section 19.2.3,
“Properties”.
The OPTION attribute specifies any options that modify the template functionality. Do not confuse
them with property options, which are defined inside the template text (between "…"). The currently
supported template options are sql and stdsql, which are used for formatting the text as an SQL
query.
Note that the database writer (for more information, refer to section Inputting syslog messages
in a database in Section 19.2.2, “Actions”) checks whether the sql and stdsql options are
specified in the template. If they are not, the database writer does not perform any action. This
is to prevent any possible security threats, such as SQL injection.
For example, use the timegenerated property, which extracts a timestamp from the message, to
generate a unique file name for each syslog message:
$template DynamicFile,"/var/log/test_logs/%timegenerated%-test.log"
Keep in mind that the $template directive only specifies the template. You must use it inside a rule for it
to take effect. In /etc/rsyslog.conf, use the question mark (?) in action definition to mark the
dynamic filename template:
*.* ?DynamicFile
Properties
Properties defined inside a template (within two percent signs (%)) allow you to access various contents
of a syslog message through the use of a property replacer. To define a property inside a template
(between the two quotation marks ("…")), use the following syntax:
%PROPERTY_NAME[:FROM_CHAR:TO_CHAR:OPTION]%
where:
The PROPERTY_NAME attribute specifies the name of a property. A comprehensible list of all available
properties and their detailed description can be found in the rsyslog.conf manual page under the
section Available Properties.
FROM_CHAR and TO_CHAR attributes denote a range of characters that the specified property will act
upon. Alternatively, regular expressions can be used to specify a range of characters. To do so, set
the letter R as the FROM_CHAR attribute and specify your desired regular expression as the TO_CHAR
attribute.
363
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The OPTION attribute specifies any property options, such as the lovercase option to convert the
input to lowercase. A comprehensible list of all available property options and their detailed
description can be found in the rsyslog.conf manual page under the section Property Options.
The following property obtains the whole message text of a syslog message:
%msg%
The following property obtains the first two characters of the message text of a syslog message:
%msg:1:2%
The following property obtains the whole message text of a syslog message and drops its last line
feed character:
%msg:::drop-last-lf%
The following property obtains the first 10 characters of the timestamp that is generated when the
syslog message is received and formats it according to the RFC 3999 date standard.
%timegenerated:1:10:date-rfc3339%
Template Examples
This section presents few examples of rsyslog templates.
Example 19.8, “A verbose syslog message template” shows a template that formats a syslog message
so that it outputs the message's severity, facility, the timestamp of when the message was received, the
hostname, the message tag, the message text, and ends with a new line.
Example 19.9, “A wall message template” shows a template that resembles a traditional wall message (a
message that is send to every user that is logged in and has their mesg(1) permission set to yes). This
template outputs the message text, along with a hostname, message tag and a timestamp, on a new line
(using \r and \n) and rings the bell (using \7).
Example 19.10, “A database formatted message template” shows a template that formats a syslog
message so that it can be used as a database query. Notice the use of the sql option at the end of the
template specified as the template option. It tells the database writer to format the message as an
MySQL SQL query.
364
Chapter 19. Viewing and Managing Log Files
rsyslog also contains a set of predefined templates identified by the RSYSLOG_ prefix. These are
reserved for the syslog use and it is advisable to not create a template using this prefix to avoid conflicts.
The following list shows these predefined templates along with their definitions.
RSYSLOG_DebugFormat
A special format used for troubleshooting property problems
RSYSLOG_SyslogProtocol23Format
The format specified in IETF's internet-draft ietf-syslog-protocol-23, which is assumed to be
come the new syslog standard RFC.
RSYSLOG_FileFormat
A modern-style logfile format similar to TraditionalFileFormat, but with high-precision
timestamps and timezone information.
RSYSLOG_TraditionalFileFormat
The older default log file format with low-precision timestamps.
RSYSLOG_ForwardFormat
A forwarding format with high-precision timestamps and timezone information.
365
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
RSYSLOG_TraditionalForwardFormat
The traditional forwarding format with low-precision timestamps.
$MainMsgQueueSize 50000
The default size defined for this directive (10,000 messages) can be overridden by specifying a
different value (as shown in the example above).
You may define multiple directives in your /etc/rsyslog.conf configuration file. A directive affects
the behavior of all configuration options until another occurrence of that same directive is detected.
Global directives can be used to configure actions, queues and for debugging. A comprehensive list of all
available configuration directives can be found in Section 19.10, “Online Documentation”. Currently, a
new configuration format has been developed that replaces the $-based syntax (see Section 19.2.6,
“Using the New Configuration Format”). However, classic global directives remain supported as a legacy
format.
All of the lines in the sample configuration file define global options that apply to every log file. In our
example, log files are rotated weekly, rotated log files are kept for the duration of 4 weeks, and all rotated
log files are compressed by gzip into the .gz format. Any lines that begin with a hash sign (#) are
comments and are not processed
You may define configuration options for a specific log file and place it under the global options.
However, it is advisable to create a separate configuration file for any specific log file in the
/etc/logrotate.d/ directory and define any configuration options there.
366
Chapter 19. Viewing and Managing Log Files
/var/log/messages {
rotate 5
weekly
postrotate
/usr/bin/killall -HUP syslogd
endscript
}
The configuration options in this file are specific for the /var/log/m essages log file only. The settings
specified here override the global settings where possible. Thus the rotated /var/log/m essages log
file will be kept for five weeks instead of four weeks as was defined in the global options.
The following is a list of some of the directives you can specify in your logrotate configuration file:
weekly — Specifies the rotation of log files on a weekly basis. Similar directives include:
daily
monthly
yearly
compress — Enables compression of rotated log files. Similar directives include:
nocompress
compresscmd — Specifies the command to be used for compressing.
uncompresscmd
compressext — Specifies what extension is to be used for compressing.
compressoptions — Lets you specify any options that may be passed to the used compression
program.
delaycompress — Postpones the compression of log files to the next rotation of log files.
rotate INTEGER — Specifies the number of rotations a log file undergoes before it is removed or
mailed to a specific address. If the value 0 is specified, old log files are removed instead of rotated.
mail ADDRESS — This option enables mailing of log files that have been rotated as many times as
is defined by the rotate directive to the specified address. Similar directives include:
nomail
mailfirst — Specifies that the just-rotated log files are to be mailed, instead of the about-to-
expire log files.
maillast — Specifies that the about-to-expire log files are to be mailed, instead of the just-
rotated log files. This is the default option when mail is enabled.
For the full list of directives and various configuration options, refer to the logrotate man page
(m an logrotate).
RainerScript is a scripting language designed for processing network events and configuring event
processors such as rsyslog. RainerScript was primarily used to define expression-based filters, see
Example 19.3, “Expression-based Filters”. The newest version of RainerScript implements the input()
and ruleset() statements, which permit the /etc/rsyslog.conf configuration file to be written in
367
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
In the following examples you can compare the configuration written with legacy-style parameters:
$InputFileName /tmp/inputfile
$InputFileTag tag1:
$InputFileStateFile inputfile-state
$InputRunFileMonitor
and the same configuration with use of the new format statement:
This significantly reduces the number of parameters used in configuration, improves readability, and also
provides higher execution speed. For more information on RainerScript statements and parameters see
Section 19.10, “Online Documentation”.
19.2.7. Rulesets
Leaving special directives aside, rsyslog handles messages as defined by rules that consist of a filter
condition and an action to be performed if the condition is true. With traditionally written
/etc/rsyslog.conf, all rules are evaluated in order of appearance for every input message. This
process starts with the first rule and continues until all rules have been processed or until the message is
discarded by one of the rules.
However, rules can be grouped into sequences called rulesets. With rulesets, you can limit the effect of
certain rules only to selected inputs or enhance the performance of rsyslog by defining a distinct set of
actions bound to a specific input. In other words, filter conditions that will be inevitably evaluated as false
for certain types of messages can be skipped. With the new configuration format, the input() and
ruleset() statements are reserved for this operation. The ruleset definition in /etc/rsyslog.conf
can look as follows:
ruleset(name="rulesetname") {
rule
rule2
call rulesetname2
…
}
Replace rulesetname with an identificator for your ruleset. The rueleset name cannot start with
RSYSLOG_ since this name space is reserved for use by rsyslog. RSYSLOG_DefautRuleset then
defines the default set of rules to be performed if message has no other ruleset assigned. With rule and
rule2 you can define rules in filter-action format mentioned above. With the call parameter, you can
nest rulesets by calling them from inside other ruleset block.
After creating a ruleset, you need to specify what input will it apply to:
Here you can identify an input message by input_type, which is an input module that gathered the
message, or by port_num – the port number. Another parameters such as file or tag can be specified for
input(). Replace rulesetname with a name of the ruleset to be evaluated against the massage. In
case an input message is not explicitly bound to a ruleset, the default ruleset is triggered.
You can also use legacy format to define rulesets, for more information see Section 19.10, “Online
368
Chapter 19. Viewing and Managing Log Files
Documentation”
The following rulesets ensure different handling of remote messages coming from different ports.
Type the following into /etc/rsyslog.conf:
ruleset(name="remote-10514") {
action(type="omfile" file="/var/log/remote-10514")
}
ruleset(name="remote-10515") {
cron.* action(type="omfile" file="/var/log/remote-10515-cron")
mail.* action(type="omfile" file="/var/log/remote-10515-mail")
}
Rulesets shown in the above example define log destinations for the remote input from two ports, in
case of 10515, messages are sorted according to the facility. Then, the TCP input is enabled and
bound to rulesets. Note that you must load required modules (imtcp) for this configuration to work.
369
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Whenever rsyslog receives a message, it passes this message to the preprocessor and then places it
into the main message queue. Messages wait there to be dequeued and passed to the rule processor.
The rule processor is a parsing and filtering engine. Here, the rules defined in /etc/rsyslog.conf
are applied. Based on these rules, the rule processor evaluates which actions are to be performed. Each
action has its own action queue. Messages are passed through this queue to the respective action
processor which creates the final output. Note that at this point, several actions can run simultaneously
on one message. For this purpose, a message is duplicated and passed to multiple action processors.
Only one queue per action is possible. Depending on configuration, the messages can be sent right to
the action processor without action queuing. This is the behavior of direct queues (see below). In case
the output action fails, the action processor notifies the action queue, which than takes an unprocessed
element back and after some time interval, the action is attempted again.
To sum up, we recognize two positions where queues stand in rsyslog: either in front of the rule
processor as single main message queue or in front of various types of output actions as action queues.
Queues provide two main advantages that both lead to increased performance of message processing:
they serve as buffers that decouple producers and consumers in the structure of rsyslog
they allow for parallelization of actions performed on messages
Apart from this, queues can be configured with several directives to provide optimal performance for your
system. These configuration options are covered in the following chapters. For more information, see
Section 19.10, “Online Documentation”.
$objectQueueType queue_type
Here, you can apply the setting for the main message queue (replace object with MainMsg) or for an
action queue (replace object with Action). Replace queue_type with one of direct, linkedlist
or fixedarray (which are in-memory queues), or disk.
The default setting for a main message queue is the FixedArray queue with a limit of 10,000 messages.
Action queues are by default set as Direct queues
Direct Queues
For many simple operations, such as when writing output to a local file, building a queue in front of an
action is not needed. To avoid queuing, use:
$objectQueueType Direct
370
Chapter 19. Viewing and Managing Log Files
Replace object with MainMsg or with Action to use this option to the main message queue or for an
action queue respectively. With direct queue, messages are passed directly and immediately from the
producer to the consumer.
Disk Queues
Disk queues store messages strictly on hard drive, which makes them highly reliable but also the slowest
of all possible queuing modes. This mode can be used to prevent the loss of highly important log data.
However, disk queues are not recommended in regular use cases. To set a disk queue, type the
following into /etc/rsyslog.conf:
$objectQueueType Disk
Replace object with MainMsg or with Action to use this option to the main message queue or for an
action queue respectively. Disk queues are written in parts of default size 10 Mb. This default size can be
modified with the following configuration directive:
$objectQueueMaxFileSize size
where size represents the specified size of disk queue part. The defined size limit is not restrictive,
rsyslog always writes one complete queue entry, even if it violates the size limit. Each part of a disk
queue matches with an individual file. The naming directive for these files looks as follows:
$objectQueueFilename name
This sets a name prefix for the file followed by a 7-digit number starting at one and incremented for each
file.
In-memory Queues
With in-memory queue, the enqueued messages are held in memory which makes the process very fast.
The queued data are lost in case of a hard reset or after a regular shutdown. However, you can use the
$ActionQueueSaveOnShutdown setting to save the data before shutdown. There are two types of in-
memory queues:
FixedArray queue — the default mode for the main message queue, with a limit of 10,000 elements.
This type of queue uses a fixed, pre-allocated array that holds pointers to queue elements. Due to
these pointers, even if the queue is empty a certain amount of memory is consumed. However,
FixedArray offers the best run time performance and is optimal when you expect a relatively low
number of queued messages and high performance.
LinkedList queue — here, all structures are dynamically allocated in a linked list, thus the memory is
allocated only when needed. LinkedList queues handle occasional message bursts very well.
In general, use LinkedList queues when in doubt. Compared to FixedArray, it consumes less memory
and lowers the processing overhead.
$objectQueueType LinkedList
$objectQueueType FixedArray
Replace object with MainMsg or with Action to use this option to the main message queue or for an
action queue respectively.
371
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The disk queue is activated if the in-memory queue is full or needs to be persisted on shutdown. With a
disk-assisted queue, you can set both disk-specific and in-memory specific configuration parameters.
This type of queue is probably the most commonly used, it is especially useful for potentially long-running
and unreliable actions.
To specify the functioning of a disk-assisted in-memory queue, use the so-called watermarks:
$objectQueueHighWatermark number
$objectQueueLowWatermark number
Replace object with MainMsg or with Action to use this option to the main message queue or for an
action queue respectively. Replace number with a number of enqueued messages. When an in-memory
queue reaches the number defined by the high watermark, it starts writing messages to disk and
continues until the in-memory queue size drops to the number defined with the low watermark. Correctly
set watermarks minimize unnecessary disk writes, but also leave memory space for message bursts
since writing to disk files is rather lengthy. Therefore, the high watermark must be lower than the whole
queue capacity set with $objectQueueSize. The difference between the high watermark and the overall
queue size is a spare memory buffer reserved for message bursts. On the other hand, setting the high
water mark too low will turn on disk assistance unnecessarily often.
$objectQueueHighWatermark number
Replace object with MainMsg or with Action to use this option to the main message queue or for an
action queue respectively. Replace number with a number of enqueued messages. You can set the
queue size only as the number of messages, not as their actual memory size. The default queue size is
10,000 messages for the main message queue and ruleset queues, and 1000 for action queues.
Disk assisted queues are unlimited by default and can not be restricted with this directive, but you can
reserve them physical disk space in bytes with the following settings:
$objectQueueMaxDiscSpace number
Replace object with MainMsg or with Action. When the size limit specified by number is hit,
372
Chapter 19. Viewing and Managing Log Files
messages are discarded until sufficient amount of space is freed by dequeued messages.
Discarding Messages
When a queue reaches a certain number of messages, you can discard less important messages in
order to save space in queue for entries of higher priority. The threshold that launches the discarding
process can be set with the so-called discard mark:
$objectQueueDiscardMark number
Replace object with MainMsg or with Action to use this option to the main message queue or for an
action queue respectively. Here, number stands for a number of messages that have to be in queue to
start the discarding process. To define which messages to discard, use:
$objectQueueDiscardSeverity priority
Replace priority with one of the following keywords (or with a number): debug (0), info (1), notice
(2), warning (3), err (4), crit (5), alert (6), and em erg (7). With this setting, both newly incoming
and already queued messages with lower then defined priority are erased from the queue immediately
after the discard mark is reached.
Using Timeframes
You can configure rsyslog to process queues during a specific time period. With this option, you can for
example transfer some processing into off-peak hours. To define a timeframe, use the following syntax:
$objectQueueDequeueTimeBegin hour
$objectQueueDequeueTimeEnd hour
With hour you can specify hours that bound your timeframe. Use the 24-hour format without minutes.
$objectQueueWorkerThreadMinimumMessages number
Replace number with a number of messages that will trigger a supplemental worker thread. For example,
with number set to 100, a new worker thread is started when more than 100 messages arrive. When
more than 200 messages arrive, the third worker thread starts and so on. However, too many working
threads running in parallel become ineffective, so you can limit the maximum number of them by using:
$objectQueueWorkerThreads number
where number stands for a maximum number off working threads that can run in parallel. For the main
message queue, the default limit is 5 messages. Once a working thread has been started, it keeps
running until an inactivity timeout appears. To set the length of timeout, type:
$objectQueueWorkerTimeoutThreadShutdown time
373
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Replace time with the duration set in milliseconds. Without this setting, a zero timeout is applied and a
worker thread is terminated immediately when it runs out of messages. If you specify time as -1, no
thread will be closed.
Batch Dequeuing
To increase performance, you can configure rsyslog to dequeue multiple messages at once. To set the
upper limit for such dequeueing, use:
$objectQueueDequeueBatchSize number
Replace number with maximum number of messages that can be dequeued at once. Note that higher
setting combined with higher number of permitted working threads results in greater memory
consumption.
Terminating Queues
When terminating a queue that still contains messages, you can try to minimize the data loss by
specifying a time interval for worker threads to finish the queue processing:
$objectQueueTimeoutShutdown time
Specify time in milliseconds. If after that period there are still some enqueued messages, workers finish
the current data element and then terminate. Unprocessed messages are therefore lost. Another time
interval can be set for workers to finish the final element:
$objectQueueTimeoutActionCompletion time
In case this timeout expires, any remaining workers are shut down. To save data at shutdown, use:
$objectQueueTimeoutSaveOnShutdown time
If set, all queue elements are saved to disk before rsyslog terminates.
$ModLoad MODULE
where $ModLoad is the global directive that loads the specified module and MODULE represents your
desired module. For example, if you want to load the Text File Input Module (im file) that enables
rsyslog to convert any standard text files into syslog messages, specify the following line in your
/etc/rsyslog.conf configuration file:
$ModLoad imfile
rsyslog offers a number of modules which are split into the following main categories:
374
Chapter 19. Viewing and Managing Log Files
Input Modules — Input modules gather messages from various sources. The name of an input
module always starts with the im prefix, such as im file, im journal, etc.
Output Modules — Output modules provide a facility to store messages into various targets such as
sending them across network, storing them in a database or encrypting them. The name of an output
module always starts with the om prefix, such as om snm p, om relp, etc.
Parser Modules — The name of a parser module always starts with the pm prefix, such as
pm rfc54 24 , pm rfc3164 , etc. These modules are useful when you want to create your custom
parsing or to parse malformed messages. With moderate knowledge of the C programming
language, you can create your own message parser.
Message Modification Modules — Message modification modules change content of syslog
messages. Names of these modules start with the m m prefix. Message Modification Modules such as
m m anon, m m norm alize, or m m jsonparse are used for anonymization or normalization of
messages.
String Generator Modules — String generator modules generate strings based on the message
content and strongly cooperate with the template feature provided by rsyslog. For more information
on templates, refer to Section 19.2.3, “Templates”. The name of a string generator module always
starts with the sm prefix, such as sm file or sm tradfile.
Library Modules — Library modules provide functionality for other loadable modules. These modules
are loaded automatically by rsyslog when needed and cannot be configured by the user.
A comprehensive list of all available modules and their detailed description can be found at
http://www.rsyslog.com/doc/rsyslog_conf_modules.html
Note that when rsyslog loads any modules, it provides them with access to some of its functions
and data. This poses a possible security threat. To minimize security risks, use trustworthy
modules only.
$ModLoad imfile
$InputFilePollInterval int
It is sufficient to load im file once, even when you import multiple files. The $InputFilePollInterval
global directive specifies how often rsyslog checks for changes in connected text files. The default
interval is 10 seconds, to change it, replace int with a time interval specified in seconds.
To identify the text files you want to import, use the following syntax in /etc/rsyslog.conf:
375
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
# File 1
$InputFileName path_to_file
$InputFileTag tag:
$InputFileStateFile state_file_name
$InputFileSeverity severity
$InputFileFacility facility
$InputRunFileMonitor
# File 2
$InputFileName path_to_file2
...
Apart from required directives, there are several other settings you can apply on the text input. You can
set the severity of messages by replacing severity or replace facility to define the subsystem that
produced the message.
The Apache HTTP server creates log files in text format. To apply the processing capabilities of
rsyslog on apache error messages, you need to first import them with use of the im file module.
Type the following into /etc/rsyslog.conf:
$ModLoad imfile
$InputFileName var/log/httpd/error_log
$InputFileTag apache-error:
$InputFileStateFile state-apache-error
$InputRunFileMonitor
376
Chapter 19. Viewing and Managing Log Files
To store the rsyslog messages in a MySQL database, type the following into /etc/rsyslog.conf:
$ModLoad ommysql
$ActionOmmysqlServerPort 1234
*.* :ommysql:database-server,database-name,database-userid,database-password
First, the output module is loaded, then the communication port is specified. Additional information,
such as name of the server and the database, and authentication data, is specified on the last line of
the above example.
Transport Layer Security (TLS) is a cryptographic protocol designed to provide communication security
over the network. When using TLS, rsyslog messages are encrypted before sending, and mutual
authentication exists between the sender and receiver.
Generic Security Service API (GSSAPI) is an application programming interface for programs to access
security services. To use it in connection with rsyslog you must have a functioning Kerberos
environment.
By default, rsyslogd uses the im journal module as a default input mode for journal files. With this
module, you import not only the messages but also the structured data provided by journald. Also you
can import older data from journald (unless you forbid it with the
$Im journalIgnorePreviousMessages directive. See Section 19.6.1, “Importing Data from Journal”
for basic configuration of im journal.
As an alternative, you can configure rsyslogd to read from the socket provided by journal as an
output for syslog-based applications. The path to the socket is /run/system d/journal/syslog. Use
this option when you wish to maintain plain rsyslog messages. Compared to im journal the socket
input currently offers more features, such as ruleset binding or filtering. To import Journal data trough
the socket, use the following configuration in /etc/rsyslog.conf:
377
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
$ModLoad imuxsock
$SystemLogSocketName /run/systemd/journal/syslog
You can also output messages from Rsyslog to Journal with the om journal module.
$ModLoad omjournal
*.* :omjournal:
For instance, the following configuration forwards all received on tcp port 10514 to the Journal:
$ModLoad imtcp
$ModLoad omjournal
$RuleSet remote
*.* :omjournal:
$InputTCPServerBindRuleset remote
$InputTCPServerRun 10514
Searching structured data with use of key-value pairs is faster and more precise than searching text files
with regular expressions. The structure also lets you to search for the same entry in messages produced
by various applications. Also, you can store JSON files in a document database such as MongoDB, which
provides additional performance and analysis capabilities. On the other hand, a structured message
requires more disk space than the unstructured one.
In rsyslog, log messages with meta data are pulled form Journal with use of the im journal module.
With the m m jsonparse module, you can parse data imported from Journal and form other sources
and process them further, for example as a database output. For parsing to be successful,
m m jsonparse requires input messages to be structured in a way that is defined by the Lumberjack
project.
The Lumberjack project aims to add structured logging to rsyslog in a backward-compatible way. To
identify a structured message, Lumberjack specifies the @cee: string that prepends the actual JSON
378
Chapter 19. Viewing and Managing Log Files
structure. Also, Lumberjack defines the the list of standard field names that should be used for entities
in the JSON string. For more information on Lumberjack, see Section 19.10, “Online Documentation”.
To build this structure inside Rsyslog, a template is used, see Section 19.6.2, “Filtering Structured
Messages”. Applications and servers can employ the libum berlog library to generate messages in
the lumberjack-compliant form. For more information on libum berlog, see Section 19.10, “Online
Documentation”.
To import data from Journal to Rsyslog, use the following configuration in /etc/rsyslog.conf:
$ModLoad imjournal
$imjournalPersistStateInterval number_of_messages
$imjournalStateFile path
$imjournalRatelimitInterval seconds
$imjournalRatelimitBurst burst_number
$ImjournalIgnorePreviousMessages off/on
*.* :imjournal:
With number_of_messages, you can specify how often will the Journal data be saved. This will
happen each time the specified number of messages is reached.
Replace path with a path to the state file. This file tracks the journal entry that was the last one
processed.
With seconds, you set the length of the rate limit interval. The number of messages processed during
this interval can not exceed the value specified in burst_number. The default setting is 20,000
messages per 600 seconds. Rsyslog discards messages that come after the maximum burst within
the rate limit was reached.
With $Im journalIgnorePreviousMessages you can ignore messages that are currently in
Journal and import only new messages, which is used when there is no state file specified. The
default setting is off. Please note that if this setting is off and there is no state file, all messages in
the Journal are processed, even if they were already processed in previous rsyslog session.
379
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Note
You can use im journal simultaneously with im uxsock module that is the traditional system log
input. However, to avoid message duplication, you must prevent im uxsock from reading the
Journal's system socket. To do so, use the $Om itLocalLogging directive:
$ModLoad imuxsock
$ModLoad imjournal
$OmitLocalLogging on
$AddUnixListenSocket /run/systemd/journal/syslog
You can translate all data and meta data stored by Journal into structured messages. Some of these
meta data entries are listed in Example 19.15, “Verbose journalctl Output”, for complete list of journal
fields see system d.journal-fields man page. For example, it is possible to focus on kernel journal
fields, that are used by messages originating in the kernel.
This template prepends @ cee: string to the JSON string and can be applied for example when creating
an output file with om file module. To access JSON field names, use the $! prefix. For example, the
following filter condition searches for messages with specific hostname and UID :
To parse lumberjack-formatted JSON messages with m m jsonparse, use the following configuration in
the /etc/rsyslog.conf:
$ModLoad mmjsonparse
*.* :mmjsonparse:
In this example, the m m jsonparse module is loaded on the first line, then all messages are forwarded
to it. Currently, there are no configuration parameters available for m m jsonparse.
380
Chapter 19. Viewing and Managing Log Files
To forward log messages into the MongoDB, use the following syntax in the /etc/rsyslog.conf
(configuration parameters for ommongodb are available only in the new configuration format - see
Section 19.2.6, “Using the New Configuration Format”):
$ModLoad ommongodb
Replace DB_server with the name or address of the MongoDB server. Specify port if you want to
select a non-standard port from the MongoDB server. The default port value is 0 and usually there
is no need to change this parameter.
With DB_name, you can identify to which database from the MongoDB server you want to direct your
output. Replace collection_name with a name of collection in this database. In MongoDB, collection
is a group documents, the equivalent of RDBMS table.
You can set your login details by replacing UID and password.
You can shape the form of the final database output with use of templates. By default, ryslog uses a
template based on standard lumberjack field names.
rsyslogd -dn
With this command, rsyslogd produces debugging information and prints it to the standard output. The
-n stands for "no fork". You can modify debugging with environmental variables, for example, you can
store the debug output in a log file. Before starting rsyslogd, type the following in the command line:
export RSYSLOG_DEBUGLOG="path"
export RSYSLOG_DEBUG="Debug"
Replace path with a desired location for the file where the debugging information will be logged. For a
complete list of options available for the RSYSLOG_DEBUG variable, see the related section in the
rsyslogd man page.
rsyslogd -N 1
Where 1 represents level of verbosity of the output message. This is a forward compatibility option
because currently, only one level is provided. However, you must add this argument to run the validation.
381
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Logging data are collected, stored and processed by the Journal's journald service. It creates and
maintains binary files called journals based on logging information that is received from the kernel, from
user processes, from standard output and standard error output of system services or via its native API.
These journals are structured and indexed, which provides relatively fast seek times. Journal entries can
carry a unique identifier. The journald service collects numerous meta data fields for each log
message and the actual journal files are secured.
journalctl
An output of this command is a list of all log files generated on the system including messages generated
by system components and by users. The structure of this output is similar to one used in
var/log/m essages/ but with certain improvements:
the priority of entries is marked visually. Lines of error priority and higher are highlighted with red
color and a bold font is used for lines with notice and warning priority
the timestamps are converted into local time-zone of your system
all logged data are shown, including rotated logs
the beginning of a boot is tagged with a special line
The following is an example output provided by the journalctl tool. When called without parameters,
the listed entries begin with a timestamp, then the hostname and application that performed the
operation is mentioned followed by the actual message.This example shows the first three entries in
the journal log.
# journalctl
-- Logs begin at Thu 2013-08-01 15:42:12 CEST, end at Thu 2013-08-01 15:48:48
CEST. --
Aug 01 15:42:12 localhost systemd-journal[54]: Allowing runtime journal files to
grow to 49.7M.
Aug 01 15:42:12 localhost kernel: Initializing cgroup subsys cpuset
Aug 01 15:42:12 localhost kernel: Initializing cgroup subsys cpu
[...]
In many cases, only the latest entries in the journal log are relevant. The simplest way to reduce
journalctl output is to use the -n option that lists only the specified number of most recent log
entries:
journalctl -n Number
Replace Number with a number of lines you want to show. When no number is specified, journalctl
displays the ten most recent entries.
The journalctl command allows you to control the form of the output with the following syntax:
journalctl -o form
382
Chapter 19. Viewing and Managing Log Files
Replace form with a keyword specifying a desired form of output. There are several options, such as
verbose, which returns full-structured entry items with all fields, export, which creates a binary stream
suitable for backups and network transfer, and json, which formats entries as a JSON data structures.
For the full list of keywords, see journalctl man page.
# journalctl -o verbose
[...]
[...]
This example lists fields that identify a single log entry. These meta data can be used for message
filtering as shown in Section 19.8.4, “Advanced Filtering” For a complete description of all possible
fields see system d.journal-fields(7) man page.
Here, replace username with a name of the user to be added to the adm group. This user then receives
the same output of the journalctl command as the root user.
383
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
When called without parameters, journalctl shows the full list of entries, starting with the oldest entry
collected. With the live view, you can supervise the log messages in real time as new entries are
continuously printed as they appear. To start journalctl in live view mode, type:
journalctl -f
This command returns a list of the ten most current log lines. The journalctl utility then stays running
and waits for new changes to view them immediately.
Filtering by Priority
Log messages are often used to track erroneous behavior on the system. To view only entries with a
selected or higher priority, use the following syntax:
journalctl -p priority
Here, replace priority with one of the following keywords (or with a number): debug (0), info (1),
notice (2), warning (3), err (4), crit (5), alert (6), and em erg (7).
journalctl -p err
Filtering by Time
To view log entries only form the current boot, type:
journalctl -b
If you reboot your system just occasionally, the -b will not significantly reduce the output of
journalctl. In such cases, time-based filtering is more helpful:
With --since and --until, you can view only log messages created within a specified time range. You
can pass values to these options in form of date or time or both as shown in the following example.
Filtering options can be combined to narrow the set of results according to your requests. For
example, to view the warning or higher priority messages from certain point in time, type:
384
Chapter 19. Viewing and Managing Log Files
Advanced Filtering
Example 19.15, “Verbose journalctl Output” lists a set of fields that specify a log entry and can all be
used for filtering. For a complete description of meta data that system d can store, see
system d.journal-fields man page. This meta data is collected for each log message, without user
intervention. Values are usually text-based, but can take binary and large values; fields can have multiple
values assigned though it is not very common.
To view a list of unique values that occur in a specified field, use the following syntax:
journalctl -F fieldname
To show only log entries that fit a specific condition, use the following syntax:
journalctl fieldname=value
Replace fieldname with a name of a field and value with a specific value contained in that field. As a
result, only lines that match this condition are returned.
As the number of meta data fields stored by system d is quite large, it is easy to forget the exact
name of your field of interest. When unsure, type:
journalctl
and press the T ab key two times. This shows a list of available field names. T ab completion
based on context works on field names, so you can type a distinctive set of letters from a field
name and then press T ab to complete the name automatically. Similarly, you can list unique
values from a field. Type:
journalctl fieldname=
Specifying two matches for the same field results in a logical OR combination of the matches. Entries
matching value1 or value2 are displayed.
Also, you can specify multiple field-value pairs to further reduce the output set:
If you specify two matches for different field names, they will be combined with a logical AND. Entries
have to match both conditions to be shown.
With use of the + symbol, you can set a logical OR combination of matches for multiple fields:
385
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
This command returns entries that match at least one of the conditions, not only those that match the
both of them.
To display entries created by avahi-daem on.service or crond.service under user with UID
70, use the following command:
Since there are two values set for the _SYST EMD_UNIT field, both results will be displayed, but only
when matching the _UID=70 condition. This can be expressed simply as: (UID=70 and (avahi or
cron)).
You can apply the aforementioned filtering also in the live view mode to keep track of the latest changes
in your selected group of log entries:
Even with persistent storage the amount of data stored depend on free memory, there is no
guarantee to cover a specific time span
More disk space is needed for logs
To enable persistent storage for Journal, create the journal directory manually as shown in the following
example. As root type:
mkdir -p /var/log/journal
386
Chapter 19. Viewing and Managing Log Files
To view system log files in an interactive, real-time application, use the Log File Viewer.
In order to use the Log File Viewer, first ensure the gnome-system-log package is installed on
your system by running, as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
After you have installed the gnome-system-log package, you can open the Log File Viewer by clicking
on Applications → System Tools → Log File Viewer, or type the following command at a shell
prompt:
~]$ gnome-system-log
The application only displays log files that exist; thus, the list might differ from the one shown in
Figure 19.2, “Log File Viewer”.
The Log File Viewer application lets you filter any existing log file. Click on Filters from the menu and
select Manage Filters to define or edit your desired filter.
387
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Adding or editing a filter lets you define its parameters as is shown in Figure 19.4, “Log File Viewer -
defining a filter”.
When you have at least one filter defined, you may select it from the Filters menu and it will
automatically search for the strings you have defined in the filter and highlight/hide every successful
match in the log file you are currently viewing.
388
Chapter 19. Viewing and Managing Log Files
When you check the Show m atches only option, only the matched strings will be shown in the log file
you are currently viewing.
Click on the Open button to open the file. The file is immediately added to the viewing list where you can
select it and view its contents.
389
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The Log File Viewer also allows you to open log files zipped in the .gz format.
Installed Documentation
rsyslogd(8) — The manual page for the rsyslogd daemon documents its usage.
rsyslog.conf(5) — The manual page named rsyslog.conf documents available configuration
options.
logrotate(8) — The manual page for the logrotate utility explains in greater detail how to
configure and use it.
journalctl(1) — The manual page for the journalctl daemon documents its usage.
journald.conf(5) — This manual page documents available configuration options.
system d.journal-fields(7) — This manual page lists special Journal fields.
390
Chapter 19. Viewing and Managing Log Files
Online Documentation
rsyslog Home Page — The rsyslog home page offers a thorough technical breakdown of its
features, documentation, configuration examples, and video tutorials.
RainerScript documentation on the rsyslog Home Page — Commented summary of data types,
expressions, and functions available in RainerScript.
Description of queues on the rsyslog Home Page — General information on various types of
message queues and their usage.
rsyslog Wiki — The rsyslog Wiki contains useful configuration examples.
Lumberjack Home Page — Lumberjack Home Page provides an overview of the libum berlog
project.
libumberlog Home Page — libumberlog Home Page provides an overview of the libum berlog
library.
See Also
Chapter 4, Gaining Privileges documents how to gain administrative privileges by using the su and
sudo commands.
Chapter 7, Managing Services with systemd provides more information on systemd and documents
how to use the system ctl command to manage system services.
391
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Red Hat Enterprise Linux is pre-configured to run important system tasks to keep the system updated.
For example, the slocate database used by the locate command is updated daily. A system
administrator can use automated tasks to perform periodic backups, monitor the system, run custom
scripts, and so on.
Red Hat Enterprise Linux comes with the following automated task utilities: cron, anacron, at, and
batch.
Every utility is intended for scheduling a different job type: while Cron and Anacron schedule recurring
jobs, At and Batch schedule one-time jobs (refer to Section 20.1, “Cron and Anacron” and Section 20.2,
“At and Batch” respectively).
Cron jobs can run as often as every minute. However, the utility assumes that the system is running
continuously and if the system is not on at the time when a job is scheduled, the job is not executed.
On the other hand, Anacron remembers the scheduled jobs if the system is not running at the time when
the job is scheduled. The job is then executed as soon as the system is up. However, Anacron can only
run a job once a day.
To determine if the packages are already installed on your system, issue the following command:
The command returns full names of the cronie and cronie-anacron packages if already installed, or
notifies you that the packages are not available.
To install these packages, use the yum command in the following form as root:
For example, to install both Cron and Anacron, type the following at a shell prompt:
For more information on how to install new packages in Red Hat Enterprise Linux, see Section 5.2.4,
“Installing Packages”.
392
Chapter 20. Automating System Tasks
how to start, stop, and restart the crond service, and shows how to configure it to start automatically at
boot time. For more information on how to manage system service in Red Hat Enterprise Linux 7 in
general, see Chapter 7, Managing Services with systemd.
To run the crond service in the current session, type the following at a shell prompt as root:
To configure the service to start automatically at boot time, use the following command as root:
To prevent the service from starting automatically at boot time, use the following command as root:
This command stops the service and starts it again in quick succession.
SHELL=/bin/sh
PATH=/sbin:/bin:/usr/sbin:/usr/bin
MAILTO=root
# the maximal random delay added to the base delay of the jobs
RANDOM_DELAY=45
# the jobs will be started during the following hours only
START_HOURS_RANGE=3-22
The first three lines define the variables that configure the environment in which the anacron tasks run:
393
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
SHELL — shell environment used for running jobs (in the example, the Bash shell)
PAT H — paths to executable programs
MAILT O — username of the user who receives the output of the anacron jobs by email
If the MAILT O variable is not defined (MAILT O=), the email is not sent.
The next two variables modify the scheduled time for the defined jobs:
RANDOM_DELAY — maximum number of minutes that will be added to the delay in m inutes
variable which is specified for each job
The minimum delay value is set, by default, to 6 minutes.
If RANDOM_DELAY is, for example, set to 12, then between 6 and 12 minutes are added to the delay
in m inutes for each job in that particular anacrontab. RANDOM_DELAY can also be set to a value
below 6, including 0. When set to 0, no random delay is added. This proves to be useful when, for
example, more computers that share one network connection need to download the same data every
day.
ST ART _HOURS_RANGE — interval, when scheduled jobs can be run, in hours
In case the time interval is missed, for example due to a power failure, the scheduled jobs are not
executed that day.
The remaining lines in the /etc/anacrontab file represent scheduled jobs and follow this format:
Any lines that begin with a hash sign (#) are comments and are not processed.
394
Chapter 20. Automating System Tasks
SHELL=/bin/sh
PATH=/sbin:/bin:/usr/sbin:/usr/bin
MAILTO=root
# the maximal random delay added to the base delay of the jobs
RANDOM_DELAY=30
# the jobs will be started during the following hours only
START_HOURS_RANGE=16-20
All jobs defined in this anacrontab file are randomly delayed by 6-30 minutes and can be executed
between 16:00 and 20:00.
The first defined job is triggered daily between 16:26 and 16:50 (RANDOM_DELAY is between 6 and 30
minutes; the delay in minutes property adds 20 minutes). The command specified for this job executes
all present programs in the /etc/cron.daily directory using the run-parts script (the run-parts
scripts accepts a directory as a command-line argument and sequentially executes every program in the
directory).
The second job executes the weeklyjob.bash script in the /etc directory once a week.
The third job runs a command, which writes the contents of /proc to the /tm p/proc file (ls /proc
>> /tm p/proc) once a month.
SHELL=/bin/bash
PATH=/sbin:/bin:/usr/sbin:/usr/bin
MAILTO=root
HOME=/
# For details see man 4 crontabs
# Example of job definition:
# .---------------- minute (0 - 59)
# | .------------- hour (0 - 23)
# | | .---------- day of month (1 - 31)
# | | | .------- month (1 - 12) OR jan,feb,mar,apr ...
# | | | | .---- day of week (0 - 6) (Sunday=0 or 7) OR sun,mon,tue,wed,thu,fri,sat
# | | | | |
# * * * * * username command to be executed
The first three lines contain the same variable definitions as an anacrontab file: SHELL, PAT H, and
MAILT O. For more information about these variables, refer to Section 20.1.3, “Configuring Anacron
Jobs”.
In addition, the file can define the HOME variable. The HOME variable defines the directory, which will be
used as the home directory when executing commands or scripts run by the job.
The remaining lines in the /etc/crontab file represent scheduled jobs and have the following format:
395
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
usernam e — specifies the user under which the jobs are run.
com m and — the command to be executed.
The command can be either a command such as ls /proc /tm p/proc or a command which
executes a custom script.
For any of the above values, an asterisk (*) can be used to specify all valid values. If you, for example,
define the month value as an asterisk, the job will be executed every month within the constraints of the
other values.
A hyphen (-) between integers specifies a range of integers. For example, 1-4 means the integers 1, 2,
3, and 4.
A list of values separated by commas (,) specifies a list. For example, 3,4 ,6,8 indicates exactly these
four integers.
The forward slash (/) can be used to specify step values. The value of an integer will be skipped within a
range following the range with /integer. For example, the minute value defined as 0-59/2 denotes
every other minute in the minute field. Step values can also be used with an asterisk. For instance, if the
month value is defined as * /3, the task will run every third month.
Any lines that begin with a hash sign (#) are comments and are not processed.
Users other than root can configure cron tasks with the crontab utility. The user-defined crontabs are
stored in the /var/spool/cron/ directory and executed as if run by the users that created them.
To create a crontab as a specific user, login as that user and type the command crontab -e to edit the
user's crontab with the editor specified in the VISUAL or EDIT OR environment variable. The file uses the
same format as /etc/crontab. When the changes to the crontab are saved, the crontab is stored
according to the user name and written to the file /var/spool/cron/username. To list the contents of
the current user's crontab file, use the crontab -l command.
The /etc/cron.d/ directory contains files that have the same syntax as the /etc/crontab file. Only
root is allowed to create and modify files in this directory.
396
Chapter 20. Automating System Tasks
The cron daemon checks the /etc/anacrontab file, the /etc/crontab file, the
/etc/cron.d/ directory, and the /var/spool/cron/ directory every minute for changes and
the detected changes are loaded into memory. It is therefore not necessary to restart the daemon
after an anacrontab or a crontab file have been changed.
If the cron.allow file exists, only users listed in the file are allowed to use cron, and the cron.deny
file is ignored.
If the cron.allow file does not exist, users listed in the cron.deny file are not allowed to use Cron.
The Cron daemon (crond) does not have to be restarted if the access control files are modified. The
access control files are checked each time a user tries to add or delete a cron job.
The root user can always use cron, regardless of the user names listed in the access control files.
You can control the access also through Pluggable Authentication Modules (PAM). The settings are
stored in the /etc/security/access.conf file. For example, after adding the following line to the
file, no other user but the root user can create crontabs:
The forbidden jobs are logged in an appropriate log file or, when using crontab -e, returned to the
standard output. For more information, refer to access.conf.5 (that is, m an 5 access.conf).
To define a black list, create a jobs.deny file in the directory that run-parts scripts will be executing
from. For example, if you need to omit a particular program from /etc/cron.daily, create the
/etc/cron.daily/jobs.deny file. In this file, specify the names of the programs to be omitted from
execution (only programs located in the same directory can be enlisted). If a job runs a command which
runs the programs from the cron.daily directory, such as run-parts /etc/cron.daily, the
programs defined in the jobs.deny file will not be executed.
The principles of jobs.deny and jobs.allow are the same as those of cron.deny and
cron.allow described in section Section 20.1.5, “Controlling Access to Cron”.
397
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
While Cron is used to schedule recurring tasks, the At utility is used to schedule a one-time task at a
specific time and the Batch utility is used to schedule a one-time task to be executed when the system
load average drops below 0.8.
rpm -q at
The command returns the full name of the at package if already installed or notifies you that the package
is not available.
To install the packages, use the yum command in the following form as root:
For example, to install both At and Batch, type the following at a shell prompt:
For more information on how to install new packages in Red Hat Enterprise Linux, see Section 5.2.4,
“Installing Packages”.
To run the atd service in the current session, type the following at a shell prompt as root:
To configure the service to start automatically at boot time, use the following command as root:
Note
It is recommended that you configure your system to start the atd service automatically at boot
time.
398
Chapter 20. Automating System Tasks
To prevent the service from starting automatically at boot time, use the following command as root:
This command stops the service and starts it again in quick succession.
1. On the command line, type the command at TIME, where TIME is the time when the command is
to be executed.
The TIME argument can be defined in any of the following formats:
HH:MM specifies the exact hour and minute; For example, 04 :00 specifies 4:00 a.m.
m idnight specifies 12:00 a.m.
noon specifies 12:00 p.m.
teatim e specifies 4:00 p.m.
MONTHDAYYEAR format; For example, January 15 2012 specifies the 15th day of January in
the year 2012. The year value is optional.
MMDDYY, MM/DD/YY, or MM.DD.YY formats; For example, 011512 for the 15th day of January in
the year 2012.
now + TIME where TIME is defined as an integer and the value type: minutes, hours, days, or
weeks. For example, now + 5 days specifies that the command will be executed at the same
time five days from now.
The time must be specified first, followed by the optional date. For more information about the
time format, refer to the /usr/share/doc/at-<version>/tim espec text file.
If the specified time has past, the job is executed at the time the next day.
2. In the displayed at> prompt, define the job commands:
A. Type the command the job should execute and press Enter. Optionally, repeat the step to
provide multiple commands.
B. Enter a shell script at the prompt and press Enter after each line in the script.
The job will use the shell set in the user's SHELL environment, the user's login shell, or
/bin/sh (whichever is found first).
3. Once finished, press Ctrl+D on an empty line to exit the prompt.
If the set of commands or the script tries to display information to standard output, the output is emailed
to the user.
To view the list of pending jobs, use the atq command. Refer to Section 20.2.5, “Viewing Pending Jobs”
for more information.
You can also restrict the usage of the at command. For more information, refer to Section 20.2.7,
399
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
If the set of commands or the script tries to display information to standard output, the output is emailed
to the user.
To view the list of pending jobs, use the atq command. Refer to Section 20.2.5, “Viewing Pending Jobs”
for more information.
You can also restrict the usage of the batch command. For more information, refer to Section 20.2.7,
“Controlling Access to At and Batch” for details.
Option Description
-f Read the commands or shell script from a file instead of specifying them
at the prompt.
-m Send email to the user when the job has been completed.
-v Display the time that the job is executed.
If the file at.allow exists, only users listed in the file are allowed to use at or batch, and the at.deny
400
Chapter 20. Automating System Tasks
file is ignored.
If at.allow does not exist, users listed in at.deny are not allowed to use at or batch.
The at daemon (atd) does not have to be restarted if the access control files are modified. The access
control files are read each time a user tries to execute the at or batch commands.
The root user can always execute at and batch commands, regardless of the content of the access
control files.
401
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Many processors include dedicated performance monitoring hardware. This hardware makes it possible
to detect when certain events happen (such as the requested data not being in cache). The hardware
normally takes the form of one or more counters that are incremented each time an event takes place.
When the counter value increments, an interrupt is generated, making it possible to control the amount
of detail (and therefore, overhead) produced by performance monitoring.
OProfile uses this hardware (or a timer-based substitute in cases where performance monitoring
hardware is not present) to collect samples of performance-related data each time a counter generates
an interrupt. These samples are periodically written out to disk; later, the data contained in these
samples can then be used to generate reports on system-level and application-level performance.
OProfile is a useful tool, but be aware of some limitations when using it:
Use of shared libraries — Samples for code in shared libraries are not attributed to the particular
application unless the --separate=library option is used.
Performance monitoring samples are inexact — When a performance monitoring register triggers a
sample, the interrupt handling is not precise like a divide by zero exception. Due to the out-of-order
execution of instructions by the processor, the sample may be recorded on a nearby instruction.
opreport does not associate samples for inline functions properly — opreport uses a simple
address range mechanism to determine which function an address is in. Inline function samples are
not attributed to the inline function but rather to the function the inline function was inserted into.
OProfile accumulates data from multiple runs — OProfile is a system-wide profiler and expects
processes to start up and shut down multiple times. Thus, samples from multiple runs accumulate.
Use the command opcontrol --reset to clear out the samples from previous runs.
Hardware performance counters do not work on guest virtual machines — Because the hardware
performance counters are not available on virtual systems, you need to use the tim er mode. Run
the command opcontrol --deinit, and then execute m odprobe oprofile tim er=1 to
enable the tim er mode.
Non-CPU-limited performance problems — OProfile is oriented to finding problems with CPU-limited
processes. OProfile does not identify processes that are asleep because they are waiting on locks or
for some other event to occur (for example an I/O device to finish an operation).
402
Chapter 21. OProfile
Command Description
ophelp Displays available events for the system's processor along with a brief
description of each.
opim port Converts sample database files from a foreign binary format to the
native format for the system. Only use this option when analyzing a
sample database from a different architecture.
opannotate Creates annotated source for an executable if the application was
compiled with debugging symbols. Refer to Section 21.6.4, “Using
opannotate” for details.
opcontrol Configures what data is collected. Refer to Section 21.3, “Configuring
OProfile Using Legacy Mode” for details.
operf Recommended tool to be used in place of opcontrol for profiling.
Refer to Section 21.2, “Using operf” for details. for details. For
differences between operf and opcontrol see Section 21.1.1,
“operf vs. opcontrol”.
opreport Retrieves profile data. Refer to Section 21.6.1, “Using opreport” for
details.
oprofiled Runs as a daemon to periodically write sample data to disk.
operf
This is the recommended mode for profiling. The operf tool uses the Linux Performance Events
Subsystem, and therefore does not require the oprofile kernel driver. The operf tool allows you to
target your profiling more precisely, as a single process or system-wide, and also allows OProfile to co-
exist better with other tools using the performance monitoring hardware on your system. Unlike
opcontrol, it can be used without the root privileges. However, operf is also capable of system-
wide operations with use of the --system -wide option, where root authority is required.
With operf, there is no initial setup needed. You can invoke operf with command-line options to
specify your profiling settings. After that, you can run the OProfile post-processing tools described in
Section 21.6, “Analyzing the Data”. Refer to Section 21.2, “Using operf” for further information.
Legacy Mode
This mode consists of the opcontrol shell script, the oprofiled daemon, and several post-
processing tools. The opcontrol command is used for configuring, starting, and stopping a profiling
session. An OProfile kernel driver, usually built as a kernel module, is used for collecting samples, which
are then recorded into sample files by oprofiled. You can use legacy mode only if you have root
privileges. In certain cases, such as when you need to sample areas with disabled interrupt request
(IRQ), this is a better alternative.
Before OProfile can be run in legacy mode, it must be configured as shown in Section 21.3, “Configuring
OProfile Using Legacy Mode”. These settings are then applied when starting OProfile (Section 21.4,
“Starting and Stopping OProfile Using Legacy Mode”).
403
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Replace options with desired command-line options to specify your profiling settings. Full set of options
is described in operf man pages. Replace range with one of the following:
--system -wide - this setting allows for global profiling, see Using operf in System-wide Mode
--pid=PID - this is to profile running application, where PID is process ID of the process you wish to
profile.
With command and args, you can define a specific command or application to be profiled, and also the
input arguments that this command or application requires. Either command, --pid or --system -wide
is required, but these cannot be used simultaneously.
When you invoke operf on a command line without setting the range option, data will be collected for
the children processes.
To run operf --system -wide, you need root authority. When finished profiling, you can stop
operf with:
Ctrl-C
If you run operf --system -wide as a background process (with & ), stop it in a controlled
manner in order to process the collected profile data. For this purpose, use:
When running operf --system -wide, it is recommended that your current working directory is
/root or a subdirectory of /root so that sample data files are not stored in locations accessible
by regular users.
operf --vmlinux=vmlinux_path
With this option, you can specify a path to a vmlinux file that matches the running kernel. Kernel samples
will be attributed to this binary, allowing post-processing tools to attribute samples to the appropriate
kernel symbols. If this option is not specified, all kernel samples will be attributed to a pseudo binary
named "no-vmlinux".
404
Chapter 21. OProfile
Most processors contain counters, which are used by OProfile to monitor specific events. As shown in
Table 21.3, “OProfile Processors and Counters”, the number of counters available depends on the
processor.
The events for each counter can be configured via the command line or with a graphical interface. For
more information on the graphical interface, refer to Section 21.10, “Graphical Interface”. If the counter
cannot be set to a specific event, an error message is displayed.
Some older processor models are not supported by the underlying Linux Performance Events
Subsystem kernel and therefore are not supported by operf. If you receive this message:
Your kernel's Performance Events Subsystem does not support your processor
type
when attempting to use operf, try profiling with opcontrol to see if your processor type may
be supported by OProfile's legacy mode.
Since hardware performance counters are not available on guest virtual machines, you have to
enable timer mode to use operf on virtual systems. To do so, type as root:
opcontrol --deinit
To set the event for each configurable counter via the command line, use:
operf --events=event1,event2…
Here, pass a comma-separated list of event specifications for profiling. Each event specification is a
colon-separated list of attributes in the following form:
event-name:sample-rate:unit-mask:kernel:user
Table 21.2, “Event Specifications” summarizes these options. The last three values are optional, if you
omit them, they will be set to their default values. Note that certain events do require a unit mask.
405
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Specification Description
event-name The exact symbolic event name taken from
ophelp
sample-rate The number of events to wait before sampling
again. The smaller the count, the more frequent
the samples. For events that do not happen
frequently, a lower count may be needed to
capture a statistically significant number of event
instances. On the other hand, sampling too
frequently can overload the system. By default,
OProfile uses a time-based event set, which
creates a sample every 100,000 clock cycles per
processor.
unit-mask Unit masks, which further define the event, are
listed in ophelp. You can insert either a
hexadecimal value, beginning with "0x", or a
string that matches the first word of the unit mask
description in ophelp. The second option is valid
only for unit masks having "extra:" parameters, as
shown by the output of ophelp. This type of unit
mask cannot be defined with a hexadecimal
value.
kernel Specifies whether to profile kernel code (insert 0
or 1(default))
user Specifies whether to profile user-space code
(insert 0 or 1 (default))
The events available vary depending on the processor type. When no event specification is given, the
default event for the running processor type will be used for profiling. Refer to Table 21.4, “Default
Events” for a list of these default events. To determine the events available for profiling, use the ophelp
command.
ophelp
406
Chapter 21. OProfile
The debuginfo package for the kernel must be installed (which contains the uncompressed
kernel) in order to monitor the kernel.
To configure OProfile not to monitor the kernel, execute the following command as root:
This command also loads the oprofile kernel module, if it is not already loaded, and creates the
/dev/oprofile/ directory, if it does not already exist. Refer to Section 21.7, “Understanding
/dev/oprofile/” for details about this directory.
Setting whether samples should be collected within the kernel only changes what data is collected, not
how or where the collected data is stored. To generate different sample files for the kernel and
application libraries, refer to Section 21.3.3, “Separating Kernel and User-space Profiles”.
407
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Use Table 21.3, “OProfile Processors and Counters” to verify that the correct processor type was
detected and to determine the number of events that can be monitored simultaneously. tim er is used
as the processor type if the processor does not have supported performance monitoring hardware.
If tim er is used, events cannot be set for any processor because the hardware does not have support
for hardware performance counters. Instead, the timer interrupt is used for profiling.
If tim er is not used as the processor type, the events monitored can be changed, and counter 0 for the
processor is set to a time-based event by default. If more than one counter exists on the processor, the
counters other than counter 0 are not set to an event by default. The default events monitored are
shown in Table 21.4, “Default Events”.
408
Chapter 21. OProfile
The number of events that can be monitored at one time is determined by the number of counters for the
processor. However, it is not a one-to-one correlation; on some processors, certain events must be
mapped to specific counters. To determine the number of counters available, execute the following
command:
ls -d /dev/oprofile/[0-9]*
The events available vary depending on the processor type. To determine the events available for
profiling, execute the following command as root (the list is specific to the system's processor type):
ophelp
Unless OProfile is be properly configured, the ophelp fails with the following error message:
To configure OProfile, follow the instructions in Section 21.3, “Configuring OProfile Using Legacy
Mode”.
The events for each counter can be configured via the command line or with a graphical interface. For
more information on the graphical interface, refer to Section 21.10, “Graphical Interface”. If the counter
409
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To set the event for each configurable counter via the command line, use opcontrol:
opcontrol --event=event-name:sample-rate
Replace event-name with the exact name of the event from ophelp, and replace sample-rate with
the number of events between samples.
When setting the event for the counter, a sample rate can also be specified:
opcontrol --event=event-name:sample-rate
Replace sample-rate with the number of events to wait before sampling again. The smaller the count,
the more frequent the samples. For events that do not happen frequently, a lower count may be needed
to capture the event instances.
Be extremely careful when setting sampling rates. Sampling too frequently can overload the
system, causing the system to appear as if it is frozen or causing the system to actually freeze.
Unit masks for each event are listed with the ophelp command. The values for each unit mask are
listed in hexadecimal format. To specify more than one unit mask, the hexadecimal values must be
combined using a bitwise or operation.
opcontrol --event=event-name:sample-rate:unit-mask
opcontrol --event=event-name:sample-rate:unit-mask:0
Execute the following command to start profiling kernel mode for the counter again:
opcontrol --event=event-name:sample-rate:unit-mask:1
To configure OProfile to ignore events in user mode for a specific counter, execute the following
command:
410
Chapter 21. OProfile
opcontrol --event=event-name:sample-rate:unit-mask:1:0
Execute the following command to start profiling user mode for the counter again:
opcontrol --event=event-name:sample-rate:unit-mask:1:1
When the OProfile daemon writes the profile data to sample files, it can separate the kernel and library
profile data into separate sample files. To configure how the daemon writes to sample files, execute the
following command as root:
opcontrol --separate=choice
If --separate=library is used, the sample file name includes the name of the executable as well as
the name of the library.
These configuration changes will take effect when the OProfile profiler is restarted.
opcontrol --start
The OProfile daemon, oprofiled, is started; it periodically writes the sample data to the
/var/lib/oprofile/sam ples/ directory. The log file for the daemon is located at
/var/lib/oprofile/oprofiled.log.
411
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
On a Red Hat Enterprise Linux 7 system, the nm i_watchdog registers with the perf
subsystem. Due to this, the perf subsystem grabs control of the performance counter registers
at boot time, blocking OProfile from working.
To resolve this, either boot with the nm i_watchdog=0 kernel parameter set, or run the following
command as root to disable nm i_watchdog at run time:
opcontrol --shutdown
To save the current set of sample files, execute the following command, replacing name with a unique
descriptive name for the current session.
opcontrol --save=name
The directory /var/lib/oprofile/sam ples/name/ is created and the current sample files are
copied to it.
To specify the session directory to hold the sample data, use the --session-dir. If not specified, the
data is saved in the oprofile_data/ directory on the current path.
By default, operf stores the profiling data in the current_dir/oprofile_data directory. You can
change to a different location with the --session-dir option. The usual post-profiling analysis tools
such as opreport and opannotate can be used to generate profile reports. These tools search for
samples in current_dir/oprofile_data first. If that directory does not exist, the analysis tools use
the standard session directory of /var/lib/oprofile/. Statistics, such as total samples received and
lost samples, are written to the session_dir/sam ples/operf.log file.
When using legacy mode, the OProfile daemon, oprofiled, periodically collects the samples and
412
Chapter 21. OProfile
writes them to the /var/lib/oprofile/sam ples/ directory. Before reading the data, make sure all
data has been written to this directory by executing the following command as root:
opcontrol --dump
Each sample file name is based on the name of the executable. For example, the samples for the default
event on a Pentium III processor for /bin/bash becomes:
\{root\}/bin/bash/\{dep\}/\{root\}/bin/bash/CPU_CLK_UNHALTED.100000
The following tools are available to profile the sample data once it has been collected:
opreport
opannotate
Use these tools, along with the binaries profiled, to generate reports that can be further analyzed.
The executable being profiled must be used with these tools to analyze the data. If it must change
after the data is collected, back up the executable used to create the samples as well as the
sample files. Please note that the sample file and the binary have to agree. Making a backup is
not going to work if they do not match. oparchive can be used to address this problem.
Samples for each executable are written to a single sample file. Samples from each dynamically linked
library are also written to a single sample file. While OProfile is running, if the executable being monitored
changes and a sample file for the executable exists, the existing sample file is automatically deleted.
Thus, if the existing sample file is needed, it must be backed up, along with the executable used to
create it before replacing the executable with a new version. The OProfile analysis tools use the
executable file that created the samples during analysis. If the executable changes the analysis tools will
be unable to analyze the associated samples. Refer to Section 21.5, “Saving Data in Legacy Mode” for
details on how to back up the sample file.
opreport
413
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Each executable is listed on its own line. The first column is the number of samples recorded for the
executable. The second column is the percentage of samples relative to the total number of samples.
The third column is the name of the executable.
Refer to the opreport man page for a list of available command line options, such as the -r option
used to sort the output from the executable with the smallest number of samples to the one with the
largest number of samples. You can also use the -t or --threshold option to trim the output of
opcontrol.
Replace executable with the full path to the executable to be analyzed. mode stands for one of the
following options:
-l
This option is used to list sample data by symbols. For example, running this command:
414
Chapter 21. OProfile
The first column is the number of samples for the symbol, the second column is the percentage
of samples for this symbol relative to the overall samples for the executable, and the third
column is the symbol name.
To sort the output from the largest number of samples to the smallest (reverse order), use -r in
conjunction with the -l option.
-i symbol-name
List sample data specific to a symbol name. For example, running:
The first column is the number of samples for the memory symbol. The second column is the
percentage of samples for the memory address relative to the total number of samples for the
symbol. The third column is the symbol name.
-d
This lists sample data by symbols with more detail than the -l option. For example, with the
following command:
415
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The data is the same as the -l option except that for each symbol, each virtual memory
address used is shown. For each virtual memory address, the number of samples and
percentage of samples relative to the number of samples for the symbol is displayed.
-e symbol-name…
With this option, you can exclude some symbols from the output. Replace symbol-name with
the comma-separated list of symbols you want to exclude
session:name
Here, you can specify the full path to the session, a directory relative to the
/var/lib/oprofile/sam ples/ directory, or if you are using operf, a directory relative to
./oprofile_data/sam ples/.
To get a more detailed view of the actions of the module, you will need to either have the module
"unstripped" (that is installed from a custom build) or have the debuginfo package installed for the kernel.
Find out which kernel is running with the unam e -a command, obtain the appropriate debuginfo
package and install it on the machine.
Then proceed with clearing out the samples from previous runs with the following command:
opcontrol --reset
416
Chapter 21. OProfile
To start the monitoring process, for example, on a machine with Westmere processor, run the following
command:
Then the detailed information, for instance, for the ext4 module can be obtained with:
For this utility to work, the appropriate debuginfo package for the executable must be installed on the
system. On Red Hat Enterprise Linux, the debuginfo packages are not automatically installed with the
corresponding packages that contain the executable. You have to obtain and install them separately.
These command line options are mandatory. Replace src-dir with a path to the directory containing
the source code and specify the executable to be analyzed. Refer to the opannotate man page for a
list of additional command line options.
cat /dev/oprofile/cpu_type
417
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
A directory exists in /dev/oprofile/ for each counter. For example, if there are 2 counters, the
directories /dev/oprofile/0/ and /dev/oprofile/1/ exist.
The values of these files can be retrieved with the cat command. For example:
cat /dev/oprofile/0/count
Determine which applications and services are used the most on a system — opreport can be
used to determine how much processor time an application or service uses. If the system is used for
multiple services but is underperforming, the services consuming the most processor time can be
moved to dedicated systems.
Determine processor usage — The CPU_CLK_UNHALT ED event can be monitored to determine the
processor load over a given period of time. This data can then be used to determine if additional
processors or a faster processor might improve system performance.
-agentlib:jvmti_oprofile
Where jvmti_oprofile is a path to the oprofile agent. For 64-bit JVM, the path looks as follows:
-agentlib:/usr/lib64/oprofile/libjvmti_oprofile.so
Currently, you can add one command-line option: --debug, which enables debugging mode.
418
Chapter 21. OProfile
The oprofile-jit package must be installed on the system in order to profile JIT code with OProfile.
With this package, you gain capability to show method-level information.
Depending on the JVM that you are using, you may have to install the debuginfo package for the JVM.
For OpenJDK, this package is required, there is no debuginfo package for Oracle JDK. To keep the
debug information packages synchronized with their respective non-debug packages, you also need to
install the yum-plugin-auto-update-debug-info plug-in. This plug-in searches the debug information
repository for corresponding updates.
After successful setup, you can apply the standard profiling and analyzing tools described in previous
sections
To learn more about Java support in OProfile, refer to the OProfile Manual, which is linked from
Section 21.12, “Additional Resources”.
After changing any of the options, save them by clicking the Save and quit button. The preferences
are written to /root/.oprofile/daem onrc, and the application exits.
On the Setup tab, to set events for the processor counters as discussed in Section 21.3.2, “Setting
Events to Monitor”, select the counter from the pulldown menu and select the event from the list. A brief
description of the event appears in the text box below the list. Only events available for the specific
counter and the specific architecture are displayed. The interface also displays whether the profiler is
running and some brief statistics about it.
419
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
On the right side of the tab, select the Profile kernel option to count events in kernel mode for the
currently selected event, as discussed in Section 21.3.3, “Separating Kernel and User-space Profiles”. If
this option is not selected, no samples are collected for the kernel.
Select the Profile user binaries option to count events in user mode for the currently selected
event, as discussed in Section 21.3.3, “Separating Kernel and User-space Profiles”. If this option is not
selected, no samples are collected for user applications.
Use the Count text field to set the sampling rate for the currently selected event as discussed in
Section 21.3.2.1, “Sampling Rate”.
If any unit masks are available for the currently selected event, as discussed in Section 21.3.2.2, “Unit
Masks”, they are displayed in the Unit Masks area on the right side of the Setup tab. Select the
checkbox beside the unit mask to enable it for the event.
420
Chapter 21. OProfile
On the Configuration tab, to profile the kernel, enter the name and location of the vm linux file for
the kernel to monitor in the Kernel im age file text field. To configure OProfile not to monitor the
kernel, select No kernel im age.
If the Verbose option is selected, the oprofiled daemon log includes more information.
To force data to be written to samples files as discussed in Section 21.6, “Analyzing the Data”, click the
421
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
To start OProfile from the graphical interface, click Start. To stop the profiler, click Stop. Exiting the
application does not stop OProfile from sampling.
While using OProfile is suggested in cases of collecting data on where and why the processor spends
time in a particular area of code, it is less usable when finding out why the processor stays idle.
You might want to use SystemTap when instrumenting specific places in code. Because SystemTap
allows you to run the code instrumentation without having to stop and restart the instrumented code, it is
particularly useful for instrumenting the kernel and daemons.
For more information on SystemTap, refer to Section 21.12.2, “Useful Websites” for the relevant
SystemTap documentation.
422
Part VI. Kernel, Module and Driver Configuration
423
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Among various code snippets and directives, the grub.cfg configuration file contains one or more
m enuentry blocks, each representing a single GRUB 2 boot menu entry. These blocks always start with
the m enuentry keyword followed by a title, list of options, and an opening curly bracket, and end with a
closing curly bracket. Anything between the opening and closing bracket should be indented. For
example, the following is a sample m enuentry block for Red Hat Enterprise Linux 7 with Linux kernel
3.8.0-0.40.el7.x86_64:
menuentry 'Red Hat Enterprise Linux Client' --class red --class gnu-linux --class
gnu --class os $menuentry_id_option 'gnulinux-simple-c60731dc-9046-4000-9182-
64bdcce08616' {
load_video
set gfxpayload=keep
insmod gzio
insmod part_msdos
insmod xfs
set root='hd0,msdos1'
if [ x$feature_platform_search_hint = xy ]; then
search --no-floppy --fs-uuid --set=root --hint-bios=hd0,msdos1 --hint-
efi=hd0,msdos1 --hint-baremetal=ahci0,msdos1 --hint='hd0,msdos1' 19d9e294-65f8-
4e37-8e73-d41d6daa6e58
else
search --no-floppy --fs-uuid --set=root 19d9e294-65f8-4e37-8e73-
d41d6daa6e58
fi
echo 'Loading Linux 3.8.0-0.40.el7.x86_64 ...'
linux /vmlinuz-3.8.0-0.40.el7.x86_64 root=/dev/mapper/rhel-root ro
rd.md=0 rd.dm=0 rd.lvm.lv=rhel/swap crashkernel=auto rd.luks=0 vconsole.keymap=us
rd.lvm.lv=rhel/root rhgb quiet
echo 'Loading initial ramdisk ...'
initrd /initramfs-3.8.0-0.40.el7.x86_64.img
}
Each m enuentry block that represents an installed Linux kernel contains linux (linuxefi on UEFI
424
Chapter 22. Working with the GRUB 2 Boot Loader
systems) and initrd directives followed by the path to the kernel and the initram fs image
respectively. If a separate /boot partition was created, the paths to the kernel and the initram fs
image are relative to /boot. In the example above, the initrd /initram fs-3.8.0-
0.4 0.el7.x86_64 .im g line means that the initram fs image is actually located at
/boot/initram fs-3.8.0-0.4 0.el7.x86_64 .im g when the root file system is mounted, and
likewise for the kernel path.
The kernel version number as given on the linux /vm linuz-kernel_version line must match the
version number of the initram fs image given on the initrd /initram fs-
kernel_version.im g line of each m enuentry block. For more information on how to verify the initial
RAM disk image, see Section 23.5, “Verifying the Initial RAM Disk Image”.
In m enuentry blocks, the initrd directive must point to the location (relative to the /boot/
directory if it is on a separate partition) of the initram fs file corresponding to the same kernel
version. This directive is called initrd because the previous tool which created initial RAM disk
images, m kinitrd, created what were known as initrd files. The grub.cfg directive remains
initrd to maintain compatibility with other tools. The file-naming convention of systems using
the dracut utility to create the initial RAM disk image is initram fs-kernel_version.im g.
For information on using Dracut, refer to Section 23.5, “Verifying the Initial RAM Disk Image”.
However, users may want to build a menu containing specific entries or to have the entries in a specific
order. GRUB 2 allows basic customization of the boot menu to give users control of what actually
appears on the screen.
GRUB 2 uses a series of scripts to build the menu; these are located in the /etc/grub.d/ directory
and include:
Scripts from the /etc/grub.d/ directory are read in alphabetical order and can be therefore renamed
to change the boot order of specific menu entries.
If you set the GRUB_T IMEOUT key in the /etc/default/grub file to 0, GRUB 2 will not display
its list of bootable kernels when the system starts up. In order to display this list when booting,
press and hold any alphanumeric key while and immediately after BIOS information is displayed,
and GRUB 2 will present you with the GRUB menu.
425
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
~]# grub2-set-default 2
Note that the position of a menu entry in the list is denoted by a number, starting with zero; therefore, in
the example above, the third entry will be loaded.
Before rebooting the machine, update the configuration file by running grub2-m kconfig -o
/boot/grub2/grub.cfg or, on UEFI systems,grub2-m kconfig -o
/boot/efi/EFI/redhat/grub.cfg
Kernel Parameters
To use a kernel parameter only during a single boot process, when the GRUB 2 boot menu appears,
move the cursor to the kernel you want to start, press the e key to edit the line with the kernel and add
the kernel parameter. For example, to run the system in emergency mode, add the emergency
parameter at the end of the linux line:
These settings are, however, not persistent and apply only for a single boot. To make the settings
persistent, edit values of the GRUB_CMDLINE_LINUX_DEFAULT key in the /etc/default/grub file.
For example. if you want to enable emergency mode for each boot, edit the entry as follows:
GRUB_CMDLINE_LINUX_DEFAULT="emergency"
Note that you can specify multiple parameters for the GRUB_CMDLINE_LINUX_DEFAULT key, similarly
to adding the parameters in the GRUB 2 boot menu.
The 4 0_custom file located in the /etc/grub.d/ directory is a template for custom entries and looks
as follows:
426
Chapter 22. Working with the GRUB 2 Boot Loader
#!/bin/sh
exec tail -n +3 $0
# This file provides an easy way to add custom menu entries. Simply type the
# menu entries you want to add after this comment. Be careful not to change
# the 'exec tail' line above.
This file can be edited or copied. Note that as a minimum, a valid menu entry must include at least the
following:
menuentry "<Title>"{
<Data>
}
Backup of /etc/grub.d/
Before proceeding, back up the contents of the /etc/grub.d/ directory in case you need to
revert the changes later.
427
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
#!/bin/sh
exec tail -n +3 $0
# This file provides an easy way to add custom menu entries. Simply type the
# menu entries you want to add after this comment. Be careful not to change
# the 'exec tail' line above.
menuentry 'First custom entry' --class red --class gnu-linux --class gnu --
class os $menuentry_id_option 'gnulinux-3.10.0-67.el7.x86_64-advanced-
32782dd0-4b47-4d56-a740-2076ab5e5976' {
load_video
set gfxpayload=keep
insmod gzio
insmod part_msdos
insmod xfs
set root='hd0,msdos1'
if [ x$feature_platform_search_hint = xy ]; then
search --no-floppy --fs-uuid --set=root --hint='hd0,msdos1'
7885bba1-8aa7-4e5d-a7ad-821f4f52170a
else
search --no-floppy --fs-uuid --set=root 7885bba1-8aa7-4e5d-a7ad-
821f4f52170a
fi
linux16 /vmlinuz-3.10.0-67.el7.x86_64 root=/dev/mapper/rhel-root ro
rd.lvm.lv=rhel/root vconsole.font=latarcyrheb-sun16 rd.lvm.lv=rhel/swap
vconsole.keymap=us crashkernel=auto rhgb quiet LANG=en_US.UTF-8
initrd16 /initramfs-3.10.0-67.el7.x86_64.img
}
menuentry 'Second custom entry' --class red --class gnu-linux --class gnu --
class os $menuentry_id_option 'gnulinux-0-rescue-
07f43f20a54c4ce8ada8b70d33fd001c-advanced-32782dd0-4b47-4d56-a740-
2076ab5e5976' {
load_video
insmod gzio
insmod part_msdos
insmod xfs
set root='hd0,msdos1'
if [ x$feature_platform_search_hint = xy ]; then
search --no-floppy --fs-uuid --set=root --hint='hd0,msdos1'
7885bba1-8aa7-4e5d-a7ad-821f4f52170a
else
search --no-floppy --fs-uuid --set=root 7885bba1-8aa7-4e5d-a7ad-
821f4f52170a
fi
linux16 /vmlinuz-0-rescue-07f43f20a54c4ce8ada8b70d33fd001c
root=/dev/mapper/rhel-root ro rd.lvm.lv=rhel/root vconsole.font=latarcyrheb-
sun16 rd.lvm.lv=rhel/swap vconsole.keymap=us crashkernel=auto rhgb quiet
initrd16 /initramfs-0-rescue-07f43f20a54c4ce8ada8b70d33fd001c.img
}
3. Remove all files from the /etc/grub.d directory except the following:
00_header,
4 0_custom ,
and README.
4. Edit, add, or remove menu entries in the 4 0_custom file as desired.
Alternatively, if you wish to keep the files in the /etc/grub2.d/ directory, make them
unexecutable by running the chm od a-x <file_nam e> command.
428
Chapter 22. Working with the GRUB 2 Boot Loader
cat <<EOF
set superusers="john"
password john johnspassword
EOF
2. To allow other users to access the menu entries, add additional lines per user at the end of the
/etc/grub.d/00_header file.
cat <<EOF
set superusers="john"
password john johnspassword
password jane janespassword
EOF
3. When the users and passwords are set up, specify the menu entries that should be password-
protected. If you do not specify the menu entries, all menu entries will be password-protected by
default.
4. Run the grub2-m kconfig -o /boot/grub2/grub.cfg command to update the
configuration file. Or the grub2-m kconfig -o /boot/efi/EFI/redhat/grub.cfg
command on UEFI systems.
429
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
set superusers="john"
password john johnspassword
password jane janespassword
In the above example, john is the superuser and can therefore boot any menu entry, use the GRUB 2
command line, and edit items of the GRUB 2 menu during boot. In this case, john can access both Red
Hat Enterprise Linux Client and Fedora. Anyone can boot Red Hat Enterprise Linux Client. User jane
can boot Fedora since she was granted the permission in the configuration. If you do not specify a menu
entry, the password protection function will not work.
After you have made the changes in the template file, run the following command to update the GRUB 2
configuration file:
Even if you do not specify a user and password for a menu entry, the superuser's password will be asked
for when accessing such a system.
cat <<EOF
setsuperusers="john"
password_pbkdf2 john
grub.pbkdf2.sha512.10000.19074739ED80F115963D984BDCB35AA671C24325755377C3E9B
014D862DA6ACC77BC110EED41822800A87FD3700C037320E51E9326188D53247EC0722DDF15F
C.C56EC0738911AD86CEA55546139FEBC366A393DF9785A8F44D3E51BF09DB980BAFEF85281
CBBC56778D8B19DC94833EA8342F7D73E3A1AA30B205091F1015A85
EOF
430
Chapter 22. Working with the GRUB 2 Boot Loader
setsuperusers="john"
password_pbkdf2 john
grub.pbkdf2.sha512.10000.19074739ED80F115963D984BDCB35AA671C24325755377C3E9B
014D862DA6ACC77BC110EED41822800A87FD3700C037320E51E9326188D53247EC0722DDF15F
C.C56EC0738911AD86CEA55546139FEBC366A393DF9785A8F44D3E51BF09DB980BAFEF85281
CBBC56778D8B19DC94833EA8342F7D73E3A1AA30B205091F1015A85
Warning
If you do not use the correct format, or modify the configuration in an incorrect way, you might be
unable to boot your system.
Use the grub2-install <device> command to reinstall GRUB 2 if the system is operating normally.
For example:
431
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
1. Run the yum rem ove grub2-tools command to remove the grub2 and grub2-tools packages,
or, on UEFI systems, to remove the grub2-efi and grub2-tools packages.
2. Run the yum rem ove grub2 command, or yum rem ove grub2-efi on UEFI systems, if you
wish to have the grub2-tools package installed as a dependency with support for all platforms.
3. Run the grub2-m kconfig -o /boot/grub2/grub.cfg or grub2-m kconfig -o
/boot/efi/EFI/redhat/grub.cfg command to update the configuration file.
GRUB_TERMINAL="serial"
GRUB_SERIAL_COMMAND="serial --speed=9600 --unit=0 --word=8 --parity=no --stop=1"
The first line disables the graphical terminal. Note that specifying the GRUB_T ERMINAL key overrides
values of GRUB_T ERMINAL_INPUT and GRUB_T ERMINAL_OUT PUT . On the second line, adjust the
baud rate, parity, and other values to fit your environment and hardware.
Once you have completed the changes in the /etc/default/grub file, it is necessary to execute the
grub2-m kconfig -o /etc/grub2/grub.cfg or grub2-m kconfig -o
/boot/efi/EFI/redhat/grub.cfg command to update the GRUB 2 configuration file.
To connect to your machine using the serial console, run the following command:
By default, if no option is specified, screen uses the standard 9600 baud rate. To set a different baud
rate, run:
To end the session in screen, press Ctrl+a, type :quit and press Enter.
Consult the screen manual pages for additional options and detailed information.
432
Chapter 22. Working with the GRUB 2 Boot Loader
The command line interface is the most basic GRUB interface, but it is also the one that grants the most
control. The command line makes it possible to type any relevant GRUB commands followed by the
Enter key to execute them. This interface features some advanced features similar to shell, including
T ab key completion based on context, and Ctrl+a to move to the beginning of a line and Ctrl+e to
move to the end of a line. In addition, the arrow, Hom e, End, and Delete keys work as they do in the
bash shell.
1. To enter rescue mode during boot, on the GRUB 2 boot screen, press the e key for edit.
2. Add the following parameter at the end of the linux line, or linuxefi on UEFI systems:
systemd.unit=rescue.target
Note that equivalent parameters, s and single, can be passed to the kernel as well.
3. Press Ctrl+x to boot the system with the parameter.
1. To enter emergency mode, on the GRUB 2 boot screen, press the e key for edit.
2. Add the following parameter at the end of the linux line, or linuxefi on UEFI systems:
systemd.unit=emergency.target
Note that equivalent parameters, emergency and -b, can be passed to the kernel as well.
3. Press Ctrl+x to boot the system with the parameter.
Note that in GRUB 2, resetting the password is no longer performed in single-user mode as it was in
GRUB included in Red Hat Enterprise Linux 6. The root password is now required to operate in
single-user mode as well as in em ergency mode.
1. Start the system and, on the GRUB 2 boot screen, press the e key for edit.
2. Add the following parameter at the end of the linux line, or linuxefi on UEFI systems:
433
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
init=/bin/sh
The Linux kernel will run the /bin/sh shell rather than the system init daemon. Therefore, some
functions may be limited or missing.
3. Press Ctrl+x to boot the system with the parameter.
The shell prompt appears.
4. Note that the file system is mounted read-only. You will not be allowed to change the password if
the file system is not writable.
To remount the file system as writable, run the m ount -o rem ount, rw command.
5. Run the passwd command and follow the instructions displayed on the command line to change
the root password.
Note that if the system is not writable, the passwd tool fails with the following error:
6. Run the exec /sbin/init command to resume the initialization and finish the system boot.
Running the exec command with another command specified replaces the shell and creates a
new process; init in this case.
Alternatively, if you wish to reboot the system, run the exec /sbin/reboot command instead.
Note that in GRUB 2, resetting the password is no longer performed via single-user mode as it was in
GRUB shipped in Red Hat Enterprise Linux 6. The root password is now required to operate in single-
user mode as well as in em ergency mode.
1. Start the system and, on the GRUB 2 boot screen, press the E key for edit.
2. Add the following parameter at the end of the linux line, or linuxefi on UEFI systems:
init=/bin/bash
The Linux kernel will run the /bin/bash shell rather than the system init. Therefore, some functions
may be limited or missing.
3. Press CT RL+X to boot the system with the parameter.
The shell prompt appears.
4. Note that the file system is mounted read-only. You will not be allowed to change the password if
the file system is not writable.
To remount the file system as writable, run the m ount -o rem ount, rw command.
5. Run the passwd command and follow the instructions displayed on the command line to change
the root password.
Note that if the system is not writable, the passwd tool fails with the following error:
6. Run the exec /sbin/init command to resume the initialization and finish the system boot.
434
Chapter 22. Working with the GRUB 2 Boot Loader
Running the exec command with another command specified replaces the shell and creates a
new process; init in this case.
Alternatively, if you wish to reboot the system, run the exec /sbin/reboot command instead.
435
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Red Hat Enterprise Linux kernels are packaged in the RPM format so that they are easy to upgrade and
verify using the Yum or PackageKit package managers. PackageKit automatically queries the Red Hat
Network servers and informs you of packages with available updates, including kernel packages.
This chapter is therefore only useful for users who need to manually update a kernel package using the
rpm command instead of yum .
Whenever possible, use either the Yum or PackageKit package manager to install a new kernel
because they always install a new kernel instead of replacing the current one, which could
potentially leave your system unable to boot.
Building a custom kernel is not supported by the Red Hat Global Services Support team, and
therefore is not explored in this manual.
For more information on installing kernel packages with Yum, refer to Section 5.1.2, “Updating
Packages”. For information on Red Hat Network, see related documents located on Customer Portal.
kernel — Contains the kernel for single, multicore and multiprocessor systems.
kernel-debug — Contains a kernel with numerous debugging options enabled for kernel diagnosis, at
the expense of reduced performance.
kernel-devel — Contains the kernel headers and makefiles sufficient to build modules against the
kernel package.
kernel-debug-devel — Contains files required for building kernel modules to match the kernel-debug
package.
kernel-headers — Includes the C header files that specify the interface between the Linux kernel and
user-space libraries and programs. The header files define structures and constants that are needed
for building most standard programs.
linux-firmware — Contains all of the firmware files that are required by various devices to operate.
perf — This package contains supporting scripts and documentation for the perf tool shipped in each
kernel image subpackage.
kernel-abi-whitelists — Contains information pertaining to the Red Hat Enterprise Linux kernel ABI,
including a lists of kernel symbols that are needed by external Linux kernel modules and a yum plug-
in to aid enforcement.
kernel-tools — Contains tools for manipulating the Linux kernel and supporting documentation.
436
Chapter 23. Manually Upgrading the Kernel
First, ensure that working boot media exists for the system. If the boot loader is not configured properly
to boot the new kernel, you can use this media to boot into Red Hat Enterprise Linux.
USB media often comes in the form of flash devices sometimes called pen drives, thumb disks, or keys,
or as an externally-connected hard disk device. Almost all media of this type is formatted as a VFAT file
system. You can create bootable USB media on media formatted as ext2, ext3, or VFAT .
You can transfer a distribution image file or a minimal boot media image file to USB media. Make sure
that sufficient free space is available on the device. Around 4 GB is required for a distribution DVD
image, around 700 MB for a distribution CD image, or around 10 MB for a minimal boot media image.
You must have a copy of the boot.iso file from a Red Hat Enterprise Linux installation DVD, or
installation CD-ROM #1, and you need a USB storage device formatted with the VFAT file system and
around 16 MB of free space. The following procedure will not affect existing files on the USB storage
device unless they have the same path names as the files that you copy onto it. To create USB boot
media, perform the following commands as the root user:
1. Install the syslinux package if it is not installed on your system. To do so, as root, run the yum
install syslinux command.
2. Install the SYSLINUX bootloader on the USB storage device:
4. Mount boot.iso:
6. Copy the ISOLINUX files from the boot.iso to the USB storage device:
7. Use the isolinux.cfg file from boot.iso as the syslinux.cfg file for the USB device:
437
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
9. You should reboot the machine with the boot media and verify that you are able to boot with it
before continuing.
Alternatively, on systems with a floppy drive, you can create a boot diskette by installing the mkbootdisk
package and running the m kbootdisk command as root. Refer to m an m kbootdisk man page after
installing the package for usage information.
To determine which kernel packages are installed, execute the command yum list installed
"kernel-* " at a shell prompt. The output will comprise some or all of the following packages,
depending on the system's architecture, and the version numbers may differ:
From the output, determine which packages need to be downloaded for the kernel upgrade. For a single
processor system, the only required package is the kernel package. Refer to Section 23.1, “Overview of
Kernel Packages” for descriptions of the different packages.
If Red Hat Network was used to download and install the updated kernel, follow the instructions in
Section 23.5, “Verifying the Initial RAM Disk Image” and Section 23.6, “Verifying the Boot Loader”, only
do not change the kernel to boot by default. Red Hat Network automatically changes the default kernel to
the latest version. To install the kernel manually, continue to Section 23.4, “Performing the Upgrade”.
It is strongly recommended that you keep the old kernel in case there are problems with the new
kernel.
At a shell prompt, change to the directory that contains the kernel RPM packages. Use -i argument with
the rpm command to keep the old kernel. Do not use the -U option, since it overwrites the currently
installed kernel, which creates boot loader problems. For example:
The next step is to verify that the initial RAM disk image has been created. Refer to Section 23.5,
438
Chapter 23. Manually Upgrading the Kernel
On all architectures other than IBM eServer System i (see Section 23.5, “Verifying the Initial RAM Disk
Image and Kernel on IBM eServer System i”), you can create an initram fs by running the dracut
command. However, you usually don't need to create an initram fs manually: this step is automatically
performed if the kernel and its associated packages are installed or upgraded from RPM packages
distributed by Red Hat.
You can verify that an initram fs corresponding to your current kernel version exists and is specified
correctly in the grub.conf configuration file by following this procedure:
1. As root, list the contents in the /boot/ directory and find the kernel
(vm linuz-<kernel_version>) and initram fs-<kernel_version> with the latest (most
recent) version number:
Example 23.1. Ensuring that the kernel and initramfs versions match
~]# ls /boot/
config-3.10.0-67.el7.x86_64
config-3.10.0-78.el7.x86_64
efi
grub
grub2
initramfs-0-rescue-07f43f20a54c4ce8ada8b70d33fd001c.img
initramfs-3.10.0-67.el7.x86_64.img
initramfs-3.10.0-67.el7.x86_64kdump.img
initramfs-3.10.0-78.el7.x86_64.img
initramfs-3.10.0-78.el7.x86_64kdump.img
initrd-plymouth.img
symvers-3.10.0-67.el7.x86_64.gz
symvers-3.10.0-78.el7.x86_64.gz
System.map-3.10.0-67.el7.x86_64
System.map-3.10.0-78.el7.x86_64
vmlinuz-0-rescue-07f43f20a54c4ce8ada8b70d33fd001c
vmlinuz-3.10.0-67.el7.x86_64
vmlinuz-3.10.0-78.el7.x86_64
Example 23.1, “Ensuring that the kernel and initramfs versions match” shows that:
we have three kernels installed (or, more correctly, three kernel files are present in /boot/),
the latest kernel is vm linuz-3.10.0-78.el7.x86_64 , and
an initram fs file matching our kernel version, initram fs-3.10.0-
78.el7.x86_64 kdum p.im g, also exists.
439
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
initrd files in the /boot directory are not the same as initramfs files
In the /boot/ directory you may find several initrd-<version>kdum p.im g files. These
are special files created by the Kdump mechanism for kernel debugging purposes, are not
used to boot the system, and can safely be ignored.
2. (Optional) If your initram fs-<kernel_version> file does not match the version of the latest
kernel in /boot/, or, in certain other situations, you may need to generate an initram fs file
with the Dracut utility. Simply invoking dracut as root without options causes it to generate an
initram fs file in the /boot/ directory for the latest kernel present in that directory:
~]# dracut
You must use the --force option if you want dracut to overwrite an existing initram fs (for
example, if your initram fs has become corrupt). Otherwise dracut will refuse to overwrite the
existing initram fs file:
~]# dracut
Will not override existing initramfs (/boot/initramfs-3.10.0-
78.el7.x86_64.img) without --force
If you need to specify specific kernel modules to be preloaded, add the names of those modules
(minus any file name suffixes such as .ko) inside the parentheses of the
add_dracutm odules="<module> [<more_modules>]" directive of the /etc/dracut.conf
configuration file. You can list the file contents of an initram fs image file created by dracut by
using the lsinitrd <initramfs_file> command:
Refer to m an dracut and m an dracut.conf for more information on options and usage.
3. Examine the grub.conf configuration file in the /boot/grub/ directory to ensure that an
initrd initram fs-<kernel_version>.im g exists for the kernel version you are booting.
Refer to Section 23.6, “Verifying the Boot Loader” for more information.
Verifying the Initial RAM Disk Image and Kernel on IBM eServer System i
440
Chapter 23. Manually Upgrading the Kernel
On IBM eServer System i machines, the initial RAM disk and kernel files are combined into a single file,
which is created with the addRam Disk command. This step is performed automatically if the kernel and
its associated packages are installed or upgraded from the RPM packages distributed by Red Hat; thus,
it does not need to be executed manually. To verify that it was created, use the command ls -l
/boot/ to make sure the /boot/vm linitrd-<kernel_version> file already exists (the
<kernel_version> should match the version of the kernel just installed).
It is always recommended to double-check the boot loader configuration file after installing a new kernel
with rpm to ensure that the configuration is correct. Otherwise, the system may not be able to boot into
Red Hat Enterprise Linux properly. If this happens, boot the system with the boot media created earlier
and re-configure the boot loader.
In the following table, find your system's architecture to determine the boot loader it uses, and then click
on the "Refer to" link to jump to the correct instructions for your system.
441
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Like the kernel itself, modules can take parameters that customize their behavior, though the default
parameters work well in most cases. User-space tools can list the modules currently loaded into a
running kernel; query all available modules for available parameters and module-specific information;
and load or unload (remove) modules dynamically into or from a running kernel. Many of these utilities,
which are provided by the kmod package, take module dependencies into account when performing
operations so that manual dependency-tracking is rarely necessary.
On modern systems, kernel modules are automatically loaded by various mechanisms when the
conditions call for it. However, there are occasions when it is necessary to load or unload modules
manually, such as when one module is preferred over another although either could provide basic
functionality, or when a module is misbehaving.
use the user-space kmod utilities to display, query, load and unload kernel modules and their
dependencies;
set module parameters both dynamically on the command line and permanently so that you can
customize the behavior of your kernel modules; and,
load modules at boot time.
In order to use the kernel module utilities described in this chapter, first ensure the kmod package
is installed on your system by running, as root:
For more information on installing packages with Yum, refer to Section 5.2.4, “Installing
Packages”.
442
Chapter 24. Working with Kernel Modules
~]$ lsmod
Module Size Used by
xfs 803635 1
exportfs 3424 1 xfs
vfat 8216 1
fat 43410 1 vfat
tun 13014 2
fuse 54749 2
ip6table_filter 2743 0
ip6_tables 16558 1 ip6table_filter
ebtable_nat 1895 0
ebtables 15186 1 ebtable_nat
ipt_MASQUERADE 2208 6
iptable_nat 5420 1
nf_nat 19059 2 ipt_MASQUERADE,iptable_nat
rfcomm 65122 4
ipv6 267017 33
sco 16204 2
bridge 45753 0
stp 1887 1 bridge
llc 4557 2 bridge,stp
bnep 15121 2
l2cap 45185 16 rfcomm,bnep
cpufreq_ondemand 8420 2
acpi_cpufreq 7493 1
freq_table 3851 2 cpufreq_ondemand,acpi_cpufreq
usb_storage 44536 1
sha256_generic 10023 2
aes_x86_64 7654 5
aes_generic 27012 1 aes_x86_64
cbc 2793 1
dm_crypt 10930 1
kvm_intel 40311 0
kvm 253162 1 kvm_intel
[output truncated]
Finally, note that lsm od output is less verbose and considerably easier to read than the content of the
/proc/m odules pseudo-file.
443
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
When entering the name of a kernel module as an argument to one of the kmod utilities, do not
append a .ko extension to the end of the name. Kernel module names do not have extensions;
their corresponding files do.
For example, to display information about the e1000e module, which is the Intel PRO/1000 network
driver, run:
filename
The absolute path to the .ko kernel object file. You can use m odinfo -n as a shortcut
command for printing only the filenam e field.
description
A short description of the module. You can use m odinfo -d as a shortcut command for
printing only the description field.
444
Chapter 24. Working with Kernel Modules
alias
The alias field appears as many times as there are aliases for a module, or is omitted entirely
if there are none.
depends
This field contains a comma-separated list of all the modules this module depends on.
If a module has no dependencies, the depends field may be omitted from the output.
parm
Each parm field presents one module parameter in the form parameter_name:description,
where:
parameter_name is the exact syntax you should use when using it as a module parameter
on the command line, or in an option line in a .conf file in the /etc/m odprobe.d/
directory; and,
description is a brief explanation of what the parameter does, along with an expectation
for the type of value the parameter accepts (such as int, unit or array of int) in parentheses.
You can list all parameters that the module supports by using the -p option. However, because
useful value type information is omitted from m odinfo -p output, it is more useful to run:
445
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Some modules have dependencies, which are other kernel modules that must be loaded before the
module in question can be loaded. The m odprobe command always takes dependencies into account
when performing operations. When you ask m odprobe to load a specific kernel module, it first examines
the dependencies of that module, if there are any, and loads them if they are not already loaded into the
kernel. m odprobe resolves dependencies recursively: it will load all dependencies of dependencies, and
so on, if necessary, thus ensuring that all dependencies are always met.
You can use the -v (or --verbose) option to cause m odprobe to display detailed information about
what it is doing, which may include loading module dependencies. The following is an example of loading
the Fibre Channel over Ethernet module verbosely:
Example 24.3, “modprobe -v shows module dependencies as they are loaded” shows that m odprobe
loaded the scsi_tgt, scsi_transport_fc, libfc and libfcoe modules as dependencies before
finally loading fcoe. Also note that m odprobe used the more “primitive” insm od command to insert
the modules into the running kernel.
Although the insm od command can also be used to load kernel modules, it does not resolve
dependencies. Because of this, you should always load modules using m odprobe instead.
446
Chapter 24. Working with Kernel Modules
Refer to Section 24.1, “Listing Currently-Loaded Modules” for more information about using lsm od to
obtain the names of the modules which are preventing you from unloading a certain module.
For example, if you want to unload the firewire_ohci module (because you believe there is a bug in
it that is affecting system stability, for example), your terminal session might look similar to this:
You have figured out the dependency tree (which does not branch in this example) for the loaded
Firewire modules: firewire_ohci depends on firewire_core, which itself depends on crc-itu-
t.
You can unload firewire_ohci using the m odprobe -v -r <module_name> command, where -r
is short for --rem ove and -v for --verbose:
The output shows that modules are unloaded in the reverse order that they are loaded, given that no
processes depend on any of the modules being unloaded.
Although the rm m od command can be used to unload kernel modules, it is recommended to use
m odprobe -r instead.
1. You can unload all dependencies of the module you want to set parameters for, unload the
module using m odprobe -r, and then load it with m odprobe along with a list of customized
parameters. This method is often used when the module does not have many dependencies, or to
test different combinations of parameters without making them persistent, and is the method
covered in this section.
2. Alternatively, you can list the new parameters in an existing or newly-created file in the
447
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
/etc/m odprobe.d/ directory. This method makes the module parameters persistent by
ensuring that they are set each time the module is loaded, such as after every reboot or
m odprobe command. This method is covered in Section 24.6, “Persistent Module Loading”,
though the following information is a prerequisite.
You can use m odprobe to load a kernel module with custom parameters using the following command
line format:
When loading a module with custom parameters on the command line, be aware of the following:
You can enter multiple parameters and values by separating them with spaces.
Some module parameters expect a list of comma-separated values as their argument. When entering
the list of values, do not insert a space after each comma, or m odprobe will incorrectly interpret the
values following spaces as additional parameters.
The m odprobe command silently succeeds with an exit status of 0 if:
it successfully loads the module, or
the module is already loaded into the kernel.
Thus, you must ensure that the module is not already loaded before attempting to load it with custom
parameters. The m odprobe command does not automatically reload the module, or alert you that it
is already loaded.
Here are the recommended steps for setting custom parameters and then loading a kernel module. This
procedure illustrates the steps using the e1000e module, which is the network driver for Intel PRO/1000
network adapters, as an example:
1. First, ensure the module is not already loaded into the kernel:
Output indicates that the module is already loaded into the kernel, in which case you must first
unload it before proceeding. Refer to Section 24.4, “Unloading a Module” for instructions on safely
unloading it.
2. Load the module and list all custom parameters after the module name. For example, if you
wanted to load the Intel PRO/1000 network driver with the interrupt throttle rate set to 3000
interrupts per second for the first, second and third instances of the driver, and Energy Efficient
Ethernet (EEE) turned on [5] , you would run, as root:
This example illustrates passing multiple values to a single parameter by separating them with
commas and omitting any spaces between them.
448
Chapter 24. Working with Kernel Modules
As shown in Example 24.1, “Listing information about a kernel module with lsmod”, many kernel modules
are loaded automatically at boot time. You can specify additional modules to be loaded by creating a new
<file_name>.m odules file in the /etc/sysconfig/m odules/ directory, where <file_name> is any
descriptive name of your choice. Your <file_name>.m odules files are treated by the system startup
scripts as shell scripts, and as such should begin with an interpreter directive (also called a “bang line”)
as their first line:
#!/bin/sh
Additionally, the <file_name>.m odules file should be executable. You can make it executable by
running:
For example, the following bluez-uinput.m odules script loads the uinput module:
#!/bin/sh
if [ ! -c /dev/input/uinput ] ; then
exec /sbin/modprobe uinput >/dev/null 2>&1
fi
The if-conditional statement on the third line ensures that the /dev/input/uinput file does not
already exist (the ! symbol negates the condition), and, if that is the case, loads the uinput module
by calling exec /sbin/m odprobe uinput. Note that the uinput module creates the
/dev/input/uinput file, so testing to see if that file exists serves as verification of whether the
uinput module is loaded into the kernel.
The following >/dev/null 2>& 1 clause at the end of that line redirects any output to /dev/null
so that the m odprobe command remains quiet.
For additional information about using multiple Ethernet cards, refer to the Linux Ethernet-HOWTO
online at http://www.redhat.com/mirrors/LDP/HOWTO/Ethernet-HOWTO.html.
449
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
bonding kernel module and a special network interface, called a channel bonding interface. Channel
bonding enables two or more network interfaces to act as one, simultaneously increasing the bandwidth
and providing redundancy.
To channel bond multiple network interfaces, the administrator must perform the following steps:
1. As root, create a new file named <bonding>.conf in the /etc/m odprobe.d/ directory. Note
that you can name this file anything you like as long as it ends with a .conf extension. Insert the
following line in this new file:
Replace <N> with the interface number, such as 0. For each configured channel bonding interface,
there must be a corresponding entry in your new /etc/m odprobe.d/<bonding>.conf file.
2. Configure a channel bonding interface as outlined in the Red Hat Enterprise Linux 7 Networking
Guide.
3. To enhance performance, adjust available module options to ascertain what combination works
best. Pay particular attention to the m iim on or arp_interval and the arp_ip_target
parameters. Refer to Section 24.7.2.1, “Bonding Module Directives” for a list of available options
and how to quickly determine the best ones for your bonded interface.
sysfs is a virtual file system that represents kernel objects as directories, files and symbolic links. sysfs
can be used to query for information about kernel objects, and can also manipulate those objects
through the use of normal file system commands. The sysfs virtual file system has a line in
/etc/fstab, and is mounted under the /sys/ directory. All bonding interfaces can be configured
dynamically by interacting with and manipulating files under the /sys/class/net/ directory.
In order to determine the best parameters for your bonding interface, create a channel bonding interface
file such as ifcfg-bond0 by following the instructions in the Red Hat Enterprise Linux 7 Networking
Guide. Insert the SLAVE=yes and MASTER=bond0 directives in the configuration files for each interface
bonded to bond0. Once this is completed, you can proceed to testing the parameters.
First, bring up the bond you created by running ifconfig bond<N> up as root:
If you have correctly created the ifcfg-bond0 bonding interface file, you will be able to see bond0
listed in the output of running ifconfig (without any options):
450
Chapter 24. Working with Kernel Modules
~]# ifconfig
bond0 Link encap:Ethernet HWaddr 00:00:00:00:00:00
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
eth0 Link encap:Ethernet HWaddr 52:54:00:26:9E:F1
inet addr:192.168.122.251 Bcast:192.168.122.255 Mask:255.255.255.0
inet6 addr: fe80::5054:ff:fe26:9ef1/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:207 errors:0 dropped:0 overruns:0 frame:0
TX packets:205 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:70374 (68.7 KiB) TX bytes:25298 (24.7 KiB)
[output truncated]
To view all existing bonds, even if they are not up, run:
You can configure each bond individually by manipulating the files located in the
/sys/class/net/bond<N>/bonding/ directory. First, the bond you are configuring must be taken
down:
As an example, to enable MII monitoring on bond0 with a 1 second interval, you could run (as root):
After configuring options for the bond in question, you can bring it up and test it by running ifconfig
bond<N> up. If you decide to change the options, take the interface down, modify its parameters using
sysfs, bring it back up, and re-test.
Once you have determined the best set of parameters for your bond, add those parameters as a space-
separated list to the BONDING_OPTS= directive of the /etc/sysconfig/network-scripts/ifcfg-
bond<N> file for the bonding interface you are configuring. Whenever that bond is brought up (for
example, by the system during the boot sequence if the ONBOOT=yes directive is set), the bonding
options specified in the BONDING_OPTS will take effect for that bond. For more information on configuring
bonding interfaces (and BONDING_OPTS), refer to the Red Hat Enterprise Linux 7 Networking Guide.
The following list provides the names of many of the more common channel bonding parameters, along
with a descriptions of what they do. For more information, refer to the brief descriptions for each parm in
m odinfo bonding output, or the exhaustive descriptions in the bonding.txt file in the kernel-doc
451
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
arp_interval=<time_in_milliseconds>
Specifies (in milliseconds) how often ARP monitoring occurs.
If using this setting while in m ode=0 or m ode=1 (the two load-balancing modes), the network
switch must be configured to distribute packets evenly across the NICs. For more information on
how to accomplish this, refer to /usr/share/doc/kernel-
doc-<kernel_version>/Docum entation/networking/bonding.txt
arp_ip_target=<ip_address>[,<ip_address_2>,… <ip_address_16>]
Specifies the target IP address of ARP requests when the arp_interval parameter is
enabled. Up to 16 IP addresses can be specified in a comma separated list.
arp_validate=<value>
Validate source/distribution of ARP probes; default is none. Other valid values are active,
backup, and all.
debug=<number>
Enables debug messages. Possible values are:
downdelay=<time_in_milliseconds>
Specifies (in milliseconds) how long to wait after link failure before disabling the link. The value
must be a multiple of the value specified in the m iim on parameter. The value is set to 0 by
default, which disables it.
lacp_rate=<value>
Specifies the rate at which link partners should transmit LACPDU packets in 802.3ad mode.
Possible values are:
slow or 0 — Default setting. This specifies that partners should transmit LACPDUs every 30
seconds.
fast or 1 — Specifies that partners should transmit LACPDUs every 1 second.
452
Chapter 24. Working with Kernel Modules
m iim on=<time_in_milliseconds>
Specifies (in milliseconds) how often MII link monitoring occurs. This is useful if high availability
is required because MII is used to verify that the NIC is active. To verify that the driver for a
particular NIC supports the MII tool, type the following command as root:
In this command, replace <interface_name> with the name of the device interface, such as
eth0, not the bond interface. If MII is supported, the command returns:
If using a bonded interface for high availability, the module for each NIC must support MII.
Setting the value to 0 (the default), turns this feature off. When configuring this setting, a good
starting point for this parameter is 100.
m ode=<value>
Allows you to specify the bonding policy. The <value> can be one of:
balance-rr or 0 — Sets a round-robin policy for fault tolerance and load balancing.
Transmissions are received and sent out sequentially on each bonded slave interface
beginning with the first one available.
active-backup or 1 — Sets an active-backup policy for fault tolerance. Transmissions are
received and sent out via the first available bonded slave interface. Another bonded slave
interface is only used if the active bonded slave interface fails.
balance-xor or 2 — Sets an XOR (exclusive-or) policy for fault tolerance and load
balancing. Using this method, the interface matches up the incoming request's MAC address
with the MAC address for one of the slave NICs. Once this link is established, transmissions
are sent out sequentially beginning with the first available interface.
broadcast or 3 — Sets a broadcast policy for fault tolerance. All transmissions are sent on
all slave interfaces.
802.3ad or 4 — Sets an IEEE 802.3ad dynamic link aggregation policy. Creates
aggregation groups that share the same speed and duplex settings. Transmits and receives
on all slaves in the active aggregator. Requires a switch that is 802.3ad compliant.
balance-tlb or 5 — Sets a Transmit Load Balancing (TLB) policy for fault tolerance and
load balancing. The outgoing traffic is distributed according to the current load on each slave
interface. Incoming traffic is received by the current slave. If the receiving slave fails, another
slave takes over the MAC address of the failed slave.
balance-alb or 6 — Sets an Active Load Balancing (ALB) policy for fault tolerance and
load balancing. Includes transmit and receive load balancing for IPV4 traffic. Receive load
balancing is achieved through ARP negotiation.
453
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
num _unsol_na=<number>
Specifies the number of unsolicited IPv6 Neighbor Advertisements to be issued after a failover
event. One unsolicited NA is issued immediately after the failover.
The valid range is 0 - 255; the default value is 1. This parameter affects only the active-
backup mode.
prim ary=<interface_name>
Specifies the interface name, such as eth0, of the primary device. The prim ary device is the
first of the bonding interfaces to be used and is not abandoned unless it fails. This setting is
particularly useful when one NIC in the bonding interface is faster and, therefore, able to handle
a bigger load.
This setting is only valid when the bonding interface is in active-backup mode. Refer to
/usr/share/doc/kernel-doc-<kernel-
version>/Docum entation/networking/bonding.txt for more information.
prim ary_reselect=<value>
Specifies the reselection policy for the primary slave. This affects how the primary slave is
chosen to become the active slave when failure of the active slave or recovery of the primary
slave occurs. This parameter is designed to prevent flip-flopping between the primary slave and
other slaves. Possible values are:
always or 0 (default) — The primary slave becomes the active slave whenever it comes
back up.
better or 1 — The primary slave becomes the active slave when it comes back up, if the
speed and duplex of the primary slave is better than the speed and duplex of the current
active slave.
failure or 2 — The primary slave becomes the active slave only if the current active slave
fails and the primary slave is up.
If no slaves are active, the first slave to recover is made the active slave.
When initially enslaved, the primary slave is always made the active slave.
Changing the prim ary_reselect policy via sysfs will cause an immediate selection of the
best active slave according to the new policy. This may or may not result in a change of the
active slave, depending upon the circumstances
updelay=<time_in_milliseconds>
Specifies (in milliseconds) how long to wait before enabling a link. The value must be a multiple
of the value specified in the m iim on parameter. The value is set to 0 by default, which disables
it.
use_carrier=<number>
Specifies whether or not m iim on should use MII/ETHTOOL ioctls or netif_carrier_ok()
to determine the link state. The netif_carrier_ok() function relies on the device driver to
maintains its state with netif_carrier_on/off; most device drivers support this function.
454
Chapter 24. Working with Kernel Modules
The MII/ETHROOL ioctls tools utilize a deprecated calling sequence within the kernel. However,
this is still configurable in case your device driver does not support netif_carrier_on/off.
Note
If the bonding interface insists that the link is up when it should not be, it is possible that
your network device driver does not support netif_carrier_on/off.
xm it_hash_policy=<value>
Selects the transmit hash policy used for slave selection in balance-xor and 802.3ad
modes. Possible values are:
0 or layer2 — Default setting. This parameter uses the XOR of hardware MAC addresses
to generate the hash. The formula used is:
This algorithm will place all traffic to a particular network peer on the same slave, and is
802.3ad compliant.
1 or layer3+4 — Uses upper layer protocol information (when available) to generate the
hash. This allows for traffic to a particular network peer to span multiple slaves, although a
single connection will not span multiple slaves.
The formula for unfragmented TCP and UDP packets used is:
For fragmented TCP or UDP packets and all other IP protocol traffic, the source and
destination port information is omitted. For non-IP traffic, the formula is the same as the
layer2 transmit hash policy.
This policy intends to mimic the behavior of certain switches; particularly, Cisco switches with
PFC2 as well as some Foundry and IBM products.
The algorithm used by this policy is not 802.3ad compliant.
2 or layer2+3 — Uses a combination of layer2 and layer3 protocol information to generate
the hash.
Uses XOR of hardware MAC addresses and IP addresses to generate the hash. The
formula is:
This algorithm will place all traffic to a particular network peer on the same slave. For non-IP
traffic, the formula is the same as for the layer2 transmit hash policy.
455
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
This policy is intended to provide a more balanced distribution of traffic than layer2 alone,
especially in environments where a layer3 gateway device is required to reach most
destinations.
This algorithm is 802.3ad compliant.
Linux Loadable Kernel Module HOWTO — The Linux Loadable Kernel Module HOWTO from the
Linux Documentation Project contains further information on working with kernel modules.
[5] Despite what the example might imply, Energy Efficient Ethernet is turned on by default in the e1 0 0 0 e driver.
456
RPM
RPM
The RPM Package Manager (RPM) is an open packaging system, which runs on Red Hat
Enterprise Linux as well as other Linux and UNIX systems. Red Hat, Inc. and the Fedora Project
encourage other vendors to use RPM for their own products. RPM is distributed under the terms of the
GPL (GNU General Public License).
The RPM Package Manager only works with packages built to work with the RPM format. RPM is itself
provided as a pre-installed rpm package. For the end user, RPM makes system updates easy. Installing,
uninstalling and upgrading RPM packages can be accomplished with short commands. RPM maintains a
database of installed packages and their files, so you can invoke powerful queries and verifications on
your system.
The RPM package format has been improved for Red Hat Enterprise Linux 7. RPM packages are now
compressed using the XZ lossless data compression format, which has the benefit of greater
compression and less CPU usage during decompression, and support multiple strong hash algorithms,
such as SHA-256, for package signing and verification.
For most package management tasks, the Yum package manager offers equal and often greater
capabilities and utility than RPM. Yum also performs and tracks complicated system dependency
resolution, and will complain and force system integrity checks if you use RPM as well to install
and remove packages. For these reasons, it is highly recommended that you use Yum instead of
RPM whenever possible to perform package management tasks. Refer to Chapter 5, Yum.
If you prefer a graphical interface, you can use the PackageKit GUI application, which uses Yum
as its back end, to manage your system's packages. Refer to Chapter 6, PackageKit for details.
When installing a package, ensure it is compatible with your operating system and processor
architecture. This can usually be determined by checking the package name. For example, the file
name of an RPM package compiled for the AMD64/Intel 64 computer architectures ends with
x86_64 .rpm .
During upgrades, RPM handles configuration files carefully, so that you never lose your customizations—
something that you cannot accomplish with regular .tar.gz files.
For the developer, RPM allows you to take software source code and package it into source and binary
packages for end users. This process is quite simple and is driven from a single file and optional patches
that you create. This clear delineation between pristine sources and your patches along with build
instructions eases the maintenance of the package as new versions of the software are released.
457
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Note
Because RPM can make changes to the system itself, performing operations like installing,
upgrading, downgrading, and uninstalling binary packages system wide will require root
privileges in most cases. In a default configuration, exceptions include the user's home directory,
temporary directories, and directories created by the administrator (with the appropriate
permissions).
Upgradability
With RPM, you can upgrade individual components of your system without completely
reinstalling. When you get a new release of an operating system based on RPM, such as
Red Hat Enterprise Linux, you do not need to reinstall a fresh copy of the operating system your
machine (as you might need to with operating systems based on other packaging systems).
RPM allows intelligent, fully-automated, in-place upgrades of your system. In addition,
configuration files in packages are preserved across upgrades, so you do not lose your
customizations. There are no special upgrade files needed to upgrade a package because the
same RPM file is used to both install and upgrade the package on your system.
Powerful Querying
RPM is designed to provide powerful querying options. You can perform searches on your
entire database for packages or even just certain files. You can also easily find out what
package a file belongs to and from where the package came. The files an RPM package
contains are in a compressed archive, with a custom binary header containing useful
information about the package and its contents, allowing you to query individual packages
quickly and easily.
System Verification
Another powerful RPM feature is the ability to verify packages. If you are worried that you
deleted an important file for some package, you can verify the package. You are then notified of
anomalies, if any—at which point you can reinstall the package, if necessary. Any configuration
files that you modified are preserved during reinstallation.
Pristine Sources
A crucial design goal was to allow the use of pristine software sources, as distributed by the
original authors of the software. With RPM, you have the pristine sources along with any
patches that were used, plus complete build instructions. This is an important advantage for
several reasons. For instance, if a new version of a program is released, you do not necessarily
have to start from scratch to get it to compile. You can look at the patch to see what you might
need to do. All the compiled-in defaults, and all of the changes that were made to get the
software to build properly, are easily visible using this technique.
The goal of keeping sources pristine may seem important only for developers, but it results in
higher quality software for end users, too.
458
RPM
The Red Hat Enterprise Linux installation media contain many installable RPMs.
The initial RPM repositories provided with the YUM package manager. Refer to Chapter 5, Yum for
details on how to use the official Red Hat Enterprise Linux package repositories.
The Extra Packages for Enterprise Linux (EPEL) is a community effort to provide high-quality add-on
packages for Red Hat Enterprise Linux. Refer to http://fedoraproject.org/wiki/EPEL for details on
EPEL RPM packages.
Unofficial, third-party repositories not affiliated with Red Hat also provide RPM packages.
When considering third-party repositories for use with your Red Hat Enterprise Linux system,
pay close attention to the repository's web site with regard to package compatibility before
adding the repository as a package source. Alternate package repositories may offer different,
incompatible versions of the same software, including packages already included in the
Red Hat Enterprise Linux repositories.
That is, rpm -U <rpm_file> is able to perform the function of either upgrading or installing as is
appropriate for the package.
Assuming the tree-1.5.3-2.el7.x86_64 .rpm package is in the current directory, log in as root and
type the following command at a shell prompt to either upgrade or install the tree package as determined
by rpm :
459
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The -v and -h options (which are combined with -U) cause rpm to print more verbose output and
display a progress meter using hash signs.
rpm provides two different options for installing packages: the aforementioned -U option (which
historically stands for upgrade), and the -i option, historically standing for install. Because the -U
option subsumes both install and upgrade functions, we recommend to use rpm -Uvh with all
packages except kernel packages.
You should always use the -i option to simply install a new kernel package instead of upgrading
it. This is because using the -U option to upgrade a kernel package removes the previous (older)
kernel package, which could render the system unable to boot if there is a problem with the new
kernel. Therefore, use the rpm -i <kernel_package> command to install a new kernel without
replacing any older kernel packages. For more information on installing kernel packages, refer to
Chapter 23, Manually Upgrading the Kernel.
The signature of a package is checked automatically when installing or upgrading a package. The
signature confirms that the package was signed by an authorized party. For example, if the verification of
the signature fails, an error message such as the following is displayed:
If you do not have the appropriate key installed to verify the signature, the message contains the word
NOKEY:
Refer to Section A.3, “Checking a Package's Signature” for more information on checking a package's
signature.
460
RPM
However, if you want to install the package anyway, you can use the --replacepkgs option, which tells
RPM to ignore the error:
This option is helpful if files installed from the RPM were deleted or if you want the original configuration
files from the RPM to be installed.
Preparing... ##################################################
file /usr/bin/foobar from install of foo-1.0-1.el7.x86_64 conflicts
with file from package bar-3.1.1.el7.x86_64
If you are installing a package from the Red Hat Enterprise Linux installation media, such as from a CD-
ROM or DVD, the dependencies may be available. Find the suggested package(s) on the Red Hat
Enterprise Linux installation media or on one of the active Red Hat Enterprise Linux mirrors and add it to
the command:
You can try the --whatprovides option to determine which package contains the required file.
If the package that contains bar.so.3 is in the RPM database, the name of the package is displayed:
bar-3.1.1.el7.i586.rpm
461
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Although we can force rpm to install a package that gives us a Failed dependencies error
(using the --nodeps option), this is not recommended, and will usually result in the installed
package failing to run. Installing or removing packages with rpm --nodeps can cause
applications to misbehave and/or crash, and can cause serious package management problems
or, possibly, system failure. For these reasons, it is best to heed such warnings; the package
manager—whether RPM, Yum or PackageKit—shows us these warnings and suggests possible
fixes because accounting for dependencies is critical. The Yum package manager can perform
dependency resolution and fetch dependencies from online repositories, making it safer, easier
and smarter than forcing rpm to carry out actions without regard to resolving dependencies.
This message means that changes you made to the configuration file may not be forward-compatible
with the new configuration file in the package, so RPM saved your original file and installed a new one.
You should investigate the differences between the two configuration files and resolve them as soon as
possible, to ensure that your system continues to function properly.
Alternatively, RPM may save the package's new configuration file as, for example, foo.conf.rpm new,
and leave the configuration file you modified untouched. You should still resolve any conflicts between
your modified configuration file and the new one, usually by merging changes from the old one to the
new one with a diff program.
If you attempt to upgrade to a package with an older version number (that is, if a higher version of the
package is already installed), the output is similar to the following:
A.2.4. Uninstalling
Uninstalling a package is just as simple as installing one. Type the following command at a shell prompt:
rpm -e foo
Notice that we used the package name foo, not the name of the original package file, foo-1.0-
1.el7.x86_64 . If you attempt to uninstall a package using the rpm -e command and the
original full file name, you will receive a package name error.
462
RPM
You can encounter dependency errors when uninstalling a package if another installed package depends
on the one you are trying to remove. For example:
rpm -e ghostscript
error: Failed dependencies:
libgs.so.8()(64bit) is needed by (installed) libspectre-0.2.2-3.el7.x86_64
libgs.so.8()(64bit) is needed by (installed) foomatic-4.0.3-1.el7.x86_64
libijs-0.35.so()(64bit) is needed by (installed) gutenprint-5.2.4-
5.el7.x86_64
ghostscript is needed by (installed) printer-filters-1.1-4.el7.noarch
Similar to how we searched for a shared object library (i.e. a <library_name>.so.<number> file) in
Section A.2.2.3, “Unresolved Dependency”, we can search for a 64-bit shared object library using this
exact syntax (and making sure to quote the file name):
Although we can force rpm to remove a package that gives us a Failed dependencies error
(using the --nodeps option), this is not recommended, and may cause harm to other installed
applications. Installing or removing packages with rpm --nodeps can cause applications to
misbehave and/or crash, and can cause serious package management problems or, possibly,
system failure. For these reasons, it is best to heed such warnings; the package manager—
whether RPM, Yum or PackageKit—shows us these warnings and suggests possible fixes
because accounting for dependencies is critical. The Yum package manager can perform
dependency resolution and fetch dependencies from online repositories, making it safer, easier
and smarter than forcing rpm to carry out actions without regard to resolving dependencies.
A.2.5. Freshening
Freshening is similar to upgrading, except that only existent packages are upgraded. Type the following
command at a shell prompt:
RPM's freshen option checks the versions of the packages specified on the command line against the
versions of packages that have already been installed on your system. When a newer version of an
already-installed package is processed by RPM's freshen option, it is upgraded to the newer version.
However, RPM's freshen option does not install a package if no previously-installed package of the same
name exists. This differs from RPM's upgrade option, as an upgrade does install packages whether or
not an older version of the package was already installed.
Freshening works for single packages or package groups. If you have just downloaded a large number
of different packages, and you only want to upgrade those packages that are already installed on your
system, freshening does the job. Thus, you do not have to delete any unwanted packages from the
group that you downloaded before using RPM.
463
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
RPM then automatically upgrades only those packages that are already installed.
A.2.6. Querying
The RPM database stores information about all RPM packages installed in your system. It is stored in the
directory /var/lib/rpm /, and is used to query what packages are installed, what versions each
package is, and to calculate any changes to any files in the package since installation, among other use
cases.
To query this database, use the -q option. The rpm -q package name command displays the package
name, version, and release number of the installed package <package_name>. For example, using rpm
-q tree to query installed package tree might generate the following output:
tree-1.5.2.2-4.el7.x86_64
You can also use the following Package Selection Options (which is a subheading in the RPM man page:
see m an rpm for details) to further refine or qualify your query:
There are a number of ways to specify what information to display about queried packages. The
following options are used to select the type of information for which you are searching. These are called
the Package Query Options.
-i displays package information including name, description, release, size, build date, install date,
vendor, and other miscellaneous information.
-l displays the list of files that the package contains.
-s displays the state of all the files in the package.
-d displays a list of files marked as documentation (man pages, info pages, READMEs, etc.) in the
package.
-c displays a list of files marked as configuration files. These are the files you edit after installation to
adapt and customize the package to your system (for example, sendm ail.cf, passwd, inittab,
etc.).
For options that display lists of files, add -v to the command to display the lists in a familiar ls -l
format.
A.2.7. Verifying
Verifying a package compares information about files installed from a package with the same information
from the original package. Among other things, verifying compares the file size, MD5 sum, permissions,
type, owner, and group of each file.
The command rpm -V verifies a package. You can use any of the Verify Options listed for querying to
specify the packages you wish to verify. A simple use of verifying is rpm -V tree, which verifies that all
the files in the tree package are as they were when they were originally installed. For example:
464
RPM
In this example, /usr/bin/tree is the absolute path to the file used to query a package.
To verify ALL installed packages throughout the system (which will take some time):
rpm -Va
This command can be useful if you suspect that your RPM database is corrupt.
If everything verified properly, there is no output. If there are any discrepancies, they are displayed. The
format of the output is a string of eight characters (a "c" denotes a configuration file) and then the file
name. Each of the eight characters denotes the result of a comparison of one attribute of the file to the
value of that attribute recorded in the RPM database. A single period (.) means the test passed. The
following characters denote specific discrepancies:
5 — MD5 checksum
S — file size
L — symbolic link
T — file modification time
D — device
U — user
G — group
M — mode (includes permissions and file type)
? — unreadable file (file permission errors, for example)
If you see any output, use your best judgment to determine if you should remove the package, reinstall it,
or fix the problem in another way.
The message <rpm_file>: rsa sha1 (m d5) pgp m d5 OK (specifically the OK part of it) is
displayed. This brief message means that the file was not corrupted during download. To see a more
verbose message, replace -K with -Kvv in the command.
On the other hand, how trustworthy is the developer who created the package? If the package is signed
with the developer's GnuPG key, you know that the developer really is who they say they are.
An RPM package can be signed using GNU Privacy Guard (or GnuPG), to help you make certain your
downloaded package is trustworthy.
GnuPG is a tool for secure communication; it is a complete and free replacement for the encryption
465
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
technology of PGP, an electronic privacy program. With GnuPG, you can authenticate the validity of
documents and encrypt/decrypt data to and from other recipients. GnuPG is capable of decrypting and
verifying PGP 5.x files as well.
During installation, GnuPG is installed by default. That way you can immediately start using GnuPG to
verify any packages that you receive from Red Hat. Before doing so, you must first import Red Hat's
public key.
To display a list of all keys installed for RPM verification, execute the command:
gpg-pubkey-db42a60e-37ea5438
To display details about a specific key, use rpm -qi followed by the output from the previous
command:
rpm -K <rpm-file>
If all goes well, the following message is displayed: m d5 gpg OK. This means that the signature of the
package has been verified, that it is not corrupt, and therefore is safe to install and use.
Perhaps you have deleted some files by accident, but you are not sure what you deleted. To verify
your entire system and see what might be missing, you could try the following command:
rpm -Va
If some files are missing or appear to have been corrupted, you should probably either re-install the
package or uninstall and then re-install the package.
At some point, you might see a file that you do not recognize. To find out which package owns it,
enter:
466
RPM
ghostscript-8.70-1.el7.x86_64
We can combine the above two examples in the following scenario. Say you are having problems with
/usr/bin/paste. You would like to verify the package that owns that program, but you do not know
which package owns paste. Enter the following command,
/usr/share/doc/procps-3.2.8/BUGS
/usr/share/doc/procps-3.2.8/FAQ
/usr/share/doc/procps-3.2.8/NEWS
/usr/share/doc/procps-3.2.8/TODO
/usr/share/man/man1/free.1.gz
/usr/share/man/man1/pgrep.1.gz
/usr/share/man/man1/pkill.1.gz
/usr/share/man/man1/pmap.1.gz
/usr/share/man/man1/ps.1.gz
/usr/share/man/man1/pwdx.1.gz
/usr/share/man/man1/skill.1.gz
/usr/share/man/man1/slabtop.1.gz
/usr/share/man/man1/snice.1.gz
/usr/share/man/man1/tload.1.gz
/usr/share/man/man1/top.1.gz
/usr/share/man/man1/uptime.1.gz
/usr/share/man/man1/w.1.gz
/usr/share/man/man1/watch.1.gz
/usr/share/man/man5/sysctl.conf.5.gz
/usr/share/man/man8/sysctl.8.gz
/usr/share/man/man8/vmstat.8.gz
You may find a new RPM, but you do not know what it does. To find information about it, use the
following command:
467
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Perhaps you now want to see what files the crontabs RPM package installs. You would enter the
following:
/etc/cron.daily
/etc/cron.hourly
/etc/cron.monthly
/etc/cron.weekly
/etc/crontab
/usr/bin/run-parts
/usr/share/man/man4/crontabs.4.gz
These are just a few examples. As you use RPM, you may find more uses for it.
468
RPM
469
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Other windowing environments have existed in the UNIX world, including some that predate the release
of the X Window System in June 1984. Nonetheless, X has been the default graphical environment for
most UNIX-like operating systems, including Red Hat Enterprise Linux, for many years.
The graphical environment for Red Hat Enterprise Linux is supplied by the X.Org Foundation, an open
source organization created to manage development and strategy for the X Window System and related
technologies. X.Org is a large-scale, rapid-developing project with hundreds of developers around the
world. It features a wide degree of support for a variety of hardware devices and architectures, and runs
on myriad operating systems and platforms.
The X Window System uses a client-server architecture. Its main purpose is to provide network
transparent window system, which runs on a wide range of computing and graphics machines. The X
server (the Xorg binary) listens for connections from X client applications via a network or local loopback
interface. The server communicates with the hardware, such as the video card, monitor, keyboard, and
mouse. X client applications exist in the user space, creating a graphical user interface (GUI) for the user
and passing user requests to the X server.
X11R7.1 was the first release to take specific advantage of making the X Window System modular. This
release split X into logically distinct modules, which make it easier for open source developers to
contribute code to the system.
In the current release, all libraries, headers, and binaries live under the /usr/ directory. The
/etc/X11/ directory contains configuration files for X client and server applications. This includes
configuration files for the X server itself, the X display managers, and many other base components.
The configuration file for the newer Fontconfig-based font architecture is still
/etc/fonts/fonts.conf. For more information on configuring and adding fonts, refer to Section B.4,
“Fonts”.
Because the X server performs advanced tasks on a wide array of hardware, it requires detailed
information about the hardware it works on. The X server is able to automatically detect most of the
hardware that it runs on and configure itself accordingly. Alternatively, hardware can be manually
specified in configuration files.
The Red Hat Enterprise Linux system installer, Anaconda, installs and configures X automatically, unless
the X packages are not selected for installation. If there are any changes to the monitor, video card or
other devices managed by the X server, most of the time, X detects and reconfigures these changes
automatically. In rare cases, X must be reconfigured manually.
470
The X Window System
range of GUIs are available with Red Hat Enterprise Linux, from the rudimentary Tab Window Manager
(twm) to the highly developed and interactive desktop environment (such as GNOME or KDE) that most
Red Hat Enterprise Linux users are familiar with.
To create the latter, more comprehensive GUI, two main classes of X client application must connect to
the X server: a window manager and a desktop environment.
Desktop environments have advanced features allowing X clients and other running processes to
communicate with one another, while also allowing all applications written to work in that environment to
perform advanced tasks, such as drag-and-drop operations.
GNOME — The default desktop environment for Red Hat Enterprise Linux based on the GTK+ 2
graphical toolkit.
KDE — An alternative desktop environment based on the Qt 4 graphical toolkit.
Both GNOME and KDE have advanced-productivity applications, such as word processors,
spreadsheets, and Web browsers; both also provide tools to customize the look and feel of the GUI.
Additionally, if both the GTK+ 2 and the Qt libraries are present, KDE applications can run in GNOME
and vice versa.
The Red Hat Enterprise Linux repositories provide five different window managers.
m etacity
The Metacity window manager is the default window manager for GNOME. It is a simple and
efficient window manager which supports custom themes. This window manager is
automatically pulled in as a dependency when the GNOME desktop is installed.
kwin
The KWin window manager is the default window manager for KDE. It is an efficient window
manager which supports custom themes. This window manager is automatically pulled in as a
dependency when the KDE desktop is installed.
com piz
The Compiz compositing window manager is based on OpenGL and can use 3D graphics
hardware to create fast compositing desktop effects for window management. Advanced
features, such as a cube workspace, are implemented as loadable plug-ins. To run this window
manager, you need to install the com piz package.
m wm
471
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
The Motif Window Manager (m wm ) is a basic, stand-alone window manager. Since it is designed
to be stand-alone, it should not be used in conjunction with GNOME or KDE. To run this window
manager, you need to install the openm otif package.
twm
The minimalist Tab Window Manager (twm ), which provides the most basic tool set among the
available window managers, can be used either as a stand-alone or with a desktop
environment. To run this window manager, you need to install the xorg-x11-twm package.
The X Window System supports two different configuration schemes. Configuration files in the
xorg.conf.d directory contain preconfigured settings from vendors and from distribution, and these
files should not be edited by hand. Configuration in the xorg.conf file, on the other hand, is done
completely by hand but is not necessary in most scenarios.
All necessary parameters for a display and peripherals are auto-detected and configured during
installation. The configuration file for the X server, /etc/X11/xorg.conf, that was necessary in
previous releases, is not supplied with the current release of the X Window System. It can still be
useful to create the file manually to configure new hardware, to set up an environment with
multiple video cards, or for debugging purposes.
The /usr/lib/xorg/m odules/ (or /usr/lib64 /xorg/m odules/) directory contains X server
modules that can be loaded dynamically at runtime. By default, only some modules in
/usr/lib/xorg/m odules/ are automatically loaded by the X server.
When Red Hat Enterprise Linux 7 is installed, the configuration files for X are created using information
gathered about the system hardware during the installation process by the HAL (Hardware Abstraction
Layer) configuration back end. Whenever the X server is started, it asks HAL for the list of input devices
and adds each of them with their respective driver. Whenever a new input device is plugged in, or an
existing input device is removed, HAL notifies the X server about the change. Because of this notification
system, devices using the m ouse, kbd, or vm m ouse driver configured in the xorg.conf file are, by
default, ignored by the X server. Refer to Section B.3.3.3, “The ServerFlags section” for further
details. Additional configuration is provided in the /etc/X11/xorg.conf.d/ directory and it can
override or augment any configuration that has been obtained through HAL.
472
The X Window System
Some options within the /etc/X11/xorg.conf file accept a Boolean switch which turns the feature on
or off. The acceptable values are:
The following shows a typical configuration file for the keyboard. Lines beginning with a hash sign (#) are
not read by the X server and are used for human-readable comments.
Section "InputClass"
Identifier "system-setup-keyboard"
MatchIsKeyboard "on"
Option "XkbModel" "pc105"
Option "XkbLayout" "cz,us"
# Option "XkbVariant" "(null)"
Option "XkbOptions"
"terminate:ctrl_alt_bksp,grp:shifts_toggle,grp_led:scroll"
EndSection
Files with the suffix .conf in configuration directories are parsed by the X server upon startup and are
treated like part of the traditional xorg.conf configuration file. These files may contain one or more
sections; for a description of the options in a section and the general layout of the configuration file, refer
to Section B.3.3, “The xorg.conf File” or to the xorg.conf(5) man page. The X server essentially
treats the collection of configuration files as one big file with entries from xorg.conf at the end. Users
are encouraged to put custom configuration into /etc/xorg.conf and leave the directory for
configuration snippets provided by the distribution.
In the following, some important sections are described in the order in which they appear in a typical
/etc/X11/xorg.conf file. More detailed information about the X server configuration file can be found
in the xorg.conf(5) man page. This section is mostly intended for advanced users as most
configuration options described below are not needed in typical configuration scenarios.
473
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
matches specified; in order to apply to an input device, all matches must apply to the device as seen in
the example below:
Section "InputClass"
Identifier "touchpad catchall"
MatchIsTouchpad "on"
Driver "synaptics"
EndSection
If this snippet is present in an xorg.conf file or an xorg.conf.d directory, any touchpad present in
the system is assigned the synaptics driver.
Note that due to alphanumeric sorting of configuration files in the xorg.conf.d directory, the
Driver setting in the example above overwrites previously set driver options. The more generic
the class, the earlier it should be listed.
The match options specify which devices a section may apply to. To match a device, all match options
must correspond. The following options are commonly used in the InputClass section:
A configuration file may have multiple InputClass sections. These sections are optional and are used
to configure a class of input devices as they are automatically added. An input device can match more
than one InputClass section. When arranging these sections, it is recommended to put generic
matches above specific ones because each input class can override settings from a previous one if an
overlap occurs.
With Red Hat Enterprise Linux 7, no InputDevice configuration is needed for most setups, and the
xorg-x11-drv-* input driver packages provide the automatic configuration through HAL. The default driver
for both keyboards and mice is evdev.
474
The X Window System
Section "InputDevice"
Identifier "Keyboard0"
Driver "kbd"
Option "XkbModel" "pc105"
Option "XkbLayout" "us"
EndSection
Identifier — Specifies a unique name for this InputDevice section. This is a required entry.
Driver — Specifies the name of the device driver X must load for the device. If the
AutoAddDevices option is enabled (which is the default setting), any input device section with
Driver "m ouse" or Driver "kbd" will be ignored. This is necessary due to conflicts between
the legacy mouse and keyboard drivers and the new evdev generic driver. Instead, the server will
use the information from the back end for any input devices. Any custom input device configuration in
the xorg.conf should be moved to the back end. In most cases, the back end will be HAL and the
configuration location will be the /etc/X11/xorg.conf.d directory.
Option — Specifies necessary options pertaining to the device.
A mouse may also be specified to override any auto-detected values for the device. The following
options are typically included when adding a mouse in the xorg.conf file:
Protocol — Specifies the protocol used by the mouse, such as IMPS/2.
Device — Specifies the location of the physical device.
Em ulate3Buttons — Specifies whether to allow a two-button mouse to act like a three-button
mouse when both mouse buttons are pressed simultaneously.
Consult the xorg.conf(5) man page for a complete list of valid options for this section.
Each entry within the ServerFlags section occupies a single line and begins with the term Option
followed by an option enclosed in double quotation marks (").
Section "ServerFlags"
Option "DontZap" "true"
EndSection
"DontZap" "boolean" — When the value of <boolean> is set to true, this setting prevents the
use of the Ctrl+Alt+Backspace key combination to immediately terminate the X server.
475
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
X keyboard extension
Even if this option is enabled, the key combination still must be configured in the X Keyboard
Extension (XKB) map before it can be used. One way how to add the key combination to the
map is to run the following command:
"DontZoom " "boolean" — When the value of <boolean> is set to true, this setting prevents
cycling through configured video resolutions using the Ctrl+Alt+Keypad-Plus and
Ctrl+Alt+Keypad-Minus key combinations.
"AutoAddDevices" "boolean" — When the value of <boolean> is set to false, the server will
not hot plug input devices and instead rely solely on devices configured in the xorg.conf file. Refer
to Section B.3.3.2, “The InputDevice section” for more information concerning input devices. This
option is enabled by default and HAL (hardware abstraction layer) is used as a back end for device
discovery.
Section "ServerLayout"
Identifier "Default Layout"
Screen 0 "Screen0" 0 0
InputDevice "Mouse0" "CorePointer"
InputDevice "Keyboard0" "CoreKeyboard"
EndSection
Screen 0 "Screen0" 0 0
The first number in this example Screen entry (0) indicates that the first monitor connector, or head
on the video card, uses the configuration specified in the Screen section with the identifier
"Screen0".
An example of a Screen section with the identifier "Screen0" can be found in Section B.3.3.8,
“The Screen section”.
If the video card has more than one head, another Screen entry with a different number and a
different Screen section identifier is necessary.
The numbers to the right of "Screen0" give the absolute X and Y coordinates for the upper left
corner of the screen (0 0 by default).
476
The X Window System
InputDevice — Specifies the name of an InputDevice section to be used with the X server.
It is advisable that there be at least two InputDevice entries: one for the default mouse and one for
the default keyboard. The options CorePointer and CoreKeyboard indicate that these are the
primary mouse and keyboard. If the AutoAddDevices option is enabled, this entry needs not to be
specified in the ServerLayout section. If the AutoAddDevices option is disabled, both mouse and
keyboard are auto-detected with the default values.
Option "option-name" — An optional entry which specifies extra parameters for the section. Any
options listed here override those listed in the ServerFlags section.
Replace <option-name> with a valid option listed for this section in the xorg.conf(5) man page.
It is possible to put more than one ServerLayout section in the /etc/X11/xorg.conf file. By
default, the server only reads the first one it encounters, however. If there is an alternative
ServerLayout section, it can be specified as a command line argument when starting an X session; as
in the Xorg -layout <layoutnam e> command.
Section "Files"
RgbPath "/usr/share/X11/rgb.txt"
FontPath "unix/:7100"
EndSection
ModulePath — An optional parameter which specifies alternate directories which store X server
modules.
Section "Monitor"
Identifier "Monitor0"
VendorName "Monitor Vendor"
ModelName "DDC Probed Monitor - ViewSonic G773-2"
DisplaySize 320 240
HorizSync 30.0 - 70.0
VertRefresh 50.0 - 180.0
EndSection
Identifier — Specifies a unique name for this Monitor section. This is a required entry.
VendorNam e — An optional parameter which specifies the vendor of the monitor.
ModelNam e — An optional parameter which specifies the monitor's model name.
477
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
DisplaySize — An optional parameter which specifies, in millimeters, the physical size of the
monitor's picture area.
HorizSync — Specifies the range of horizontal sync frequencies compatible with the monitor, in
kHz. These values help the X server determine the validity of built-in or specified Modeline entries
for the monitor.
VertRefresh — Specifies the range of vertical refresh frequencies supported by the monitor, in
kHz. These values help the X server determine the validity of built-in or specified Modeline entries
for the monitor.
Modeline — An optional parameter which specifies additional video modes for the monitor at
particular resolutions, with certain horizontal sync and vertical refresh resolutions. Refer to the
xorg.conf(5) man page for a more detailed explanation of Modeline entries.
Option "option-name" — An optional entry which specifies extra parameters for the section.
Replace <option-name> with a valid option listed for this section in the xorg.conf(5) man page.
The following example shows a typical Device section for a video card:
Section "Device"
Identifier "Videocard0"
Driver "mga"
VendorName "Videocard vendor"
BoardName "Matrox Millennium G200"
VideoRam 8192
Option "dpms"
EndSection
Identifier — Specifies a unique name for this Device section. This is a required entry.
Driver — Specifies which driver the X server must load to utilize the video card. A list of drivers can
be found in /usr/share/hwdata/videodrivers, which is installed with the hwdata package.
VendorNam e — An optional parameter which specifies the vendor of the video card.
BoardNam e — An optional parameter which specifies the name of the video card.
VideoRam — An optional parameter which specifies the amount of RAM available on the video card,
in kilobytes. This setting is only necessary for video cards the X server cannot probe to detect the
amount of video RAM.
BusID — An entry which specifies the bus location of the video card. On systems with only one video
card a BusID entry is optional and may not even be present in the default /etc/X11/xorg.conf
file. On systems with more than one video card, however, a BusID entry is required.
Screen — An optional entry which specifies which monitor connector or head on the video card the
Device section configures. This option is only useful for video cards with multiple heads.
If multiple monitors are connected to different heads on the same video card, separate Device
sections must exist and each of these sections must have a different Screen value.
Values for the Screen entry must be an integer. The first head on the video card has a value of 0.
The value for each additional head increments this value by one.
Option "option-name" — An optional entry which specifies extra parameters for the section.
Replace <option-name> with a valid option listed for this section in the xorg.conf(5) man page.
478
The X Window System
One of the more common options is "dpm s" (for Display Power Management Signaling, a VESA
standard), which activates the Energy Star energy compliance setting for the monitor.
Section "Screen"
Identifier "Screen0"
Device "Videocard0"
Monitor "Monitor0"
DefaultDepth 16
SubSection "Display"
Depth 24
Modes "1280x1024" "1280x960" "1152x864" "1024x768" "800x600" "640x480"
EndSubSection
SubSection "Display"
Depth 16
Modes "1152x864" "1024x768" "800x600" "640x480"
EndSubSection
EndSection
Identifier — Specifies a unique name for this Screen section. This is a required entry.
Device — Specifies the unique name of a Device section. This is a required entry.
Monitor — Specifies the unique name of a Monitor section. This is only required if a specific
Monitor section is defined in the xorg.conf file. Normally, monitors are detected automatically.
DefaultDepth — Specifies the default color depth in bits. In the previous example, 16 (which
provides thousands of colors) is the default. Only one DefaultDepth entry is permitted, although
this can be overridden with the Xorg command line option -depth <n>, where <n> is any additional
depth specified.
SubSection "Display" — Specifies the screen modes available at a particular color depth. The
Screen section can have multiple Display subsections, which are entirely optional since screen
modes are detected automatically.
This subsection is normally used to override auto-detected modes.
Option "option-name" — An optional entry which specifies extra parameters for the section.
Replace <option-name> with a valid option listed for this section in the xorg.conf(5) man page.
This section is rarely used, as the DRI Group and Mode are automatically initialized to default values. If a
different Group or Mode is needed, then adding this section to the xorg.conf file will override the
479
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
default values.
Section "DRI"
Group 0
Mode 0666
EndSection
Since different video cards use DRI in different ways, do not add to this section without first referring to
http://dri.freedesktop.org/wiki/.
B.4. Fonts
Red Hat Enterprise Linux uses Fontconfig subsystem to manage and display fonts under the X Window
System. It simplifies font management and provides advanced display features, such as anti-aliasing.
This system is used automatically for applications programmed using the Qt 3 or GT K+ 2 graphical
toolkits, or their newer versions.
The Fontconfig font subsystem allows applications to directly access fonts on the system and use the X
FreeType interface library (Xft) or other rendering mechanisms to render Fontconfig fonts with advanced
features such as anti-aliasing. Graphical applications can use the Xft library with Fontconfig to draw text
to the screen.
Font configuration
Fontconfig uses the /etc/fonts/fonts.conf configuration file, which should not be edited by
hand.
Fonts group
Any system where the user expects to run remote X applications needs to have the fonts group
installed. This can be done by selecting the group in the installer, and also by running the yum
groupinstall fonts command after installation.
1. To add fonts for an individual user, copy the new fonts into the .fonts/ directory in the user's
home directory.
To add fonts system-wide, copy the new fonts into the /usr/share/fonts/ directory. It is a
good idea to create a new subdirectory, such as local/ or similar, to help distinguish between
user-installed and default fonts.
2. Run the fc-cache command as root to update the font information cache:
fc-cache <path-to-font-directory>
In this command, replace <path-to-font-directory> with the directory containing the new
fonts (either /usr/share/fonts/local/ or /hom e/<user>/.fonts/).
480
The X Window System
Individual users may also install fonts interactively, by typing fonts:/// into the Nautilus
address bar, and dragging the new font files there.
The following subsections review how X starts up in both runlevel 3 and runlevel 5. For more information
about runlevels, refer to Chapter 7, Managing Services with systemd.
B.5.1. Runlevel 3
When in runlevel 3, the best way to start an X session is to log in and type startx. The startx
command is a front-end to the xinit command, which launches the X server (Xorg) and connects X
client applications to it. Because the user is already logged into the system at runlevel 3, startx does
not launch a display manager or authenticate users. Refer to Section B.5.2, “Runlevel 5” for more
information about display managers.
1. When the startx command is executed, it searches for the .xinitrc file in the user's home
directory to define the desktop environment and possibly other X client applications to run. If no
.xinitrc file is present, it uses the system default /etc/X11/xinit/xinitrc file instead.
2. The default xinitrc script then searches for user-defined files and default system files, including
.Xresources, .Xm odm ap, and .Xkbm ap in the user's home directory, and Xresources,
Xm odm ap, and Xkbm ap in the /etc/X11/ directory. The Xm odm ap and Xkbm ap files, if they
exist, are used by the xm odm ap utility to configure the keyboard. The Xresources file is read to
assign specific preference values to applications.
3. After setting the above options, the xinitrc script executes all scripts located in the
/etc/X11/xinit/xinitrc.d/ directory. One important script in this directory is xinput.sh,
which configures settings such as the default language.
4. The xinitrc script attempts to execute .Xclients in the user's home directory and turns to
/etc/X11/xinit/Xclients if it cannot be found. The purpose of the Xclients file is to start
the desktop environment or, possibly, just a basic window manager. The .Xclients script in the
user's home directory starts the user-specified desktop environment in the .Xclients-default
file. If .Xclients does not exist in the user's home directory, the standard
/etc/X11/xinit/Xclients script attempts to start another desktop environment, trying
GNOME first, then KDE, followed by twm .
When in runlevel 3, the user is returned to a text mode user session after ending an X session.
B.5.2. Runlevel 5
When the system boots into runlevel 5, a special X client application called a display manager is
launched. A user must authenticate using the display manager before any desktop environment or
window managers are launched.
Depending on the desktop environments installed on the system, three different display managers are
available to handle user authentication.
481
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
GDM (GNOME Display Manager) — The default display manager for Red Hat Enterprise Linux.
GNOME allows the user to configure language settings, shutdown, restart or log in to the system.
KDM — KDE's display manager which allows the user to shutdown, restart or log in to the system.
xdm (X Window Display Manager) — A very basic display manager which only lets the user log in to
the system.
When booting into runlevel 5, the /etc/X11/prefdm script determines the preferred display manager
by referencing the /etc/sysconfig/desktop file. A list of options for this file is available in this file:
/usr/share/doc/initscripts-<version-number>/sysconfig.txt
Each of the display managers reference the /etc/X11/xdm /Xsetup_0 file to set up the login screen.
Once the user logs into the system, the /etc/X11/xdm /GiveConsole script runs to assign ownership
of the console to the user. Then, the /etc/X11/xdm /Xsession script runs to accomplish many of the
tasks normally performed by the xinitrc script when starting X from runlevel 3, including setting
system and user resources, as well as running the scripts in the /etc/X11/xinit/xinitrc.d/
directory.
Users can specify which desktop environment they want to use when they authenticate using the GNOME
or KDE display managers by selecting it from the Sessions menu item accessed by selecting System →
Preferences → More Preferences → Sessions. If the desktop environment is not specified in the
display manager, the /etc/X11/xdm /Xsession script checks the .xsession and .Xclients files in
the user's home directory to decide which desktop environment to load. As a last resort, the
/etc/X11/xinit/Xclients file is used to select a desktop environment or window manager to use in
the same way as runlevel 3.
When the user finishes an X session on the default display (:0) and logs out, the
/etc/X11/xdm /T akeConsole script runs and reassigns ownership of the console to the root user.
The original display manager, which continues running after the user logged in, takes control by
spawning a new display manager. This restarts the X server, displays a new login window, and starts the
entire process over again.
The user is returned to the display manager after logging out of X from runlevel 5.
For more information on how display managers control user authentication, refer to the
/usr/share/doc/gdm -<version-number>/README, where <version-number> is the version
number for the gdm package installed, or the xdm man page.
482
The X Window System
m an xorg.conf — Contains information about the xorg.conf configuration files, including the
meaning and syntax for the different sections within the files.
m an Xorg — Describes the Xorg display server.
483
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
Revision History
Revision 0.0-0.6 Thu, Apr 10 2014 Stephen Wadeley
Added TigerVNC chapter. Updates mainly to OpenLMI, and Yum chapters, as well as the GRUB 2
section.
Index
Symbols
.fetchmailrc, Fetchmail Configuration Options
- server options, Server Options
- user options, User Options
(see OProfile)
A
adding
- group, Adding a New Group
- user, Adding a New User
484
Revision History
- files
- /etc/httpd/conf.d/ssl.conf , Enabling the mod_ssl Module
- /etc/httpd/conf/httpd.conf , Editing the Configuration Files
- modules
- developing, Writing a Module
- loading, Loading a Module
- mod_ssl , Setting Up an SSL Server
- mod_userdir, Updating the Configuration
- version 2.4
- changes, Notable Changes
at , At and Batch
- additional resources, Additional Resources
B
batch , At and Batch
- additional resources, Additional Resources
485
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
C
ch-email .fetchmailrc
- global options, Global Options
channel bonding
- configuration, Using Channel Bonding
- description, Using Channel Bonding
- parameters to bonded interfaces, Bonding Module Directives
D
desktop environments (see X)
df, Using the df Command
directory server (see OpenLDAP)
display managers (see X)
documentation
- finding installed, Practical and Common Examples of RPM Usage
E
email
- additional resources, Additional Resources
- installed documentation, Installed Documentation
486
Revision History
- Fetchmail, Fetchmail
- history of, Mail Servers
- mail server
- Dovecot, Dovecot
- Postfix, Postfix
- Procmail, Mail Delivery Agents
- program classifications, Email Program Classifications
- protocols, Email Protocols
- IMAP, IMAP
- POP, POP
- SMTP, SMTP
- Sendmail, Sendmail
- spam
- filtering out, Spam Filters
- types
- Mail Delivery Agent, Mail Delivery Agent
- Mail Transport Agent, Mail Transport Agent
- Mail User Agent, Mail User Agent
F
feedback
- contact information for this manual, Feedback
Fetchmail, Fetchmail
- additional resources, Additional Resources
- command options, Fetchmail Command Options
- informational, Informational or Debugging Options
- special, Special Options
487
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
G
GNOME, Desktop Environments
- (see also X)
group configuration
- adding groups, Adding a New Group
- filtering list of groups, Viewing Users and Groups
- groupadd, Adding a New Group
- modify users in groups, Modifying Group Properties
- modifying group properties, Modifying Group Properties
- viewing list of groups, Using the User Manager Tool
488
Revision History
GRUB 2
- configuring GRUB 2, Working with the GRUB 2 Boot Loader
- customizing GRUB 2, Working with the GRUB 2 Boot Loader
- re-installing GRUB 2, Working with the GRUB 2 Boot Loader
H
hardware
- viewing, Viewing Hardware Information
I
information
- about your system, System Monitoring Tools
K
KDE, Desktop Environments
- (see also X)
kernel
- downloading, Downloading the Upgraded Kernel
- installing kernel packages, Manually Upgrading the Kernel
- kernel packages, Overview of Kernel Packages
489
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
- upgrading
- preparing, Preparing to Upgrade
- working boot media, Preparing to Upgrade
kernel module
- bonding module, Using Channel Bonding
- description, Using Channel Bonding
- parameters to bonded interfaces, Bonding Module Directives
- Ethernet module
- supporting multiple cards, Using Multiple Ethernet Cards
- files
- /proc/modules, Listing Currently-Loaded Modules
- listing
- currently loaded modules, Listing Currently-Loaded Modules
- module information, Displaying Information About a Module
- loading
- at the boot time, Persistent Module Loading
- for the current session, Loading a Module
- module parameters
- bonding module parameters, Bonding Module Directives
- supplying, Setting Module Parameters
490
Revision History
kernel package
- kernel
- for single,multicore and multiprocessor systems, Overview of Kernel Packages
- kernel-devel
- kernel headers and makefiles, Overview of Kernel Packages
- kernel-doc
- documentation files, Overview of Kernel Packages
- kernel-headers
- C header files files, Overview of Kernel Packages
- linux-firmware
- firmware files, Overview of Kernel Packages
- perf
- firmware files, Overview of Kernel Packages
kernel upgrading
- preparing, Preparing to Upgrade
L
LDAP (see OpenLDAP)
localectl (see keyboard configuration)
Log File Viewer
- filtering, Viewing Log Files
- monitoring, Monitoring Log Files
- refresh rate, Viewing Log Files
- searching, Viewing Log Files
491
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
M
Mail Delivery Agent (see email)
Mail Transport Agent (see email) (see MTA)
Mail Transport Agent Switcher, Mail Transport Agent (MTA) Configuration
Mail User Agent, Mail Transport Agent (MTA) Configuration (see email)
MDA (see Mail Delivery Agent)
memory usage, Viewing Memory Usage
metacity, Window Managers
- (see also X)
MUA, Mail Transport Agent (MTA) Configuration (see Mail User Agent)
mwm, Window Managers
492
Revision History
- (see also X)
N
net program, Samba Distribution Programs
NIC
- binding into single channel, Using Channel Bonding
O
opannotate (see OProfile)
opcontrol (see OProfile)
OpenLDAP
- checking status, Verifying the Service Status
- client applications, Overview of Common LDAP Client Applications
- configuration
- database, Changing the Database-Specific Configuration
- global, Changing the Global Configuration
- overview, OpenLDAP Server Setup
- directives
- olcAllows, Changing the Global Configuration
- olcConnMaxPending, Changing the Global Configuration
- olcConnMaxPendingAuth, Changing the Global Configuration
- olcDisallows, Changing the Global Configuration
- olcIdleTimeout, Changing the Global Configuration
- olcLogFile, Changing the Global Configuration
- olcReadOnly, Changing the Database-Specific Configuration
- olcReferral, Changing the Global Configuration
- olcRootDN, Changing the Database-Specific Configuration
- olcRootPW, Changing the Database-Specific Configuration
- olcSuffix, Changing the Database-Specific Configuration
- olcWriteTimeout, Changing the Global Configuration
- directories
- /etc/openldap/slapd.d/, Configuring an OpenLDAP Server
- /etc/openldap/slapd.d/cn=config/cn=schema/, Extending Schema
493
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
- DSA keys
- generating, Generating Key Pairs
- RSA keys
- generating, Generating Key Pairs
OpenSSL
- SSL (see SSL )
- TLS (see TLS )
494
Revision History
- events
- sampling rate, Sampling Rate
- setting, Setting Events to Monitor
P
package
- kernel RPM, Manually Upgrading the Kernel
package groups
- listing package groups with Yum
- yum groups, Listing Package Groups
495
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
PackageKit, PackageKit
- adding and removing, Using Add/Remove Software
- architecture, PackageKit Architecture
- installing and removing package groups, Installing and Removing Package Groups
- installing packages, PackageKit
- managing packages, PackageKit
- PolicyKit
- authentication, Updating Packages with Software Update
496
Revision History
- kernel-devel
- kernel headers and makefiles, Overview of Kernel Packages
- kernel-doc
- documentation files, Overview of Kernel Packages
- kernel-headers
- C header files files, Overview of Kernel Packages
- linux-firmware
- firmware files, Overview of Kernel Packages
497
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
passwords
- shadow, Shadow Passwords
498
Revision History
R
RAM, Viewing Memory Usage
rcp, Using the scp Utility
Red Hat Enterprise Linux installation media
- installable packages, Finding RPM Packages
- determining file ownership with, Practical and Common Examples of RPM Usage
499
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
S
Samba (see Samba)
- Abilities, Samba Features
- Additional Resources, Additional Resources
- installed documentation, Installed Documentation
- related books, Related Books
- useful websites, Useful Websites
500
Revision History
- Reference, Samba
- Samba Printers, Adding a Samba (SMB) printer
- service
- conditional restarting, Starting and Stopping Samba
- reloading, Starting and Stopping Samba
- restarting, Starting and Stopping Samba
- starting, Starting and Stopping Samba
- stopping, Starting and Stopping Samba
- share
- connecting to via the command line, Command Line
- connecting to with Nautilus, Connecting to a Samba Share
- mounting, Mounting the Share
Sendmail, Sendmail
501
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
502
Revision History
system information
- cpu usage, Viewing CPU Usage
- file systems, Viewing Block Devices and File Systems
- gathering, System Monitoring Tools
- hardware, Viewing Hardware Information
- memory usage, Viewing Memory Usage
- processes, Viewing System Processes
- currently running, Using the top Command
System Monitor, Using the System Monitor Tool, Using the System Monitor Tool, Using the
System Monitor Tool, Using the System Monitor Tool
system-config-users (see user configuration and group configuration)
T
testparm program, Samba Distribution Programs
TLS , Setting Up an SSL Server
- (see also Apache HTTP Server )
U
updating currently installed packages
503
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
user configuration
- adding users, Adding a New User
- changing full name, Modifying User Properties
- changing home directory, Modifying User Properties
- changing login shell, Modifying User Properties
- changing password, Modifying User Properties
- command line configuration
- passwd, Adding a New User
- useradd, Adding a New User
useradd command
- user account creation using, Adding a New User
V
virtual host (see Apache HTTP Server )
vsftpd
- additional resources, Additional Resources
- installed documentation, Installed Documentation
- online documentation, Online Documentation
504
Revision History
W
wbinfo program, Samba Distribution Programs
web server (see Apache HTTP Server)
window managers (see X)
Windows 2000
- connecting to shares using Samba, Encrypted Passwords
Windows 98
- connecting to shares using Samba, Encrypted Passwords
Windows ME
- connecting to shares using Samba, Encrypted Passwords
Windows NT 4.0
- connecting to shares using Samba, Encrypted Passwords
Windows XP
- connecting to shares using Samba, Encrypted Passwords
X
X
- /etc/X11/xorg.conf
- Boolean values for, The Structure of the Configuration
- Device, The Device section
- DRI, The DRI section
- Files section, The Files section
- InputDevice section, The InputDevice section
- introducing, The xorg.conf.d Directory, The xorg.conf File
- Monitor, The Monitor section
- Screen, The Screen section
- Section tag, The Structure of the Configuration
- ServerFlags section, The ServerFlags section
- ServerLayout section, The ServerLayout Section
- structure of, The Structure of the Configuration
505
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
- configuration directory
- /etc/X11/xorg.conf.d, The xorg.conf.d Directory
- configuration files
- /etc/X11/ directory, X Server Configuration Files
- /etc/X11/xorg.conf, The xorg.conf File
- options within, X Server Configuration Files
- server options, The xorg.conf.d Directory, The xorg.conf File
- desktop environments
- GNOME, Desktop Environments
- KDE, Desktop Environments
- display managers
- configuration of preferred, Runlevel 5
- definition of, Runlevel 5
- GNOME, Runlevel 5
- KDE, Runlevel 5
- prefdm script, Runlevel 5
- xdm, Runlevel 5
- fonts
- Fontconfig, Fonts
- Fontconfig, adding fonts to, Adding Fonts to Fontconfig
- FreeType, Fonts
- introducing, Fonts
- Xft, Fonts
506
Revision History
Y
Yum
- configuring plug-ins, Enabling, Configuring, and Disabling Yum Plug-ins
- configuring Yum and Yum repositories, Configuring Yum and Yum Repositories
- disabling plug-ins, Enabling, Configuring, and Disabling Yum Plug-ins
- displaying packages
- yum info, Displaying Package Information
507
Red Hat Enterprise Linux 7.0 Beta System Administrators Guide
- repository, Adding, Enabling, and Disabling a Yum Repository, Creating a Yum Repository
- searching packages with Yum
- yum search, Searching Packages
Yum repositories
- viewing Yum repositories with PackageKit, Refreshing Software Sources (Yum
Repositories)
Yum Updates
- checking for updates, Checking For Updates
- updating a single package, Updating Packages
- updating all packages and dependencies, Updating Packages
- updating packages, Updating Packages
- updating security-related packages, Updating Packages
508
RED HAT ENTERPRISE LINUX 5, 6, AND 7
TASK RHEL5 RHEL6 RHEL7
usermod
usermod
View user account details
USER MANAGEMENT
/etc/passwd
AND IDENTITY
rhn_register security semanage
Change user permissions usermod
Configure subscription subscription-manager 1 setsebool /etc/sudoers
rhn_register rhnreg_ks
SECURITY
rhn_register 2 system-config-selinux
subscription-manager
groupmod
Change group permissions
sosreport sosreport Report on system /etc/sudoers
View system profile sealert
dmidecode dmidecode security
hwbrowser lshw Change password policy chage
authconfig
View RHEL version information /etc/redhat-release LDAP, SSSD, Kerberos authconfig-tui Encrypted password
/etc/shadow
authconfig-gtk location
1 subscription-manager is used for Satellite 6, Satellite 5.6 with SAM and newer, and Red Hat’s CDN.
2 RHN tools are deprecated on Red Hat Enterprise Linux 7. rhn_register should be used for Satellite server 5.6 and newer only. For details, see: Satellite 5.6 unable to register RHEL 7 client system due to Network users getent View/end user sessions w
rhn-setup package not included in Minimal installation
Graphical configuration tools system-config-* gnome-control-center Default file system ext3 ext4 xfs
/etc/ssh/ssh_config lvcreate
Configure SSH Create logical volume lvcreate
/etc/ssh/sshd_config ssm create (if backend is lvm)
~/.ssh/config ssh-keygen
vgextend
Enlarge volumes vgextend
lvextend
formatted with default lvextend
xfs_growfs
TASK RHEL5 RHEL6 RHEL7 file system resize2fs
ssm resize
ip addr
TASK RHEL5 RHEL6 RHEL7 ip addr nmcli dev show
View network interface
ifconfig teamdctl
info
brctl brctl
append rd.break or init=/bin/bash
Single user/rescue mode append 1 or s or init=/bin/bash to kernel cmdline bridge
to kernel cmdline
/etc/sysconfig/network-scripts/ifcfg-*
Shut down system shutdown systemctl shutdown
Configure network nmcli con [add|mod|edit]
/etc/sysconfig/network-scripts/ifcfg-*
interface nmtui
Power off system poweroff systemctl poweroff
KERNEL, BOOT, AND HARDWARE
nm-connection-editor
Configure default run level/target /etc/inittab systemctl set-default View routes ip route
/etc/default/grub /etc/sysconfig/network
Configure routes
Configure GRUB bootloader /boot/grub/grub.conf grub2-mkconfig system-config-network
grub-set-default
rpm -q kernel df
View kernel version View disk usage df
uname -r iostat
Key differences between Red Hat Enterprise Linux 7 and Red Hat Enterprise Linux 8
The text of and illustrations in this document are licensed by Red Hat under a Creative Commons
Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is
available at
http://creativecommons.org/licenses/by-sa/3.0/
. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must
provide the URL for the original version.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert,
Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift,
Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States
and other countries.
Linux ® is the registered trademark of Linus Torvalds in the United States and other countries.
XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States
and/or other countries.
MySQL ® is a registered trademark of MySQL AB in the United States, the European Union and
other countries.
Node.js ® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the
official Joyent Node.js open source or commercial project.
The OpenStack ® Word Mark and OpenStack logo are either registered trademarks/service marks
or trademarks/service marks of the OpenStack Foundation, in the United States and other
countries and are used with the OpenStack Foundation's permission. We are not affiliated with,
endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
Abstract
This document provides an overview of changes in Red Hat Enterprise Linux 8 since Red Hat
Enterprise Linux 7 to help you evaluate migration to Red Hat Enterprise Linux 8.
Table of Contents
Table of Contents
. . . . . . . . . . . . . FEEDBACK
PROVIDING . . . . . . . . . . . . ON
. . . .RED
. . . . .HAT
. . . . .DOCUMENTATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8. . . . . . . . . . . . .
. . . . . . . . . . . 1.. .PREFACE
CHAPTER . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9. . . . . . . . . . . . .
. . . . . . . . . . . 2.
CHAPTER . . ARCHITECTURES
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
..............
. . . . . . . . . . . 3.
CHAPTER . . REPOSITORIES
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11. . . . . . . . . . . . .
. . . . . . . . . . . 4.
CHAPTER . . .APPLICATION
. . . . . . . . . . . . . . .STREAMS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
..............
.CHAPTER
. . . . . . . . . . 5.
. . INSTALLER
. . . . . . . . . . . . .AND
. . . . .IMAGE
. . . . . . . .CREATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
..............
5.1. ADD-ONS 13
5.1.1. OSCAP 13
5.1.2. Kdump 13
5.2. INSTALLER NETWORKING 13
5.2.1. Device naming scheme 13
5.3. INSTALLATION IMAGES AND PACKAGES 13
5.3.1. Unified ISO 13
5.3.2. Stage2 image 13
5.3.3. inst.addrepo parameter 14
5.3.4. Installation from an expanded ISO 14
5.4. INSTALLER GRAPHICAL USER INTERFACE 14
5.4.1. The Installation Summary window 14
5.5. SYSTEM PURPOSE NEW IN RHEL 14
5.5.1. System Purpose support in the graphical installation 14
5.5.2. System Purpose support in Pykickstart 14
5.6. INSTALLER MODULE SUPPORT 14
5.6.1. Installing modules using Kickstart 14
5.7. KICKSTART CHANGES 15
5.7.1. auth or authconfig is deprecated in RHEL 8 15
5.7.2. Kickstart no longer supports Btrfs 15
5.7.3. Using Kickstart files from previous RHEL releases 15
5.7.4. Deprecated Kickstart commands and options 15
5.7.5. Removed Kickstart commands and options 16
5.7.6. New Kickstart commands and options 16
5.8. IMAGE CREATION 16
5.8.1. Custom system image creation with Image Builder 16
. . . . . . . . . . . 6.
CHAPTER . . .SOFTWARE
. . . . . . . . . . . . MANAGEMENT
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
..............
6.1. NOTABLE CHANGES TO THE YUM STACK 18
6.1.1. Advantages of YUM v4 over YUM v3 18
6.1.2. How to use YUM v4 18
Installing software 18
Availability of plug-ins 18
Availability of APIs 18
6.1.3. Availability of YUM configuration file options 18
6.1.4. YUM v4 features behaving differently 26
6.1.4.1. yum list presents duplicate entries 26
6.1.5. Changes in the transaction history log files 27
6.2. NOTABLE RPM FEATURES AND CHANGES 27
.CHAPTER
. . . . . . . . . . 7.
. . INFRASTRUCTURE
. . . . . . . . . . . . . . . . . . . . SERVICES
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
..............
7.1. TIME SYNCHRONIZATION 29
1
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
.CHAPTER
. . . . . . . . . . 8.
. . .SECURITY
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
..............
8.1. CHANGES IN CORE CRYPTOGRAPHIC COMPONENTS 37
8.1.1. System-wide cryptographic policies are applied by default 37
8.1.2. Strong crypto defaults by removing insecure cipher suites and protocols 37
8.1.3. Cipher suites and protocols disabled in all policy levels 37
8.1.4. Switching the system to FIPS mode 38
8.1.5. TLS 1.0 and TLS 1.1 are deprecated 38
8.1.6. TLS 1.3 support in cryptographic libraries 38
8.1.7. DSA is deprecated in RHEL 8 38
8.1.8. SSL2 Client Hello has been deprecated in NSS 38
8.1.9. NSS now use SQL by default 39
8.2. SSH 39
8.2.1. OpenSSH rebased to version 7.8p1 39
8.2.2. libssh implements SSH as a core cryptographic component 39
8.2.3. libssh2 is not available in RHEL 8 39
8.3. RSYSLOG 40
8.3.1. The default rsyslog configuration file format is now non-legacy 40
8.3.2. The imjournal option and configuring system logging with minimized journald usage 40
8.3.3. Negative effects of the default logging setup on performance 40
8.4. OPENSCAP 40
8.4.1. OpenSCAP API consolidated 40
8.4.2. A utility for security and compliance scanning of containers is not available 40
8.5. AUDIT 40
8.5.1. Audit 3.0 replaces audispd with auditd 41
8.6. SELINUX 41
8.6.1. New SELinux booleans 41
8.6.2. SELinux packages migrated to Python 3 41
8.7. REMOVED SECURITY FUNCTIONALITY 41
8.7.1. shadow-utils no longer allow all-numeric user and group names 41
8.7.2. securetty is now disabled by default 41
8.7.3. The Clevis HTTP pin has been removed 42
8.7.3.1. Coolkey has been removed 42
8.7.3.2. crypto-utils have been removed 42
8.7.3.3. KLIPS has been removed from Libreswan 42
. . . . . . . . . . . 9.
CHAPTER . . .NETWORKING
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
..............
9.1. NETWORKMANAGER 43
9.1.1. Legacy network scripts support 43
2
Table of Contents
.CHAPTER
. . . . . . . . . . 10.
. . . KERNEL
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
..............
10.1. RESOURCE CONTROL 48
10.1.1. Control group v2 available as a Technology Preview in RHEL 8 48
10.2. MEMORY MANAGEMENT 48
10.2.1. 52-bit PA for 64-bit ARM available 48
10.2.2. 5-level page tables x86_64 49
10.3. PERFORMANCE ANALYSIS AND OBSERVABILITY TOOLS 49
10.3.1. bpftool added to kernel 49
10.3.2. eBPF available as a Technology Preview 49
10.3.3. BCC is available as a Technology Preview 49
10.4. BOOTING PROCESS 49
10.4.1. How to install and boot custom kernels in RHEL 8 49
10.4.2. Early kdump support in RHEL 8 50
.CHAPTER
. . . . . . . . . . 11.
. . .HARDWARE
. . . . . . . . . . . . .ENABLEMENT
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
..............
11.1. REMOVED HARDWARE SUPPORT 51
11.1.1. Removed device drivers 51
11.1.2. Removed adapters 54
11.1.3. Other removed hardware support 59
11.1.3.1. AGP graphics cards are no longer supported 59
11.1.3.2. FCoE software removal 59
11.1.3.3. The e1000 network driver is not supported in RHEL 8 60
11.1.3.4. RHEL 8 does not support the tulip driver 60
11.1.3.5. The qla2xxx driver no longer supports target mode 60
. . . . . . . . . . . 12.
CHAPTER . . . FILE
. . . . . SYSTEMS
. . . . . . . . . . .AND
. . . . .STORAGE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62
..............
12.1. FILE SYSTEMS 62
12.1.1. Btrfs has been removed 62
12.1.2. XFS now supports shared copy-on-write data extents 62
12.1.3. The ext4 file system now supports metadata checksums 63
12.1.4. The /etc/sysconfig/nfs file and legacy NFS service names are no longer available 63
12.2. STORAGE 63
3
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
12.2.1. The BOOM boot manager simplifies the process of creating boot entries 63
12.2.2. Stratis is now available 63
12.2.3. LUKS2 is now the default format for encrypting volumes 64
12.2.4. Multiqueue scheduling on block devices 64
12.2.5. VDO now supports all architectures 64
12.2.6. VDO no longer supports read cache 64
12.2.7. The dmraid package has been removed 65
12.2.8. Software FCoE and Fibre Channel no longer support the target mode 65
12.2.9. The detection of marginal paths in DM Multipath has been improved 65
12.2.10. New overrides section of the DM Multipath configuration file 65
12.2.11. NVMe/FC is fully supported on Broadcom Emulex and Marvell Qlogic Fibre Channel adapters 66
12.2.12. Support for Data Integrity Field/Data Integrity Extension (DIF/DIX) 66
12.2.13. libstoragemgmt-netapp-plugin has been removed 66
12.3. LVM 67
12.3.1. Removal of clvmd for managing shared storage devices 67
12.3.2. Removal of lvmetad daemon 67
12.3.3. LVM can no longer manage devices formatted with the GFS pool volume manager or the lvm1 metadata
format. 67
12.3.4. LVM libraries and LVM Python bindings have been removed 67
12.3.5. The ability to mirror the log for LVM mirrors has been removed 68
. . . . . . . . . . . 13.
CHAPTER . . . HIGH
. . . . . . AVAILABILITY
. . . . . . . . . . . . . . . AND
. . . . . .CLUSTERS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69
..............
13.1. NEW FORMATS FOR PCS CLUSTER SETUP, PCS CLUSTER NODE ADD AND PCS CLUSTER NODE
REMOVE COMMANDS 69
13.2. MASTER RESOURCES RENAMED TO PROMOTABLE CLONE RESOURCES 69
13.3. NEW COMMANDS FOR AUTHENTICATING NODES IN A CLUSTER 70
13.4. LVM VOLUMES IN A RED HAT HIGH AVAILABILITY ACTIVE/PASSIVE CLUSTER 70
13.5. SHARED LVM VOLUMES IN A RED HAT HIGH AVAILABILITY ACTIVE/ACTIVE CLUSTER 70
13.6. GFS2 FILE SYSTEMS IN A RHEL 8 PACEMAKER CLUSTER 71
. . . . . . . . . . . 14.
CHAPTER . . . SHELLS
. . . . . . . . . AND
. . . . . COMMAND-LINE
. . . . . . . . . . . . . . . . . . TOOLS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72
..............
14.1. LOCALIZATION IS DISTRIBUTED IN MULTIPLE PACKAGES 72
14.2. REMOVED SUPPORT FOR ALL-NUMERIC USER AND GROUP NAMES 72
14.3. THE NOBODY USER REPLACES NFSNOBODY 72
14.4. VERSION CONTROL SYSTEMS 72
14.4.1. Notable changes in Subversion 1.10 72
. . . . . . . . . . . 15.
CHAPTER . . . DYNAMIC
. . . . . . . . . . .PROGRAMMING
. . . . . . . . . . . . . . . . . LANGUAGES,
. . . . . . . . . . . . . . .WEB
. . . . . SERVERS,
. . . . . . . . . . .DATABASE
. . . . . . . . . . . . SERVERS
. . . . . . . . . . . . . . . . . . . . . . .74
..............
15.1. DYNAMIC PROGRAMMING LANGUAGES 74
15.1.1. Notable changes in Python 74
15.1.1.1. Python 3 is the default Python implementation in RHEL 8 74
15.1.1.2. Migrating from Python 2 to Python 3 74
15.1.1.3. Configuring the unversioned Python 74
15.1.1.4. Python scripts must specify major version in hashbangs at RPM build time 75
15.1.1.5. Python binding of the net-snmp package is unavailable 75
15.1.1.6. Additional resources 75
15.1.2. Notable changes in PHP 75
15.1.3. Notable changes in Perl 76
15.1.4. Notable changes in Ruby 77
15.1.5. Notable changes in SWIG 77
15.1.6. Node.js new in RHEL 78
15.1.7. Tcl 78
15.1.7.1. Notable changes in Tcl/Tk 8.6 78
15.2. WEB SERVERS 79
4
Table of Contents
. . . . . . . . . . . 16.
CHAPTER . . . COMPILERS
. . . . . . . . . . . . . AND
. . . . . .DEVELOPMENT
. . . . . . . . . . . . . . . . .TOOLS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
..............
16.1. CHANGES IN TOOLCHAIN SINCE RHEL 7 85
16.1.1. Changes in GCC in RHEL 8 85
16.1.2. Security enhancements in GCC in RHEL 8 87
16.1.3. Compatibility-breaking changes in GCC in RHEL 8 90
C++ ABI change in std::string and std::list 90
GCC no longer builds Ada, Go, and Objective C/C++ code 90
16.2. COMPILER TOOLSETS 90
16.3. JAVA IMPLEMENTATIONS AND JAVA TOOLS IN RHEL 8 90
16.4. COMPATIBILITY-BREAKING CHANGES IN GDB 91
GDBserver now starts inferiors with shell 91
gcj support removed 91
New syntax for symbol dumping maintenance commands 92
Thread numbers are no longer global 92
Memory for value contents can be limited 93
Sun version of stabs format no longer supported 93
Sysroot handling changes 93
HISTSIZE no longer controls GDB command history size 93
Completion limiting added 93
HP-UX XDB compatibility mode removed 94
Handling signals for threads 94
Breakpoint modes always-inserted off and auto merged 94
remotebaud commands no longer supported 94
16.5. COMPATIBILITY-BREAKING CHANGES IN COMPILERS AND DEVELOPMENT TOOLS 94
librtkaio removed 94
Sun RPC and NIS interfaces removed from glibc 95
The nosegneg libraries for 32-bit Xen have been removed 95
make new operator != causes a different interpretation of certain existing makefile syntax 95
Valgrind library for MPI debugging support removed 95
Development headers and static libraries removed from valgrind-devel 95
. . . . . . . . . . . 17.
CHAPTER . . . IDENTITY
. . . . . . . . . . .MANAGEMENT
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .96
..............
17.1. IDENTITY MANAGEMENT PACKAGES ARE INSTALLED AS A MODULE 96
17.2. ACTIVE DIRECTORY USERS CAN NOW ADMINISTER IDENTITY MANAGEMENT 96
17.3. SESSION RECORDING SOLUTION FOR RHEL 8 ADDED 97
17.4. REMOVED IDENTITY MANAGEMENT FUNCTIONALITY 97
17.4.1. NSS databases not supported in OpenLDAP 97
17.4.2. Selected Python Kerberos packages have been replaced 97
17.5. SSSD 97
17.5.1. authselect replaces authconfig 97
17.5.2. KCM replaces KEYRING as the default credential cache storage 98
5
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
. . . . . . . . . . . 18.
CHAPTER . . . THE
. . . . .WEB
. . . . . CONSOLE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .100
...............
18.1. THE WEB CONSOLE IS NOW AVAILABLE BY DEFAULT 100
18.2. NEW FIREWALL INTERFACE 100
18.3. SUBSCRIPTION MANAGEMENT 100
18.4. BETTER IDM INTEGRATION FOR THE WEB CONSOLE 100
18.5. THE WEB CONSOLE IS NOW COMPATIBLE WITH MOBILE BROWSERS 101
18.6. THE WEB CONSOLE FRONT PAGE NOW DISPLAYS MISSING UPDATES AND SUBSCRIPTIONS 101
18.7. THE WEB CONSOLE NOW SUPPORTS PBD ENROLLMENT 101
18.8. SUPPORT LUKS V2 101
18.9. VIRTUAL MACHINES CAN NOW BE MANAGED USING THE WEB CONSOLE 101
18.10. INTERNET EXPLORER UNSUPPORTED BY THE WEB CONSOLE 102
. . . . . . . . . . . 19.
CHAPTER . . . VIRTUALIZATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .103
...............
19.1. VIRTUAL MACHINES CAN NOW BE MANAGED USING THE WEB CONSOLE 103
19.2. THE Q35 MACHINE TYPE IS NOW SUPPORTED BY VIRTUALIZATION 103
19.3. REMOVED VIRTUALIZATION FUNCTIONALITY 103
The cpu64-rhel6 CPU model has been deprecated and removed 103
IVSHMEM has been disabled 103
virt-install can no longer use NFS locations 104
RHEL 8 does not support the tulip driver 104
LSI Logic SAS and Parallel SCSI drivers are not supported 104
Installing virtio-win no longer creates a floppy disk image with the Windows drivers 104
.CHAPTER
. . . . . . . . . . 20.
. . . .CONTAINERS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .105
...............
20.1. RHEL 8 INTERNATIONAL LANGUAGES 105
20.2. NOTABLE CHANGES TO INTERNATIONALIZATION IN RHEL 8 106
. . . . . . . . . . . 21.
CHAPTER . . . RELATED
. . . . . . . . . . .INFORMATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .107
...............
.APPENDIX
. . . . . . . . . . .A.
. . CHANGES
. . . . . . . . . . . .TO
. . . PACKAGES
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .108
...............
A.1. NEW PACKAGES 108
A.1.1. Packages added in RHEL 8 minor releases 108
A.1.2. Packages new in RHEL 8.0 109
A.2. PACKAGE REPLACEMENTS 116
A.3. MOVED PACKAGES 173
A.4. REMOVED PACKAGES 175
A.5. PACKAGES WITH REMOVED SUPPORT 283
6
Table of Contents
7
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
1. Make sure you are viewing the documentation in the Multi-page HTML format. In addition,
ensure you see the Feedback button in the upper right corner of the document.
2. Use your mouse cursor to highlight the part of text that you want to comment on.
3. Click the Add Feedback pop-up that appears below the highlighted text.
3. Fill in the Description field with your suggestion for improvement. Include a link to the
relevant part(s) of documentation.
8
CHAPTER 1. PREFACE
CHAPTER 1. PREFACE
This document provides an overview of differences between two major versions of Red Hat
Enterprise Linux: RHEL 7 and RHEL 8. It provides a list of changes relevant for evaluating migration to
RHEL 8 rather than an exhaustive list of all alterations.
Capabilities and limits of RHEL 8 as compared to other versions of the system are available in the
Knowledgebase article Red Hat Enterprise Linux technology capabilities and limits .
Information regarding the RHEL life cycle is provided in the Red Hat Enterprise Linux Life Cycle
document.
For details regarding RHEL 8 usage, see the RHEL 8 product documentation .
For guidance regarding an in-place upgrade from RHEL 7 to RHEL 8, see Upgrading to RHEL 8 .
For information about major differences between RHEL 6 and RHEL 7, see the RHEL 7 Migration
Planning Guide.
9
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
CHAPTER 2. ARCHITECTURES
Red Hat Enterprise Linux 8 is distributed with the kernel version 4.18, which provides support for the
following architectures:
IBM Z
Make sure you purchase the appropriate subscription for each architecture. For more information, see
Get Started with Red Hat Enterprise Linux - additional architectures . For a list of available subscriptions,
see Subscription Utilization on the Customer Portal.
Note that all architectures are supported by the standard kernel packages in RHEL 8; no kernel-alt
package is needed.
10
CHAPTER 3. REPOSITORIES
CHAPTER 3. REPOSITORIES
Red Hat Enterprise Linux 8 is distributed through two main repositories:
BaseOS
AppStream
Both repositories are required for a basic RHEL installation, and are available with all RHEL
subscriptions.
Content in the BaseOS repository is intended to provide the core set of the underlying OS functionality
that provides the foundation for all installations. This content is available in the RPM format and is
subject to support terms similar to those in previous releases of RHEL. For a list of packages distributed
through BaseOS, see the Package manifest.
Content in the Application Stream repository includes additional user space applications, runtime
languages, and databases in support of the varied workloads and use cases. Content in AppStream is
available in one of two formats - the familiar RPM format and an extension to the RPM format called
modules. For a list of packages available in AppStream, see the Package manifest.
In addition, the CodeReady Linux Builder repository is available with all RHEL subscriptions. It provides
additional packages for use by developers. Packages included in the CodeReady Linux Builder
repository are unsupported.
For more information about RHEL 8 repositories, see the Package manifest.
11
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Components made available as Application Streams can be packaged as modules or RPM packages and
are delivered through the AppStream repository in RHEL 8. Each Application Stream component has a
given life cycle, either the same as RHEL 8 or shorter. For details, see Red Hat Enterprise Linux Life
Cycle.
Modules are collections of packages representing a logical unit: an application, a language stack, a
database, or a set of tools. These packages are built, tested, and released together.
Module streams represent versions of the Application Stream components. For example, two streams
(versions) of the PostgreSQL database server are available in the postgresql module: PostgreSQL 10
(the default stream) and PostgreSQL 9.6. Only one module stream can be installed on the system.
Different versions can be used in separate containers.
Detailed module commands are described in the Installing, managing, and removing user-space
components document. For a list of modules available in AppStream, see the Package manifest.
12
CHAPTER 5. INSTALLER AND IMAGE CREATION
5.1. ADD-ONS
5.1.1. OSCAP
The OSCAP add-on is enabled by default in Red Hat Enterprise Linux 8.
5.1.2. Kdump
The Kdump add-on adds support for configuring kernel crash dumping during installation. This add-on
has full support in Kickstart (using the %addon com_redhat_kdump command and its options), and is
fully integrated as an additional window in the graphical and text-based user interfaces.
As a result, the AppStream repository is enabled under the Additional Repositories section of the
Installation Source GUI window. You cannot remove the AppStream repository or change its settings
but you can disable it in Installation Source. This feature does not work if you boot the installation using
a different base repository and then change it to the unified ISO. If you do that, the base repository is
replaced. However, the AppStream repository is not replaced and points to the original file.
With this new update, the installation failure can be avoided if multiple locations are specified. If all the
defined locations are URLs, namely HTTP, HTTPS, or FTP, they will be tried sequentially until the
requested file is fetched successfully. If there is a location that is not a URL, only the last specified
location is tried. The remaining locations are ignored.
13
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
For more information about the Red Hat Enterprise Linux 8 BaseOS and AppStream repositories, see
the Repositories section of this document.
In Red Hat Enterprise Linux 8, the installation program has been extended to handle all modular
14
CHAPTER 5. INSTALLER AND IMAGE CREATION
In Red Hat Enterprise Linux 8, the installation program has been extended to handle all modular
features. Kickstart scripts can now enable module and stream combinations, install module profiles, and
install modular packages.
Similarly to authconfig commands issued on command line, authconfig commands in Kickstart scripts
now use the authselect-compat tool to run the new authselect tool. For a description of this
compatibility layer and its known issues, see the manual page authselect-migration(7). The installation
program will automatically detect use of the deprecated commands and install on the system the
authselect-compat package to provide the compatibility layer.
Where only specific options are listed, the base command and its other options are still available and not
deprecated.
device
deviceprobe
dmraid
multipath
bootloader --upgrade
ignoredisk --interactive
partition --active
15
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
reboot --kexec
Except the auth or authconfig command, using the commands in Kickstart files prints a warning in the
logs.
You can turn the deprecated command warnings into errors with the inst.ksstrict boot option, except
for the auth or authconfig command.
btrfs
part/partition btrfs
unsupported_hardware
Where only specific options and values are listed, the base command and its other options are still
available and not removed.
rhsm
zipl
The following commands and options were added in Red Hat Enterprise Linux 8.
RHEL 8.0
authselect
module
With Image Builder, users can create custom system images which include additional packages. Image
16
CHAPTER 5. INSTALLER AND IMAGE CREATION
With Image Builder, users can create custom system images which include additional packages. Image
Builder functionality can be accessed through:
To learn more about Image Builder, see the documentation title Composing a customized RHEL system
image.
17
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Increased performance
For detailed information about differences between the new YUM v4 tool and the previous version YUM
v3 from RHEL 7, see Changes in DNF CLI compared to YUM .
For installing software, you can use the yum command and its particular options in the same way as on
RHEL 7.
Availability of plug-ins
Legacy YUM v3 plug-ins are incompatible with the new version of YUM v4. Selected yum plug-ins and
utilities have been ported to the new DNF back end, and can be installed under the same names as in
RHEL 7. They also provide compatibility symlinks, so the binaries, configuration files and directories can
be found in usual locations.
In the event that a plug-in is no longer included, or a replacement does not meet a usability need, please
reach out to Red Hat Support to request a Feature Enhancement as described in How do I open and
manage a support case on the Customer Portal?
Availability of APIs
Note that the legacy Python API provided by YUM v3 is no longer available. Users are advised to
migrate their plug-ins and scripts to the new API provided by YUM v4 (DNF Python API), which is stable
and fully supported. The upstream project documents the new DNF Python API - see the DNF API
Reference.
The Libdnf and Hawkey APIs (both C and Python) are to be considered unstable, and will likely change
during RHEL 8 life cycle.
This section summarizes changes in configuration file options between RHEL 7 and RHEL 8 for the
18
CHAPTER 6. SOFTWARE MANAGEMENT
This section summarizes changes in configuration file options between RHEL 7 and RHEL 8 for the
/etc/yum.conf and /etc/yum.repos.d/*.repo files.
Table 6.1. Changes in configuration file options for the /etc/yum.conf file
alwaysprompt removed
assumeno available
assumeyes available
autocheck_running_kernel available
autosavets removed
bandwidth available
bugtracker_url available
cachedir available
check_config_file_age available
clean_requirements_on_remove available
color available
color_list_available_downgrade available
color_list_available_install available
color_list_available_reinstall available
color_list_available_running_kernel removed
color_list_available_upgrade available
color_list_installed_extra available
color_list_installed_newer available
color_list_installed_older available
color_list_installed_reinstall available
color_list_installed_running_kernel removed
19
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
color_search_match available
color_update_installed available
color_update_local available
color_update_remote available
commands removed
config_file_path available
debuglevel available
deltarpm available
deltarpm_metadata_percentage removed
deltarpm_percentage available
depsolve_loop_limit removed
disable_excludes available
diskspacecheck available
distroverpkg removed
enable_group_conditionals removed
errorlevel available
exactarchlist removed
exclude available
exit_on_lock available
fssnap_abort_on_errors removed
fssnap_automatic_keep removed
fssnap_automatic_post removed
20
CHAPTER 6. SOFTWARE MANAGEMENT
fssnap_automatic_pre removed
fssnap_devices removed
fssnap_percentage removed
ftp_disable_epsv removed
gpgcheck available
group_command removed
group_package_types available
groupremove_leaf_only removed
history_list_view available
history_record available
history_record_packages available
http_caching removed
include removed
installonly_limit available
installonlypkgs available
installrootkeep removed
ip_resolve available
keepalive removed
keepcache available
kernelpkgnames removed
loadts_ignoremissing removed
loadts_ignorenewrpm removed
21
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
loadts_ignorerpm removed
localpkg_gpgcheck available
logfile removed
max_connections removed
mddownloadpolicy removed
mdpolicy removed
metadata_expire available
metadata_expire_filter removed
minrate available
mirrorlist_expire removed
multilib_policy available
obsoletes available
override_install_langs removed
overwrite_groups removed
password available
payload_gpgcheck removed
persistdir available
pluginconfpath available
pluginpath available
plugins available
protected_multilib removed
protected_packages available
22
CHAPTER 6. SOFTWARE MANAGEMENT
proxy available
proxy_password available
proxy_username available
query_install_excludes removed
recent available
recheck_installed_requires removed
remove_leaf_only removed
repo_gpgcheck available
repopkgsremove_leaf_only removed
reposdir available
reset_nice available
retries available
rpmverbosity available
shell_exit_status removed
showdupesfromrepos available
skip_broken available
skip_missing_names_on_install removed
skip_missing_names_on_update removed
ssl_check_cert_permissions removed
sslcacert available
sslclientcert available
sslclientkey available
23
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
sslverify available
syslog_device removed
syslog_facility removed
syslog_ident removed
throttle available
timeout available
tolerant removed
tsflags available
ui_repoid_vars removed
upgrade_group_objects_upgrade available
upgrade_requirements_on_install removed
usercache removed
username available
usr_w_check removed
Table 6.2. Changes in configuration file options for the /etc/yum.repos.d/*.repo file
async removed
bandwidth available
baseurl available
compare_providers_priority removed
cost available
deltarpm_metadata_percentage removed
24
CHAPTER 6. SOFTWARE MANAGEMENT
deltarpm_percentage available
enabled available
enablegroups available
exclude available
failovermethod removed
ftp_disable_epsv removed
gpgcakey removed
gpgcheck available
gpgkey available
http_caching removed
includepkgs available
ip_resolve available
keepalive removed
metadata_expire available
metadata_expire_filter removed
metalink available
mirrorlist available
mirrorlist_expire removed
name available
password available
proxy available
proxy_password available
25
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
proxy_username available
repo_gpgcheck available
repositoryid removed
retries available
skip_if_unavailable available
ssl_check_cert_permissions removed
sslcacert available
sslclientcert available
sslclientkey available
sslverify available
throttle available
timeout available
ui_repoid_vars removed
username available
When listing packages using the yum list command, duplicate entries may be presented, one for each
repository where a package of the same name and version resides.
This is intentional, and it allows the users to distinguish such packages when necessary.
For example, if package-1.2 is available in both repo1 and repo2, YUM v4 will print both instances:
[…]
package-1.2 repo1
package-1.2 repo2
26
CHAPTER 6. SOFTWARE MANAGEMENT
[…]
By contrast, the legacy YUM v3 command filtered out such duplicates so that only one instance was
shown:
[…]
package-1.2 repo1
[…]
In RHEL 8, there is no direct equivalent to the /var/log/yum.log file. To display the information about
the transactions, including the PackageKit and microdnf, use the yum history command.
Alternatively, you can search the /var/log/dnf.rpm.log file, but this log file does not include the
transactions from PackageKit and microdnf, and it has a log rotation which provides the periodic removal
of the stored information.
New --nopretrans and --noposttrans switches to disable the execution of the %pretrans and
%posttrans scriptlets respectively.
New --noplugins switch to disable loading and execution of all RPM plug-ins.
New syslog plug-in for logging any RPM activity by the System Logging protocol (syslog).
The rpmbuild command can now do all build steps from a source package directly.
This is possible if rpmbuild is used with any of the -r[abpcils] options.
This is ensured by the new --reinstall option. To reinstall a previously installed package, use the
27
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
This is ensured by the new --reinstall option. To reinstall a previously installed package, use the
syntax below:
This option ensures a proper installation of the new package and removal of the old package.
Stricter spec-parser
Improved support for reproducible builds (builds that create an identical package):
Setting buildhost
Using the -p option to query an uninstalled PACKAGE_FILE is now optional. For this use case,
the rpm command now returns the same result with or without the -p option. The only use case
where the -p option is necessary is to verify that the file name does not match any Provides in
the rpmdb database.
The %makeinstall macro has been deprecated. To install a program, use the
%make_install macro instead.
28
CHAPTER 7. INFRASTRUCTURE SERVICES
In RHEL 8, the NTP protocol is implemented only by the chronyd daemon, provided by the chrony
package.
The ntp daemon is no longer available. If you used ntp on your RHEL 7 system, you might need to
migrate to chrony.
Possible replacements for previous ntp features that are not supported by chrony are documented in
Achieving some settings previously supported by ntp in chrony .
To synchronize the system clock with a reference clock, for example a GPS receiver
As an NTPv4(RFC 5905) server or peer to provide a time service to other computers in the
network
For more information about chrony, see Configuring basic system settings.
See the following resources for information about differences between chrony and ntp:
In RHEL 8, the default chrony configuration file, /etc/chrony.conf, includes the leapsectz directive.
Get information about leap seconds from the system tz database (tzdata)
Set the TAI-UTC offset of the system clock in order that the system provides an accurate
29
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Set the TAI-UTC offset of the system clock in order that the system provides an accurate
International Atomic Time (TAI) clock (CLOCK_TAI)
The directive is not compatible with servers that hide leap seconds from their clients using a leap smear,
such as chronyd servers configured with the leapsecmode and smoothtime directives. If a client
chronyd is configured to synchronize to such servers, remove leapsectz from the configuration file.
New features:
A new method of provisioning secondary servers called Catalog Zones has been added.
Domain Name System Cookies are now sent by the named service and the dig utility.
The Response Rate Limiting feature can now help with mitigation of DNS amplification
attacks.
A new zone file format called map has been added. Zone data stored in this format can be
mapped directly into memory, which enables zones to load significantly faster.
A new tool called delv (domain entity lookup and validation) has been added, with dig-like
semantics for looking up DNS data and performing internal DNS Security Extensions (DNSSEC)
validation.
A new mdig command is now available. This command is a version of the dig command that
sends multiple pipelined queries and then waits for responses, instead of sending one query and
waiting for the response before sending the next query.
A new prefetch option, which improves the recursive resolver performance, has been added.
A new in-view zone option, which allows zone data to be shared between views, has been added.
When this option is used, multiple views can serve the same zones authoritatively without
storing multiple copies in memory.
A new max-zone-ttl option, which enforces maximum TTLs for zones, has been added. When a
zone containing a higher TTL is loaded, the load fails. Dynamic DNS (DDNS) updates with
higher TTLs are accepted but the TTL is truncated.
New quotas have been added to limit queries that are sent by recursive resolvers to
authoritative servers experiencing denial-of-service attacks.
The nslookup utility now looks up both IPv6 and IPv4 addresses by default.
The named service now checks whether other name server processes are running before
starting up.
30
CHAPTER 7. INFRASTRUCTURE SERVICES
When loading a signed zone, named now checks whether a Resource Record Signature’s (RSIG)
inception time is in the future, and if so, it regenerates the RRSIG immediately.
Zone transfers now use smaller message sizes to improve message compression, which reduces
network usage.
Feature changes:
The version 3 XML schema for the statistics channel, including new statistics and a flattened
XML tree for faster parsing, is provided by the HTTP interface. The legacy version 2 XML
schema is no longer supported.
The named service now listens on both IPv6 and IPv4 interfaces by default.
The named service no longer supports GeoIP. Access control lists (ACLs) defined by presumed
location of query sender are unavailable.
However, if the last configured name server is not responding or unreachable, name resolution fails. To
prevent such fail, you can use one of the following approaches:
Ensure that configured name servers always reply with the recursion available flag set.
Optionally, you can also use the dig utility to detect whether recursion is available or not.
7.4. PRINTING
To achieve various tasks related to printing, you can choose one of the following tools:
For more information on print setting tools in RHEL 8, see Deploying different types of servers.
Error log
Access log
31
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Page log
In RHEL 8, the logs are no longer stored in specific files within the /var/log/cups directory, which was
used in RHEL 7. Instead, all three types are logged centrally in systemd-journald together with logs from
other programs.
For more information on how to use CUPS logs in RHEL 8, see Deploying different types of servers.
If the syspurpose role (reported by the syspurpose show command) contains atomic, and at
the same time:
If the syspurpose role contains desktop or workstation and the chassis type (reported by
dmidecode) is Notebook, Laptop, or Portable, then the balanced profile is selected
32
CHAPTER 7. INFRASTRUCTURE SERVICES
brltty Configuration A Bluetooth device address may now contain dashes (-) instead
option change of colons (:). The bth: and bluez: device qualifier aliases are no
longer supported.
cups Directive options Removed Digest and BasicDigest authentication types for
removal AuthType and DefaultAuthType directives in
/etc/cups/cupsd.conf. Migrate to Basic.
cups Directives moved SetEnv and PassEnv moved from cupsd.conf to cups-
between conf files files.conf
dhcp Behavior change dhclient sends the hardware address as a client identifier by
default. The client-id option is configurable. For more
information, see the /etc/dhcp/dhclient.conf file.
dhcp Options The -I option is now used for standard-ddns-updates. For the
incompatibility previous functionality (dhcp-client-identifier), use the new -C
option.
33
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
dosfstools Behavior change Data structures are now automatically aligned to cluster size. To
disable the alignment, use the -a option. fsck.fat now defaults
to interactive repair mode which previously had to be selected
with the -r option.
finger Functionality
removal
GeoIP Functionality
removal
grep Behavior change grep now treats files containining data improperly encoded for
the current locale as binary.
grep Behavior change grep -P no longer reports an error and exits when given invalid
UTF-8 data
grep Behavior change grep now warns if the GREP_OPTIONS environment variable is
now used. Use an alias or script instead.
grep Behavior change grep -P eports an error and exits in locales with multibyte
character encodings other than UTF-8
grep Behavior change When searching binary data, grep may treat non-text bytes as
line terminators, which impacts performance significantly.
grep Behavior change grep -z no longer automatically treats the byte '\200' as binary
data.
grep Behavior change Context no longer excludes selected lines omitted because of -
m.
postfix Configuration 3.x version have compatibility safety net that runs Postfix
change programs with backwards-compatible default settings after an
upgrade.
postfix Configuration In the Postfix MySQL database client, the default option_group
change value has changed to client , set it to empty value for backward
compatible behavior.
34
CHAPTER 7. INFRASTRUCTURE SERVICES
postfix Configuration The postqueue command no longer forces all message arrival
change times to be reported in UTC. To get the old behavior, set
TZ=UTC in main.cf.
quagga Functionality
removal
spamassasin Command line In spamc, the command line option -S/--ssl can no longer be
option change used to specify SSL/TLS version. The option can now only be
used without an argument to enable TLS.
35
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
vim Default settings Vim runs default.vim script, if no ~/.vimrc file is available.
change
vim Default settings Vim now supports bracketed paste from terminal. Include 'set
change t_BE=' in vimrc for the previous behavior.
wireshark Python bindings Dissectors can no longer be written in Python, use C instead.
removal
wireshark Option removal -C suboption for -N option for asynchronous DNS name
resolution removed
wireshark Ouput change With the -H option, the output no longer shows SHA1,
RIPEMD160 and MD5 hashes. It now shows SHA256,
RIPEMD160 and SHA1 hashes.
wvdial Functionality
removal
36
CHAPTER 8. SECURITY
CHAPTER 8. SECURITY
The DEFAULT system-wide cryptographic policy offers secure settings for current threat models. It
allows the TLS 1.2 and 1.3 protocols, as well as the IKEv2 and SSH2 protocols. The RSA keys and Diffie-
Hellman parameters are accepted if larger than 2047 bits.
See the Consistent security by crypto policies in Red Hat Enterprise Linux 8 article on the Red Hat Blog
and the update-crypto-policies(8) man page for more information.
8.1.2. Strong crypto defaults by removing insecure cipher suites and protocols
The following list contains cipher suites and protocols removed from the core cryptographic libraries in
RHEL 8. They are not present in the sources, or their support is disabled during the build, so applications
cannot use them.
Camellia
ARIA
SEED
IDEA
37
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
AES-CCM8
To switch the system to FIPS mode in RHEL 8, enter the following command and restart your system:
# fips-mode-setup --enable
For more information, see the Strong crypto defaults in RHEL 8 and deprecation of weak crypto
algorithms Knowledgebase article on the Red Hat Customer Portal and the update-crypto-policies(8)
man page.
The Transport Layer Security (TLS) protocol version 1.2 and earlier allow to start a negotiation with a
Client Hello message formatted in a way that is backward compatible with the Secure Sockets Layer
(SSL) protocol version 2. Support for this feature in the Network Security Services ( NSS) library has
been deprecated and it is disabled by default.
Applications that require support for this feature need to use the new
38
CHAPTER 8. SECURITY
Applications that require support for this feature need to use the new
SSL_ENABLE_V2_COMPATIBLE_HELLO API to enable it. Support for this feature may be removed
completely in future releases of Red Hat Enterprise Linux 8.
8.2. SSH
The openssh packages have been upgraded to upstream version 7.8p1. Notable changes include:
Changed the minimal modulus size for Diffie-Hellman parameters to 2048 bits.
This change introduces libssh as a core cryptographic component in Red Hat Enterprise Linux 8. The
libssh library implements the Secure SHell (SSH) protocol.
Note that libssh does not comply with the system-wide crypto policy.
The deprecated libssh2 library misses features, such as support for elliptic curves or Generic Security
Service Application Program Interface (GSSAPI), and it has been removed from RHEL 8 in favor of
libssh
39
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
8.3. RSYSLOG
The configuration files in the rsyslog packages now use the non-legacy format by default. The legacy
format can be still used, although mixing current and legacy configuration statements has several
constraints. Configurations carried from previous RHEL releases should be revised. See the
rsyslog.conf(5) man page for more information.
8.3.2. The imjournal option and configuring system logging with minimized journald
usage
To avoid duplicate records that might appear when journald rotated its files, the imjournal option has
been added. Note that use of this option can affect performance.
Note that the system with rsyslog can be configured to provide better performance as described in the
Configuring system logging without journald or with minimized journald usage Knowledgebase article.
See the Negative effects of the RHEL default logging setup on performance and their mitigations
Knowledgebase article for more information.
8.4. OPENSCAP
unimplemented symbols
8.4.2. A utility for security and compliance scanning of containers is not available
In Red Hat Enterprise Linux 7, the oscap-docker utility can be used for scanning of Docker containers
based on Atomic technologies. In Red Hat Enterprise Linux 8, the Docker- and Atomic-related
OpenSCAP commands are not available. As a result, oscap-docker or an equivalent utility for security
and compliance scanning of containers is not available in RHEL 8 at the moment.
8.5. AUDIT
40
CHAPTER 8. SECURITY
With this update, functionality of audispd has been moved to auditd. As a result, audispd configuration
options are now part of auditd.conf. In addition, the plugins.d directory has been moved under
/etc/audit. The current status of auditd and its plug-ins can now be checked by running the service
auditd state command.
8.6. SELINUX
colord_use_nfs
mysql_connect_http
pdns_can_network_connect_db
ssh_use_tcpd
sslh_can_bind_any_port
sslh_can_connect_any_port
virt_use_pcscd
To get a list of booleans including their meaning, and to find out if they are enabled or disabled, install
the selinux-policy-devel package and use:
# semanage boolean -l
The useradd and groupadd commands disallow user and group names consisting purely of numeric
characters. The reason for not allowing such names is that this can confuse potentially many tools that
work with user and group names and user and group ids (which are numbers). Please note that the all-
numeric user and group names are deprecated in Red Hat Enterprise Linux 7 and their support is
completely removed in Red Hat Enterprise Linux 8.
Because of the dynamic nature of tty device files on modern Linux systems, the securetty PAM module
has been disabled by default and the /etc/securetty configuration file is no longer included in RHEL.
Since /etc/securetty listed many possible devices so that the practical effect in most cases was to allow
41
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
by default, this change has only a minor impact. However, if you use a more restrictive configuration, you
need to add a line enabling the pam_securetty.so module to the appropriate files in the /etc/pam.d
directory, and create a new /etc/securetty file.
The Clevis HTTP pin has been removed from RHEL 8, and the clevis encrypt http sub-command is no
longer available.
The Coolkey driver for smart cards has been removed from RHEL 8, and OpenSC now provides its
functionality.
The crypto-utils packages have been removed from RHEL 8. You can use tools provided by the
openssl, gnutls-utils, and nss-tools packages instead.
In Red Hat Enterprise Linux 8, support for Kernel IP Security (KLIPS) IPsec stack has been removed
from Libreswan.
42
CHAPTER 9. NETWORKING
CHAPTER 9. NETWORKING
9.1. NETWORKMANAGER
NOTE
If any of these scripts are required, the installation of the deprecated network scripts in
the system is still possible with the following command:
The ifup and the ifdown scripts link to the installed legacy network scripts.
Calling the legacy network scripts shows a warning about their deprecation.
Note that this feature is currently not supported in graphical interfaces and in the nmtui utility.
43
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
If you upgrade from RHEL 7 to RHEL 8 and NetworkManager behaves different, add the following
setting to the [main] section in the /etc/NetworkManager/NetworkManager.conf file to use the
dhclient plug-in:
[main]
dhcp=dhclient
9.2.1. nftables replaces iptables as the default network packet filtering framework
The nftables framework provides packet classification facilities and it is the designated successor to the
iptables, ip6tables, arptables, and ebtables tools. It offers numerous improvements in convenience,
features, and performance over previous packet-filtering tools, most notably:
rules all applied atomically instead of fetching, updating, and storing a complete rule set
support for debugging and tracing in the rule set (nftrace) and monitoring trace events (in the
nft tool)
Similarly to iptables, nftables use tables for storing chains. The chains contain individual rules for
performing actions. The nft tool replaces all tools from the previous packet-filtering frameworks. The
libnftables library can be used for low-level interaction with nftables Netlink API over the libmnl library.
The iptables, ip6tables, ebtables and arptables tools are replaced by nftables-based drop-in
replacements with the same name. While external behavior is identical to their legacy counterparts,
internally they use nftables with legacy netfilter kernel modules through a compatibility interface where
required.
Effect of the modules on the nftables rule set can be observed using the nft list ruleset command.
Since these tools add tables, chains, and rules to the nftables rule set, be aware that nftables rule-set
operations, such as the nft flush ruleset command, might affect rule sets installed using the formerly
44
CHAPTER 9. NETWORKING
To quickly identify which variant of the tool is present, version information has been updated to include
the back-end name. In RHEL 8, the nftables-based iptables tool prints the following version string:
$ iptables --version
iptables v1.8.0 (nf_tables)
For comparison, the following version information is printed if legacy iptables tool is present:
$ iptables --version
iptables v1.8.0 (legacy)
The arptables FORWARD chain functionality has been removed in Red Hat Enterprise Linux (RHEL) 8.
You can now use the FORWARD chain of the ebtables tool adding the rules into it.
In RHEL 8, the ebtables command is provided by the iptables-ebtables package, which contains an
nftables-based reimplementation of the tool. This tool has a different code base, and its output
deviates in aspects, which are either negligible or deliberate design choices.
Consequently, when migrating your scripts parsing some ebtables output, adjust the scripts to reflect
the following:
MAC address formatting has been changed to be fixed in length. Where necessary, individual
byte values contain a leading zero to maintain the format of two characters per octet.
Formatting of IPv6 prefixes has been changed to conform with RFC 4291. The trailing part after
the slash character no longer contains a netmask in the IPv6 address format but a prefix length.
This change applies to valid (left-contiguous) masks only, while others are still printed in the old
formatting.
This update adds the iptables-translate and ip6tables-translate tools to convert the existing iptables
or ip6tables rules into the equivalent ones for nftables. Note that some extensions lack translation
support. If such an extension exists, the tool prints the untranslated rule prefixed with the # sign. For
example:
45
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
In Red Hat Enterprise Linux (RHEL) 8, the wpa_supplicant package is built with
CONFIG_DEBUG_SYSLOG enabled. This allows reading the wpa_supplicant log using the journalctl
utility instead of checking the contents of the /var/log/wpa_supplicant.log file.
The wpa_supplicant package does not support wireless extensions. When a user is trying to use wext
as a command-line argument, or trying to use it on old adapters which only support wireless extensions,
will not be able to run the wpa_supplicant daemon.
Additionally, two new TCP congestion algorithms, BBR and NV, are available, offering lower latency, and
better throughput than cubic in most scenarios.
46
CHAPTER 9. NETWORKING
9.6.2. Certain network adapters require a firmware update to fully support 802.1ad
The firmware of certain network adapters does not fully support the 802.1ad standard, which is also
called Q-in-Q or stacked virtual local area networks (VLANs). Contact your hardware vendor on details
how to verify that your network adapter uses a firmware that supports the 802.1ad standard and how to
update the firmware. As a result, with the correct firmware, configuring stacked VLANs on RHEL 8.0
work as expected.
47
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Unlike the previous version, control group v2 has only a single hierarchy. This single hierarchy enables
the Linux kernel to:
CPU controller regulates the distribution of CPU cycles. This controller implements:
Weight and absolute bandwidth limit models for normal scheduling policy.
Memory controller regulates the memory distribution. Currently, the following types of memory
usages are tracked:
Remote Direct Memory Access (RDMA) controller limits RDMA/IB specific resources that
certain processes can use. These processes are grouped through the RDMA controller.
Process number controller enables the control group to stop any new tasks from being fork()’d
or clone()’d after a certain limit.
Writeback controller acts as a mechanism, which balances conflicts between I/O and the
memory controllers.
The information above was based on cgroups-v2 online documentation. You can refer to the same link to
obtain more information about particular control group v2 controllers.
48
CHAPTER 10. KERNEL
These limits have been extended to 57/52 bit of virtual/physical memory addressing with 128 PiB of
virtual address space (64PB user/64PB kernel) and 4 PB of physical memory capacity.
With the extended address range, the memory management in Red Hat Enterprise Linux 8 adds support
for 5-level page table implementation, to be able to handle the expanded address range. By default
RHEL8 will disable the 5-level page table support even on systems that support this feature. This is due
to a potential performance degradation when using 5 level of page tables if extended virtual or physical
address space is not needed. A boot argument will enable systems with hardware that supports this
feature to use it.
49
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Each bootloader has a different configuration file and format that has to be modified when a new kernel
is installed or removed. In the previous versions of Red Hat Enterprise Linux the component that
permitted this work was the grubby utility. However, for Red Hat Enterprise Linux 8 the bootloader
configuration was standardized by implementing the BLS file format, where grubby works as a thin
wrapper around the BLS operations.
To address this problem, RHEL 8 introduced an early kdump support. To learn more about this
mechanism, see the /usr/share/doc/kexec-tools/early-kdump-howto.txt file. See also What is early
kdump support and how do I configure it?.
50
CHAPTER 11. HARDWARE ENABLEMENT
3w-9xxx
3w-sas
aic79xx
aoe
arcmsr
ata drivers:
acard-ahci
sata_mv
sata_nv
sata_promise
sata_qstor
sata_sil
sata_sil24
sata_sis
sata_svw
sata_sx4
sata_uli
sata_via
sata_vsc
bfa
cxgb3
cxgb3i
e1000
51
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
floppy
hptiop
initio
isci
iw_cxgb3
mptbase - This driver is left in place for virtualization use case and easy developer transition.
However it is not supported.
mptctl
mptsas - This driver is left in place for virtualization use case and easy developer transition.
However it is not supported.
mptscsih - This driver is left in place for virtualization use case and easy developer transition.
However it is not supported.
mptspi - This driver is left in place for virtualization use case and easy developer transition.
However it is not supported.
mtip32xx
mvsas
mvumi
OSD drivers:
osd
libosd
osst
pata drivers:
pata_acpi
pata_ali
pata_amd
pata_arasan_cf
pata_artop
pata_atiixp
pata_atp867x
pata_cmd64x
pata_cs5536
52
CHAPTER 11. HARDWARE ENABLEMENT
pata_hpt366
pata_hpt37x
pata_hpt3x2n
pata_hpt3x3
pata_it8213
pata_it821x
pata_jmicron
pata_marvell
pata_netcell
pata_ninja32
pata_oldpiix
pata_pdc2027x
pata_pdc202xx_old
pata_piccolo
pata_rdc
pata_sch
pata_serverworks
pata_sil680
pata_sis
pata_via
pdc_adma
pm80xx(pm8001)
pmcraid
qla3xxx - This driver is left in place for virtualization use case and easy developer transition.
However it is not supported.
stex
sx8
tulip
ufshcd
wireless drivers:
53
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
carl9170
iwl4965
iwl3945
mwl8k
rt73usb
rt61pci
rtl8187
wil6210
To check the PCI IDs of the hardware on your system, run the lspci -nn command.
The following adapters from the aacraid driver have been removed:
54
CHAPTER 11. HARDWARE ENABLEMENT
55
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The following adapters from the mpt2sas driver have been removed:
56
CHAPTER 11. HARDWARE ENABLEMENT
The following adapters from the megaraid_sas driver have been removed:
The following adapters from the qla2xxx driver have been removed:
The following adapters from the qla4xxx driver have been removed:
The following adapters from the be2iscsi driver have been removed:
57
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The following Ethernet adapters controlled by the be2net driver have been removed:
The following adapters from the lpfc driver have been removed:
58
CHAPTER 11. HARDWARE ENABLEMENT
Graphics cards using the Accelerated Graphics Port (AGP) bus are not supported in Red Hat
Enterprise Linux 8. Use the graphics cards with the PCI Express bus as the recommended replacement.
Fibre Channel over Ethernet (FCoE) software has been removed from Red Hat Enterprise Linux 8.
59
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Fibre Channel over Ethernet (FCoE) software has been removed from Red Hat Enterprise Linux 8.
Specifically, the fcoe.ko kernel module is no longer available for creating software FCoE interfaces over
Ethernet adapters and drivers. This change is due to a lack of industry adoption for software-managed
FCoE.
The fcoe.ko kernel module is no longer available. This removes support for software FCoE with
Data Center Bridging enabled Ethernet adapters and drivers.
Link-level software configuration via Data Center Bridging eXchange (DCBX) using lldpad is no
longer supported for FCoE.
The fcoe-utils tools (specifically fcoemon) is configured by default to not validate DCB
configuration or communicate with lldpad.
The libhbaapi and libhbalinux libraries are no longer used by fcoe-utils, and will not undergo
any direct testing from Red Hat.
Currently supported offloading FCoE adapters that appear as Fibre Channel adapters to the
operating system and do not use the fcoe-utils management tools, unless stated in a separate
note. This applies to select adapters supported by the lpfc FC driver. Note that the bfa driver is
not included in Red Hat Enterprise Linux 8.
Currently supported offloading FCoE adapters that do use the fcoe-utils management tools
but have their own kernel drivers instead of fcoe.ko and manage DCBX configuration in their
drivers and/or firmware, unless stated in a separate note. The fnic, bnx2fc, and qedf drivers will
continue to be fully supported in Red Hat Enterprise Linux 8.
The libfc.ko and libfcoe.ko kernel modules that are required for some of the supported drivers
covered by the previous statement.
For more information, see Section 12.2.8, “Software FCoE and Fibre Channel no longer support the
target mode”.
In Red Hat Enterprise Linux 8, the e1000 network driver is not supported. This affects both bare metal
and virtual environments. However, the newer e1000e network driver continues to be fully supported in
RHEL 8.
With this update, the tulip network driver is no longer supported. As a consequence, when using RHEL 8
on a Generation 1 virtual machine (VM) on the Microsoft Hyper-V hypervisor, the "Legacy Network
Adapter" device does not work, which causes PXE installation of such VMs to fail.
For the PXE installation to work, install RHEL 8 on a Generation 2 Hyper-V VM. If you require a RHEL 8
Generation 1 VM, use ISO installation.
Support for target mode with the qla2xxx QLogic Fibre Channel driver has been disabled. The effects
60
CHAPTER 11. HARDWARE ENABLEMENT
Support for target mode with the qla2xxx QLogic Fibre Channel driver has been disabled. The effects
of this change are:
The rtslib library and the targetcli utility no longer support qla2xxx.
61
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
You can no longer create, mount, or install on Btrfs file systems in Red Hat Enterprise Linux 8. The
Anaconda installer and the Kickstart commands no longer support Btrfs.
Fast
Creating shared copies does not utilize disk I/O.
Space-efficient
Shared blocks do not consume additional disk space.
Transparent
Files sharing common blocks act like regular files.
Per-file snapshots
This functionality is also used by kernel subsystems such as Overlayfs and NFS for more efficient
operation.
Shared copy-on-write data extents are now enabled by default when creating an XFS file system,
starting with the xfsprogs package version 4.17.0-2.el8.
Note that Direct Access (DAX) devices currently do not support XFS with shared copy-on-write data
extents. To create an XFS file system without this feature, use the following command:
Red Hat Enterprise Linux 7 can mount XFS file systems with shared copy-on-write data extents only in
the read-only mode.
62
CHAPTER 12. FILE SYSTEMS AND STORAGE
12.1.4. The /etc/sysconfig/nfs file and legacy NFS service names are no longer available
In Red Hat Enterprise Linux 8.0, the NFS configuration has moved from the /etc/sysconfig/nfs
configuration file, which was used in Red Hat Enterprise Linux 7, to /etc/nfs.conf.
The /etc/nfs.conf file uses a different syntax. Red Hat Enterprise Linux 8 attempts to automatically
convert all options from /etc/sysconfig/nfs to /etc/nfs.conf when upgrading from Red Hat Enterprise
Linux 7.
Both configuration files are supported in Red Hat Enterprise Linux 7. Red Hat recommends that you use
the new /etc/nfs.conf file to make NFS configuration in all versions of Red Hat Enterprise Linux
compatible with automated configuration systems.
Additionally, the following NFS service aliases have been removed and replaced by their upstream
names:
12.2. STORAGE
12.2.1. The BOOM boot manager simplifies the process of creating boot entries
BOOM is a boot manager for Linux systems that use boot loaders supporting the BootLoader
Specification for boot entry configuration. It enables flexible boot configuration and simplifies the
creation of new or modified boot entries: for example, to boot snapshot images of the system created
using LVM.
BOOM does not modify the existing boot loader configuration, and only inserts additional entries. The
existing configuration is maintained, and any distribution integration, such as kernel installation and
update scripts, continue to function as before.
BOOM has a simplified command-line interface (CLI) and API that ease the task of creating boot
entries.
63
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Stratis enables you to more easily perform storage tasks such as:
To administer Stratis storage, use the stratis utility, which communicates with the stratisd background
service.
For more information, see the Stratis documentation: Managing layered local storage with Stratis .
Due to the internal flexible layout, LUKS2 is also an enabler of future features. It supports auto-
unlocking through the generic kernel-keyring token built in libcryptsetup that allow users unlocking of
LUKS2 volumes using a passphrase stored in the kernel-keyring retention service.
The protected key setup using the wrapped key cipher scheme.
For more details, see the cryptsetup(8) and cryptsetup-reencrypt(8) man pages.
The SCSI Multiqueue (scsi-mq) driver is now enabled by default, and the kernel boots with the
scsi_mod.use_blk_mq=Y option. This change is consistent with the upstream Linux kernel.
Device Mapper Multipath (DM Multipath) requires the scsi-mq driver to be active.
64
CHAPTER 12. FILE SYSTEMS AND STORAGE
Red Hat might reintroduce the VDO read cache in a later Red Hat Enterprise Linux release, using a
different implementation.
The dmraid package has been removed from Red Hat Enterprise Linux 8. Users requiring support for
combined hardware and software RAID host bus adapters (HBA) should use the mdadm utility, which
supports native MD software RAID, the SNIA RAID Common Disk Data Format (DDF), and the Intel®
Matrix Storage Manager (IMSM) formats.
12.2.8. Software FCoE and Fibre Channel no longer support the target mode
Software FCoE: NIC Software FCoE target functionality is removed in Red Hat Enterprise Linux
8.0.
Fibre Channel no longer supports the target mode. Target mode is disabled for the qla2xxx
QLogic Fibre Channel driver in Red Hat Enterprise Linux 8.0.
The following options in the /etc/multipath.conf file control marginal paths behavior:
marginal_path_double_failed_time
marginal_path_err_sample_time
marginal_path_err_rate_threshold
marginal_path_err_recheck_gap_time
DM Multipath disables a path and tests it with repeated I/O for the configured sample time if:
If the path has more than the configured err rate during this testing, DM Multipath ignores it for the
configured gap time, and then retests it to see if it is working well enough to be reinstated.
The /etc/multipath.conf file now includes an overrides section that allows you to set a configuration
value for all of your devices. These attributes are used by DM Multipath for all devices unless they are
overwritten by the attributes specified in the multipaths section of the /etc/multipath.conf file for
65
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
paths that contain the device. This functionality replaces the all_devs parameter of the devices section
of the configuration file, which is no longer supported.
12.2.11. NVMe/FC is fully supported on Broadcom Emulex and Marvell Qlogic Fibre
Channel adapters
The NVMe over Fibre Channel (NVMe/FC) transport type is now fully supported in Initiator mode when
used with Broadcom Emulex and Marvell Qlogic Fibre Channel 32Gbit adapters that feature NVMe
support.
NVMe over Fibre Channel is an additional fabric transport type for the Nonvolatile Memory Express
(NVMe) protocol, in addition to the Remote Direct Memory Access (RDMA) protocol that was
previously introduced in Red Hat Enterprise Linux.
Enabling NVMe/FC:
To enable NVMe/FC in the lpfc driver, edit the /etc/modprobe.d/lpfc.conf file and add the
following option:
lpfc_enable_fc4_type=3
To enable NVMe/FC in the qla2xxx driver, edit the /etc/modprobe.d/qla2xxx.conf file and add
the following option:
qla2xxx.ql2xnvmeenable=1
Additional restrictions:
With Marvell Qlogic adapters, Red Hat Enterprise Linux does not support using NVMe/FC and
SCSI/FC on an initiator port at the same time.
DIF/DIX increases the size of the commonly used 512 byte disk block from 512 to 520 bytes, adding the
Data Integrity Field (DIF). The DIF stores a checksum value for the data block that is calculated by the
Host Bus Adapter (HBA) when a write occurs. The storage device then confirms the checksum on
receipt, and stores both the data and the checksum. Conversely, when a read occurs, the checksum can
be verified by the storage device, and by the receiving HBA.
66
CHAPTER 12. FILE SYSTEMS AND STORAGE
The package requires the NetApp 7-mode API, which is being phased out by NetApp.
RHEL 8 has removed default support for the TLSv1.0 protocol with the
TLS_RSA_WITH_3DES_EDE_CBC_SHA cipher, using this plug-in with TLS does not work.
12.3. LVM
LVM no longer uses clvmd (cluster lvm daemon) for managing shared storage devices. Instead, LVM
now uses lvmlockd (lvm lock daemon).
For details about using lvmlockd, see the lvmlockd(8) man page. For details about using
shared storage in general, see the lvmsystemid(7) man page.
For information on using LVM in a Pacemaker cluster, see the help screen for the LVM-activate
resource agent.
For an example of a procedure to configure a shared logical volume in a Red Hat High
Availability cluster, see Configuring a GFS2 file system in a cluster .
LVM no longer uses the lvmetad daemon for caching metadata, and will always read metadata from
disk. LVM disk reading has been reduced, which reduces the benefits of caching.
Previously, autoactivation of logical volumes was indirectly tied to the use_lvmetad setting in the
lvm.conf configuration file. The correct way to disable autoactivation continues to be setting
auto_activation_volume_list in the lvm.conf file.
12.3.3. LVM can no longer manage devices formatted with the GFS pool volume
manager or the lvm1 metadata format.
LVM can no longer manage devices formatted with the GFS pool volume manager or the`lvm1`
metadata format. if you created your logical volume before Red Hat Enterprise Linux 4 was introduced,
then this may affect you. Volume groups using the lvm1 format should be converted to the lvm2 format
using the vgconvert command.
12.3.4. LVM libraries and LVM Python bindings have been removed
The lvm2app library and LVM Python bindings, which were provided by the lvm2-python-libs package,
have been removed. Red Hat recommends the following solutions instead:
The LVM D-Bus API in combination with the lvm2-dbusd service. This requires using Python
version 3.
The LVM command-line utilities with JSON formatting; this formatting has been available since
the lvm2 package version 2.02.158.
You must port any applications using the removed libraries and bindings to the D-Bus API before
upgrading to Red Hat Enterprise Linux 8.
67
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
12.3.5. The ability to mirror the log for LVM mirrors has been removed
The mirrored log feature of mirrored LVM volumes has been removed. Red Hat Enterprise Linux (RHEL)
8 no longer supports creating or activating LVM volumes with a mirrored mirror log.
RAID1 LVM volumes. The main advantage of RAID1 volumes is their ability to work even in
degraded mode and to recover after a transient failure.
Disk mirror log. To convert a mirrored mirror log to disk mirror log, use the following command:
lvconvert --mirrorlog disk my_vg/my_lv.
68
CHAPTER 13. HIGH AVAILABILITY AND CLUSTERS
Application versions: What version of the highly-available application will the RHEL 8 cluster
require?
Application process order: What may need to change in the start and stop processes of the
application?
Cluster infrastructure: Since pcs supports multiple network connections in RHEL 8, does the
number of NICs known to the cluster change?
Needed packages: Do you need to install all of the same packages on the new cluster?
Because of these and other considerations for running a Pacemaker cluster in RHEL 8, it is not possible
to perform in-place upgrades from RHEL 7 to RHEL 8 clusters and you must configure a new cluster in
RHEL 8. You cannot run a cluster that includes nodes running both RHEL 7 and RHEL 8.
Additionally, you should plan for the following before performing an upgrade:
Final cutover: What is the process to stop the application running on the old cluster and start it
on the new cluster to reduce application downtime?
The major differences in cluster creation and administration between RHEL 7 and RHEL 8 are listed in
the following sections.
13.1. NEW FORMATS FOR PCS CLUSTER SETUP, PCS CLUSTER NODE ADD AND PCS
CLUSTER NODE REMOVE COMMANDS
In Red Hat Enterprise Linux 8, pcs fully supports the use of node names, which are now required and
replace node addresses in the role of node identifier. Node addresses are now optional.
In the pcs host auth command, node addresses default to node names.
In the pcs cluster setup and pcs cluster node add commands, node addresses default to the
node addresses specified in the pcs host auth command.
With these changes, the formats for the commands to set up a cluster, add a node to a cluster, and
remove a node from a cluster have changed. For information on these new command formats, see the
help display for the pcs cluster setup, pcs cluster node add and pcs cluster node remove
commands.
Red Hat Enterprise Linux (RHEL) 8 supports Pacemaker 2.0, in which a master/slave resource is no
69
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Red Hat Enterprise Linux (RHEL) 8 supports Pacemaker 2.0, in which a master/slave resource is no
longer a separate type of resource but a standard clone resource with a promotable meta-attribute set
to true. The following changes have been implemented in support of this update:
It is no longer possible to create master resources with the pcs command. Instead, it is possible
to create promotable clone resources. Related keywords and commands have been changed
from master to promotable.
When managing a RHEL7 cluster in the Web UI, master resources are still called master, as
RHEL7 clusters do not support promotable clones.
The new command for authentication is pcs host auth. This command allows users to specify
host names, addresses and pcsd ports.
The pcs cluster auth command authenticates only the nodes in a local cluster and does not
accept a node list
It is now possible to specify an address for each node. pcs/pcsd will then communicate with
each node using the specified address. These addresses can be different than the ones
corosync uses internally.
The pcs pcsd clear-auth command has been replaced by the pcs pcsd deauth and pcs host
deauth commands. The new commands allow users to deauthenticate a single host as well as all
hosts.
Previously, node authentication was bidirectional, and running the pcs cluster auth command
caused all specified nodes to be authenticated against each other. The pcs host auth
command, however, causes only the local host to be authenticated against the specified nodes.
This allows better control of what node is authenticated against what other nodes when running
this command. On cluster setup itself, and also when adding a node, pcs automatically
synchronizes tokens on the cluster, so all nodes in the cluster are still automatically
authenticated as before and the cluster nodes can communicate with each other.
Note that these changes are not backward compatible. Nodes that were authenticated on a RHEL 7
system will need to be authenticated again.
70
CHAPTER 13. HIGH AVAILABILITY AND CLUSTERS
In RHEL 8, LVM uses the LVM lock daemon lvmlockd instead of clvmd for managing shared storage
devices in an active/active cluster. This requires that you configure the logical volumes on which you
mount a GFS2 file system as shared logical volumes.
Additionally, this requires that you use the LVM-activate resource agent to manage an LVM volume and
that you use the lvmlockd resource agent to manage the lvmlockd daemon.
For a full procedure for configuring a RHEL 8 Pacemaker cluster that includes GFS2 file systems using
shared logical volumes, see Configuring a GFS2 file system in a cluster .
To use GFS2 file systems that were created on a RHEL 7 system in a RHEL 8 cluster, you must
configure the logical volumes on which they are mounted as shared logical volumes in a RHEL 8 system,
and you must start locking for the volume group. For an example of the procedure that configures
existing RHEL 7 logical volumes as shared logical volumes for use in a RHEL 8 Pacemaker cluster, see
Migrating a GFS2 file system from RHEL7 to RHEL8 .
71
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The meta-packages which install extra add-on packages containing translations, dictionaries and locales
for every package installed on the system are called langpacks.
In RHEL 8, both of these pair have been merged into the nobody user and group pair, which uses the ID
of 65534. The nfsnobody pair is not created in RHEL 8.
This change reduces the confusion about files that are owned by nobody but are not related to NFS.
Mercurial 4.8, a lightweight distributed version control system, designed for efficient handling
of large projects.
Note that the Concurrent Versions System (CVS) and Revision Control System (RCS), available in
RHEL 7, are not distributed with RHEL 8.
Subversion 1.10 introduces a number of new features since the version 1.7 distributed in RHEL 7, as well
as the following compatibility changes:
Due to incompatibilities in the Subversion libraries used for supporting language bindings,
72
CHAPTER 14. SHELLS AND COMMAND-LINE TOOLS
Due to incompatibilities in the Subversion libraries used for supporting language bindings,
Python 3 bindings for Subversion 1.10 are unavailable. As a consequence, applications that
require Python bindings for Subversion are unsupported.
Existing working copies checked out by the Subversion 1.7 client in RHEL 7 must be upgraded
to the new format before they can be used from Subversion 1.10. After installing RHEL 8, run
the svn upgrade command in each working copy.
73
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Red Hat Enterprise Linux 8 is distributed with Python 3.6. The package might not be installed by default.
To install Python 3.6, use the yum install python3 command.
Python 2.7 is available in the python2 package. However, Python 2 will have a shorter life cycle and its
aim is to facilitate a smoother transition to Python 3 for customers.
Neither the default python package nor the unversioned /usr/bin/python executable is distributed with
RHEL 8. Customers are advised to use python3 or python2 directly. Alternatively, administrators can
configure the unversioned python command using the alternatives command.
As a developer, you may want to migrate your former code that is written in Python 2 to Python 3. For
more information on how to migrate large code bases to Python 3, see The Conservative Python 3
Porting Guide.
Note that after this migration, the original Python 2 code becomes interpretable by the Python 3
interpreter and stays interpretable for the Python 2 interpreter as well.
System administrators can configure the unversioned python command on the system using the
alternatives command. Note that the required package, either python3 or python2, needs to be
installed before configuring the unversioned command to the respective version.
To reset this configuration and remove the unversioned python command, run:
74
CHAPTER 15. DYNAMIC PROGRAMMING LANGUAGES, WEB SERVERS, DATABASE SERVERS
WARNING
15.1.1.4. Python scripts must specify major version in hashbangs at RPM build time
In RHEL 8, executable Python scripts are expected to use hashbangs (shebangs) specifying explicitly at
least the major Python version.
#! /usr/bin/python
#! /usr/bin/env python
To modify hashbangs in the Python scripts causing these build errors at RPM build time, use the
pathfix.py script from the platform-python-devel package:
Multiple PATHs can be specified. If a PATH is a directory, pathfix.py recursively scans for any Python
scripts matching the pattern ^[a-zA-Z0-9_]+\.py$, not only those with an ambiguous hashbang. Add the
command for running pathfix.py to the %prep section or at the end of the %install section.
The Net-SNMP suite of tools does not provide binding for Python 3, which is the default Python
implementation in RHEL 8. Consequently, python-net-snmp, python2-net-snmp, or python3-net-snmp
packages are unavailable in RHEL 8.
Red Hat Enterprise Linux 8 is distributed with PHP 7.2. This version introduces the following major
changes over PHP 5.4, which is available in RHEL 7:
PHP uses FastCGI Process Manager (FPM) by default (safe for use with a threaded httpd)
75
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The php_value and php-flag variables should no longer be used in the httpd configuration files;
they should be set in pool configuration instead: /etc/php-fpm.d/*.conf
PHP script errors and warnings are logged to the /var/log/php-fpm/www-error.log file instead
of /var/log/httpd/error.log
When changing the PHP max_execution_time configuration variable, the httpd ProxyTimeout
setting should be increased to match
The user running PHP scripts is now configured in the FPM pool configuration (the /etc/php-
fpm.d/www.conf file; the apache user is the default)
The php-fpm service needs to be restarted after a configuration change or after a new
extension is installed
The zip extension has been moved from the php-common package to a separate package,
php-pecl-zip
aspell
mysql (note that the mysqli and pdo_mysql extensions are still available, provided by php-
mysqlnd package)
memcache
Perl 5.26, distributed with RHEL 8, introduces the following changes over the version available in RHEL
7:
The IO::Socket::IP module for handling IPv4 and IPv6 sockets transparently has been added.
The Config::Perl::V module to access perl -V data in a structured way has been added.
A new perl-App-cpanminus package has been added, which contains the cpanm utility for
getting, extracting, building, and installing modules from the Comprehensive Perl Archive
Network (CPAN) repository.
The current directory . has been removed from the @INC module search path for security
reasons.
The do statement now returns a deprecation warning when it fails to load a file because of the
behavioral change described above.
Hashes are randomized by default now. The order in which keys and values are returned from a
hash changes on each perl run. To disable the randomization, set the PERL_PERTURB_KEYS
environment variable to 0.
76
CHAPTER 15. DYNAMIC PROGRAMMING LANGUAGES, WEB SERVERS, DATABASE SERVERS
The find2perl, s2p, a2p, c2ph, and pstruct tools have been removed.
The ${^ENCODING} facility has been removed. The encoding pragma’s default mode is no
longer supported. To write source code in other encoding than UTF-8, use the encoding’s Filter
option.
The perl packaging is now aligned with upstream. The perl package installs also core modules,
while the /usr/bin/perl interpreter is provided by the perl-interpreter package. In previous
releases, the perl package included just a minimal interpreter, whereas the perl-core package
included both the interpreter and the core modules.
The IO::Socket::SSL Perl module no longer loads a certificate authority certificate from the
./certs/my-ca.pem file or the ./ca directory, a server private key from the ./certs/server-
key.pem file, a server certificate from the ./certs/server-cert.pem file, a client private key from
the ./certs/client-key.pem file, and a client certificate from the ./certs/client-cert.pem file.
Specify the paths to the files explicitly instead.
RHEL 8 provides Ruby 2.5, which introduces numerous new features and enhancements over Ruby
2.0.0 available in RHEL 7. Notable changes include:
The Fixnum and Bignum classes have been unified into the Integer class.
Performance has been improved by optimizing the Hash class, improved access to instance
variables, and the Mutex class being smaller and faster.
Bundled libraries, such as RubyGems, Rake, RDoc, Psych, Minitest, and test-unit, have been
updated.
Other libraries, such as mathn, DL, ext/tk, and XMLRPC, which were previously distributed with
Ruby, are deprecated or no longer included.
RHEL 8 includes the Simplified Wrapper and Interface Generator (SWIG) version 3.0, which provides
77
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
numerous new features, enhancements, and bug fixes over the version 2.0 distributed in RHEL 7. Most
notably, support for the C++11 standard has been implemented. SWIG now supports also Go 1.6, PHP 7,
Octave 4.2, and Python 3.5.
Node.js, a software development platform for building fast and scalable network applications in the
JavaScript programming language, is provided for the first time in RHEL. It was previously available only
as a Software Collection. RHEL 8 provides Node.js 10.
15.1.7. Tcl
Tool command language (Tcl) is a dynamic programming language. The interpreter for this language,
together with the C library, is provided by the tcl package.
Using Tcl paired with Tk (Tcl/Tk) enables creating cross-platform GUI applications. Tk is provided by
the tk package.
A Tk C library bindings available for multiple languages, such as C, Ruby, Perl and Python
RHEL 8 is distributed with Tcl/Tk version 8.6, which provides multiple notable changes over Tcl/Tk
version 8.5:
List processing
Two new commands, lmap and dict map are available, which allow the expression of
transformations over Tcl containers.
For more detailed information about Tcl/Tk version 8.6 changes and new feaures, see the following
resources:
HTTP/2 support is now provided by the mod_http2 package, which is a part of the httpd
module.
systemd socket activation is supported. See httpd.socket(8) man page for more details.
mod_proxy_fdpass - provides support for the passing the socket of the client to another
process
mod_request
mod_macro
mod_watchdog
A new subpackage, httpd-filesystem, has been added, which contains the basic directory layout
for the Apache HTTP Server including the correct permissions for the directories.
Instantiated service support, httpd@.service has been introduced. See the httpd.service man
page for more information.
A new httpd-init.service replaces the %post script to create a self-signed mod_ssl key pair.
Automated TLS certificate provisioning and renewal using the Automatic Certificate
Management Environment (ACME) protocol is now supported with the mod_md package (for
use with certificate providers such as Let’s Encrypt).
79
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The Apache HTTP Server now supports loading TLS certificates and private keys from
hardware security tokens directly from PKCS#11 modules. As a result, a mod_ssl configuration
can now use PKCS#11 URLs to identify the TLS private key, and, optionally, the TLS certificate
in the SSLCertificateKeyFile and SSLCertificateFile directives.
mod_file_cache
mod_nss
mod_perl
The default type of the DBM authentication database used by the Apache HTTP Server in
RHEL 8 has been changed from SDBM to db5.
The mod_wsgi module for the Apache HTTP Server has been updated to Python 3. WSGI
applications are now supported only with Python 3, and must be migrated from Python 2.
The multi-processing module (MPM) configured by default with the Apache HTTP Server has
changed from a multi-process, forked model (known as prefork) to a high-performance multi-
threaded model, event.
Any third-party modules that are not thread-safe need to be replaced or removed. To change
the configured MPM, edit the /etc/httpd/conf.modules.d/00-mpm.conf file. See the
httpd.service(8) man page for more information.
The minimum UID and GID allowed for users by suEXEC are now 1000 and 500, respectively
(previously 100 and 100).
80
CHAPTER 15. DYNAMIC PROGRAMMING LANGUAGES, WEB SERVERS, DATABASE SERVERS
For instructions on deploying, see Setting up the Apache HTTP web server.
RHEL 8 introduces nginx 1.14, a web and proxy server supporting HTTP and other protocols, with a
focus on high concurrency, performance, and low memory usage. nginx was previously available only as
a Software Collection.
The nginx web server now supports loading TLS private keys from hardware security tokens directly
from PKCS#11 modules. As a result, an nginx configuration can use PKCS#11 URLs to identify the TLS
private key in the ssl_certificate_key directive.
Varnish Cache, a high-performance HTTP reverse proxy, is provided for the first time in RHEL. It was
previously available only as a Software Collection. Varnish Cache stores files or fragments of files in
memory that are used to reduce the response time and network bandwidth consumption on future
equivalent requests. RHEL 8.0 is distributed with Varnish Cache 6.0.
RHEL 8.0 is distributed with Squid 4.4, a high-performance proxy caching server for web clients,
supporting FTP, Gopher, and HTTP data objects. This release provides numerous new features,
enhancements, and bug fixes over the version 3.5 available in RHEL 7.
81
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
MySQL 8.0, a multi-user, multi-threaded SQL database server. It consists of the MySQL server
daemon, mysqld, and many client programs.
MariaDB 10.3, a multi-user, multi-threaded SQL database server. For all practical purposes,
MariaDB is binary-compatible with MySQL.
Redis 5, an advanced key-value store. It is often referred to as a data structure server because
keys can contain strings, hashes, lists, sets, and sorted sets. Redis is provided for the first time
in RHEL.
Note that the NoSQL MongoDB database server is not included in RHEL 8.0 because it uses the Server
Side Public License (SSPL).
By design, it is impossible to install more than one version (stream) of the same module in parallel. For
example, you need to choose only one of the available streams from the postgresql module, either 10
(default) or 9.6. Parallel installation of components is possible in Red Hat Software Collections for RHEL
6 and RHEL 7. In RHEL 8, different versions of database servers can be used in containers.
MariaDB 10.3 provides numerous new features over the version 5.5 distributed in RHEL 7, such as:
System-versioned tables
FOR loops
Invisible columns
Sequences
Parallel replication
Multi-source replication
In addition, the new mariadb-connector-c packages provide a common client library for MySQL and
MariaDB. This library is usable with any version of the MySQL and MariaDB database servers. As a
result, the user is able to connect one build of an application to any of the MySQL and MariaDB servers
distributed with RHEL 8.
82
CHAPTER 15. DYNAMIC PROGRAMMING LANGUAGES, WEB SERVERS, DATABASE SERVERS
The default allowed level of the plug-in maturity has been changed to one level less than the
server maturity. As a result, plug-ins with a lower maturity level that were previously working, will
no longer load.
RHEL 8 is distributed with MySQL 8.0, which provides, for example, the following enhancements:
MySQL now incorporates a transactional data dictionary, which stores information about
database objects.
The default character set has been changed from latin1 to utf8mb4.
Support for common table expressions, both nonrecursive and recursive, has been added.
MySQL now supports window functions, which perform a calculation for each row from a query,
using related rows.
InnoDB now supports the NOWAIT and SKIP LOCKED options with locking read statements.
The new mariadb-connector-c packages provide a common client library for MySQL and
MariaDB. This library is usable with any version of the MySQL and MariaDB database servers.
As a result, the user is able to connect one build of an application to any of the MySQL and
MariaDB servers distributed with RHEL 8.
In addition, the MySQL 8.0 server distributed with RHEL 8 is configured to use
mysql_native_password as the default authentication plug-in because client tools and libraries in
RHEL 8 are incompatible with the caching_sha2_password method, which is used by default in the
upstream MySQL 8.0 version.
[mysqld]
default_authentication_plugin=caching_sha2_password
RHEL 8.0 provides two versions of the PostgreSQL database server, distributed in two streams of the
postgresql module: PostgreSQL 10 (the default stream) and PostgreSQL 9.6. RHEL 7 includes
PostgreSQL version 9.2.
83
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The postgres_fdw data federation driver now supports remote join, sort, UPDATE, and
DELETE operations
84
CHAPTER 16. COMPILERS AND DEVELOPMENT TOOLS
Numerous general optimizations have been added, such as alias analysis, vectorizer
improvements, identical code folding, inter-procedural analysis, store merging optimization
pass, and others.
The Leak Sanitizer for detection of memory leaks has been added.
The Undefined Behavior Sanitizer for detection of undefined behavior has been added.
Debug information can now be produced in the DWARF5 format. This capability is experimental.
The source code coverage analysis tool GCOV has been extended with various improvements.
Support for the OpenMP 4.5 specification has been added. Additionally, the offloading features
of the OpenMP 4.0 specification are now supported by the C, C++, and Fortran compilers.
New warnings and improved diagnostics have been added for static detection of certain likely
programming errors.
Source locations are now tracked as ranges rather than points, which allows much richer
diagnostics. The compiler now offers “fix-it” hints, suggesting possible code modifications. A
spell checker has been added to offer alternative names and ease detecting typos.
Security
GCC has been extended to provide tools to ensure additional hardening of the generated code.
Improvements related to security include:
The -fstack-clash-protection option has been added to generate additional code guarding
against stack clash.
The new -Wstringop-truncation warning option lists calls to bounded string manipulation
functions such as strncat, strncpy, or stpncpy that might truncate the copied string or leave
the destination unchanged.
The -Warray-bounds warning option has been improved to detect out-of-bounds array indices
and pointer offsets better.
85
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The -Wclass-memaccess warning option has been added to warn about potentially unsafe
manipulation of objects of non-trivial class types by raw memory access functions such as
memcpy or realloc.
Multiple new architecture-specific options for the Intel AVX-512 architecture, a number of its
microarchitectures, and Intel Software Guard Extensions (SGX) have been added.
Code generation can now target the 64-bit ARM architecture LSE extensions, ARMv8.2-A 16-
bit Floating-Point Extensions (FPE), and ARMv8.2-A, ARMv8.3-A, and ARMv8.4-A architecture
versions.
Handling of the -march=native option on the ARM and 64-bit ARM architectures has been
fixed.
Support for the z13 and z14 processors of the IBM Z architecture has been added.
The default standard used when compiling code in the C language has changed to C17 with
GNU extensions.
The default standard used when compiling code in the C++ language has changed to C++14 with
GNU extensions.
The C++ runtime library now supports the C++11 and C++14 standards.
The C++ compiler now implements the C++14 standard with many new features such as variable
templates, aggregates with non-static data member initializers, the extended constexpr
specifier, sized deallocation functions, generic lambdas, variable-length arrays, digit separators,
and others.
Support for the C language standard C11 has been improved: ISO C11 atomics, generic
selections, and thread-local storage are now available.
The new __auto_type GNU C extension provides a subset of the functionality of C++11 auto
keyword in the C language.
The _FloatN and _FloatNx type names specified by the ISO/IEC TS 18661-3:2015 standard are
now recognized by the C front end.
The default standard used when compiling code in the C language has changed to C17 with
GNU extensions. This has the same effect as using the --std=gnu17 option. Previously, the
default was C89 with GNU extensions.
GCC can now experimentally compile code using the C++17 language standard and certain
features from the C++20 standard.
Passing an empty class as an argument now takes up no space on the Intel 64 and AMD64
architectures, as required by the platform ABI. Passing or returning a class with only deleted
copy and move constructors now uses the same calling convention as a class with a non-trivial
copy or move constructor.
86
CHAPTER 16. COMPILERS AND DEVELOPMENT TOOLS
The value returned by the C++11 alignof operator has been corrected to match the C _Alignof
operator and return minimum alignment. To find the preferred alignment, use the GNU
extension __alignof__.
The main version of the libgfortran library for Fortran language code has been changed to 5.
Support for the Ada (GNAT), GCC Go, and Objective C/C++ languages has been removed. Use
the Go Toolset for Go code development.
Additional resources
Using Go Toolset
New warnings
These warning options have been added:
-Wmisleading- Places where the indentation of the code gives a misleading idea of the block
indentation structure of the code to a human reader.
-Walloc-zero Calls to memory allocation functions that attempt to allocate zero amount of
memory. Works also with functions where the allocation is specified by
multiplying two parameters and with any functions decorated with attribute
alloc_size.
87
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
-Walloca-larger- Calls to the alloca function where the requested memory is more thansize.
than=size
-Wvla-larger-than=size Definitions of Variable Length Arrays (VLA) that can either exceed the
specified size or whose bound is not known to be sufficiently constrained.
-Wformat-overflow=level Both certain and likely buffer overflow in calls to the sprintf family of
formatted output functions. For more details and explanation of the level
value, see the gcc(1) manual page.
-Wformat- Both certain and likely output truncation in calls to the snprintf family of
truncation=level formatted output functions. For more details and explanation of the level
value, see the gcc(1) manual page.
-Wstringop- Buffer overflow in calls to string handling functions such as memcpy and
overflow=type strcpy. For more details and explanation of thelevel value, see the gcc(1)
manual page.
Warning improvements
These GCC warnings have been improved:
The -Warray-bounds option has been improved to detect more instances of out-of-bounds
array indices and pointer offsets. For example, negative or excessive indices into flexible array
members and string literals are detected.
The -Wrestrict option introduced in GCC 7 has been enhanced to detect many more instances
of overlapping accesses to objects via restrict-qualified arguments to standard memory and
string manipulation functions such as memcpy and strcpy.
The -Wnonnull option has been enhanced to detect a broader set of cases of passing null
pointers to functions that expect a non-null argument (decorated with attribute nonnull).
New UndefinedBehaviorSanitizer
A new run-time sanitizer for detecting undefined behavior called UndefinedBehaviorSanitizer has been
added. The following options are noteworthy:
Option Check
88
CHAPTER 16. COMPILERS AND DEVELOPMENT TOOLS
Option Check
Option Check
-fsanitize-address-use-after- Sanitize variables whose address is taken and used after a scope
scope where the variable is defined.
The option -fstack-clash-protection has been added to insert probes when stack space is
allocated statically or dynamically to reliably detect stack overflows and thus mitigate the attack
vector that relies on jumping over a stack guard page provided by the operating system.
89
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Additional resources
For more details and explanation of the values supplied to some of the options above, see the
gcc(1) manual page:
$ man gcc
Clang and LLVM Toolset 7.0.1, which provides the LLVM compiler infrastructure framework, the
Clang compiler for the C and C++ languages, the LLDB debugger, and related tools for code
analysis. See the Using Clang and LLVM Toolset document.
Rust Toolset 1.31, which provides the Rust programming language compiler rustc, the cargo
build tool and dependency manager, the cargo-vendor plugin, and required libraries. See the
Using Rust Toolset document.
Go Toolset 1.11.5, which provides the Go programming language tools and libraries. Go is
alternatively known as golang. See the Using Go Toolset document.
The java-11-openjdk packages, which provide the OpenJDK 11 Java Runtime Environment and
the OpenJDK 11 Java Software Development Kit.
The java-1.8.0-openjdk packages, which provide the OpenJDK 8 Java Runtime Environment
and the OpenJDK 8 Java Software Development Kit.
The ant module, providing a Java library and command-line tool for compiling, assembling,
90
CHAPTER 16. COMPILERS AND DEVELOPMENT TOOLS
The ant module, providing a Java library and command-line tool for compiling, assembling,
testing, and running Java applications. Ant has been updated to version 1.10.
The maven module, providing a software project management and comprehension tool. Maven
was previously available only as a Software Collection or in the unsupported Optional channel.
The scala module, providing a general purpose programming language for the Java platform.
Scala was previously available only as a Software Collection.
In addition, the java-1.8.0-ibm packages are distributed through the Supplementary repository. Note
that packages in this repository are unsupported by Red Hat.
Parsing output of GDB is not recommended. Prefer scripts using the Python GDB API or the GDB
Machine Interface (MI).
When using the target extended-remote GDB command, disable shell with the set startup-
with-shell off command.
When using the target remote GDB command, disable shell with the --no-startup-with-shell
option of GDBserver.
This example shows how running the /bin/echo /* command through GDBserver differs on Red Hat
Enterprise Linux versions 7 and 8:
On RHEL 7:
On RHEL 8:
Support for debugging Java programs compiled with the GNU Compiler for Java (gcj) has been
91
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Support for debugging Java programs compiled with the GNU Compiler for Java (gcj) has been
removed.
As an example, the following command no longer stores symbols in a file, but produces an error message:
The new syntax for the symbol dumping maintenance commands is:
GDB now stores a second thread ID per thread, called the global thread ID, which is the new equivalent
of thread numbers in previous releases. To access the global thread number, use the $_gthread
convenience variable and InferiorThread.global_num Python attribute.
For backwards compatibility, the Machine Interface (MI) thread IDs always contains the global IDs.
# debuginfo-install coreutils
$ gdb -batch -ex 'file echo' -ex start -ex 'add-inferior' -ex 'inferior 2' -ex 'file echo' -ex start -ex 'info
threads' -ex 'pring $_thread' -ex 'inferior 1' -ex 'pring $_thread'
(...)
Id Target Id Frame
* 2 process 203923 "echo" main (argc=1, argv=0x7fffffffdb88) at src/echo.c:109
1 process 203914 "echo" main (argc=1, argv=0x7fffffffdb88) at src/echo.c:109
$1 = 2
(...)
$2 = 1
92
CHAPTER 16. COMPILERS AND DEVELOPMENT TOOLS
$1 = 1
(...)
$2 = 1
On Red Hat Enterprise Linux 8, value requires 131072 bytes, which is more than max-value-
size
The specified system root is prepended to the file name of the main executable, when GDB starts
processes remotely, or when it attaches to already running processes (both local and remote). This
means that for remote processes, the default value target: makes GDB always try to load the
debugging information from the remote system. To prevent this, run the set sysroot command before
the target remote command so that local symbol files are found before the remote ones.
93
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Additionally, the signal command now always correctly delivers the requested signal to the current
thread. If the program is stopped for a signal and the user switched threads, GDB asks for confirmation.
Applications using the LD_PRELOAD method to load librtkaio display a warning about a
missing library, load the librt library instead and run correctly.
Applications using the LD_LIBRARY_PATH method to load librtkaio load the librt library
instead and run correctly, without any warning.
Applications using the dlopen() system call to access librtkaio directly load the librt library
instead.
Use the fallback mechanism described above, without any changes to their applications.
Change code of their applications to use the librt library, which offers a compatible POSIX-
compliant API.
Change code of their applications to use the libaio library, which offers a compatible API.
Both librt and libaio can provide comparable features and performance under specific conditions.
Note that the libaio package has Red Hat compatibility level of 2, while librtk and the removed librtkaio
level 1.
94
CHAPTER 16. COMPILERS AND DEVELOPMENT TOOLS
make new operator != causes a different interpretation of certain existing makefile syntax
The != shell assignment operator has been added to GNU make as an alternative to the $(shell …)
function to increase compatibility with BSD makefiles. As a consequence, variables with name ending in
exclamation mark and immediately followed by assignment such as variable!=value are now interpreted
as the shell assignment. To restore the previous behavior, add a space after the exclamation mark, such
as variable! =value.
For more details and differences between the operator and the function, see the GNU make manual.
Users of libmpiwrap.so are encouraged to build their own version from upstream sources specific to
their MPI implementation and version. Supply these custom-built libraries to Valgrind using the
LD_PRELOAD technique.
95
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The IdM server module stream is called DL1 and contains multiple profiles that correspond to the
different types of IdM servers:
adtrust: an IdM server that has a trust agreement with Active Directory
# yum distro-sync
For details, see Installing packages required for an Identity Management server and Packages required
to install an Identity Management client.
The IdM LDAP server has its own mechanisms to grant access control. RHEL 8 introduces an update
that allows adding an ID user override for an AD user as a member of an IdM group. An ID override is a
record describing what a specific Active Directory user or group properties should look like within a
specific ID view, in this case the Default Trust View. As a consequence of the update, the IdM LDAP
server is able to apply access control rules for the IdM group to the AD user.
AD users are now able to use the self service features of IdM UI, for example to upload their SSH keys,
96
CHAPTER 17. IDENTITY MANAGEMENT
AD users are now able to use the self service features of IdM UI, for example to upload their SSH keys,
or change their personal data. An AD administrator is able to fully administer IdM without having two
different accounts and passwords.
NOTE
Currently, selected features in IdM may still be unavailable to AD users. For example,
setting passwords for IdM users as an AD user from the IdM admins group might fail.
The solution can be used for auditing of user sessions on security-sensitive systems. In the event of a
security breach, the recorded sessions can be reviewed as a part of a forensic analysis. The system
administrators are now able to configure the session recording locally and view the result from the RHEL
8 web console interface or from the Command-Line Interface using the tlog-play utility.
python-gssapi supports both python 2 and python 3 whereas python-krbV does not
the GSSAPI-based packages allow the use of other Generic Security Services API (GSSAPI)
mechanisms in addition to Kerberos, such as the NT LAN Manager NTLM for backward
compatibility reasons
17.5. SSSD
In RHEL 8, the authselect utility replaces the authconfig utility. authselect comes with a safer
97
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
In RHEL 8, the authselect utility replaces the authconfig utility. authselect comes with a safer
approach to PAM stack management that makes the PAM configuration changes simpler for system
administrators. authselect can be used to configure authentication methods such as passwords,
certificates, smart cards and fingerprint. authselect does not configure services required to join remote
domains. This task is performed by specialized tools, such as realmd or ipa-client-install.
With this update, RHEL 8 contains a credential cache that is better suited for containerized
environments and that provides a basis for building more features in future releases.
With this update, the sssctl utility of the System Security Services Daemon (SSSD) can print an access
control report for an Identity Management (IdM) domain. This feature meets the need of certain
environments to see, for regulatory reasons, a list of users and groups that can access a specific client
machine. Running sssctl access-report domain_name on an IdM client prints the parsed subset of
host-based access control (HBAC) rules in the IdM domain that apply to the client machine.
17.5.4. Local users are cached by SSSD and served through the nss_sss module
In RHEL 8, the System Security Services Daemon (SSSD) serves users and groups from the
/etc/passwd and /etc/groups files by default. The sss nsswitch module precedes files in the
/etc/nsswitch.conf file.
The advantage of serving local users through SSSD is that the nss_sss module has a fast memory-
mapped cache that speeds up Name Service Switch (NSS) lookups compared to accessing the disk and
opening the files on each NSS request. Previously, the Name service cache daemon (nscd) helped
accelerate the process of accessing the disk. However, using nscd in parallel with SSSD is cumbersome,
as both SSSD and nscd use their own independent caching. Consequently, using nscd in setups where
SSSD is also serving users from a remote domain, for example LDAP or Active Directory, can cause
unpredictable behavior.
With this update, the resolution of local users and groups is faster in RHEL 8. Note that the root user is
never handled by SSSD, therefore root resolution cannot be impacted by a potential bug in SSSD. Note
also that if SSSD is not running, the nss_sss module handles the situation gracefully by falling back to
nss_files to avoid problems. You do not have to configure SSSD in any way, the files domain is added
automatically.
17.5.5. SSSD now allows you to select one of the multiple smart-card authentication
devices
By default, the System Security Services Daemon (SSSD) tries to detect a device for smart-card
authentication automatically. If there are multiple devices connected, SSSD selects the first one it
detects. Consequently, you cannot select a particular device, which sometimes leads to failures.
With this update, you can configure a new p11_uri option for the [pam] section of the sssd.conf
configuration file. This option enables you to define which device is used for smart-card authentication.
98
CHAPTER 17. IDENTITY MANAGEMENT
For example, to select a reader with the slot id 2 detected by the OpenSC PKCS#11 module, add:
p11_uri = library-description=OpenSC%20smartcard%20framework;slot-id=2
The sssd-secrets component of the System Security Services Daemon (SSSD) has been removed in
Red Hat Enterprise Linux 8. This is because Custodia, a secrets service provider, is no longer actively
developed. Use other Identity Management tools to store secrets, for example the Identity Management
Vault. :parent-context-of-the-web-console: considerations-in-adopting-RHEL-8
99
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
In addition, on a non-minimal installation of RHEL 8, the web console is automatically installed and
firewall ports required by the console are automatically open.
A system message has also been added prior to login that provides information about how to enable or
access the web console.
Enable/disable firewall
Add/remove services
For details, see Using the web console for managing firewall .
Active subscriptions
Expired subscriptions
Renewed subscriptions
If you want to renew the subscription or get a different one in Red Hat Customer Portal, you do not have
to update the Subscription Manager data manually. The Subscription Manager synchronizes data with
Red Hat Customer Portal automatically.
This paragraph is the assembly introduction. It explains what the user will accomplish by working through
the modules in the assembly and sets the context for the user story the assembly is based on. Can
include more than one paragraph. Consider using the information from the user story.
NOTE
The web console’s Subscriptions page is now provided by the new subscription-manager-
cockpit package.
If your system is enrolled in an Identity Management (IdM) domain, the RHEL 8 web console now uses
100
CHAPTER 18. THE WEB CONSOLE
If your system is enrolled in an Identity Management (IdM) domain, the RHEL 8 web console now uses
the domain’s centrally managed IdM resources by default. This includes the following benefits:
The IdM domain’s administrators can use the web console to manage the local machine.
The console’s web server automatically switches to a certificate issued by the IdM certificate
authority (CA) and accepted by browsers.
Users with a Kerberos ticket in the IdM domain do not need to provide login credentials to
access the web console.
SSH hosts known to the IdM domain are accessible to the web console without manually adding
an SSH connection.
Note that for IdM integration with the web console to work properly, the user first needs to run the ipa-
advise utility with the enable-admins-sudo option in the IdM master system.
Stronger cryptography
The Virtual Machines page can now be added to the RHEL 8 web console interface, which enables the
101
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The Virtual Machines page can now be added to the RHEL 8 web console interface, which enables the
user to create and manage libvirt-based virtual machines.
For information about the differences in virtual management features between the web console and the
Virtual Machine Manager, see Differences in virtualization features in Virtual Machine Manager and the
web console.
102
CHAPTER 19. VIRTUALIZATION
In addition, the Virtual Machine Manager (virt-manager) application has been deprecated, and may
become unsupported in a future major release of RHEL.
Note, however, that the web console currently does not provide all of the virtual management features
that virt-manager does. For details about the differences in available features between the RHEL 8 web
console and the Virtual Machine Manager, see the Configuring and managing virtualization document.
Note that the previously default PC machine type has become deprecated and may become
unsupported in a future major release of RHEL. However, changing the machine type of existing VMs
from PC to Q35 is not recommended.
Older operating systems, such as Windows XP, do not support Q35 and will not boot if used on a
Q35 VM.
Currently, when using RHEL 6 as the operating system on a Q35 VM, hot-plugging a PCI device
to that VM in some cases does not work. In addition, certain legacy virtio devices do not work
properly on RHEL 6 Q35 VMs.
Therefore, using the PC machine type is recommended for RHEL 6 VMs.
Q35 emulates PCI Express (PCI-e) buses instead of PCI. As a result, a different device
topology and addressing scheme is presented to the guest OS.
The inter-VM shared memory device (IVSHMEM) feature, which provides shared memory between
103
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
The inter-VM shared memory device (IVSHMEM) feature, which provides shared memory between
multiple virtual machines, is now disabled in Red Hat Enterprise Linux 8. A virtual machine configured
with this device will fail to boot. Similarly, attempting to hot-plug such a device device will fail as well.
For the PXE installation to work, install RHEL 8 on a Generation 2 Hyper-V VM. If you require a RHEL 8
Generation 1 VM, use ISO installation.
LSI Logic SAS and Parallel SCSI drivers are not supported
The LSI Logic SAS driver (mptsas) and LSI Logic Parallel driver (mptspi) for SCSI are no longer
supported. As a consequence, the drivers can be used for installing RHEL 8 as a guest operating system
on a VMWare hypervisor to a SCSI disk, but the created VM will not be supported by Red Hat.
Installing virtio-win no longer creates a floppy disk image with the Windows drivers
Due to the limitation of floppy drives, virtio-win drivers are no longer provided as floppy images. Users
should use the ISO image instead. :context: considerations-in-adopting-RHEL-8
104
CHAPTER 20. CONTAINERS
Docker is not included in RHEL 8.0. For working with containers, use the podman, buildah,
skopeo, and runc tools.
For information on these tools and on using containers in RHEL 8, see Building, running, and
managing containers.
To learn how to use podman, see Building, running, and managing containers.
In RHEL 8 GA, Red Hat Universal Base Images (UBI) are newly available. UBIs replace some of
the images Red Hat previously provided, such as the standard and the minimal RHEL base
images.
Unlike older Red Hat images, UBIs are freely redistributable. This means they can be used in any
environment and shared anywhere. You can use them even if you are not a Red Hat customer.
In RHEL 8 GA, additional container images are available that provide AppStream components,
for which container images are distributed with Red Hat Software Collections in RHEL 7. All of
these RHEL 8 images are based on the ubi8 base image.
Container images ARM for the 64-bit ARM architecture are fully supported in RHEL 8.
The rhel-tools container has been removed in RHEL 8. The sos and redhat-support-tool tools
are provided in the support-tools container. System administrators can also use this image as a
base for building system tools container image.
= Internationalization
East Asian Languages - Japanese, Korean, Simplified Chinese, and Traditional Chinese.
European Languages - English, German, Spanish, French, Italian, Portuguese, and Russian.
The following table lists the fonts and input methods provided for various major languages.
English dejavu-sans-fonts
105
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
French dejavu-sans-fonts
German dejavu-sans-fonts
Italian dejavu-sans-fonts
Russian dejavu-sans-fonts
Spanish dejavu-sans-fonts
Portuguese dejavu-sans-fonts
Support for the Unicode 11 computing industry standard has been added.
The glibc package updates for multiple locales are now synchronized with the Common Locale
Data Repository (CLDR). :context: considerations-in-adopting-RHEL-8
106
CHAPTER 21. RELATED INFORMATION
Upgrading to RHEL 8
107
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
108
APPENDIX A. CHANGES TO PACKAGES
For a complete list of packages available in the current minor RHEL 8 release, see the Package manifest.
# | 389-ds-base-legacy-tools
C | c2esp, cargo, cargo-doc, cargo-vendor, cjose, cjose-devel, clang, clang-analyzer, clang-devel, clang-
libs, clang-tools-extra, cldr-emoji-annotation, clippy, cmake-data, cmake-doc, cmake-filesystem,
cmake-rpm-macros, cockpit-composer, cockpit-dashboard, cockpit-machines, cockpit-packagekit,
cockpit-pcp, cockpit-session-recording, cockpit-storaged, compat-guile18, compat-guile18-devel,
compat-libgfortran-48, compat-libpthread-nonshared, compat-openssl10, compiler-rt, composer-cli,
container-exception-logger, container-selinux, containernetworking-plugins, containers-common,
coreutils-common, coreutils-single, cppcheck, createrepo_c, createrepo_c-devel, createrepo_c-libs,
crypto-policies, CUnit, CUnit-devel, cyrus-imapd-vzic
109
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
110
APPENDIX A. CHANGES TO PACKAGES
111
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
112
APPENDIX A. CHANGES TO PACKAGES
113
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
114
APPENDIX A. CHANGES TO PACKAGES
115
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Y | yasm
116
APPENDIX A. CHANGES TO PACKAGES
117
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
118
APPENDIX A. CHANGES TO PACKAGES
119
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
espeak espeak-ng RHEL 8.0 The espeak package, providing backends for
speech synthesis, has been replaced by an
actively developed espeak-ng package.
espeak-ng is mostly compatible with
espeak.
120
APPENDIX A. CHANGES TO PACKAGES
121
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
glibc glibc, glibc-all- RHEL 8.0 The non-core NSS modules for NIS and other
langpacks, glibc- data sources have been split into separate
locale-source, glibc- packages ( nss_db, libnsl ). The language
minimal-langpack, support has been split into language pack
libnsl, libxcrypt, support (glibc-all-langpacks, glibc-
nss_db minimal-langpack, glibc-locale-source,
and the glibc-langpack-* modules). The
libxcrypt package is distinct.
122
APPENDIX A. CHANGES TO PACKAGES
123
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
124
APPENDIX A. CHANGES TO PACKAGES
125
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
126
APPENDIX A. CHANGES TO PACKAGES
127
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
libssh2 libssh, libssh2 RHEL 8.0 The libssh2 package was temporarily
available in RHEL 8.0 due to a qemu-kvm
dependency. Starting with RHEL 8.1, the
QEMU emulator uses the libssh library
instead, and libssh2 has been removed.
128
APPENDIX A. CHANGES TO PACKAGES
129
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
mod_wsgi python3-mod_wsgi RHEL 8.0 The mod_wsgi module for the Apache
HTTP Server has been updated to Python 3.
WSGI applications are now supported only
with Python 3, and must be migrated from
Python 2.
130
APPENDIX A. CHANGES TO PACKAGES
ntp chrony, ntpstat RHEL 8.0 For details, see Using the Chrony suite to
configure NTP.
131
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
132
APPENDIX A. CHANGES TO PACKAGES
pcre pcre, pcre-cpp, RHEL 8.0 The PCRE libpcrecpp.so.0 library with C++
pcre-utf16, pcre- API has been moved from the pcre package
utf32 to pcre-cpp package. The libpcre16.so.0
library with UTF-16 support has been moved
from the pcre package to the pcre-utf16
package, and the libpcre32.so.0 library with
UTF-32 support has been moved to the
pcre-utf32 package.
133
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
perl perl, perl-Attribute- RHEL 8.0 In RHEL 8, the package providing the Perl
Handlers, perl-B- interpreter has been renamed from perl to
Debug, perl- perl-interpreter, while the perl package is
bignum, perl- now just a meta-package. Basic language
bignum, perl-Devel- support modules have been moved to perl-
Peek, perl-Devel- libs, and a number of other modules
PPPort, perl-Devel- previously bundled in perl are now
SelfStubber, perl- distributed as separate packages.
Errno, perl-ExtUtils-
Command, perl-
ExtUtils-Miniperl,
perl-Filter-Simple,
perl-interpreter,
perl-IO, perl-IPC-
SysV, perl-libs, perl-
Math-BigInt, perl-
Math-BigInt-
FastCalc, perl-
Math-BigRat, perl-
Math-Complex,
perl-Memoize, perl-
MIME-Base64, perl-
Net-Ping, perl-
open, perl-perlfaq,
perl-PerlIO-via-
QuotedPrint, perl-
Pod-Html, perl-
SelfLoader, perl-
Term-ANSIColor,
perl-Term-Cap,
perl-Test, perl-
Text-Balanced,
perl-Unicode-
Collate, perl-
Unicode-Normalize
134
APPENDIX A. CHANGES TO PACKAGES
php-mysql php-mysqlnd RHEL 8.0 The php-mysql package, which uses the
libmysqlclient library, has been replaced by
the php-mysqlnd package, which uses the
MySQL Native Driver.
135
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
136
APPENDIX A. CHANGES TO PACKAGES
137
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
138
APPENDIX A. CHANGES TO PACKAGES
139
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
140
APPENDIX A. CHANGES TO PACKAGES
141
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
142
APPENDIX A. CHANGES TO PACKAGES
143
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
144
APPENDIX A. CHANGES TO PACKAGES
quota quota, quota-rpc RHEL 8.0 The rpc.rquotad daemon has been moved
from the quota RPM package to quota-rpc .
To use disk quota limits on your NFS server
and to have the limits readable or settable
from other machines, install the quota-rpc
package, and enable and start the rpc-
rquotad.service systemd service.
145
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
146
APPENDIX A. CHANGES TO PACKAGES
147
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
148
APPENDIX A. CHANGES TO PACKAGES
149
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
150
APPENDIX A. CHANGES TO PACKAGES
151
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
152
APPENDIX A. CHANGES TO PACKAGES
153
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
154
APPENDIX A. CHANGES TO PACKAGES
155
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
156
APPENDIX A. CHANGES TO PACKAGES
157
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
158
APPENDIX A. CHANGES TO PACKAGES
159
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
160
APPENDIX A. CHANGES TO PACKAGES
161
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
162
APPENDIX A. CHANGES TO PACKAGES
163
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
164
APPENDIX A. CHANGES TO PACKAGES
165
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
166
APPENDIX A. CHANGES TO PACKAGES
167
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
168
APPENDIX A. CHANGES TO PACKAGES
169
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
170
APPENDIX A. CHANGES TO PACKAGES
171
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
172
APPENDIX A. CHANGES TO PACKAGES
yum-metadata- python3-dnf RHEL 8.0 Users should now use the DNF API (queries,
parser package objects, and others) to work with the
repodata content.
yum-plugin-auto- dnf-plugins-core RHEL 8.0 All these plug-ins are now part of the dnf-
update-debug-info, plugins-core package but are still
yum-plugin- installable under the original names.
changelog, yum-
plugin-copr
yum-plugin- python3-dnf- RHEL 8.0 Still installable under the original name.
versionlock plugin-versionlock
For a complete list of packages available in the current minor RHEL 8 release, see the Package manifest.
173
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
174
APPENDIX A. CHANGES TO PACKAGES
For a complete list of packages available in the current minor RHEL 8 release, see the Package manifest.
Package Note
a2ps The a2ps package has been removed. Theenscript package can cover
some its functionality. Users can configure enscript in the
/etc/enscript.cfg file.
abrt-addon-upload-watch
abrt-devel
abrt-gui-devel
abrt-retrace-client
acpid-sysvinit
advancecomp
adwaita-icon-theme-devel
adwaita-qt-common
adwaita-qt4
agg
agg-devel
aic94xx-firmware
akonadi
akonadi-devel
akonadi-mysql
alacarte
alsa-tools
anaconda-widgets-devel
175
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
ant-antunit
ant-antunit-javadoc
antlr-C++-doc
antlr-python
apache-commons-
configuration
apache-commons-
configuration-javadoc
apache-commons-daemon
apache-commons-daemon-
javadoc
apache-commons-daemon-
jsvc
apache-commons-dbcp
apache-commons-dbcp-
javadoc
apache-commons-digester
apache-commons-digester-
javadoc
apache-commons-jexl
apache-commons-jexl-
javadoc
apache-commons-pool
apache-commons-pool-
javadoc
apache-commons-validator
176
APPENDIX A. CHANGES TO PACKAGES
Package Note
apache-commons-validator-
javadoc
apache-commons-vfs
apache-commons-vfs-ant
apache-commons-vfs-
examples
apache-commons-vfs-
javadoc
apache-rat
apache-rat-core
apache-rat-javadoc
apache-rat-plugin
apache-rat-tasks
args4j
args4j-javadoc
ark
ark-libs
asciidoc-latex
at-spi
at-spi-devel
at-spi-python
at-sysvinit
177
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
atlas-static
attica
attica-devel
audiocd-kio
audiocd-kio-devel
audiocd-kio-libs
audiofile
audiofile-devel
audit-libs-python
audit-libs-static
authconfig-gtk
authd
autogen-libopts-devel
automoc
autotrace-devel
avahi-dnsconfd
avahi-glib-devel
avahi-gobject-devel
avahi-qt3
avahi-qt3-devel
avahi-qt4
avahi-qt4-devel
avahi-tools
178
APPENDIX A. CHANGES TO PACKAGES
Package Note
avahi-ui
avahi-ui-devel
avahi-ui-tools
avalon-framework
avalon-framework-javadoc
avalon-logkit
avalon-logkit-javadoc
bacula-console-bat
bacula-devel
bacula-traymonitor
baekmuk-ttf-batang-fonts
baekmuk-ttf-dotum-fonts
baekmuk-ttf-fonts-common
baekmuk-ttf-fonts-
ghostscript
baekmuk-ttf-gulim-fonts
baekmuk-ttf-hline-fonts
base64coder
base64coder-javadoc
batik
batik-demo
batik-javadoc
batik-rasterizer
179
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
batik-slideshow
batik-squiggle
batik-svgpp
batik-ttf2svg
bcc-devel
bison-devel
blas-static
blas64-devel
blas64-static
bltk
bluedevil
bluedevil-autostart
bmc-snmp-proxy
bogofilter-bogoupgrade
bridge-utils
bsdcpio
bsh-demo
bsh-utils
btrfs-progs
btrfs-progs-devel
buildnumber-maven-plugin
buildnumber-maven-plugin-
javadoc
180
APPENDIX A. CHANGES TO PACKAGES
Package Note
bwidget
bzr
bzr-doc
cairo-tools
caribou
caribou-antler
caribou-devel
caribou-gtk2-module
caribou-gtk3-module
cdparanoia-static
cdrskin
ceph-common
check-static
cheese-libs-devel
cifs-utils-devel
cim-schema-docs
cim-schema-docs
cjkuni-ukai-fonts
clutter-gst2-devel
clutter-tests
cmpi-bindings-pywbem
cobertura
cobertura-javadoc
181
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
cockpit-machines-ovirt
codehaus-parent
codemodel-javadoc
cogl-tests
colord-extra-profiles
colord-kde
compat-cheese314
compat-dapl
compat-dapl-devel
compat-dapl-static
compat-dapl-utils
compat-db
compat-db-headers
compat-db47
compat-exiv2-023
compat-gcc-44
compat-gcc-44-c++
compat-gcc-44-gfortran
compat-glade315
compat-glew
compat-glibc
compat-glibc-headers
compat-gnome-desktop314
182
APPENDIX A. CHANGES TO PACKAGES
Package Note
compat-grilo02
compat-libcap1
compat-libcogl-pango12
compat-libcogl12
compat-libcolord1
compat-libf2c-34
compat-libgdata13
compat-libgfortran-41
compat-libgnome-bluetooth11
compat-libgnome-desktop3-
7
compat-libgweather3
compat-libical1
compat-libmediaart0
compat-libmpc
compat-libpackagekit-glib2-
16
compat-libstdc++-33
compat-libtiff3
compat-libupower-glib1
compat-libxcb
compat-openldap
compat-openmpi16
compat-openmpi16-devel
183
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
compat-opensm-libs
compat-poppler022
compat-poppler022-cpp
compat-poppler022-glib
compat-poppler022-qt
compat-sap-c++-5
compat-sap-c++-6
compat-sap-c++-7
comps-extras
conman
console-setup
coolkey-devel
cpptest
cpptest-devel
cppunit
cppunit-devel
cppunit-doc
cpuid
cracklib-python
crda-devel
crit
criu-devel
184
APPENDIX A. CHANGES TO PACKAGES
Package Note
crypto-utils
cryptsetup-python
cvs Version control system supported in RHEL 8 are Git, Mercurial, and
Subversion.
cvs-contrib Version control system supported in RHEL 8 are Git, Mercurial, and
Subversion.
cvs-doc Version control system supported in RHEL 8 are Git, Mercurial, and
Subversion.
cvs-inetd Version control system supported in RHEL 8 are Git, Mercurial, and
Subversion.
cvsps
cyrus-imapd-devel
dapl
dapl-devel
dapl-static
dapl-utils
dbus-doc
dbus-python-devel
dbus-tests
dbusmenu-qt
dbusmenu-qt-devel
dbusmenu-qt-devel-docs
debugmode
dejavu-lgc-sans-fonts
dejavu-lgc-sans-mono-fonts
185
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
dejavu-lgc-serif-fonts
deltaiso
device-mapper-multipath-
sysvinit
dhcp-devel
dialog-devel
dleyna-connector-dbus-devel
dleyna-core-devel
dlm-devel
dmraid Users requiring support for combined hardware and software RAID host bus
adapters (HBA) should use the mdadm utility.
dmraid-devel
dmraid-events
dmraid-events-logwatch
docbook-simple
docbook-slides
docbook-utils-pdf
docbook5-style-xsl
docbook5-style-xsl-
extensions
docker-rhel-push-plugin
dom4j
dom4j-demo
dom4j-javadoc
186
APPENDIX A. CHANGES TO PACKAGES
Package Note
dom4j-manual
dovecot-pigeonhole
dracut-fips-aesni
dragon
drm-utils
drpmsync
dtdinst
dumpet
dvgrab
e2fsprogs-static
ecj
edac-utils-devel
efax
efivar-devel
egl-utils
ekiga
ElectricFence
emacs-a2ps
emacs-a2ps-el
emacs-auctex
emacs-auctex-doc
187
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
emacs-git
emacs-git-el
emacs-gnuplot
emacs-gnuplot-el
emacs-php-mode
empathy Instant messaging clients supported in RHEL 8 are hexchat and pidgin.
enchant-aspell
enchant-voikko
eog-devel
epydoc
espeak-devel
evince-devel
evince-dvi
evolution-data-server-doc
evolution-data-server-perl
evolution-data-server-tests
evolution-devel
evolution-devel-docs
evolution-tests
expat-static The expat-static package providing a static library for the expat XML
library is no longer provided. Use dynamic linking instead.
expect-devel
expectk
188
APPENDIX A. CHANGES TO PACKAGES
Package Note
farstream
farstream-devel
farstream-python
farstream02-devel
fedfs-utils-admin
fedfs-utils-client
fedfs-utils-common
fedfs-utils-devel
fedfs-utils-lib
fedfs-utils-nsdbparams
fedfs-utils-python
fedfs-utils-server
felix-bundlerepository
felix-bundlerepository-
javadoc
felix-framework
felix-framework-javadoc
felix-osgi-obr
felix-osgi-obr-javadoc
felix-shell
felix-shell-javadoc
fence-sanlock
festival
189
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
festival-devel
festival-docs
festival-freebsoft-utils
festival-lib
festival-speechtools-devel
festival-speechtools-libs
festival-speechtools-utils
festvox-awb-arctic-hts
festvox-bdl-arctic-hts
festvox-clb-arctic-hts
festvox-jmk-arctic-hts
festvox-kal-diphone
festvox-ked-diphone
festvox-rms-arctic-hts
festvox-slt-arctic-hts
file-static
filebench
filesystem-content
finch
finch-devel
finger Users of the finger client/server can use the who, pinky , and last
commands. For remote machines, use these commands with SSH.
finger-server
190
APPENDIX A. CHANGES TO PACKAGES
Package Note
flatpak-devel
fltk-fluid
fltk-static
flute-javadoc
folks
folks-devel
folks-tools
fontforge-devel
fontpackages-tools
fonttools
fop
fop-javadoc
fprintd-devel
freeradius-python
freetype-demos
fros
fros-gnome
fros-recordmydesktop
fuseiso
fwupd-devel
fwupdate-devel
gamin-python
gavl-devel
191
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
gcab
gcc-gnat
gcc-go
gcc-objc
gcc-objc++
gcc-plugin-devel
gconf-editor
gd-progs
gdk-pixbuf2-tests
gdm-devel
gdm-pam-extensions-devel
gedit-devel
gedit-plugin-bookmarks
gedit-plugin-
bracketcompletion
gedit-plugin-charmap
gedit-plugin-codecomment
gedit-plugin-colorpicker
gedit-plugin-colorschemer
gedit-plugin-commander
gedit-plugin-drawspaces
gedit-plugin-findinfiles
gedit-plugin-joinlines
192
APPENDIX A. CHANGES TO PACKAGES
Package Note
gedit-plugin-multiedit
gedit-plugin-smartspaces
gedit-plugin-synctex
gedit-plugin-terminal
gedit-plugin-textsize
gedit-plugin-translate
gedit-plugin-wordcompletion
gedit-plugins
gedit-plugins-data
gegl-devel
geoclue
geoclue-devel
geoclue-doc
geoclue-gsmloc
geoclue-gui
GeoIP The GeoIp package is capable of working only with legacy databases. A
replacement provided in RHEL 8 is the new libmaxminddb package,
together with the geoipupdate package. This is a new API created by the
upstream GeoIP project and it supports new format of databases, mmdb.
GeoIP-data
GeoIP-devel
GeoIP-update
geronimo-jaspic-spec
geronimo-jaspic-spec-
javadoc
193
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
geronimo-jaxrpc
geronimo-jaxrpc-javadoc
geronimo-jta
geronimo-jta-javadoc
geronimo-osgi-support
geronimo-osgi-support-
javadoc
geronimo-saaj
geronimo-saaj-javadoc
ghostscript-chinese
ghostscript-chinese-zh_CN
ghostscript-chinese-zh_TW
ghostscript-cups
ghostscript-gtk
giflib-utils
gimp-data-extras
gimp-help
gimp-help-ca
gimp-help-da
gimp-help-de
gimp-help-el
gimp-help-en_GB
gimp-help-es
194
APPENDIX A. CHANGES TO PACKAGES
Package Note
gimp-help-fr
gimp-help-it
gimp-help-ja
gimp-help-ko
gimp-help-nl
gimp-help-nn
gimp-help-pt_BR
gimp-help-ru
gimp-help-sl
gimp-help-sv
gimp-help-zh_CN
git-bzr
git-cvs
git-gnome-keyring
git-hg
git-p4
gjs-tests
glade
glade3
glade3-libgladeui
glade3-libgladeui-devel
glassfish-dtd-parser
glassfish-dtd-parser-javadoc
195
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
glassfish-jaxb-javadoc
glassfish-jsp
glassfish-jsp-javadoc
glew
glib-networking-tests
gmp-static
gnome-clocks
gnome-contacts
gnome-desktop3-tests
gnome-devel-docs
gnome-dictionary
gnome-doc-utils
gnome-doc-utils-stylesheets
gnome-documents
gnome-documents-libs
gnome-icon-theme
gnome-icon-theme-devel
gnome-icon-theme-extras
gnome-icon-theme-legacy
gnome-icon-theme-symbolic
gnome-packagekit
gnome-packagekit-common
gnome-packagekit-installer
196
APPENDIX A. CHANGES TO PACKAGES
Package Note
gnome-packagekit-updater
gnome-python2
gnome-python2-bonobo
gnome-python2-canvas
gnome-python2-devel
gnome-python2-gconf
gnome-python2-gnome
gnome-python2-gnomevfs
gnome-settings-daemon-
devel
gnome-software-devel
gnome-vfs2
gnome-vfs2-devel
gnome-vfs2-smb
gnome-weather
gnome-weather-tests
gnote
gnu-efi-utils
gnu-getopt
gnu-getopt-javadoc
gnuplot-latex
gnuplot-minimal
gob2
197
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
gom-devel
google-noto-sans-korean-
fonts
google-noto-sans-simplified-
chinese-fonts
google-noto-sans-traditional-
chinese-fonts
gperftools
gperftools-devel
gperftools-libs
gpm-static
grantlee
grantlee-apidocs
grantlee-devel
graphviz-graphs
graphviz-guile
graphviz-java
graphviz-lua
graphviz-ocaml
graphviz-perl
graphviz-php
graphviz-python
graphviz-ruby
graphviz-tcl
198
APPENDIX A. CHANGES TO PACKAGES
Package Note
groff-doc
groff-perl
groff-x11
groovy
groovy-javadoc
grub2
grub2-ppc-modules
grub2-ppc64-modules
gsm-tools
gsound-devel
gssdp-utils
gstreamer
gstreamer-devel
gstreamer-devel-docs
gstreamer-plugins-bad-free
gstreamer-plugins-bad-free-
devel
gstreamer-plugins-bad-free-
devel-docs
gstreamer-plugins-base
gstreamer-plugins-base-devel
gstreamer-plugins-base-
devel-docs
gstreamer-plugins-base-tools
199
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
gstreamer-plugins-good
gstreamer-plugins-good-
devel-docs
gstreamer-python
gstreamer-python-devel
gstreamer-tools
gstreamer1-devel-docs
gstreamer1-plugins-base-
devel-docs
gstreamer1-plugins-base-
tools
gstreamer1-plugins-ugly-free-
devel
gtk-vnc
gtk-vnc-devel
gtk-vnc-python
gtk-vnc2-devel
gtk3-devel-docs
gtk3-immodules
gtk3-tests
gtkhtml3
gtkhtml3-devel
gtksourceview3-tests
gucharmap
gucharmap-devel
200
APPENDIX A. CHANGES TO PACKAGES
Package Note
gucharmap-libs
gupnp-av-devel
gupnp-av-docs
gupnp-dlna-devel
gupnp-dlna-docs
gupnp-docs
gupnp-igd-python
gutenprint-devel
gutenprint-extras
gutenprint-foomatic
gvfs-tests
gvnc-devel
gvnc-tools
gvncpulse
gvncpulse-devel
gwenview
gwenview-libs
hawkey-devel
highcontrast-qt
highcontrast-qt4
highcontrast-qt5
highlight-gui
201
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
hispavoces-pal-diphone
hispavoces-sfl-diphone
hsakmt
hsakmt-devel
hspell-devel
hsqldb
hsqldb-demo
hsqldb-javadoc
hsqldb-manual
htdig
html2ps
http-parser-devel
httpunit
httpunit-doc
httpunit-javadoc
i2c-tools-eepromer
i2c-tools-python
ibus-pygtk2
ibus-qt
ibus-qt-devel
ibus-qt-docs
ibus-rawcode
202
APPENDIX A. CHANGES TO PACKAGES
Package Note
ibus-table-devel
ibutils
ibutils-devel
ibutils-libs
icc-profiles-openicc
icon-naming-utils
im-chooser
im-chooser-common
ImageMagick
ImageMagick-c++
ImageMagick-c++-devel
ImageMagick-devel
ImageMagick-doc
ImageMagick-perl
imsettings
imsettings-devel
imsettings-gsettings
imsettings-libs
imsettings-qt
imsettings-xim
indent
infinipath-psm
203
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
infinipath-psm-devel
iniparser
iniparser-devel
iok
ipa-gothic-fonts
ipa-mincho-fonts
ipa-pgothic-fonts
ipa-pmincho-fonts
iperf3-devel
iproute-doc
ipset-devel
ipsilon
ipsilon-authform
ipsilon-authgssapi
ipsilon-authldap
ipsilon-base
ipsilon-client
ipsilon-filesystem
ipsilon-infosssd
ipsilon-persona
ipsilon-saml2
ipsilon-saml2-base
ipsilon-tools-ipa
204
APPENDIX A. CHANGES TO PACKAGES
Package Note
iputils-sysvinit
iscsi-initiator-utils-devel
isdn4k-utils
isdn4k-utils-devel
isdn4k-utils-doc
isdn4k-utils-static
isdn4k-utils-vboxgetty
isomd5sum-devel
istack-commons-javadoc
ixpdimm-cli
ixpdimm-monitor
ixpdimm_sw
ixpdimm_sw-devel
jai-imageio-core
jai-imageio-core-javadoc
jakarta-taglibs-standard
jakarta-taglibs-standard-
javadoc
jandex
jandex-javadoc
jansson-devel-doc
jarjar
jarjar-javadoc
205
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
jarjar-maven-plugin
jasper
jasper-utils
java-1.6.0-openjdk
java-1.6.0-openjdk-demo
java-1.6.0-openjdk-devel
java-1.6.0-openjdk-javadoc
java-1.6.0-openjdk-src
java-1.7.0-openjdk
java-1.7.0-openjdk-
accessibility
java-1.7.0-openjdk-demo
java-1.7.0-openjdk-devel
java-1.7.0-openjdk-headless
java-1.7.0-openjdk-javadoc
java-1.7.0-openjdk-src
java-1.8.0-openjdk-
accessibility-debug
java-1.8.0-openjdk-debug
java-1.8.0-openjdk-demo-
debug
java-1.8.0-openjdk-devel-
debug
java-1.8.0-openjdk-headless-
debug
206
APPENDIX A. CHANGES TO PACKAGES
Package Note
java-1.8.0-openjdk-javadoc-
debug
java-1.8.0-openjdk-javadoc-
zip-debug
java-1.8.0-openjdk-src-debug
java-11-openjdk-debug
java-11-openjdk-demo-debug
java-11-openjdk-devel-debug
java-11-openjdk-headless-
debug
java-11-openjdk-javadoc-
debug
java-11-openjdk-javadoc-zip-
debug
java-11-openjdk-jmods-debug
java-11-openjdk-src-debug
jboss-ejb-3.1-api
jboss-ejb-3.1-api-javadoc
jboss-el-2.2-api
jboss-el-2.2-api-javadoc
jboss-jaxrpc-1.1-api
jboss-jaxrpc-1.1-api-javadoc
jboss-servlet-2.5-api
jboss-servlet-2.5-api-javadoc
jboss-servlet-3.0-api
207
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
jboss-servlet-3.0-api-javadoc
jboss-specs-parent
jboss-transaction-1.1-api
jboss-transaction-1.1-api-
javadoc
jettison
jettison-javadoc
jetty-annotations
jetty-ant
jetty-artifact-remote-
resources
jetty-assembly-descriptors
jetty-build-support
jetty-build-support-javadoc
jetty-client
jetty-continuation
jetty-deploy
jetty-distribution-remote-
resources
jetty-http
jetty-io
jetty-jaas
jetty-jaspi
jetty-javadoc
208
APPENDIX A. CHANGES TO PACKAGES
Package Note
jetty-jmx
jetty-jndi
jetty-jsp
jetty-jspc-maven-plugin
jetty-maven-plugin
jetty-monitor
jetty-parent
jetty-plus
jetty-project
jetty-proxy
jetty-rewrite
jetty-runner
jetty-security
jetty-server
jetty-servlet
jetty-servlets
jetty-start
jetty-test-policy
jetty-test-policy-javadoc
jetty-toolchain
jetty-util
jetty-util-ajax
jetty-version-maven-plugin
209
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
jetty-version-maven-plugin-
javadoc
jetty-webapp
jetty-websocket-api
jetty-websocket-client
jetty-websocket-common
jetty-websocket-parent
jetty-websocket-server
jetty-websocket-servlet
jetty-xml
jing
jing-javadoc
jline-demo
jna-contrib
jna-javadoc
joda-convert
joda-convert-javadoc
js
js-devel
jsch-demo
json-glib-tests
jsr-311
jsr-311-javadoc
210
APPENDIX A. CHANGES TO PACKAGES
Package Note
juk
junit-demo
k3b
k3b-common
k3b-devel
k3b-libs
kaccessible
kaccessible-libs
kactivities
kactivities-devel
kamera
kate
kate-devel
kate-libs
kate-part
kcalc
kcharselect
kcm-gtk
kcm_colors
kcm_touchpad
kcolorchooser
kcoloredit
kde-base-artwork
211
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
kde-baseapps
kde-baseapps-devel
kde-baseapps-libs
kde-filesystem
kde-l10n
kde-l10n-Arabic
kde-l10n-Basque
kde-l10n-Bosnian
kde-l10n-British
kde-l10n-Bulgarian
kde-l10n-Catalan
kde-l10n-Catalan-Valencian
kde-l10n-Croatian
kde-l10n-Czech
kde-l10n-Danish
kde-l10n-Dutch
kde-l10n-Estonian
kde-l10n-Farsi
kde-l10n-Finnish
kde-l10n-Galician
kde-l10n-Greek
kde-l10n-Hebrew
kde-l10n-Hungarian
212
APPENDIX A. CHANGES TO PACKAGES
Package Note
kde-l10n-Icelandic
kde-l10n-Interlingua
kde-l10n-Irish
kde-l10n-Kazakh
kde-l10n-Khmer
kde-l10n-Latvian
kde-l10n-Lithuanian
kde-l10n-LowSaxon
kde-l10n-Norwegian
kde-l10n-Norwegian-Nynorsk
kde-l10n-Polish
kde-l10n-Portuguese
kde-l10n-Romanian
kde-l10n-Serbian
kde-l10n-Slovak
kde-l10n-Slovenian
kde-l10n-Swedish
kde-l10n-Tajik
kde-l10n-Thai
kde-l10n-Turkish
kde-l10n-Ukrainian
kde-l10n-Uyghur
kde-l10n-Vietnamese
213
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
kde-l10n-Walloon
kde-plasma-
networkmanagement
kde-plasma-
networkmanagement-
libreswan
kde-plasma-
networkmanagement-libs
kde-plasma-
networkmanagement-mobile
kde-print-manager
kde-runtime
kde-runtime-devel
kde-runtime-drkonqi
kde-runtime-libs
kde-settings
kde-settings-ksplash
kde-settings-minimal
kde-settings-plasma
kde-settings-pulseaudio
kde-style-oxygen
kde-style-phase
kde-wallpapers
kde-workspace
kde-workspace-devel
214
APPENDIX A. CHANGES TO PACKAGES
Package Note
kde-workspace-ksplash-
themes
kde-workspace-libs
kdeaccessibility
kdeadmin
kdeartwork
kdeartwork-screensavers
kdeartwork-sounds
kdeartwork-wallpapers
kdeclassic-cursor-theme
kdegraphics
kdegraphics-devel
kdegraphics-libs
kdegraphics-strigi-analyzer
kdegraphics-thumbnailers
kdelibs
kdelibs-apidocs
kdelibs-common
kdelibs-devel
kdelibs-ktexteditor
kdemultimedia
kdemultimedia-common
kdemultimedia-devel
215
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
kdemultimedia-libs
kdenetwork
kdenetwork-common
kdenetwork-devel
kdenetwork-fileshare-samba
kdenetwork-kdnssd
kdenetwork-kget
kdenetwork-kget-libs
kdenetwork-kopete
kdenetwork-kopete-devel
kdenetwork-kopete-libs
kdenetwork-krdc
kdenetwork-krdc-devel
kdenetwork-krdc-libs
kdenetwork-krfb
kdenetwork-krfb-libs
kdepim
kdepim-devel
kdepim-libs
kdepim-runtime
kdepim-runtime-libs
kdepimlibs
216
APPENDIX A. CHANGES TO PACKAGES
Package Note
kdepimlibs-akonadi
kdepimlibs-apidocs
kdepimlibs-devel
kdepimlibs-kxmlrpcclient
kdeplasma-addons
kdeplasma-addons-devel
kdeplasma-addons-libs
kdesdk
kdesdk-cervisia
kdesdk-common
kdesdk-devel
kdesdk-dolphin-plugins
kdesdk-kapptemplate
kdesdk-kapptemplate-
template
kdesdk-kcachegrind
kdesdk-kioslave
kdesdk-kmtrace
kdesdk-kmtrace-devel
kdesdk-kmtrace-libs
kdesdk-kompare
kdesdk-kompare-devel
kdesdk-kompare-libs
217
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
kdesdk-kpartloader
kdesdk-kstartperf
kdesdk-kuiviewer
kdesdk-lokalize
kdesdk-okteta
kdesdk-okteta-devel
kdesdk-okteta-libs
kdesdk-poxml
kdesdk-scripts
kdesdk-strigi-analyzer
kdesdk-thumbnailers
kdesdk-umbrello
kdeutils
kdeutils-common
kdeutils-minimal
kdf
kernel-rt-doc
kernel-rt-trace
kernel-rt-trace-devel
kernel-rt-trace-kvm
keytool-maven-plugin
keytool-maven-plugin-
javadoc
218
APPENDIX A. CHANGES TO PACKAGES
Package Note
kgamma
kgpg
kgreeter-plugins
khotkeys
khotkeys-libs
kiconedit
kinfocenter
kio_sysinfo
kmag
kmenuedit
kmix
kmod-oracleasm
kolourpaint
kolourpaint-libs
konkretcmpi
konkretcmpi-devel
konkretcmpi-python
konsole
konsole-part
kross-interpreters
kross-python
kross-ruby
kruler
219
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
ksaneplugin
kscreen
ksnapshot
ksshaskpass
ksysguard
ksysguard-libs
ksysguardd
ktimer
kwallet
kwin
kwin-gles
kwin-gles-libs
kwin-libs
kwrite
kxml
kxml-javadoc
lapack64-devel
lapack64-static
lasso-devel
latencytop
latencytop-common
latencytop-tui
latrace
220
APPENDIX A. CHANGES TO PACKAGES
Package Note
lcms2-utils
ldns-doc
ldns-python
libabw-devel
libabw-doc
libabw-tools
libappindicator
libappindicator-devel
libappindicator-docs
libappstream-glib-builder
libappstream-glib-builder-
devel
libart_lgpl
libart_lgpl-devel
libasan-static
libavc1394-devel
libbase-javadoc
libblockdev-btrfs
libblockdev-btrfs-devel
libblockdev-crypto-devel
libblockdev-devel
libblockdev-dm-devel
libblockdev-fs-devel
221
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libblockdev-kbd-devel
libblockdev-loop-devel
libblockdev-lvm-devel
libblockdev-mdraid-devel
libblockdev-mpath-devel
libblockdev-nvdimm-devel
libblockdev-part-devel
libblockdev-swap-devel
libblockdev-utils-devel
libblockdev-vdo-devel
libbluedevil
libbluedevil-devel
libbluray-devel
libbonobo
libbonobo-devel
libbonoboui
libbonoboui-devel
libbytesize-devel
libcacard-tools
libcap-ng-python
libcdr-devel
libcdr-doc
libcdr-tools
222
APPENDIX A. CHANGES TO PACKAGES
Package Note
libcgroup-devel
libchamplain-demos
libchewing
libchewing-devel
libchewing-python
libcmis-devel
libcmis-tools
libcmpiutil
libcmpiutil-devel
libcryptui
libcryptui-devel
libdb-devel-static
libdb-java
libdb-java-devel
libdb-tcl
libdb-tcl-devel
libdbi
libdbi-dbd-mysql
libdbi-dbd-pgsql
libdbi-dbd-sqlite
libdbi-devel
libdbi-drivers
223
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libdbusmenu-gtk2
libdbusmenu-gtk2-devel
libdhash-devel
libdmapsharing-devel
libdmmp-devel
libdmx-devel
libdnet-progs
libdnet-python
libdnf-devel
libdv-tools
libdvdnav-devel
libeasyfc-devel
libeasyfc-gobject-devel
libee
libee-devel
libee-utils
libesmtp
libesmtp-devel
libestr-devel
libetonyek-doc
libetonyek-tools
libevdev-utils
224
APPENDIX A. CHANGES TO PACKAGES
Package Note
libexif-doc
libexttextcat-devel
libexttextcat-tools
libfastjson-devel
libfonts-javadoc
libformula-javadoc
libfprint-devel
libfreehand-devel
libfreehand-doc
libfreehand-tools
libgcab1-devel
libgccjit
libgdither-devel
libgee06
libgee06-devel
libgepub
libgepub-devel
libgfortran-static
libgfortran4
libgfortran5
libglade2
libglade2-devel
libGLEWmx
225
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libgnat
libgnat-devel
libgnat-static
libgnome
libgnome-devel
libgnome-keyring-devel
libgnomecanvas
libgnomecanvas-devel
libgnomeui
libgnomeui-devel
libgo
libgo-devel
libgo-static
libgovirt-devel
libgxim
libgxim-devel
libgxps-tools
libhangul-devel
libhbaapi-devel
libhif-devel
libibcommon
libibcommon-devel
libibcommon-static
226
APPENDIX A. CHANGES TO PACKAGES
Package Note
libical-glib
libical-glib-devel
libical-glib-doc
libid3tag
libid3tag-devel
libiec61883-utils
libieee1284-python
libimobiledevice-python
libimobiledevice-utils
libindicator
libindicator-devel
libindicator-tools
libinvm-cim
libinvm-cim-devel
libinvm-cli
libinvm-cli-devel
libinvm-i18n
libinvm-i18n-devel
libiodbc
libiodbc-devel
libipa_hbac-devel
libiptcdata-devel
libiptcdata-python
227
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libitm-static
libixpdimm-cim
libixpdimm-core
libjpeg-turbo-static
libkcddb
libkcddb-devel
libkcompactdisc
libkcompactdisc-devel
libkdcraw
libkdcraw-devel
libkexiv2
libkexiv2-devel
libkipi
libkipi-devel
libkkc-devel
libkkc-tools
libksane
libksane-devel
libkscreen
libkscreen-devel
libkworkspace
liblayout-javadoc
libloader-javadoc
228
APPENDIX A. CHANGES TO PACKAGES
Package Note
liblognorm-devel
liblouis-devel
liblouis-doc
liblouis-utils
libmatchbox-devel
libmbim-devel
libmediaart-devel
libmediaart-tests
libmnl-static
libmodman-devel
libmpc-devel
libmsn
libmsn-devel
libmspub-devel
libmspub-doc
libmspub-tools
libmtp-examples
libmudflap
libmudflap-devel
libmudflap-static
libmwaw-devel
libmwaw-doc
libmwaw-tools
229
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libmx
libmx-devel
libmx-docs
libndp-devel
libnetfilter_cthelper-devel
libnetfilter_cttimeout-devel
libnftnl-devel
libnl
libnl-devel
libnm-gtk
libnm-gtk-devel
libntlm
libntlm-devel
libobjc
libodfgen-doc
libofa
libofa-devel
liboil
liboil-devel
libopenraw-pixbuf-loader
liborcus-devel
liborcus-doc
liborcus-tools
230
APPENDIX A. CHANGES TO PACKAGES
Package Note
libosinfo-devel
libosinfo-vala
libotf-devel
libpagemaker-devel
libpagemaker-doc
libpagemaker-tools
libpinyin-devel
libpinyin-tools
libpipeline-devel
libplist-python
libpmemcto
libpmemcto-debug
libpmemcto-devel
libpmemobj++-devel
libpng-static
libpng12-devel
libproxy-kde
libpst
libpst-devel
libpst-devel-doc
libpst-doc
libpst-python
libpurple-perl
231
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libpurple-tcl
libqmi-devel
libquadmath-static
LibRaw-static
librelp-devel
libreoffice
libreoffice-bsh
libreoffice-gdb-debug-
support
libreoffice-glade
libreoffice-librelogo
libreoffice-nlpsolver
libreoffice-officebean
libreoffice-officebean-
common
libreoffice-postgresql
libreoffice-rhino
libreofficekit-devel
librepo-devel
libreport-compat
libreport-devel
libreport-gtk-devel
libreport-web-devel
librepository-javadoc
232
APPENDIX A. CHANGES TO PACKAGES
Package Note
librevenge-doc
librhsm-devel
librsvg2-tools
libselinux-static
libsemanage-devel
libsemanage-static
libserializer-javadoc
libsexy
libsexy-devel
libsmbios-devel
libsmi-devel
libsndfile-utils
libsolv-demo
libsolv-devel
libsolv-tools
libspiro-devel
libss-devel
libssh2 The libssh2 package was temporarily available in RHEL 8.0 due to a
qemu-kvm dependency. Starting with RHEL 8.1, the QEMU emulator uses
the libssh library instead, and libssh2 has been removed.
libssh2-devel
libsss_certmap-devel
libsss_idmap-devel
libsss_simpleifp-devel
233
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libstaroffice-devel
libstaroffice-doc
libstaroffice-tools
libstdc++-static
libstoragemgmt-devel
libstoragemgmt-targetd-
plugin
libtar-devel
libteam-devel
libtheora-devel-docs
libtiff-static
libtimezonemap-devel
libtnc
libtnc-devel
libtranslit
libtranslit-devel
libtranslit-icu
libtranslit-m17n
libtsan-static
libudisks2-devel
libuninameslist-devel
libunwind
libunwind-devel
234
APPENDIX A. CHANGES TO PACKAGES
Package Note
libusal-devel
libusb-static
libusbmuxd-utils
libuser-devel
libusnic_verbs
libvdpau-docs
libverto-glib
libverto-glib-devel
libverto-libevent-devel
libverto-tevent
libverto-tevent-devel
libvirt-cim
libvirt-daemon-driver-lxc
libvirt-daemon-lxc
libvirt-gconfig-devel
libvirt-glib-devel
libvirt-gobject-devel
libvirt-java
libvirt-java-devel
libvirt-java-javadoc
libvirt-login-shell
libvirt-snmp
libvisio-doc
235
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
libvisio-tools
libvma-devel
libvma-utils
libvoikko-devel
libvpx-utils
libwebp-java
libwebp-tools
libwpd-tools
libwpg-tools
libwps-tools
libwsman-devel
libwvstreams
libwvstreams-devel
libwvstreams-static
libxcb-doc
libXevie
libXevie-devel
libXfont
libXfont-devel
libxml2-static
libxslt-python
libXvMC-devel
libzapojit
236
APPENDIX A. CHANGES TO PACKAGES
Package Note
libzapojit-devel
libzmf-devel
libzmf-doc
libzmf-tools
lldpad-devel
log4cxx
log4cxx-devel
log4j-manual
lpsolve-devel
lua-static
lvm2-cluster
lvm2-python-libs
lvm2-sysvinit
lz4-static
m17n-contrib
m17n-contrib-extras
m17n-db-devel
m17n-db-extras
m17n-lib-devel
m17n-lib-tools
m2crypto
malaga-devel
man-pages-cs
237
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
man-pages-es
man-pages-es-extra
man-pages-fr
man-pages-it
man-pages-ja
man-pages-ko
man-pages-pl
man-pages-ru
man-pages-zh-CN
mariadb-bench
marisa-devel
marisa-perl
marisa-python
marisa-ruby
marisa-tools
maven-changes-plugin
maven-changes-plugin-
javadoc
maven-deploy-plugin
maven-deploy-plugin-javadoc
maven-doxia-module-fo
maven-ear-plugin
maven-ear-plugin-javadoc
238
APPENDIX A. CHANGES TO PACKAGES
Package Note
maven-ejb-plugin
maven-ejb-plugin-javadoc
maven-error-diagnostics
maven-gpg-plugin
maven-gpg-plugin-javadoc
maven-istack-commons-
plugin
maven-jarsigner-plugin
maven-jarsigner-plugin-
javadoc
maven-javadoc-plugin
maven-javadoc-plugin-
javadoc
maven-jxr
maven-jxr-javadoc
maven-osgi
maven-osgi-javadoc
maven-plugin-jxr
maven-project-info-reports-
plugin
maven-project-info-reports-
plugin-javadoc
maven-release
maven-release-javadoc
maven-release-manager
239
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
maven-release-plugin
maven-reporting-exec
maven-repository-builder
maven-repository-builder-
javadoc
maven-scm
maven-scm-javadoc
maven-scm-test
maven-shared-jar
maven-shared-jar-javadoc
maven-site-plugin
maven-site-plugin-javadoc
maven-verifier-plugin
maven-verifier-plugin-javadoc
maven-wagon-provider-test
maven-wagon-scm
maven-war-plugin
maven-war-plugin-javadoc
mdds-devel
meanwhile-devel
meanwhile-doc
memcached-devel
memstomp
240
APPENDIX A. CHANGES TO PACKAGES
Package Note
mesa-demos
mesa-libxatracker-devel
mesa-private-llvm
mesa-private-llvm-devel
metacity-devel
mgetty Logins through a serial line can be done using agetty. Customers can use
other means for faxing (web faxing, multi-function printer, and others).
mgetty-sendfax
mgetty-viewfax
mgetty-voice
migrationtools
minizip
minizip-devel
mipv6-daemon
mkbootdisk
mobile-broadband-provider-
info-devel
mod_auth_mellon-diagnostics
mod_revocator
ModemManager-vala
mono-icon-theme
mozjs17
mozjs17-devel
241
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
mozjs24
mozjs24-devel
mpage
mpich-3.0-autoload
mpich-3.0-doc
mpich-3.2-autoload
mpich-3.2-doc
mpitests-compat-openmpi16
msv-demo
msv-msv
msv-rngconv
msv-xmlgen
mvapich2-2.0-devel
mvapich2-2.0-doc
mvapich2-2.0-psm-devel
mvapich2-2.2-devel
mvapich2-2.2-doc
mvapich2-2.2-psm-devel
mvapich2-2.2-psm2-devel
mvapich23-devel
mvapich23-doc
mvapich23-psm-devel
mvapich23-psm2-devel
242
APPENDIX A. CHANGES TO PACKAGES
Package Note
nagios-plugins-bacula
nasm-doc
nasm-rdoff
ncurses-static
nekohtml
nekohtml-demo
nekohtml-javadoc
nepomuk-core
nepomuk-core-devel
nepomuk-core-libs
nepomuk-widgets
nepomuk-widgets-devel
net-snmp-gui
net-snmp-perl
net-snmp-python
net-snmp-sysvinit
netsniff-ng
NetworkManager-glib
NetworkManager-glib-devel
newt-static
nfsometer
nfstest
nhn-nanum-brush-fonts
243
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
nhn-nanum-fonts-common
nhn-nanum-myeongjo-fonts
nhn-nanum-pen-fonts
nmap-frontend
nss-pem
nss-pkcs11-devel
nss_compat_ossl
nss_compat_ossl-devel
ntp-doc
ntp-perl
nuvola-icon-theme
nuxwdog
nuxwdog-client-java
nuxwdog-client-perl
nuxwdog-devel
obex-data-server
obexd
objectweb-anttask
objectweb-anttask-javadoc
ocaml-brlapi
ocaml-calendar
ocaml-calendar-devel
ocaml-csv
244
APPENDIX A. CHANGES TO PACKAGES
Package Note
ocaml-csv-devel
ocaml-curses
ocaml-curses-devel
ocaml-docs
ocaml-emacs
ocaml-fileutils
ocaml-fileutils-devel
ocaml-gettext
ocaml-gettext-devel
ocaml-libvirt
ocaml-libvirt-devel
ocaml-ocamlbuild-doc
ocaml-source
ocaml-x11
ocaml-xml-light
ocaml-xml-light-devel
oci-register-machine
okular
okular-devel
okular-libs
okular-part
opa-libopamgt-devel
opal
245
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
opal-devel
open-vm-tools-devel
open-vm-tools-test
opencc
opencc-devel
opencc-tools
openchange-client
openchange-devel
openchange-devel-docs
opencv-devel-docs
opencv-python
OpenEXR
openhpi-devel
OpenIPMI-modalias
openjpeg-libs
openldap-servers
openldap-servers-sql
openlmi
openlmi-account
openlmi-account-doc
openlmi-fan
openlmi-fan-doc
openlmi-hardware
246
APPENDIX A. CHANGES TO PACKAGES
Package Note
openlmi-hardware-doc
openlmi-indicationmanager-
libs
openlmi-indicationmanager-
libs-devel
openlmi-journald
openlmi-journald-doc
openlmi-logicalfile
openlmi-logicalfile-doc
openlmi-networking
openlmi-networking-doc
openlmi-pcp
openlmi-powermanagement
openlmi-powermanagement-
doc
openlmi-providers
openlmi-providers-devel
openlmi-python-base
openlmi-python-providers
openlmi-python-test
openlmi-realmd
openlmi-realmd-doc
openlmi-service
openlmi-service-doc
247
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
openlmi-software
openlmi-software-doc
openlmi-storage
openlmi-storage-doc
openlmi-tools
openlmi-tools-doc
openobex-apps
openobex-devel
openscap-containers
openscap-engine-sce-devel
openslp-devel
openslp-server
opensm-static
openssh-server-sysvinit
openssl-static
openssl098e
openvswitch
openvswitch-controller
openvswitch-test
openwsman-perl
openwsman-ruby
248
APPENDIX A. CHANGES TO PACKAGES
Package Note
oprofile-devel
oprofile-gui
oprofile-jit
optipng
ORBit2
ORBit2-devel
orc-doc
ortp
ortp-devel
oscilloscope
oxygen-cursor-themes
oxygen-gtk
oxygen-gtk2
oxygen-gtk3
oxygen-icon-theme
PackageKit-yum-plugin
pakchois-devel
pam_snapper
pango-tests
paps-devel
passivetex
pax
pciutils-devel-static
249
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
pcp-collector
pcp-monitor
pcre-tools
pcre2-static
pcre2-tools
pentaho-libxml-javadoc
pentaho-reporting-flow-
engine-javadoc
perl-AppConfig
perl-Archive-Extract
perl-B-Keywords
perl-Browser-Open
perl-Business-ISBN
perl-Business-ISBN-Data
perl-CGI-Session
perl-Class-Load
perl-Class-Load-XS
perl-Config-Simple
perl-Config-Tiny
perl-Convert-ASN1
perl-CPAN-Changes
perl-CPANPLUS
perl-CPANPLUS-Dist-Build
250
APPENDIX A. CHANGES TO PACKAGES
Package Note
perl-Crypt-CBC
perl-Crypt-DES
perl-Crypt-PasswdMD5
perl-Crypt-SSLeay
perl-CSS-Tiny
perl-Data-Peek
perl-DateTime-Format-
DateParse
perl-DBD-Pg-tests
perl-DBIx-Simple
perl-Devel-Cover
perl-Devel-Cycle
perl-Devel-
EnforceEncapsulation
perl-Devel-Leak
perl-Email-Address
perl-FCGI
perl-File-Find-Rule-Perl
perl-File-Inplace
perl-Font-AFM
perl-Font-TTF
perl-FreezeThaw
perl-GD
perl-GD-Barcode
251
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
perl-Hook-LexWrap
perl-HTML-Format
perl-HTML-FormatText-
WithLinks
perl-HTML-FormatText-
WithLinks-AndTables
perl-Image-Base
perl-Image-Info
perl-Image-Xbm
perl-Image-Xpm
perl-Inline
perl-Inline-Files
perl-IO-CaptureOutput
perl-JSON-tests
perl-LDAP
perl-libxml-perl
perl-Locale-Maketext-
Gettext
perl-Locale-PO
perl-Log-Message
perl-Log-Message-Simple
perl-Mixin-Linewise
perl-Module-Manifest
perl-Module-Signature
252
APPENDIX A. CHANGES TO PACKAGES
Package Note
perl-Net-Daemon
perl-Net-DNS-Nameserver
perl-Net-DNS-Resolver-
Programmable
perl-Net-LibIDN
perl-Net-Telnet
perl-Newt
perl-Object-Accessor
perl-Object-Deadly
perl-Package-Constants
perl-PAR-Dist
perl-Parallel-Iterator
perl-Parse-CPAN-Meta
perl-Parse-RecDescent
perl-Perl-Critic
perl-Perl-Critic-More
perl-Perl-MinimumVersion
perl-Perl4-CoreLibs
perl-PlRPC
perl-Pod-Coverage-TrustPod
perl-Pod-Eventual
perl-Pod-POM
perl-Pod-Spell
253
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
perl-PPI
perl-PPI-HTML
perl-PPIx-Regexp
perl-PPIx-Utilities
perl-Probe-Perl
perl-Readonly-XS
perl-Sort-Versions
perl-String-Format
perl-String-Similarity
perl-Syntax-Highlight-
Engine-Kate
perl-Task-Weaken
perl-Template-Toolkit
perl-Term-UI
perl-Test-ClassAPI
perl-Test-CPAN-Meta
perl-Test-DistManifest
perl-Test-EOL
perl-Test-HasVersion
perl-Test-Inter
perl-Test-Manifest
perl-Test-Memory-Cycle
perl-Test-MinimumVersion
254
APPENDIX A. CHANGES TO PACKAGES
Package Note
perl-Test-MockObject
perl-Test-NoTabs
perl-Test-Object
perl-Test-Output
perl-Test-Perl-Critic
perl-Test-Perl-Critic-Policy
perl-Test-Portability-Files
perl-Test-Script
perl-Test-Spelling
perl-Test-SubCalls
perl-Test-Synopsis
perl-Test-Tester
perl-Test-Vars
perl-Test-Without-Module
perl-Text-CSV_XS
perl-Text-Iconv
perl-Tree-DAG_Node
perl-Unicode-Map8
perl-Unicode-String
perl-UNIVERSAL-can
perl-UNIVERSAL-isa
perl-Version-Requirements
perl-WWW-Curl
255
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
perl-XML-Dumper
perl-XML-Filter-BufferText
perl-XML-Grove
perl-XML-Handler-YAWriter
perl-XML-LibXSLT
perl-XML-SAX-Writer
perl-XML-TreeBuilder
perl-XML-Writer
perl-XML-XPathEngine
phonon
phonon-backend-gstreamer
phonon-devel
php-pecl-memcache
php-pspell
pidgin-perl
pinentry-qt
pinentry-qt4
pki-javadoc
plasma-scriptengine-python
plasma-scriptengine-ruby
plexus-digest
plexus-digest-javadoc
plexus-mail-sender
256
APPENDIX A. CHANGES TO PACKAGES
Package Note
plexus-mail-sender-javadoc
plexus-tools-pom
plymouth-devel
pm-utils
pm-utils-devel
pngcrush
pngnq
polkit-kde
polkit-qt
polkit-qt-devel
polkit-qt-doc
poppler-demos
poppler-qt
poppler-qt-devel
popt-static
postfix-sysvinit
pothana2000-fonts
powerpc-utils-python
pprof
pps-tools
pptp-setup
procps-ng-devel
protobuf-emacs
257
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
protobuf-emacs-el
protobuf-java
protobuf-javadoc
protobuf-lite-devel
protobuf-lite-static
protobuf-python
protobuf-static
protobuf-vim
psutils
psutils-perl
pth-devel
ptlib
ptlib-devel
publican
publican-common-db5-web
publican-common-web
publican-doc
publican-redhat
pulseaudio-esound-compat
pulseaudio-module-gconf
pulseaudio-module-zeroconf
pulseaudio-qpaeq
pygpgme
258
APPENDIX A. CHANGES TO PACKAGES
Package Note
pygtk2-libglade
pykde4
pykde4-akonadi
pykde4-devel
pyldb-devel
pyliblzma
PyOpenGL
PyOpenGL-Tk
pyOpenSSL-doc
pyorbit
pyorbit-devel
PyPAM
pyparsing-doc
PyQt4
PyQt4-devel
pytalloc-devel
python-adal
python-appindicator
python-beaker
python-cffi-doc
python-cherrypy
python-criu
python-debug
259
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
python-deltarpm
python-di
python-dtopt
python-fpconst
python-gpod
python-gudev
python-inotify-examples
python-ipaddr
python-IPy
python-isodate
python-isomd5sum
python-kitchen
python-kitchen-doc
python-libteam
python-lxml-docs
python-matplotlib
python-matplotlib-doc
python-matplotlib-qt4
python-matplotlib-tk
python-memcached
python-msrest
python-msrestazure
python-mutagen
260
APPENDIX A. CHANGES TO PACKAGES
Package Note
python-openvswitch
python-paramiko
python-paramiko-doc
python-paste
python-pillow-devel
python-pillow-doc
python-pillow-qt
python-pillow-sane
python-pillow-tk
python-pyblock
python-rados
python-rbd
python-reportlab-docs
python-rtslib-doc
python-setproctitle
python-slip-gtk
python-smbc
python-smbc-doc
python-smbios
python-sphinx-doc
python-sphinx-theme-
openlmi
python-tempita
261
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
python-tornado
python-tornado-doc
python-twisted-core
python-twisted-core-doc
python-twisted-web
python-twisted-words
python-urlgrabber
python-volume_key
python-webob
python-webtest
python-which
python-zope-interface
python2-caribou
python2-futures
python2-gexiv2
python2-smartcols
python2-solv
python2-subprocess32
qca-ossl
qca2
qca2-devel
qimageblitz
qimageblitz-devel
262
APPENDIX A. CHANGES TO PACKAGES
Package Note
qimageblitz-examples
qjson
qjson-devel
qpdf-devel
qt
qt-assistant
qt-config
qt-demos
qt-devel
qt-devel-private
qt-doc
qt-examples
qt-mysql
qt-odbc
qt-postgresql
qt-qdbusviewer
qt-qvfb
qt-settings
qt-x11
qt3
qt3-config
qt3-designer
qt3-devel
263
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
qt3-devel-docs
qt3-MySQL
qt3-ODBC
qt3-PostgreSQL
qt5-qt3d-doc
qt5-qtbase-doc
qt5-qtcanvas3d-doc
qt5-qtconnectivity-doc
qt5-qtdeclarative-doc
qt5-qtenginio
qt5-qtenginio-devel
qt5-qtenginio-doc
qt5-qtenginio-examples
qt5-qtgraphicaleffects-doc
qt5-qtimageformats-doc
qt5-qtlocation-doc
qt5-qtmultimedia-doc
qt5-qtquickcontrols-doc
qt5-qtquickcontrols2-doc
qt5-qtscript-doc
qt5-qtsensors-doc
qt5-qtserialbus-devel
qt5-qtserialbus-doc
264
APPENDIX A. CHANGES TO PACKAGES
Package Note
qt5-qtserialport-doc
qt5-qtsvg-doc
qt5-qttools-doc
qt5-qtwayland-doc
qt5-qtwebchannel-doc
qt5-qtwebsockets-doc
qt5-qtx11extras-doc
qt5-qtxmlpatterns-doc
quagga Since RHEL 8.1, Quagga has been replaced by Free Range Routing
(FRRouting, or FRR), a new routing protocol stack, provided by the frr
package in the AppStream repository. FRR provides TCP/IP-based routing
services with support for multiple IPv4 and IPv6 routing protocols, such as
BGP, IS-IS, OSPF, PIM, and RIP. For more information, see Setting the
routing protocols for your system.
quagga-contrib
quota-devel
qv4l2
rarian-devel
ras-utils
rcs Version control system supported in RHEL 8 are Git, Mercurial, and
Subversion.
rdate
rdist
readline-static
realmd-devel-docs
Red_Hat_Enterprise_Linux-
Release_Notes-7-as-IN
265
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
Red_Hat_Enterprise_Linux-
Release_Notes-7-bn-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-de-DE
Red_Hat_Enterprise_Linux-
Release_Notes-7-en-US
Red_Hat_Enterprise_Linux-
Release_Notes-7-es-ES
Red_Hat_Enterprise_Linux-
Release_Notes-7-fr-FR
Red_Hat_Enterprise_Linux-
Release_Notes-7-gu-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-hi-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-it-IT
Red_Hat_Enterprise_Linux-
Release_Notes-7-ja-JP
Red_Hat_Enterprise_Linux-
Release_Notes-7-kn-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-ko-KR
Red_Hat_Enterprise_Linux-
Release_Notes-7-ml-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-mr-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-or-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-pa-IN
266
APPENDIX A. CHANGES TO PACKAGES
Package Note
Red_Hat_Enterprise_Linux-
Release_Notes-7-pt-BR
Red_Hat_Enterprise_Linux-
Release_Notes-7-ru-RU
Red_Hat_Enterprise_Linux-
Release_Notes-7-ta-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-te-IN
Red_Hat_Enterprise_Linux-
Release_Notes-7-zh-CN
Red_Hat_Enterprise_Linux-
Release_Notes-7-zh-TW
redhat-access-gui
redhat-access-plugin-ipa
redhat-bookmarks
redhat-lsb-supplemental
redhat-lsb-trialuse
redhat-upgrade-dracut
redhat-upgrade-dracut-
plymouth
redhat-upgrade-tool
redland-mysql
redland-pgsql
redland-virtuoso
relaxngcc
rest-devel
267
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
resteasy-base-jettison-
provider
resteasy-base-tjws
rfkill
rhdb-utils
rhino
rhino-demo
rhino-javadoc
rhino-manual
rhythmbox-devel
rngom
rngom-javadoc
rp-pppoe
rrdtool-php
rrdtool-python
rsh-server
rsyslog-libdbi
rsyslog-udpspoof
rtcheck
rtctl
ruby-tcltk
rubygem-net-http-persistent
268
APPENDIX A. CHANGES TO PACKAGES
Package Note
rubygem-net-http-persistent-
doc
rubygem-thor
rubygem-thor-doc
rusers
rusers-server
rwho
sac-javadoc
samba-dc
samba-dc-libs
samba-devel
sanlock-python
satyr-devel
satyr-python
saxon
saxon-demo
saxon-javadoc
saxon-manual
saxon-scripts
sbc-devel
sblim-cim-client2
sblim-cim-client2-javadoc
sblim-cim-client2-manual
269
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
sblim-cmpi-base
sblim-cmpi-base-devel
sblim-cmpi-base-test
sblim-cmpi-fsvol
sblim-cmpi-fsvol-devel
sblim-cmpi-fsvol-test
sblim-cmpi-network
sblim-cmpi-network-devel
sblim-cmpi-network-test
sblim-cmpi-nfsv3
sblim-cmpi-nfsv3-test
sblim-cmpi-nfsv4
sblim-cmpi-nfsv4-test
sblim-cmpi-params
sblim-cmpi-params-test
sblim-cmpi-sysfs
sblim-cmpi-sysfs-test
sblim-cmpi-syslog
sblim-cmpi-syslog-test
sblim-gather
sblim-gather-devel
sblim-gather-provider
sblim-gather-test
270
APPENDIX A. CHANGES TO PACKAGES
Package Note
sblim-indication_helper
sblim-indication_helper-devel
sblim-smis-hba
sblim-testsuite
sblim-wbemcli
scannotation
scannotation-javadoc
scpio
screen
SDL-static
sdparm
seahorse-nautilus
seahorse-sharing
sendmail-sysvinit
setools-devel
setools-gui
setools-libs-tcl
setuptool
shared-desktop-ontologies
shared-desktop-ontologies-
devel
shim-unsigned-ia32
shim-unsigned-x64
271
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
sisu
sisu-parent
slang-slsh
slang-static
smbios-utils
smbios-utils-bin
smbios-utils-python
snakeyaml
snakeyaml-javadoc
snapper
snapper-devel
snapper-libs
sntp
SOAPpy
soprano
soprano-apidocs
soprano-devel
source-highlight-devel
sox
sox-devel
speex-tools
spice-streaming-agent
spice-streaming-agent-devel
272
APPENDIX A. CHANGES TO PACKAGES
Package Note
spice-xpi
sqlite-tcl
squid-migration-script
squid-sysvinit
sssd-libwbclient-devel
stax2-api
stax2-api-javadoc
strigi
strigi-devel
strigi-libs
strongimcv
subversion-kde
subversion-python
subversion-ruby
sudo-devel
suitesparse-doc
suitesparse-static
supermin-helper
svgpart
svrcore
svrcore-devel
sweeper
273
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
syslinux-devel
syslinux-perl
system-config-date
system-config-date-docs
system-config-firewall
system-config-firewall-base
system-config-firewall-tui
system-config-keyboard
system-config-keyboard-base
system-config-kickstart
system-config-language
system-config-users-docs
system-switch-java
systemd-sysv
t1lib
t1lib-apps
t1lib-devel
t1lib-static
t1utils
taglib-doc
talk
274
APPENDIX A. CHANGES TO PACKAGES
Package Note
talk-server
tang-nagios
targetd
tcl-pgtcl
tclx
tclx-devel
tcp_wrappers-devel
tcp_wrappers-libs
teamd-devel
teckit-devel
telepathy-farstream
telepathy-farstream-devel
telepathy-filesystem
telepathy-gabble
telepathy-glib
telepathy-glib-devel
telepathy-glib-vala
telepathy-haze
telepathy-logger
telepathy-logger-devel
telepathy-mission-control
275
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
telepathy-mission-control-
devel
telepathy-salut
tex-preview
texlive-collection-
documentation-base
texlive-mh
texlive-mh-doc
texlive-misc
texlive-thailatex
texlive-thailatex-doc
tix-doc
tn5250
tn5250-devel
tncfhh
tncfhh-devel
tncfhh-examples
tncfhh-libs
tncfhh-utils
tog-pegasus-test
tokyocabinet-devel-doc
tomcat The Apache Tomcat server has been removed from RHEL. Apache Tomcat
is a servlet container for the Java Servlet and JavaServer Pages (JSP)
technologies. Red Hat recommends that users requiring a servlet container
use the JBoss Web Server.
276
APPENDIX A. CHANGES TO PACKAGES
Package Note
tomcat-admin-webapps
tomcat-docs-webapp
tomcat-el-2.2-api
tomcat-javadoc
tomcat-jsp-2.2-api
tomcat-jsvc
tomcat-lib
tomcat-servlet-3.0-api
tomcat-webapps
totem-devel
totem-pl-parser-devel
tracker-devel
tracker-docs
tracker-needle
tracker-preferences
trang
trousers-static
txw2
txw2-javadoc
udftools
unique3
unique3-devel
unique3-docs
277
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
unoconv
uriparser
uriparser-devel
usbguard-devel
usbredir-server
usnic-tools
ustr-debug
ustr-debug-static
ustr-devel
ustr-static
uuid-c++
uuid-c++-devel
uuid-dce
uuid-dce-devel
uuid-perl
uuid-php
v4l-utils
v4l-utils-devel-tools
vala-doc
valadoc
valadoc-devel
valgrind-openmpi
vemana2000-fonts
278
APPENDIX A. CHANGES TO PACKAGES
Package Note
vigra
vigra-devel
virtuoso-opensource
virtuoso-opensource-utils
vlgothic-p-fonts
vsftpd-sysvinit
vte3
vte3-devel
wayland-doc
webkitgtk3
webkitgtk3-devel
webkitgtk3-doc
webkitgtk4-doc
webrtc-audio-processing-
devel
whois
woodstox-core
woodstox-core-javadoc
wordnet
wordnet-browser
wordnet-devel
wordnet-doc
ws-commons-util
279
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
ws-commons-util-javadoc
ws-jaxme
ws-jaxme-javadoc
ws-jaxme-manual
wsdl4j
wsdl4j-javadoc
wvdial
x86info
xchat-tcl
xdg-desktop-portal-devel
xerces-c
xerces-c-devel
xerces-c-doc
xferstats
xguest
xhtml2fo-style-xsl
xhtml2ps
xisdnload
xml-commons-apis12
xml-commons-apis12-javadoc
xml-commons-apis12-manual
xmlgraphics-commons
280
APPENDIX A. CHANGES TO PACKAGES
Package Note
xmlgraphics-commons-
javadoc
xmlrpc-c-apps
xmlrpc-client
xmlrpc-common
xmlrpc-javadoc
xmlrpc-server
xmlsec1-gcrypt-devel
xmlsec1-nss-devel
xmlto-tex
xmlto-xhtml
xorg-x11-drv-intel-devel
xorg-x11-drv-keyboard
xorg-x11-drv-mouse
xorg-x11-drv-mouse-devel
xorg-x11-drv-openchrome
xorg-x11-drv-openchrome-
devel
xorg-x11-drv-synaptics
xorg-x11-drv-synaptics-devel
xorg-x11-drv-vmmouse
xorg-x11-drv-void
xorg-x11-server-source
281
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
Package Note
xorg-x11-xkb-extras
xpp3
xpp3-javadoc
xpp3-minimal
xsettings-kde
xstream
xstream-javadoc
xulrunner
xulrunner-devel
xvattr
xz-compat-libs
yelp-xsl-devel
yum-NetworkManager-
dispatcher
yum-plugin-filter-data
yum-plugin-fs-snapshot
yum-plugin-keys
yum-plugin-list-data
yum-plugin-local
yum-plugin-merge-conf
yum-plugin-ovl
yum-plugin-post-transaction-
actions
282
APPENDIX A. CHANGES TO PACKAGES
Package Note
yum-plugin-pre-transaction-
actions
yum-plugin-protectbase
yum-plugin-ps
yum-plugin-rpm-warm-cache
yum-plugin-show-leaves
yum-plugin-upgrade-helper
yum-plugin-verify
yum-updateonboot
The following packages are distributed in a supported channel in RHEL 7 and in RHEL 8 they are a part
of the CodeReady Linux Builder repository:
antlr-tool rhel7-base
bcel rhel7-base
cal10n rhel7-base
cdi-api-javadoc rhel7-base
codemodel rhel7-base
dejagnu rhel7-base
docbook-style-dsssl rhel7-base
docbook-utils rhel7-base
283
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
docbook5-schemas rhel7-base
flex-devel rhel7-base
geronimo-jms rhel7-base
gnome-common rhel7-base
hamcrest rhel7-base
imake rhel7-base
isorelax rhel7-base
jakarta-oro rhel7-base
javamail rhel7-base
jaxen rhel7-base
jdom rhel7-base
jna rhel7-base
junit rhel7-base
jvnet-parent rhel7-base
libdbusmenu-doc rhel7-base
libdbusmenu-gtk3-devel rhel7-base
libfdt rhel7-base
libgit2-devel rhel7-extras
libindicator-gtk3-devel rhel7-base
libmodulemd-devel rhel7-extras
libseccomp-devel rhel7-base
nasm rhel7-base
objectweb-asm rhel7-base
284
APPENDIX A. CHANGES TO PACKAGES
openjade rhel7-base
openldap-servers rhel7-base
opensp rhel7-base
perl-Class-Singleton rhel7-base
perl-DateTime rhel7-base
perl-DateTime-Locale rhel7-base
perl-DateTime-TimeZone rhel7-base
perl-Devel-Symdump rhel7-base
perl-Digest-SHA1 rhel7-base
perl-HTML-Tree rhel7-base
perl-HTTP-Daemon rhel7-base
perl-IO-stringy rhel7-base
perl-List-MoreUtils rhel7-base
perl-Module-Implementation rhel7-base
perl-Package-DeprecationManager rhel7-base
perl-Package-Stash rhel7-base
perl-Package-Stash-XS rhel7-base
perl-Params-Validate rhel7-base
perl-Pod-Coverage rhel7-base
perl-SGMLSpm rhel7-base
perl-Test-Pod rhel7-base
perl-Test-Pod-Coverage rhel7-base
perl-XML-Twig rhel7-base
285
Red Hat Enterprise Linux 8 Considerations in adopting RHEL 8
perl-YAML-Tiny rhel7-base
perltidy rhel7-base
qdox rhel7-base
regexp rhel7-base
texinfo rhel7-base
ustr rhel7-base
weld-parent rhel7-base
xmltoman rhel7-base
xorg-x11-apps rhel7-base
The following packages have been moved to the CodeReady Linux Builder repository within RHEL 8:
286
APPENDIX A. CHANGES TO PACKAGES
287
Samba download, install and configuration
• Samba is a Linux tool or utility that allows sharing for Linux resources such as files
and printers to with other operating systems
• It works exactly like NFS but the difference is NFS shares within Linux or Unix like
system whereas Samba shares with other OS (e.g. Windows, MAC etc.)
For example, computer “A” shares its filesystem with computer “B” using Samba
then computer “B” will see that shared filesystem as if it is mounted as the local
filesystem
• Samba shares its filesystem through a protocol called SMB (Server Message Block)
which was invented by IBM
• Another protocol used to share Samba is through CIFS (Common Internet File
System) invented by Microsoft and also NMB (NetBios Name server)
• CIFS became the extension of SMB and now Microsoft has introduced newer version
of SMB v2 and v3 that are mostly used in the industry
• Most people, when they use either SMB or CIFS, are talking about the same exact
thing. The two are interchangeable not only in discussion, but also in application –
i.e., a client speaking CIFS can talk to a server speaking SMB and vice versa. Why?
Because CIFS is a form of SMB
• Enable samba to be allowed through firewall (Only if you have firewall running)
# firewall-cmd --permanent --zone=public --add-service=samba
# firewall-cmd –reload
• Also, you need to change the SELinux security context for the samba shared
directory as follows: (Only if you have SELinux enabled)
# chcon -t samba_share_t /samba/morepretzels
[global]
workgroup = WORKGROUP
netbios name = centos
security = user
map to guest = bad user
dns proxy = no
[Anonymous]
path = /samba/morepretzels
browsable = yes
writable = yes
guest ok = yes
guest only = yes
read only = no
• Once the packages are installed, enable and start Samba services
# systemctl enable smb
# systemctl enable nmb
# systemctl start smb
# systemctl start nmb
• Mount on Windows client
o Go to start
o Go to search bar
o Type \\192.168.1.95 (This is my server IP, you can check your Linux
CentOS IP by running the command ifconfig)
• Create a group smbgrp & user larry to access the samba server with proper
authentication
# useradd larry
# groupadd smbgrp
# usermod -a -G smbgrp larry
# smbpasswd -a larry
New SMB password: YOUR SAMBA PASS
Retype new SMB password: REPEAT YOUR SAMBA PASS
Added user larry
# mkdir /samba/securepretzels
# chown -R larry:smbgrp /samba/securepretzels
# chmod -R 0770 /samba/securepretzels
# chcon -t samba_share_t /samba/securepretzels
# vi /etc/samba/smb.conf
Add the following lines
[Secure]
path = /samba/securepretzels
valid users = @smbgrp
guest ok = no
writable = yes
browsable = yes
The text of and illustrations in this document are licensed by Red Hat under a Creative Commons
Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is
available at
http://creativecommons.org/licenses/by-sa/3.0/
. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must
provide the URL for the original version.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert,
Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift,
Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States
and other countries.
Linux ® is the registered trademark of Linus Torvalds in the United States and other countries.
XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States
and/or other countries.
MySQL ® is a registered trademark of MySQL AB in the United States, the European Union and
other countries.
Node.js ® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the
official Joyent Node.js open source or commercial project.
The OpenStack ® Word Mark and OpenStack logo are either registered trademarks/service marks
or trademarks/service marks of the OpenStack Foundation, in the United States and other
countries and are used with the OpenStack Foundation's permission. We are not affiliated with,
endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
Abstract
This document describes basics of system administration on Red Hat Enterprise Linux 8. The title
focuses on: basic tasks that a system administrator needs to do just after the operating system has
been successfully installed, installing software with yum, using systemd for service management,
managing users, groups and file permissions, using chrony to configure NTP, working with Python 3
and others.
Table of Contents
Table of Contents
.CHAPTER
. . . . . . . . . . 1.. .GETTING
. . . . . . . . . . STARTED
. . . . . . . . . . .WITH
. . . . . .SYSTEM
. . . . . . . . .ADMINISTRATION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9. . . . . . . . . . . . .
1.1. PERFORMING BASIC SYSTEM ADMINISTRATION TASKS IN THE WEB CONSOLE 9
1.1.1. What the RHEL 8 web console is and which tasks it can be used for 9
1.1.2. Restarting the system using the web console 10
1.1.3. Shutting down the system using the web console 11
1.1.4. Configuring the host name in the web console 12
1.1.4.1. Host name 12
1.1.4.2. Pretty host name in the web console 12
1.1.4.3. Setting the host name using the web console 12
1.1.5. Joining a RHEL 8 system to an IdM domain using the web console 14
1.1.6. Configuring time settings using the web console 16
1.1.7. Optimizing the system performance using the web console 17
1.1.7.1. Performance tuning options in the web console 18
1.1.7.2. Setting a performance profile in the web console 18
1.1.8. Disabling SMT to prevent CPU security issues using the web console 19
1.2. GETTING STARTED WITH RHEL SYSTEM ROLES 21
1.2.1. Introduction to RHEL System Roles 21
1.2.2. RHEL System Roles terminology 21
1.2.3. Applying a role 22
1.2.4. Additional resources 24
1.3. CHANGING BASIC ENVIRONMENT SETTINGS 24
1.3.1. Configuring the date and time 24
1.3.1.1. Displaying the current date and time 24
1.3.1.2. Additional resources 25
1.3.2. Configuring the system locale 25
1.3.3. Configuring the keyboard layout 25
1.3.4. Changing the language using desktop GUI 26
1.3.5. Additional resources 29
1.4. CONFIGURING AND MANAGING NETWORK ACCESS 29
1.4.1. Configuring the network and host name in the graphical installation mode 29
1.4.2. Configuring a static Ethernet connection using nmcli 30
1.4.3. Adding a connection profile using nmtui 33
1.4.4. Managing networking in the RHEL 8 web console 35
1.4.5. Managing networking using RHEL System Roles 36
1.4.6. Additional resources 37
1.5. REGISTERING THE SYSTEM AND MANAGING SUBSCRIPTIONS 37
1.5.1. Registering the system after the installation 37
1.5.2. Registering subscriptions with credentials in the web console 38
1.5.3. Registering a system using Red Hat account on GNOME 41
1.5.4. Registering a system using an activation key on GNOME 42
1.6. MAKING SYSTEMD SERVICES START AT BOOT TIME 42
1.6.1. Enabling or disabling the services using the CLI 42
1.6.2. Managing services in the RHEL 8 web console 43
1.7. CONFIGURING SYSTEM SECURITY 45
1.7.1. Enhancing system security with a firewall 45
1.7.1.1. Enabling the firewalld service 45
1.7.1.2. Managing firewall in the RHEL 8 web console 46
1.7.1.3. Additional resources 46
1.7.2. Managing basic SELinux settings 46
1.7.2.1. SELinux states and modes 46
1.7.2.2. Ensuring the required state of SELinux 47
1
Red Hat Enterprise Linux 8 Configuring basic system settings
.CHAPTER
. . . . . . . . . . 2.
. . MANAGING
. . . . . . . . . . . . .SOFTWARE
. . . . . . . . . . . . .PACKAGES
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62
..............
2.1. SOFTWARE MANAGEMENT TOOLS IN RED HAT ENTERPRISE LINUX 8 62
2.2. APPLICATION STREAMS 62
2.3. SEARCHING FOR SOFTWARE PACKAGES 62
2.3.1. Searching packages with yum 63
2.3.2. Listing packages with yum 63
2.3.3. Listing repositories with yum 63
2.3.4. Displaying package information with yum 64
2.3.5. Listing package groups with yum 64
2.3.6. Specifying global expressions in yum input 64
2.4. INSTALLING SOFTWARE PACKAGES 65
2.4.1. Installing packages with yum 65
2.4.2. Installing a package group with yum 66
2.4.3. Specifying a package name in yum input 66
2.5. UPDATING SOFTWARE PACKAGES 67
2.5.1. Checking for updates with yum 67
2.5.2. Updating a single package with yum 67
2.5.3. Updating a package group with yum 67
2.5.4. Updating all packages and their dependencies with yum 67
2.5.5. Updating security-related packages with yum 68
2.5.6. Automating software updates 68
2.5.6.1. Installing DNF Automatic 68
2.5.6.2. DNF Automatic configuration file 68
2.5.6.3. Enabling DNF Automatic 69
2.5.6.4. Overview of the systemd timer units included in the dnf-automatic package 71
2.6. UNINSTALLING SOFTWARE PACKAGES 72
2.6.1. Removing packages with yum 72
2
Table of Contents
.CHAPTER
. . . . . . . . . . 3.
. . MANAGING
. . . . . . . . . . . . . SERVICES
. . . . . . . . . . .WITH
. . . . . . SYSTEMD
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
..............
3.1. INTRODUCTION TO SYSTEMD 81
Overriding the default systemd configuration using system.conf 82
3.1.1. Main features 82
3.1.2. Compatibility changes 83
3.2. MANAGING SYSTEM SERVICES 84
Specifying service units 85
Behavior of systemctl in a chroot environment 86
3.2.1. Listing services 86
3.2.2. Displaying service status 87
3.2.3. Starting a service 89
3.2.4. Stopping a service 89
3.2.5. Restarting a service 90
3.2.6. Enabling a service 90
3.2.7. Disabling a service 91
3.2.8. Starting a conflicting service 92
3.3. WORKING WITH SYSTEMD TARGETS 92
3.3.1. Viewing the default target 93
3.3.2. Viewing the current target 93
3.3.3. Changing the default target 94
3.3.4. Changing the current target 95
3.3.5. Changing to rescue mode 95
3.3.6. Changing to emergency mode 96
3.4. SHUTTING DOWN, SUSPENDING, AND HIBERNATING THE SYSTEM 96
3.4.1. Shutting down the system 97
Using systemctl commands 97
Using the shutdown command 97
3.4.2. Restarting the system 98
3
Red Hat Enterprise Linux 8 Configuring basic system settings
. . . . . . . . . . . 4.
CHAPTER . . .MANAGING
. . . . . . . . . . . . USER
. . . . . . AND
. . . . . .GROUP
. . . . . . . .ACCOUNTS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
...............
4.1. INTRODUCTION TO USERS AND GROUPS 122
4.2. CONFIGURING RESERVED USER AND GROUP IDS 122
4.3. USER PRIVATE GROUPS 123
4.4. MANAGING USER ACCOUNTS WITH THE WEB CONSOLE 123
4.4.1. Getting started using the RHEL web console 123
4.4.1.1. What is the RHEL web console 124
4.4.1.2. Installing the web console 125
4.4.1.3. Logging in to the web console 125
4.4.1.4. Connecting to the web console from a remote machine 126
4.4.1.5. Logging in to the web console using a one-time password 127
4.4.2. Managing user accounts in the web console 128
4.4.2.1. System user accounts managed in the web console 128
4.4.2.2. Adding new accounts using the web console 129
4.4.2.3. Enforcing password expiration in the web console 130
4.4.2.4. Terminating user sessions in the web console 131
4.5. MANAGING USERS FROM THE COMMAND LINE 132
4.5.1. Adding a new user from the command line 133
4.5.2. Adding a new group from the command line 133
4.5.3. Adding a user to a groups from the command line 134
4.5.4. Removing a user from a group from the command line 134
4.5.4.1. Overriding the primary group of the user 135
4.5.4.2. Overriding the supplementary groups of the user 135
4.5.5. Creating a group directory 136
4.6. MANAGING SUDO ACCESS 137
4.6.1. Granting sudo access to a user 137
4.7. CHANGING AND RESETTING THE ROOT PASSWORD 138
4.7.1. Changing the root password as the root user 138
4
Table of Contents
4.7.2. Changing or resetting the forgotten root password as a non-root user 139
4.7.3. Resetting the forgotten root password on boot 139
. . . . . . . . . . . 5.
CHAPTER . . MANAGING
. . . . . . . . . . . . .FILE
. . . . . PERMISSIONS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .141
..............
5.1. INTRODUCTION TO FILE PERMISSIONS 141
5.1.1. Base permissions 141
5.1.2. User file-creation mode mask 143
5.1.3. Default permissions 144
5.2. DISPLAYING FILE PERMISSIONS 146
5.3. CHANGING FILE PERMISSIONS 146
5.3.1. Changing file permissions using symbolic values 146
5.3.2. Changing file permissions using octal values 148
5.4. DISPLAYING THE UMASK 148
5.4.1. Displaying the current octal value of the umask 148
5.4.2. Displaying the current symbolic value of the umask 148
5.4.3. Displaying the default bash umask 149
5.5. SETTING THE UMASK FOR THE CURRENT SHELL SESSION 150
5.5.1. Setting the umask using symbolic values 150
5.5.2. Setting the umask using octal values 151
5.6. CHANGING THE DEFAULT UMASK 151
5.6.1. Changing the default umask for the non-login shell 151
5.6.2. Changing the default umask for the login shell 152
5.6.3. Changing the default umask for a specific user 152
5.6.4. Setting default UMASK for newly created home directories 152
5.7. ACCESS CONTROL LIST 153
5.7.1. Displaying the current ACL 153
5.7.2. Setting the ACL 153
. . . . . . . . . . . 6.
CHAPTER . . .USING
. . . . . . .THE
. . . . .CHRONY
. . . . . . . . . .SUITE
. . . . . . TO
. . . .CONFIGURE
. . . . . . . . . . . . . NTP
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
...............
6.1. INTRODUCTION TO CONFIGURING NTP WITH CHRONY 155
6.2. INTRODUCTION TO CHRONY SUITE 155
6.2.1. Using chronyc to control chronyd 155
6.3. DIFFERENCES BETWEEN CHRONY AND NTP 156
6.4. MIGRATING TO CHRONY 156
6.4.1. Migration script 157
6.4.2. Timesync role 158
6.5. CONFIGURING CHRONY 158
6.5.1. Configuring chrony for security 162
6.6. USING CHRONY 163
6.6.1. Installing chrony 163
6.6.2. Checking the status of chronyd 163
6.6.3. Starting chronyd 164
6.6.4. Stopping chronyd 164
6.6.5. Checking if chrony is synchronized 164
6.6.5.1. Checking chrony tracking 164
6.6.5.2. Checking chrony sources 166
6.6.5.3. Checking chrony source statistics 167
6.6.6. Manually Adjusting the System Clock 168
6.7. SETTING UP CHRONY FOR DIFFERENT ENVIRONMENTS 168
6.7.1. Setting up chrony for a system in an isolated network 168
6.8. CHRONY WITH HW TIMESTAMPING 169
6.8.1. Understanding hardware timestamping 169
6.8.2. Verifying support for hardware timestamping 169
5
Red Hat Enterprise Linux 8 Configuring basic system settings
. . . . . . . . . . . 7.
CHAPTER . . USING
. . . . . . . .SECURE
. . . . . . . . .COMMUNICATIONS
. . . . . . . . . . . . . . . . . . . . .BETWEEN
. . . . . . . . . . .TWO
. . . . . SYSTEMS
. . . . . . . . . . . WITH
. . . . . . OPENSSH
. . . . . . . . . . . . . . . . . . . . . . . 177
...............
7.1. SSH AND OPENSSH 177
7.2. CONFIGURING AND STARTING AN OPENSSH SERVER 178
7.3. USING KEY PAIRS INSTEAD OF PASSWORDS FOR SSH AUTHENTICATION 179
7.3.1. Setting an OpenSSH server for key-based authentication 179
7.3.2. Generating SSH key pairs 180
7.4. USING SSH KEYS STORED ON A SMART CARD 181
7.5. MAKING OPENSSH MORE SECURE 183
7.6. CONNECTING TO A REMOTE SERVER USING AN SSH JUMP HOST 185
7.7. ADDITIONAL RESOURCES 186
.CHAPTER
. . . . . . . . . . 8.
. . .CONFIGURING
...............A
. . REMOTE
. . . . . . . . . .LOGGING
. . . . . . . . . . .SOLUTION
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .188
...............
8.1. THE RSYSLOG LOGGING SERVICE 188
8.2. INSTALLING RSYSLOG DOCUMENTATION 188
8.3. CONFIGURING REMOTE LOGGING OVER TCP 189
8.3.1. Configuring a server for remote logging over TCP 189
8.3.2. Configuring remote logging to a server over TCP 191
8.4. CONFIGURING REMOTE LOGGING OVER UDP 192
8.4.1. Configuring a server for receiving remote logging information over UDP 192
8.4.2. Configuring remote logging to a server over UDP 194
8.5. CONFIGURING RELIABLE REMOTE LOGGING 195
8.6. SUPPORTED RSYSLOG MODULES 197
8.7. ADDITIONAL RESOURCES 197
. . . . . . . . . . . 9.
CHAPTER . . .USING
. . . . . . .PYTHON
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .198
...............
9.1. INTRODUCTION TO PYTHON 198
9.1.1. Python versions 198
9.1.2. The internal platform-python package 199
9.2. INSTALLING AND USING PYTHON 199
9.2.1. Installing Python 3 199
9.2.1.1. Installing additional Python 3 packages for developers 200
9.2.2. Installing Python 2 201
9.2.3. Using Python 3 201
9.2.4. Using Python 2 202
9.2.5. Configuring the unversioned Python 202
9.2.5.1. Configuring the unversioned python command directly 202
9.2.5.2. Configuring the unversioned python command to the required Python version interactively 203
9.3. MIGRATION FROM PYTHON 2 TO PYTHON 3 203
6
Table of Contents
.CHAPTER
. . . . . . . . . . 10.
. . . USING
. . . . . . . .THE
. . . . PHP
. . . . . SCRIPTING
. . . . . . . . . . . . .LANGUAGE
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208
................
10.1. INSTALLING THE PHP SCRIPTING LANGUAGE 208
10.2. USING THE PHP SCRIPTING LANGUAGE WITH A WEB SERVER 209
10.2.1. Using PHP with the Apache HTTP Server 209
10.2.2. Using PHP with the nginx web server 210
10.3. RUNNING A PHP SCRIPT USING THE COMMAND-LINE INTERFACE 212
10.4. ADDITIONAL RESOURCES 213
. . . . . . . . . . . 11.
CHAPTER . . .USING
. . . . . . .LANGPACKS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .214
...............
11.1. CHECKING LANGUAGES THAT PROVIDE LANGPACKS 214
11.2. WORKING WITH RPM WEAK DEPENDENCY-BASED LANGPACKS 214
11.2.1. Listing already installed language support 214
11.2.2. Checking the availability of language support 214
11.2.3. Listing packages installed for a language 215
11.2.4. Installing language support 215
11.2.5. Removing language support 215
11.3. SAVING DISK SPACE BY USING GLIBC-LANGPACK-<LOCALE_CODE> 215
. . . . . . . . . . . 12.
CHAPTER . . . GETTING
. . . . . . . . . . STARTED
. . . . . . . . . . .WITH
. . . . . .TCL/TK
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217
...............
12.1. INTRODUCTION TO TCL/TK 217
12.2. NOTABLE CHANGES IN TCL/TK 8.6 217
12.3. MIGRATING TO TCL/TK 8.6 218
12.3.1. Migration path for developers of Tcl extensions 218
12.3.2. Migration path for users scripting their tasks with Tcl/Tk 218
. . . . . . . . . . . 13.
CHAPTER . . . USING
. . . . . . . .PREFIXDEVNAME
. . . . . . . . . . . . . . . . . . .FOR
. . . . NAMING
. . . . . . . . . .OF
. . . ETHERNET
. . . . . . . . . . . . NETWORK
. . . . . . . . . . . .INTERFACES
. . . . . . . . . . . . . . . . . . . . . . . . .220
...............
13.1. INTRODUCTION TO PREFIXDEVNAME 220
13.2. SETTING PREFIXDEVNAME 220
13.3. LIMITATIONS OF PREFIXDEVNAME 220
7
Red Hat Enterprise Linux 8 Configuring basic system settings
8
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
NOTE
The following basic administration tasks may include items that are usually done already
during the installation process, but they do not have to be done necessarily, such as the
registration of the system. The sections dealing with such tasks provide a summary of
how you can achieve the same goals during the installation.
For information on Red Hat Enterprise Linux installation, see Performing a standard
RHEL installation.
Although you can perform all post-installation tasks through the command line, you can also use the
RHEL 8 web console to perform some of them.
1.1.1. What the RHEL 8 web console is and which tasks it can be used for
The RHEL 8 web console is an interactive server administration interface. It interacts directly with the
operating system from a real Linux session in a browser.
Managing packages
Configuring SELinux
9
Red Hat Enterprise Linux 8 Configuring basic system settings
Updating software
For more information on installing and using the RHEL 8 web console, see Managing systems using the
RHEL 8 web console.
Prerequisites
Procedure
2. Click Overview.
4. If any users are logged into the system, write a reason for the restart in the Restart dialog box.
10
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
6. Click Restart.
Prerequisites
Procedure
2. Click Overview.
4. If any users are logged in to the system, write a reason for the shutdown in the Shut Down
dialog box.
11
Red Hat Enterprise Linux 8 Configuring basic system settings
The host name identifies the system. By default, the host name is set to localhost, but you can change
it.
Host name
It is a unique name which identifies a system.
Domain
Add the domain as a suffix behind the host name when using a system in a network and when using
names instead of just IP addresses.
A host name with an attached domain name is called a fully qualified domain name (FQDN). For
example: mymachine.example.com.
You can configure a pretty host name in the RHEL web console. The pretty host name is a host name
with capital letters, spaces, and so on.
The pretty host name displays in the web console, but it does not have to correspond with the host
name.
This procedure sets the real host name or the pretty host name in the web console.
Prerequisites
Procedure
12
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Procedure
2. Click Overview.
4. In the Change Host Name dialog box, enter the host name in the Pretty Host Name field.
5. The Real Host Name field attaches a domain name to the pretty name.
You can change the real host name manually if it does not correspond with the pretty host
name.
6. Click Change.
13
Red Hat Enterprise Linux 8 Configuring basic system settings
Verification steps
2. Reopen the web console by entering an address with the new host name in the address bar of
your browser.
1.1.5. Joining a RHEL 8 system to an IdM domain using the web console
This procedure uses the web console to join the Red Hat Enterprise Linux 8 system to the Identity
Management (IdM) domain.
Prerequisites
The IdM domain is running and reachable from the client you want to join.
Procedure
14
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
4. In the Join a Domain dialog box, enter the host name of the IdM server in the Domain Address
field.
5. In the Authentication drop down list, select if you want to use a password or a one-time
password for authentication.
6. In the Domain Administrator Name field, enter the user name of the IdM administration
account.
7. In the password field, add the password or one-time password according to what you selected in
the Authentication drop down list earlier.
8. Click Join.
15
Red Hat Enterprise Linux 8 Configuring basic system settings
Verification steps
1. If the RHEL 8 web console did not display an error, the system has been joined to the IdM
domain and you can see the domain name in the System screen.
2. To verify that the user is a member of the domain, click the Terminal page and type the id
command:
$ id
euid=548800004(example_user) gid=548800004(example_user)
groups=548800004(example_user) context=unconfined_u:unconfined_r:unconfined_t:s0-
s0:c0.c1023
Additional resources
Prerequisites
Procedure
16
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
3. In the Change System Time dialog box, change the time zone if necessary.
4. In the Set Time drop down menu, select one of the following:
Manually
Use this option if you need to set the time manually, without an NTP server.
Automatically using NTP server
This is a default option, which synchronizes time automatically with the preset NTP servers.
Automatically using specific NTP servers
Use this option only if you need to synchronize the system with a specific NTP server.
Specify the DNS name or the IP address of the server.
5. Click Change.
Verification steps
Additional resources
17
Red Hat Enterprise Linux 8 Configuring basic system settings
In the web console, you can set a performance profile to optimize the performance of the system for a
selected task.
Red Hat Enterprise Linux 8 provides several performance profiles that optimize the system for the
following tasks:
Throughput performance
Latency performance
Network performance
Virtual machines
The tuned service optimizes system options to match the selected profile.
In the web console, you can set which performance profile your system uses.
Additional resources
For details about the tuned service, see Monitoring and managing system status and
performance.
This procedure uses the web console to optimize the system performance for a selected task.
Prerequisites
Procedure
2. Click Overview.
18
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
4. In the Change Performance Profile dialog box, change the profile if necessary.
Verification steps
1.1.8. Disabling SMT to prevent CPU security issues using the web console
This section describes how to to disable Simultaneous Multi Threading (SMT) in case of attacks that
misuse CPU SMT. Disabling SMT can mitigate security vulnerabilities, such as L1TF or MDS.
IMPORTANT
Prerequisites
19
Red Hat Enterprise Linux 8 Configuring basic system settings
Procedure
2. Click System.
5. In the CPU Security Toggles, switch on the Disable simultaneous multithreading (nosmt)
option.
20
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Additional resources
For more details on security attacks that you can prevent by disabling SMT, see:
On Red Hat Enterprise Linux 8, the interface currently consists of the following roles:
kdump
network
selinux
storage
timesync
All these roles are provided by the rhel-system-roles package available in the AppStream repository.
Additional resources
For RHEL System Roles overview, see the Red Hat Enterprise Linux (RHEL) System Roles
Red Hat Knowledgebase article.
For information on a particular role, see the documentation under the /usr/share/doc/rhel-
system-roles directory. This documentation is installed automatically with the rhel-system-
roles package.
Ansible playbook
Playbooks are Ansible’s configuration, deployment, and orchestration language. They can describe a
21
Red Hat Enterprise Linux 8 Configuring basic system settings
Playbooks are Ansible’s configuration, deployment, and orchestration language. They can describe a
policy you want your remote systems to enforce, or a set of steps in a general IT process.
Control node
Any machine with Ansible installed. You can run commands and playbooks, invoking /usr/bin/ansible
or /usr/bin/ansible-playbook, from any control node. You can use any computer that has Python
installed on it as a control node - laptops, shared desktops, and servers can all run Ansible. However,
you cannot use a Windows machine as a control node. You can have multiple control nodes.
Inventory
A list of managed nodes. An inventory file is also sometimes called a “hostfile”. Your inventory can
specify information like IP address for each managed node. An inventory can also organize managed
nodes, creating and nesting groups for easier scaling. To learn more about inventory, see the
Working with Inventory section.
Managed nodes
The network devices (and/or servers) you manage with Ansible. Managed nodes are also sometimes
called “hosts”. Ansible is not installed on managed nodes.
Prerequisites
The rhel-system-roles package is installed on the system that you want to use as a control
node:
The Ansible Engine repository is enabled, and the ansible package is installed on the system
that you want to use as a control node. You need the ansible package to run playbooks that use
RHEL System Roles.
If you do not have a Red Hat Ansible Engine Subscription, you can use a limited supported
version of Red Hat Ansible Engine provided with your Red Hat Enterprise Linux subscription.
In this case, follow these steps:
# subscription-manager refresh
# subscription-manager repos --enable ansible-2-for-rhel-8-x86_64-rpms
If you have a Red Hat Ansible Engine Subscription, follow the procedure described in How
do I Download and Install Red Hat Ansible Engine?.
A playbook is a list of one or more plays. Every play can include Ansible variables, tasks, or roles.
22
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Playbooks are human-readable, and they are expressed in the YAML format.
Procedure
---
- hosts: webservers
roles:
- rhel-system-roles.network
- rhel-system-roles.timesync
NOTE
Every role includes a README file, which documents how to use the role and
supported parameter values. You can also find an example playbook for a
particular role under the documentation directory of the role. Such
documentation directory is provided by default with the rhel-system-roles
package, and can be found in the following location:
/usr/share/doc/rhel-system-roles/SUBSYSTEM/
Replace SUBSYSTEM with the name of the required role, such as selinux,
kdump, network, timesync, or storage.
An inventory is a list of systems against which Ansible works. For more information on how to
create and inventory, and how to work with it, see Ansible documentation.
If you do not have an inventory, you can create it at the time of running ansible-playbook:
If you have only one targeted host against which you want to run the playbook, use:
If you have multiple targeted hosts against which you want to run the playbook, use:
Additional resources
For more detailed information on using the ansible-playbook command, see the ansible-
playbook man page.
23
Red Hat Enterprise Linux 8 Configuring basic system settings
Deploying the same SELinux configuration on multiple systems using RHEL System Roles
System locales
Keyboard layout
Language
Red Hat Enterprise Linux 8 uses the chronyd daemon to implement NTP. chronyd is available from the
chrony package. For more information, see Using the chrony suite to configure NTP .
To display the current date and time, use either of these steps.
Procedure
$ date
Mon Mar 30 16:02:59 CEST 2020
$ timedatectl
Local time: Mon 2020-03-30 16:04:42 CEST
Universal time: Mon 2020-03-30 14:04:42 UTC
RTC time: Mon 2020-03-30 14:04:41
Time zone: Europe/Prague (CEST, +0200)
System clock synchronized: yes
NTP service: active
RTC in local TZ: no
24
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Additional resources
For more information, see the date(1) and timedatectl(1) man pages.
For more information on time settings in the web console, see Using the web console for
configuring time settings.
Procedure
$ localectl list-locales
C.utf8
aa_DJ
aa_DJ.iso88591
aa_DJ.utf8
...
$ localectl status
3. To set or change the default system locale settings, use a localectl set-locale sub-command as
the root user. For example:
Additional resources
For more information, see the localectl(1), locale(7), and locale.conf(5) man pages.
Procedure
$ localectl list-keymaps
ANSI-dvorak
al
al-plisi
25
Red Hat Enterprise Linux 8 Configuring basic system settings
amiga-de
amiga-us
...
$ localectl status
...
VC Keymap: us
...
3. To set or change the default system keymap, use a localectl set-keymap sub-command as the
root user. For example:
# localectl set-keymap us
Additional resources
For more information, see the localectl(1), locale(7), and locale.conf(5) man pages.
Prerequisites
Procedure
1. Open the GNOME Control Center from the System menu by clicking on its icon.
26
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
2. In the GNOME Control Center, choose Region & Language from the left vertical bar.
27
Red Hat Enterprise Linux 8 Configuring basic system settings
If your region and language are not listed, scroll down, and click More to select from available
regions and languages.
5. Click Done.
NOTE
28
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
NOTE
Some applications do not support certain languages. The text of an application that
cannot be translated into the selected language remains in US English.
Additional resources
For more information on how to launch the GNOME Control Center, see approaches described
in Launching applications
1.4.1. Configuring the network and host name in the graphical installation mode
Follow the steps in this procedure to configure your network and host name.
Procedure
1. From the Installation Summary window, click Network and Host Name*.
2. From the list in the left-hand pane, select an interface. The details are displayed in the right-
hand pane.
NOTE
4. Click + to add a virtual network interface, which can be either: Team, Bond, Bridge, or VLAN.
6. Click Configure to change settings such as IP addresses, DNS servers, or routing configuration
for an existing interface (both virtual and physical).
7. Type a host name for your system in the Host Name field.
NOTE
29
Red Hat Enterprise Linux 8 Configuring basic system settings
NOTE
There are several types of network device naming standards used to identify
network devices with persistent names, for example, em1 and wl3sp0. For
information about these standards, see the Configuring and managing
networking document.
The host name can be either a fully-qualified domain name (FQDN) in the
format hostname.domainname, or a short host name with no domain name.
Many networks have a Dynamic Host Configuration Protocol (DHCP) service
that automatically supplies connected systems with a domain name. To allow
the DHCP service to assign the domain name to this machine, specify only
the short host name. The value localhost.localdomain means that no
specific static host name for the target system is configured, and the actual
host name of the installed system is configured during the processing of the
network configuration, for example, by NetworkManager using DHCP or
DNS.
For details about configuring network settings and the host name when using a Kickstart file, see
the corresponding appendix in Performing an advanced RHEL installation .
If you install Red Hat Enterprise Linux using the text mode of the Anaconda installation
program, use the Network settings option to configure the network.
Procedure
The further steps modify the Example-Connection connection profile you created.
30
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
To set multiple DNS servers, specify them space-separated and enclosed in quotes.
7. Set the DNS search domain for the IPv4 and IPv6 connection:
Verification steps
31
Red Hat Enterprise Linux 8 Configuring basic system settings
connection.type: 802-3-ethernet
connection.interface-name: enp7s0
...
3. Use the ping utility to verify that this host can send packets to other hosts.
# ping 192.0.2.3
For IPv6:
# ping 2001:db8:2::1
# ping 198.162.3.1
For IPv6:
# ping 2001:db8:2::1
# ping 192.0.2.254
For IPv6:
# ping 2001:db8:1::fffe
4. Use the host utility to verify that name resolution works. For example:
# host client.example.com
If the command returns any error, such as connection timed out or no servers could be
reached, verify your DNS settings.
Troubleshooting steps
1. If the connection fails or if the network interface switches between an up and down status:
Make sure that the network cable is plugged-in to the host and a switch.
Check whether the link failure exists only on this host or also on other hosts connected to
the same switch the server is connected to.
Verify that the network cable and the network interface are working as expected. Perform
hardware diagnosis steps and replace defect cables and network interface cards.
32
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Additional resources
See the nm-settings(5) man page for more information on connection profile properties and
their settings.
For further details about the nmcli utility, see the nmcli(1) man page.
If the configuration on the disk does not match the configuration on the device, starting or
restarting NetworkManager creates an in-memory connection that reflects the configuration of
the device. For further details and how to avoid this problem, see NetworkManager duplicates a
connection after restart of NetworkManager service.
Prerequisites
Procedure
# nmtui
33
Red Hat Enterprise Linux 8 Configuring basic system settings
9. Select the new connection entry, and press Enter to activate the connection.
Verification steps
34
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Additional resources
For more information on testing connections, see Testing basic network settings in Configuring
and managing networking.
For further details about the nmtui application, see the nmtui(1) man page.
If the configuration on the disk does not match the configuration on the device, starting or
restarting NetworkManager creates an in-memory connection that reflects the configuration of
the device. For further details and how to avoid this problem, see NetworkManager duplicates a
connection after restart of NetworkManager service.
Ethernet
Bridge
Bonded
VLAN
MacVLAN
Infiniband
The required networking connections for each host are provided as a list within the
network_connections variable.
WARNING
The network role updates or creates all connection profiles on the target system
exactly as specified in the network_connections variable. Therefore, the network
role removes options from the specified profiles if the options are only present on
the system but not in the network_connections variable.
The following example shows how to apply the network role to ensure that an Ethernet connection with
the required parameters exists:
36
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Example 1.2. An example playbook applying the network role to set up an Ethernet connection
with the required parameters
# SPDX-License-Identifier: BSD-3-Clause
---
- hosts: network-test
vars:
network_connections:
roles:
- rhel-system-roles.network
For more information on applying a system role, see Introduction to RHEL System Roles .
You can use a subscription to Red Hat Content Delivery Network to track:
Registered systems
Prerequisites
37
Red Hat Enterprise Linux 8 Configuring basic system settings
For more information about the installation process, see Performing a standard RHEL
installation.
Procedure
The command prompts you to enter your Red Hat Customer Portal user name and password.
If the registration process fails, you can register your system with a specific pool. For guidance
on how to do it, proceed with the following steps:
This command displays all available subscriptions for your Red Hat account. For every
subscription, various characteristics are displayed, including the pool ID.
b. Attach the appropriate subscription to your system by replacing pool_id with the pool ID
determined in the previous step:
Additional resources
For more details about registering RHEL systems using the --auto-attach option, see
Understanding autoattaching subscriptions on the Customer Portal section.
For more details about manually registering RHEL systems, see Understanding the manual
registration and subscription on the Customer Portal section.
Prerequisites
38
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Procedure
1. Type subscription in the search field and press the Enter key.
Alternatively, you can log in to the RHEL 8 web console. For details, see Logging in to the web
console.
2. In the polkit authentication dialog for privileged tasks, add the password belonging to the user
name displayed in the dialog.
3. Click Authenticate.
39
Red Hat Enterprise Linux 8 Configuring basic system settings
At this point, your Red Hat Enterprise Linux 8 system has been successfully registered.
40
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Prerequisites
Procedure
1. Go to the system menu, which is accessible from the top-right screen corner and click the
Settings icon.
4. If you are not using the Red Hat server, enter the server address in the URL field.
41
Red Hat Enterprise Linux 8 Configuring basic system settings
Enter your Red hat account user name in the Login field,
7. Click Register.
Prerequisites
Procedure
1. Go to the system menu, which is accessible from the top-right screen corner and click the
Settings icon.
4. Enter URL to the customized server, if you are not using the Red Hat server.
7. Click Register
This section provides information on how to ensure that a service is enabled or disabled at boot time. It
also explains how to manage the services through the web console.
This section describes the steps for enabling or disabling those services on an already installed operating
42
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
This section describes the steps for enabling or disabling those services on an already installed operating
system:
Prerequisites
Procedure
WARNING
You cannot enable a service that has been previously masked. You have to unmask
it first:
Prerequisites
Procedure
2. Log in to the web console with your root credentials on the system.
3. To display the web console panel, click the Host icon, which is in the upper-left corner of the
43
Red Hat Enterprise Linux 8 Configuring basic system settings
3. To display the web console panel, click the Host icon, which is in the upper-left corner of the
window.
a. Click Targets.
d. To stop the service, click the button and choose the option 'Stop'.
44
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
This section covers only the basic security features that you can configure after installation of the
operating system. For detailed information on securing Red Hat Enterprise Linux, see the Security
section in Product Documentation for Red Hat Enterprise Linux 8 .
The firewalld service, which provides a firewall in Red Hat Enterprise Linux, is automatically enabled
during installation.
Procedure
2. If firewalld is not enabled and running, switch to the root user, and start the firewalld service
and enable to start it automatically after the system restarts:
Verification steps
Additional resources
45
Red Hat Enterprise Linux 8 Configuring basic system settings
To configure the firewalld service in the web console, navigate to Networking → Firewall.
Procedure
1. To enable or disable firewalld in the web console, switch the Firewall toggle button.
NOTE
Additionally, you can define more fine-grained access through the firewall to a service
using the Add services… button.
For detailed information on configuring and using a firewall, see Using and configuring firewalls .
Disabled
Enabled
Enabled
Enforcing
Permissive
In enforcing mode, SELinux enforces the loaded policies. SELinux denies access based on SELinux
policy rules and enables only the interactions that are explicitly allowed. Enforcing mode is the safest
SELinux mode and is the default mode after installation.
In permissive mode, SELinux does not enforce the loaded policies. SELinux does not deny access, but
reports actions that break the rules to the /var/log/audit/audit.log log. Permissive mode is the default
46
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
mode during installation. Permissive mode is also useful in some specific cases, for example when
troubleshooting problems.
Additional resources
By default, SELinux operates in enforcing mode. However, in specific scenarios, you can set SELinux to
permissive mode or even disable it.
IMPORTANT
Red Hat recommends to keep your system in enforcing mode. For debugging purposes,
you can set SELinux to permissive mode.
Follow this procedure to change the state and mode of SELinux on your system.
Procedure
$ getenforce
a. To Enforcing mode:
# setenforce Enforcing
b. To Permissive mode:
# setenforce Permissive
NOTE
3. To set SELinux mode to persist across reboots, modify the SELINUX variable in the
/etc/selinux/config configuration file.
For example, to switch SELinux to enforcing mode:
47
Red Hat Enterprise Linux 8 Configuring basic system settings
WARNING
Additional resources
For more information on permanent changes of SELinux modes, see Changing SELinux states
and modes.
You can set SELinux mode through the RHEL 8 web console in the SELinux menu item.
By default, SELinux enforcing policy in the web console is on, and SELinux operates in enforcing mode.
By turning it off, you switch SELinux to permissive mode. Note that this selection is automatically
reverted on the next boot to the configuration defined in the /etc/sysconfig/selinux file.
Procedure
1. In the web console, use the Enforce policy toggle button in the SELinux menu item to turn
SELinux enforcing policy on or off.
You can manage various SELinux local customizations on multiple target systems using the
selinux system role. For more information, see the Deploying the same SELinux configuration
on multiple systems section.
48
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Security hardening
Using SELinux
Securing networks
Every user operates under its own account, and managing user accounts thus represents a core element
of Red Hat Enterprise Linux system administration.
WARNING
For system accounts, user IDs below 1000 are reserved. For normal accounts, you can use IDs
starting at 1000. However, the recommended practice is to assign IDs starting at 5000.
Group
A group in an entity which ties together multiple user accounts for a common purpose, such as
granting access to particular files.
Additional resources
For more information, see Configuring reserved user and group IDs .
49
Red Hat Enterprise Linux 8 Configuring basic system settings
$ id
uid=1000(example.user) gid=1000(example.user) groups=1000(example.user),10(wheel)
context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
# useradd example.user
# passwd example.user
Additional resources
The RHEL web console displays all user accounts located in the system. Therefore, you can see at least
one user account just after the first login to the web console.
After logging into the RHEL web console, you can perform the following operations:
Lock accounts.
50
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Prerequisites
The RHEL web console must be installed and accessible. For details, see Installing the web
console.
Procedure
2. Click Accounts.
4. In the Full Name field, enter the full name of the user.
The RHEL web console automatically suggests a user name from the full name and fills it in the
User Name field. If you do not want to use the original naming convention consisting of the first
letter of the first name and the whole surname, update the suggestion.
5. In the Password/Confirm fields, enter the password and retype it for verification that your
password is correct. The color bar placed below the fields shows you security level of the
entered password, which does not allow you to create a user with a weak password.
6. Click Create to save the settings and close the dialog box.
51
Red Hat Enterprise Linux 8 Configuring basic system settings
Now you can see the new account in the Accounts settings and you can use the credentials to connect
to the system.
This section provides a brief introduction to kdump, and information about configuring kdump using the
RHEL web console or using the corresponding RHEL system role.
IMPORTANT
A kernel crash dump can be the only information available in the event of a system failure
(a critical bug). Therefore, ensuring that kdump is operational is important in mission-
critical environments. Red Hat advise that system administrators regularly update and
test kexec-tools in your normal kernel update cycle. This is especially important when new
kernel features are implemented.
1.9.2. Configuring kdump memory usage and target location in web console
The procedure below shows you how to use the Kernel Dump tab in the Red Hat Enterprise Linux web
console interface to configure the amount of memory that is reserved for the kdump kernel. The
52
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
procedure also describes how to specify the target location of the vmcore dump file and how to test
your configuration.
Prerequisites
Procedure
1. Open the Kernel Dump tab and start the kdump service.
4. Select the Local Filesystem option from the drop-down and specify the directory you want to
save the dump in.
Alternatively, select the Remote over SSH option from the drop-down to send the vmcore
to a remote machine using the SSH protocol.
Fill the Server, ssh key, and Directory fields with the remote machine address, ssh key
location, and a target directory.
Another choice is to select the Remote over NFS option from the drop-down and fill the
Mount field to send the vmcore to a remote machine using the NFS protocol.
NOTE
53
Red Hat Enterprise Linux 8 Configuring basic system settings
NOTE
Tick the Compression check box to reduce the size of the vmcore file.
WARNING
This step disrupts execution of the kernel and results in a system crash and
loss of data.
Additional resources
For a complete list of currently supported targets for kdump, see Supported kdump targets .
For information on how to configure an SSH server and set up a key-based authentication, see
Using secure communications between two systems with OpenSSH .
WARNING
The kdump role replaces the kdump configuration of the managed hosts entirely
by replacing the /etc/kdump.conf file. Additionally, if the kdump role is applied, all
previous kdump settings are also replaced, even if they are not specified by the role
variables, by replacing the /etc/sysconfig/kdump file.
The following example playbook shows how to apply the kdump system role to set the location of the
54
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
The following example playbook shows how to apply the kdump system role to set the location of the
crash dump files:
---
- hosts: kdump-test
vars:
kdump_path: /var/crash
roles:
- rhel-system-roles.kdump
Additional resources
For a detailed reference on kdump role variables, install the rhel-system-roles package, and
see the README.md or README.html files in the /usr/share/doc/rhel-system-roles/kdump
directory.
For more information on RHEL System Roles, see Introduction to RHEL System Roles
You can use the utility as a disaster recovery solution and also for system migration.
Produce a bootable image and restore the system from an existing backup, using the image.
Additionally, for disaster recovery, you can also integrate certain backup software with ReaR.
1. Install ReaR.
55
Red Hat Enterprise Linux 8 Configuring basic system settings
Prerequisites
Procedure
1. Install ReaR, the genisomage pre-mastering program, and the syslinux package providing a
suite of boot loaders:
# rear mkrescue
3. Modify the ReaR configuration file in an editor of your choice, for example:
# vi /etc/rear/local.conf
4. Add the backup setting details to /etc/rear/local.conf. For example, in the case of the NETFS
backup method, add the following lines:
BACKUP=NETFS
BACKUP_URL=backup.location
5. To configure ReaR to keep the previous backup archives when the new ones are created, also
add the following line to the configuration file:
NETFS_KEEP_OLD_BACKUP_COPY=y
6. To make the backups incremental, meaning that only the changed files are backed up on each
run, add the following line:
BACKUP_TYPE=incremental
56
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
The systemd-journald daemon collects messages from various sources and forwards them to Rsyslog
for further processing. The systemd-journald daemon collects messages from the following sources:
Kernel
Syslog
The Rsyslog service sorts the syslog messages by type and priority and writes them to the files in the
/var/log directory. The /var/log directory persistently stores the log messages.
Procedure
2. Click Logs.
Figure 1.2. Inspecting the log files in the RHEL 8 web console
57
Red Hat Enterprise Linux 8 Configuring basic system settings
Figure 1.2. Inspecting the log files in the RHEL 8 web console
You can use the journalctl command to view messages in the system journal using the command line,
for example:
Command Description
journalctl FILEPATH Shows logs related to a specific file. For example, the
journalctl /dev/sda command displays logs related
to the /dev/sda file system.
Command Description
journalctl -b _SYSTEMD_UNIT=foo Filters log to see ones matching the "foo" systemd
service.
58
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Command Description
Command Description
journalctl --list-boots Shows a tabular list of boot numbers, their IDs, and
the timestamps of the first and last message
pertaining to the boot. You can use the ID in the next
command to view detailed information.
journalctl --boot=ID _SYSTEMD_UNIT=foo Shows information about the specified boot ID.
To obtain support from Red Hat, use the Red Hat Customer Portal, which provides access to everything
available with your subscription.
1.12.1. Obtaining Red Hat Support through Red Hat Customer Portal
The following section describes how to use the Red Hat Customer Portal to get help.
Prerequisites
59
Red Hat Enterprise Linux 8 Configuring basic system settings
Prerequisites
A valid user account on the Red Hat Customer Portal. See Create a Red Hat Login .
Procedure
The following section describes how to use the sosreport command to produce reports for your support
cases.
Prerequisites
A valid user account on the Red Hat Customer Portal. See Create a Red Hat Login .
A support-case number.
Procedure
NOTE
The default minimal installation of Red Hat Enterprise Linux does not include the
sos package, which provides the sosreport command.
2. Generate a report:
# sosreport
Note that when attaching the report, you are prompted to enter the number of the relevant
support case.
60
CHAPTER 1. GETTING STARTED WITH SYSTEM ADMINISTRATION
Additional resources
For more information on sosreport, see the What is a sosreport and how to create one in
Red Hat Enterprise Linux 4.6 and later? Red Hat Knowledgebase article.
61
Red Hat Enterprise Linux 8 Configuring basic system settings
NOTE
Upstream documentation identifies the technology as DNF and the tool is referred to as
DNF in the upstream. As a result, some output returned by the new YUM tool in RHEL 8
mentions DNF.
Although YUM v4 used in RHEL 8 is based on DNF, it is compatible with YUM v3 used in RHEL 7. For
software installation, the yum command and most of its options work the same way in RHEL 8 as they
did in RHEL 7.
Selected yum plug-ins and utilities have been ported to the new DNF back end, and can be installed
under the same names as in RHEL 7. Packages also provide compatibility symlinks, so the binaries,
configuration files, and directories can be found in usual locations.
Note that the legacy Python API provided by YUM v3 is no longer available. You can migrate your plug-
ins and scripts to the new API provided by YUM v4 (DNF Python API), which is stable and fully
supported. See DNF API Reference for more information.
Components made available as Application Streams can be packaged as modules or RPM packages, and
are delivered through the AppStream repository in Red Hat Enterprise Linux 8. Each Application Stream
has a given life cycle, either the same as RHEL 8 or shorter, more suitable to the particular application.
Application Streams with a shorter life cycle are listed in the Red Hat Enterprise Linux 8 Application
Streams Life Cycle page.
Modules are collections of packages representing a logical unit: an application, a language stack, a
database, or a set of tools. These packages are built, tested, and released together.
Module streams represent versions of the Application Stream components. For example, two streams
(versions) of the PostgreSQL database server are available in the postgresql module: PostgreSQL 10
(the default stream) and PostgreSQL 9.6. Only one module stream can be installed on the system.
Different versions can be used in separate containers.
Detailed module commands are described in the Installing, managing, and removing user-space
components document. For a list of modules available in AppStream, see the Package manifest.
62
CHAPTER 2. MANAGING SOFTWARE PACKAGES
List packages.
List repositories.
Note that yum search command returns term matches within the name and summary of the
packages. This makes the search faster and enables you to search for packages you do not know
the name of, but for which you know a related term.
Replace term with a term you want to search for in a package name, summary, or description.
Note that yum search --all enables a more exhaustive but slower search.
To list all packages in all enabled repositories that are available to install, use:
Note that you can filter the results by appending global expressions as arguments. See Section 2.3.6,
“Specifying global expressions in yum input” for more details.
63
Red Hat Enterprise Linux 8 Configuring basic system settings
# yum repolist
# yum repoinfo
Note that you can filter the results by passing the ID or name of repositories as arguments or by
appending global expressions. See Section 2.3.6, “Specifying global expressions in yum input” for more
details.
Note that you can filter the results by appending global expressions as arguments. See Section 2.3.6,
“Specifying global expressions in yum input” for more details.
Note that you can filter the results by appending command line options for the yum group list
command (--hidden, --available). For more available options see the man pages.
Note that you can filter the results by appending global expressions as arguments. See Section 2.7.4,
“Specifying global expressions in yum input” for more details.
64
CHAPTER 2. MANAGING SOFTWARE PACKAGES
yum commands allow you to filter the results by appending one or more glob expressions as arguments.
Global expressions must be escaped when passed as arguments to the yum command. To ensure global
expressions are passed to yum as intended, use one of the following methods:
Escape the wildcard characters by preceding them with a backslash (\) character.
Install packages.
When installing packages on a multilib system (AMD64, Intel 64 machine), you can specify the
architecture of the package by appending it to the package name:
If you know the name of the binary you want to install, but not the package name, you can use
the path to the binary as an argument:
yum searches through the package lists, finds the package which provides /usr/sbin/binary-file,
65
Red Hat Enterprise Linux 8 Configuring basic system settings
yum searches through the package lists, finds the package which provides /usr/sbin/binary-file,
and prompts you as to whether you want to install it.
Note that you can optimize the package search by explicitly defining how to parse the argument. See
Section 2.4.3, “Specifying a package name in yum input” for more details.
Or
Replace group-name with the full name of the group or environmental group.
Replace name and architecture with the exact name and architecture of the package.
To install a package using it’s exact name, epoch, version, release, and architecture, use:
Replace name, epoch, version, release, and architecture with the exact name, epoch, version,
release, and architecture of the package.
66
CHAPTER 2. MANAGING SOFTWARE PACKAGES
# yum check-update
The output returns the list of packages and their dependencies that have an update available.
IMPORTANT
When applying updates to kernel, yum always installs a new kernel regardless of whether
you are using the yum update or yum install command.
# yum update
67
Red Hat Enterprise Linux 8 Configuring basic system settings
DNF Automatic is an alternative command-line interface to yum that is suited for automatic and regular
execution using systemd timers, cron jobs and other such tools.
DNF Automatic synchronizes package metadata as needed and then checks for updates available.
After, the tool can perform one of the following actions depending on how you configure it:
Exit
The outcome of the operation is then reported by a selected mechanism, such as the standard output or
email.
The following procedure describes how to install the DNF Automatic tool.
Procedure
Verification steps
To verify the successful installation, confirm the presence of the dnf-automatic package by
running the following command:
By default, DNF Automatic uses /etc/dnf/automatic.conf as its configuration file to define its behavior.
68
CHAPTER 2. MANAGING SOFTWARE PACKAGES
[commands] section
Sets the mode of operation of DNF Automatic.
[emitters] section
Defines how the results of DNF Automatic are reported.
[command_email] section
Provides the email emitter configuration for an external command used to send email.
[email] section
Provides the email emitter configuration.
[base] section
Overrides settings from the main configuration file of yum.
With the default settings of the /etc/dnf/automatic.conf file, DNF Automatic checks for available
updates, downloads them, and reports the results as standard output.
WARNING
Settings of the operation mode from the [commands] section are overridden by
settings used by a systemd timer unit for all timer units except dnf-automatic.timer.
Additional resources
For more details on systemd timer units, see the man dnf-automatic manual pages.
For the overview of the systemd timer units included in the dnf-automatic package, see
Section 2.5.6.4 Overview of the systemd timer units included in the dnf-automatic package
To run DNF Automatic, you always need to enable and start a specific systemd timer unit. You can use
one of the timer units provided in the dnf-automatic package, or you can write your own timer unit
depending on your needs.
Prerequisites
For more information on DNF Automatic configuration file, see Section 2.5.6.2, “DNF Automatic
configuration file”.
Procedure
Select, enable and start a systemd timer unit that fits your needs:
69
Red Hat Enterprise Linux 8 Configuring basic system settings
dnf-automatic-download.timer
dnf-automatic-install.timer
dnf-automatic-notifyonly.timer
dnf-automatic.timer
In terms of downloading and applying updates, this timer unit behaves according to settings in the
/etc/dnf/automatic.conf configuration file. The default behavior is similar to dnf-automatic-
download.timer: it downloads the updated packages, but it does not install them.
NOTE
Alternatively, you can also run DNF Automatic by executing the /usr/bin/dnf-automatic
file directly from the command line or from a custom script.
Verification steps
70
CHAPTER 2. MANAGING SOFTWARE PACKAGES
Additional resources
For more information on the dnf-automatic timers, see the man dnf-automatic manual pages.
For the overview of the systemd timer units included in the dnf-automatic package, see Section
2.5.6.4 Overview of the systemd timer units included in the dnf-automatic package
2.5.6.4. Overview of the systemd timer units included in the dnf-automatic package
The systemd timer units take precedence and override the settings in the /etc/dnf/automatic.conf
configuration file concerning downloading and applying updates.
download_updates = yes
in the /etc/dnf/automatic.conf configuration file, but you have activated the dnf-automatic-
notifyonly.timer unit, the packages will not be downloaded.
71
Red Hat Enterprise Linux 8 Configuring basic system settings
Additional resources
For more information on the dnf-automatic timers, see the man dnf-automatic manual pages.
For more information on the /etc/dnf/automatic.conf configuration file, see Section 2.5.6.2.
DNF Automatic configuration file
Remove packages.
NOTE
72
CHAPTER 2. MANAGING SOFTWARE PACKAGES
Note that you can optimize the package search by explicitly defining how to parse the argument. See
Section 2.6.3, “Specifying a package name in yum input” for more details.
Or
Replace name and architecture with the exact name and architecture of the package.
To install a package using it’s exact name, epoch, version, release, and architecture, use:
Replace name, epoch, version, release, and architecture with the exact name, epoch, version,
release, and architecture of the package.
73
Red Hat Enterprise Linux 8 Configuring basic system settings
Note that you can filter the results by appending command line options for the yum group list
command (--hidden, --available). For more available options see the man pages.
Note that you can filter the results by appending global expressions as arguments. See Section 2.7.4,
“Specifying global expressions in yum input” for more details.
Or
Replace group-name with the full name of the group or environmental group.
Or
74
CHAPTER 2. MANAGING SOFTWARE PACKAGES
Escape the wildcard characters by preceding them with a backslash (\) character.
List transactions.
Revert transactions.
Repeat transactions.
# yum history
To display a list of all the latest operations for a selected package, use:
75
Red Hat Enterprise Linux 8 Configuring basic system settings
Replace package-name with the name of the package. You can filter the command output by
appending global expressions. See Section 2.8.4, “Specifying global expressions in yum input”
for more details.
Note that the yum history undo command only reverts the steps that were performed during the
transaction. If the transaction installed a new package, the yum history undo command uninstalls it. If
the transaction uninstalled a package, the yum history undo command reinstalls it. yum history undo
also attempts to downgrade all updated packages to their previous versions, if the older packages are
still available.
Note that the yum history redo command only repeats the steps that were performed during the
transaction.
76
CHAPTER 2. MANAGING SOFTWARE PACKAGES
Escape the wildcard characters by preceding them with a backslash (\) character.
Note that the values you define in individual [repository] sections of the /etc/yum.conf file override
values set in the [main] section.
NOTE
Do not give custom repositories names used by the Red Hat repositories to avoid
conflicts.
For a complete list of available [repository] options, see the [repository] OPTIONS section of the
yum.conf(5) manual page.
NOTE
77
Red Hat Enterprise Linux 8 Configuring basic system settings
NOTE
WARNING
To list available repository IDs, see Section 2.3.2, “Listing packages with yum”.
To list available repository IDs, see Section 2.3.2, “Listing packages with yum”.
78
CHAPTER 2. MANAGING SOFTWARE PACKAGES
You can add additional options under the [main] section heading in /etc/yum.conf.
For a complete list of available [main] options, see the [main] OPTIONS section of the yum.conf(5)
manual page.
The following section describes how to enable, configure, and disable yum plug-ins.
The plug-in configuration files always contain a [main] section where the enabled= option controls
whether the plug-in is enabled when you run yum commands. If this option is missing, you can add it
manually to the file.
Every installed plug-in has its own configuration file in the /etc/dnf/plugins/ directory. You can enable or
disable plug-in specific options in these files.
1. Ensure a line beginning with plugins= is present in the [main] section of the /etc/yum.conf
file.
plugins=1
1. Ensure a line beginning with plugins= is present in the [main] section of the /etc/yum.conf
file.
79
Red Hat Enterprise Linux 8 Configuring basic system settings
plugins=0
IMPORTANT
Disabling all plug-ins is not advised. Certain plug-ins provide important yum
services. In particular, the product-id and subscription-manager plug-ins
provide support for the certificate-based Content Delivery Network (CDN).
Disabling plug-ins globally is provided as a convenience option, and is
advisable only when diagnosing a potential problem with yum.
To disable all yum plug-ins for a particular command, append --noplugins option to the
command.
80
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
Systemd introduces the concept of systemd units. These units are represented by unit configuration
files located in one of the directories listed in the following table.
Directory Description
System services
Listening sockets
For a complete list of available systemd unit types, see the following table.
81
Red Hat Enterprise Linux 8 Configuring basic system settings
For example, to override the default value of the timeout limit, which is set to 90 seconds, use the
DefaultTimeoutStartSec parameter to input the required value in seconds.
DefaultTimeoutStartSec=required value
For further information, see Example 3.20, “Changing the timeout limit” .
Socket-based activation — At boot time, systemd creates listening sockets for all system
services that support this type of activation, and passes the sockets to these services as soon as
they are started. This not only allows systemd to start services in parallel, but also makes it
possible to restart a service without losing any message sent to it while it is unavailable: the
corresponding socket remains accessible and all messages are queued.
Systemd uses socket units for socket-based activation.
Bus-based activation — System services that use D-Bus for inter-process communication can
be started on-demand the first time a client application attempts to communicate with them.
Systemd uses D-Bus service files for bus-based activation.
Path-based activation — System services that support path-based activation can be started
82
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
Path-based activation — System services that support path-based activation can be started
on-demand when a particular file or directory changes its state. Systemd uses path units for
path-based activation.
Mount and automount point management — Systemd monitors and manages mount and
automount points. Systemd uses mount units for mount points and automount units for
automount points.
Aggressive parallelization — Because of the use of socket-based activation, systemd can start
system services in parallel as soon as all listening sockets are in place. In combination with
system services that support on-demand activation, parallel activation significantly reduces the
time required to boot the system.
Backwards compatibility with SysV init — Systemd supports SysV init scripts as described in
the Linux Standard Base Core Specification , which eases the upgrade path to systemd service
units.
Systemd has only limited support for runlevels. It provides a number of target units that can be
directly mapped to these runlevels and for compatibility reasons, it is also distributed with the
earlier runlevel command. Not all systemd targets can be directly mapped to runlevels,
however, and as a consequence, this command might return N to indicate an unknown runlevel.
It is recommended that you avoid using the runlevel command if possible.
For more information about systemd targets and their comparison with runlevels, see
Section 3.3, “Working with systemd targets” .
The systemctl utility does not support custom commands. In addition to standard commands
such as start, stop, and status, authors of SysV init scripts could implement support for any
number of arbitrary commands in order to provide additional functionality. For example, the init
script for iptables could be executed with the panic command, which immediately enabled
panic mode and reconfigured the system to start dropping all incoming and outgoing packets.
This is not supported in systemd and the systemctl only accepts documented commands.
For more information about the systemctl utility and its comparison with the earlier service
utility, see Table 3.3, “Comparison of the service utility with systemctl” .
The systemctl utility does not communicate with services that have not been started by
systemd. When systemd starts a system service, it stores the ID of its main process in order to
keep track of it. The systemctl utility then uses this PID to query and manage the service.
Consequently, if a user starts a particular daemon directly on the command line, systemctl is
unable to determine its current status or stop it.
Systemd stops only running services. Previously, when the shutdown sequence was initiated,
Red Hat Enterprise Linux 6 and earlier releases of the system used symbolic links located in the
/etc/rc0.d/ directory to stop all available system services regardless of their status. With
systemd , only running services are stopped on shutdown.
System services are unable to read from the standard input stream. When systemd starts a
83
Red Hat Enterprise Linux 8 Configuring basic system settings
System services are unable to read from the standard input stream. When systemd starts a
service, it connects its standard input to /dev/null to prevent any interaction with the user.
System services do not inherit any context (such as the HOME and PATH environment
variables) from the invoking user and their session. Each service runs in a clean execution
context.
When loading a SysV init script, systemd reads dependency information encoded in the Linux
Standard Base (LSB) header and interprets it at run time.
All operations on service units are subject to a default timeout of 5 minutes to prevent a
malfunctioning service from freezing the system. This value is hardcoded for services that are
generated from initscripts and cannot be changed. However, individual configuration files can
be used to specify a longer timeout value per service, see Example 3.20, “Changing the timeout
limit”.
For a detailed list of compatibility changes introduced with systemd, see the Migration Planning Guide
for Red Hat Enterprise Linux 7.
Service units end with the .service file extension and serve a similar purpose as init scripts. To view,
start, stop, restart, enable, or disable system services, use the systemctl command as described in
Comparison of the service utility with systemctl , Comparison of the chkconfig utility with systemctl , and
further in this section. The service and chkconfig commands are still available in the system and work
as expected, but are only included for compatibility reasons and should be avoided.
84
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
systemctl is-active
name.service
service --status-all systemctl list-units --type Displays the status of all services.
service --all
systemctl is-enabled
name.service
However, the file extension can be omitted, in which case the systemctl utility assumes the argument is
a service unit. The following command is equivalent to the one above:
Additionally, some units have alias names. Those names can have shorter names than units, which can be
used instead of the actual unit names. To find all aliases that can be used for a particular unit, use:
85
Red Hat Enterprise Linux 8 Configuring basic system settings
The exception to this are unit file commands such as the systemctl enable and systemctl disable
commands. These commands do not need a running system and do not affect running processes, but
they do affect unit files. Therefore, you can run these commands even in chroot environment. For
example, to enable the httpd service on a system under the /srv/website1/ directory:
# chroot /srv/website1
# systemctl enable httpd.service
Created symlink /etc/systemd/system/multi-user.target.wants/httpd.service, pointing to
/usr/lib/systemd/system/httpd.service.
For each service unit file, this command displays its full name (UNIT) followed by a note whether the unit
file has been loaded (LOAD), its high-level ( ACTIVE) and low-level ( SUB) unit file activation state, and
a short description (DESCRIPTION).
By default, the systemctl list-units command displays only active units. If you want to list all loaded
units regardless of their state, run this command with the --all or -a command line option:
You can also list all available service units to see if they are enabled. To do so, type:
For each service unit, this command displays its full name (UNIT FILE) followed by information whether
the service unit is enabled or not (STATE). For information on how to determine the status of individual
service units, see Displaying service status.
To list all currently loaded service units, run the following command:
86
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
46 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'
To list all installed service unit files to determine if they are enabled, type:
Replace name with the name of the service unit you want to inspect (for example, gdm). This command
displays the name of the selected service unit followed by its short description, one or more fields
described in Table 3.5, “Available service unit information” , and if it is executed by the root user, also the
most recent log entries.
Field Description
87
Red Hat Enterprise Linux 8 Configuring basic system settings
Field Description
To only verify that a particular service unit is running, run the following command:
Note that both systemctl is-active and systemctl is-enabled return an exit status of 0 if the specified
service unit is running or enabled. For information on how to list all currently loaded service units, see
Listing services.
The service unit for the GNOME Display Manager is named gdm.service. To determine the current
status of this service unit, type the following at a shell prompt:
To determine what services are ordered to start before the specified service, type the following at a
shell prompt:
88
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
├─system.slice
├─systemd-journald.socket
├─systemd-user-sessions.service
└─basic.target
[output truncated]
To determine what services are ordered to start after the specified service, type the following at a
shell prompt:
Replace name with the name of the service unit you want to start (for example, gdm). This command
starts the selected service unit in the current session. For information on how to enable a service unit to
be started at boot time, see Enabling a service . For information on how to determine the status of a
certain service unit, see Displaying service status.
The service unit for the Apache HTTP Server is named httpd.service. To activate this service unit
and start the httpd daemon in the current session, run the following command as root:
Replace name with the name of the service unit you want to stop (for example, bluetooth). This
command stops the selected service unit in the current session. For information on how to disable a
89
Red Hat Enterprise Linux 8 Configuring basic system settings
service unit and prevent it from being started at boot time, see Disabling a service . For information on
how to determine the status of a certain service unit, see Displaying service status.
The service unit for the bluetoothd daemon is named bluetooth.service. To deactivate this service
unit and stop the bluetoothd daemon in the current session, run the following command as root:
Replace name with the name of the service unit you want to restart (for example, httpd). This command
stops the selected service unit in the current session and immediately starts it again. Importantly, if the
selected service unit is not running, this command starts it too. To tell systemd to restart a service unit
only if the corresponding service is already running, run the following command as root:
Certain system services also allow you to reload their configuration without interrupting their execution.
To do so, type as root:
Note that system services that do not support this feature ignore this command altogether. For
convenience, the systemctl command also supports the reload-or-restart and reload-or-try-restart
commands that restart such services instead. For information on how to determine the status of a
certain service unit, see Displaying service status.
In order to prevent users from encountering unnecessary error messages or partially rendered web
pages, the Apache HTTP Server allows you to edit and reload its configuration without the need to
restart it and interrupt actively processed requests. To do so, type the following at a shell prompt as
root:
90
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
Replace name with the name of the service unit you want to enable (for example, httpd). This command
reads the [Install] section of the selected service unit and creates appropriate symbolic links to the
/usr/lib/systemd/system/name.service file in the /etc/systemd/system/ directory and its
subdirectories. This command does not, however, rewrite links that already exist. If you want to ensure
that the symbolic links are re-created, use the following command as root:
This command disables the selected service unit and immediately enables it again. For information on
how to determine whether a certain service unit is enabled to start at boot time, see Displaying service
status. For information on how to start a service in the current session, see Starting a service .
To configure the Apache HTTP Server to start automatically at boot time, run the following
command as root:
Replace name with the name of the service unit you want to disable (for example, bluetooth). This
command reads the [Install] section of the selected service unit and removes appropriate symbolic links
to the /usr/lib/systemd/system/name.service file from the /etc/systemd/system/ directory and its
subdirectories. In addition, you can mask any service unit to prevent it from being started manually or by
another service. To do so, run the following command as root:
This command replaces the /etc/systemd/system/name.service file with a symbolic link to /dev/null,
rendering the actual unit file inaccessible to systemd. To revert this action and unmask a service unit,
type as root:
For information on how to determine whether a certain service unit is enabled to start at boot time, see
Displaying service status. For information on how to stop a service in the current session, see Stopping a
service.
Example 3.6, “Stopping a service” illustrates how to stop the bluetooth.service unit in the current
session. To prevent this service unit from starting at boot time, type the following at a shell prompt
as root:
91
Red Hat Enterprise Linux 8 Configuring basic system settings
When you attempt to start a new service, systemd resolves all dependencies automatically. Note that
this is done without explicit notification to the user. If you are already running a service, and you attempt
to start another service with a negative dependency, the first service is automatically stopped.
For example, if you are running the postfix service, and you try to start the sendmail service, systemd
first automatically stops postfix, because these two services are conflicting and cannot run on the same
port.
Systemd targets are represented by target units. Target units end with the .target file extension and
their only purpose is to group together other systemd units through a chain of dependencies. For
example, the graphical.target unit, which is used to start a graphical session, starts system services such
as the GNOME Display Manager (gdm.service) or Accounts Service (accounts-daemon.service) and
also activates the multi-user.target unit. Similarly, the multi-user.target unit starts other essential
system services such as NetworkManager (NetworkManager.service) or D-Bus (dbus.service) and
activates another target unit named basic.target.
Red Hat Enterprise Linux 7 was distributed with a number of predefined targets that are more or less
similar to the standard set of runlevels from the previous releases of this system. For compatibility
reasons, it also provides aliases for these targets that directly map them to SysV runlevels. Table 3.6,
“Comparison of SysV runlevels with systemd targets” provides a complete list of SysV runlevels and
their corresponding systemd targets.
92
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
To view, change, or configure systemd targets, use the systemctl utility as described in Table 3.7,
“Comparison of SysV init commands with systemctl” and in the sections below. The runlevel and telinit
commands are still available in the system and work as expected, but are only included for compatibility
reasons and should be avoided.
systemctl get-default
This command resolves the symbolic link located at /etc/systemd/system/default.target and displays
the result.
$ systemctl get-default
graphical.target
93
Red Hat Enterprise Linux 8 Configuring basic system settings
For each target unit, this commands displays its full name (UNIT) followed by a note whether the unit has
been loaded (LOAD), its high-level ( ACTIVE) and low-level ( SUB) unit activation state, and a short
description (DESCRIPTION).
By default, the systemctl list-units command displays only active units. If you want to list all loaded
units regardless of their state, run this command with the --all or -a command line option:
17 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'.
Replace name with the name of the target unit you want to use by default (for example, multi-user).
This command replaces the /etc/systemd/system/default.target file with a symbolic link to
/usr/lib/systemd/system/name.target, where name is the name of the target unit you want to use.
94
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
To configure the system to use the multi-user.target unit by default, run the following command as
root:
Replace name with the name of the target unit you want to use (for example, multi-user). This
command starts the target unit named name and all dependent units, and immediately stops all others.
To turn off the graphical user interface and change to the multi-user.target unit in the current
session, run the following command as root:
To change the current target and enter rescue mode in the current session, type the following at a shell
prompt as root:
systemctl rescue
This command is similar to systemctl isolate rescue.target, but it also sends an informative message to
all users that are currently logged into the system. To prevent systemd from sending this message, run
this command with the --no-wall command line option:
For information on how to enter emergency mode, see Section 3.3.6, “Changing to emergency mode” .
To enter rescue mode in the current session, run the following command as root:
95
Red Hat Enterprise Linux 8 Configuring basic system settings
# systemctl rescue
To change the current target and enter emergency mode, type the following at a shell prompt as root:
systemctl emergency
This command is similar to systemctl isolate emergency.target, but it also sends an informative
message to all users that are currently logged into the system. To prevent systemd from sending this
message, run this command with the --no-wall command line option:
For information on how to enter rescue mode, see Section 3.3.5, “Changing to rescue mode” .
To enter emergency mode without sending a message to all users that are currently logged into the
system, run the following command as root:
96
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
systemctl poweroff
To shut down and halt the system without powering off the machine, run the following command as
root:
systemctl halt
By default, running either of these commands causes systemd to send an informative message to all
users that are currently logged into the system. To prevent systemd from sending this message, run the
selected command with the --no-wall command line option, for example:
Where hh:mm is the time in 24 hour clock format. The /run/nologin file is created 5 minutes before
system shutdown to prevent new logins. When a time argument is used, an optional message, the wall
message, can be appended to the command.
To shut down and halt the system after a delay, without powering off the machine, use a command in
the following format as root:
shutdown --halt +m
97
Red Hat Enterprise Linux 8 Configuring basic system settings
Where +m is the delay time in minutes. The now keyword is an alias for +0.
shutdown -c
systemctl reboot
By default, this command causes systemd to send an informative message to all users that are currently
logged into the system. To prevent systemd from sending this message, run this command with the --
no-wall command line option:
systemctl suspend
This command saves the system state in RAM and with the exception of the RAM module, powers off
most of the devices in the machine. When you turn the machine back on, the system then restores its
state from RAM without having to boot again. Because the system state is saved in RAM and not on the
hard disk, restoring the system from suspend mode is significantly faster than restoring it from
hibernation, but as a consequence, a suspended system state is also vulnerable to power outages.
For information on how to hibernate the system, see Section 3.4.4, “Hibernating the system”.
systemctl hibernate
This command saves the system state on the hard disk drive and powers off the machine. When you turn
the machine back on, the system then restores its state from the saved data without having to boot
again. Because the system state is saved on the hard disk and not in RAM, the machine does not have to
maintain electrical power to the RAM module, but as a consequence, restoring the system from
hibernation is significantly slower than restoring it from suspend mode.
To hibernate and suspend the system, run the following command as root:
systemctl hybrid-sleep
For information on how to suspend the system, see Section 3.4.3, “Suspending the system”.
98
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
unit_name.type_extension
Here, unit_name stands for the name of the unit and type_extension identifies the unit type, see
Table 3.2, “Available systemd unit types” for a complete list of unit types. For example, there usually is
sshd.service as well as sshd.socket unit present on your system.
Unit files can be supplemented with a directory for additional configuration files. For example, to add
custom configuration options to sshd.service, create the sshd.service.d/custom.conf file and insert
additional directives there. For more information on configuration directories, see Section 3.5.4,
“Modifying existing unit files”.
Many unit file options can be set using the so called unit specifiers – wildcard strings that are
dynamically replaced with unit parameters when the unit file is loaded. This enables creation of generic
unit files that serve as templates for generating instantiated units. See Section 3.5.5, “Working with
instantiated units” for details.
The [Unit] section — contains generic options that are not dependent on the type of the unit.
These options provide unit description, specify the unit’s behavior, and set dependencies to
other units. For a list of most frequently used [Unit] options, see Table 3.9, “Important [Unit]
section options”.
The [Unit type] section — if a unit has type-specific directives, these are grouped under a
section named after the unit type. For example, service unit files contain the [Service] section.
The [Install] section — contains information about unit installation used by systemctl enable
and disable commands. For a list of options for the [Install] section, see Table 3.11, “Important
[Install] section options”.
99
Red Hat Enterprise Linux 8 Configuring basic system settings
After [b] Defines the order in which units are started. The unit
starts only after the units specified in After are
active. Unlike Requires, After does not explicitly
activate the specified units. The Before option has
the opposite functionality to After .
[b] In most cases, it is sufficient to set only the ordering dependencies with After and Before unit file options. If you also
set a requirement dependency with Wants (recommended) or Requires, the ordering dependency still needs to be
specified. That is because ordering and requirement dependencies work independently from each other.
100
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
101
Red Hat Enterprise Linux 8 Configuring basic system settings
RequiredBy A list of units that depend on the unit. When this unit
is enabled, the units listed in RequiredBy gain a
Require dependency on the unit.
A whole range of options that can be used to fine tune the unit configuration. The below example shows
a service unit installed on the system. Moreover, unit file options can be defined in a way that enables
dynamic creation of units as described in Working with instantiated units .
[Unit]
Description=Postfix Mail Transport Agent
After=syslog.target network.target
Conflicts=sendmail.service exim.service
[Service]
Type=forking
PIDFile=/var/spool/postfix/pid/master.pid
102
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
EnvironmentFile=-/etc/sysconfig/network
ExecStartPre=-/usr/libexec/postfix/aliasesdb
ExecStartPre=-/usr/libexec/postfix/chroot-update
ExecStart=/usr/sbin/postfix start
ExecReload=/usr/sbin/postfix reload
ExecStop=/usr/sbin/postfix stop
[Install]
WantedBy=multi-user.target
The [Unit] section describes the service, specifies the ordering dependencies, as well as conflicting
units. In [Service], a sequence of custom scripts is specified to be executed during unit activation, on
stop, and on reload. EnvironmentFile points to the location where environment variables for the
service are defined, PIDFile specifies a stable PID for the main process of the service. Finally, the
[Install] section lists units that depend on the service.
1. Prepare the executable file with the custom service. This can be a custom-created script, or an
executable delivered by a software provider. If required, prepare a PID file to hold a constant
PID for the main process of the custom service. It is also possible to include environment files to
store shell variables for the service. Make sure the source script is executable (by executing the
chmod a+x) and is not interactive.
2. Create a unit file in the /etc/systemd/system/ directory and make sure it has correct file
permissions. Execute as root:
touch /etc/systemd/system/name.service
Replace name with a name of the service to be created. Note that file does not need to be
executable.
3. Open the name.service file created in the previous step, and add the service configuration
options. There is a variety of options that can be used depending on the type of service you wish
to create, see Section 3.5.1, “Understanding the unit file structure” . The following is an example
unit configuration for a network-related service:
[Unit]
Description=service_description
After=network.target
[Service]
ExecStart=path_to_executable
Type=forking
PIDFile=path_to_pidfile
103
Red Hat Enterprise Linux 8 Configuring basic system settings
[Install]
WantedBy=default.target
Where:
the After setting ensures that the service is started only after the network is running. Add a
space-separated list of other relevant services or targets.
Type=forking is used for daemons that make the fork system call. The main process of the
service is created with the PID specified in path_to_pidfile. Find other startup types in
Table 3.10, “Important [Service] section options” .
WantedBy states the target or targets that the service should be started under. Think of
these targets as of a replacement of the older concept of runlevels, see Section 3.3,
“Working with systemd targets” for details.
4. Notify systemd that a new name.service file exists by executing the following command as
root:
systemctl daemon-reload
WARNING
When using the Emacs text editor, it is often faster and more convenient to have it running in the
background instead of starting a new instance of the program whenever editing a file. The following
steps show how to create a unit file for Emacs, so that it can be handled like a service.
1. Create a unit file in the /etc/systemd/system/ directory and make sure it has the correct file
permissions. Execute as root:
# touch /etc/systemd/system/emacs.service
104
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
[Unit]
Description=Emacs: the extensible, self-documenting text editor
[Service]
Type=forking
ExecStart=/usr/bin/emacs --daemon
ExecStop=/usr/bin/emacsclient --eval "(kill-emacs)"
Environment=SSH_AUTH_SOCK=%t/keyring/ssh
Restart=always
[Install]
WantedBy=default.target
With the above configuration, the /usr/bin/emacs executable is started in daemon mode on
service start. The SSH_AUTH_SOCK environment variable is set using the "%t" unit specifier
that stands for the runtime directory. The service also restarts the emacs process if it exits
unexpectedly.
3. Execute the following commands to reload the configuration and start the custom service:
# systemctl daemon-reload
As the editor is now registered as a systemd service, you can use all standard systemctl commands.
For example, run systemctl status emacs to display the editor’s status or systemctl enable emacs
to make the editor start automatically on system boot.
System Administrators often need to configure and run multiple instances of a service. This is done
by creating copies of the original service configuration files and modifying certain parameters to
avoid conflicts with the primary instance of the service. The following procedure shows how to
create a second instance of the sshd service:
1. Create a copy of the sshd_config file that will be used by the second daemon:
# cp /etc/ssh/sshd{,-second}_config
2. Edit the sshd-second_config file created in the previous step to assign a different port
number and PID file to the second daemon:
Port 22220
PidFile /var/run/sshd-second.pid
See the sshd_config(5) manual page for more information on Port and PidFile options.
Make sure the port you choose is not in use by any other service. The PID file does not have
to exist before running the service, it is generated automatically on service start.
3. Create a copy of the systemd unit file for the sshd service:
105
Red Hat Enterprise Linux 8 Configuring basic system settings
# cp /usr/lib/systemd/system/sshd.service /etc/systemd/system/sshd-second.service
b. Add sshd.service to services specified in the After option, so that the second instance
starts only after the first one has already started:
c. The first instance of sshd includes key generation, therefore remove the
ExecStartPre=/usr/sbin/sshd-keygen line.
[Unit]
Description=OpenSSH server second instance daemon
After=syslog.target network.target auditd.service sshd.service
[Service]
EnvironmentFile=/etc/sysconfig/sshd
ExecStart=/usr/sbin/sshd -D -f /etc/ssh/sshd-second_config $OPTIONS
ExecReload=/bin/kill -HUP $MAINPID
KillMode=process
Restart=on-failure
RestartSec=42s
[Install]
WantedBy=multi-user.target
5. If using SELinux, add the port for the second instance of sshd to SSH ports, otherwise the
second instance of sshd will be rejected to bind to the port:
Verify if the sshd-second.service is running by using the systemctl status command. Also,
verify if the port is enabled correctly by connecting to the service:
If the firewall is in use, make sure that it is configured appropriately in order to allow
106
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
If the firewall is in use, make sure that it is configured appropriately in order to allow
connections to the second instance of sshd.
To learn how to properly choose a target for ordering and dependencies of your custom unit files,
see the following articles
How to write a service unit file which enforces that particular services have to be started
How to decide what dependencies a systemd service unit definition should have
Additional information with some real-world examples of cases triggered by the ordering and
dependencies in a unit file is available in Red Hat Knowledgebase article Is there any useful information
about writing unit files?
If you want to set limits for services started by systemd, see the Red Hat Knowledgebase article How to
set limits for services in RHEL 7 and systemd. These limits need to be set in the service’s unit file. Note
that systemd ignores limits set in the /etc/security/limits.conf and /etc/security/limits.d/*.conf
configuration files. The limits defined in these files are set by PAM when starting a login session, but
daemons started by systemd do not use PAM login sessions.
Converting an init script to a unit file requires analyzing the script and extracting the necessary
information from it. Based on this data you can create a unit file. As init scripts can vary greatly
depending on the type of the service, you might need to employ more configuration options for
translation than outlined in this chapter. Note that some levels of customization that were available with
init scripts are no longer supported by systemd units.
The majority of information needed for conversion is provided in the script’s header. The following
example shows the opening section of the init script used to start the postfix service on Red Hat
Enterprise Linux 6:
!/bin/bash # postfix Postfix Mail Transfer Agent # chkconfig: 2345 80 30 # description: Postfix is a Mail
Transport Agent, which is the program that moves mail from one machine to another. # processname:
master # pidfile: /var/spool/postfix/pid/master.pid # config: /etc/postfix/main.cf # config:
/etc/postfix/master.cf BEGIN INIT INFO # Provides: postfix MTA # Required-Start: $local_fs $network
$remote_fs # Required-Stop: $local_fs $network $remote_fs # Default-Start: 2 3 4 5 # Default-Stop: 0
1 6 # Short-Description: start and stop postfix # Description: Postfix is a Mail Transport Agent, which
is the program that moves mail from one machine to another. # END INIT INFO
In the above example, only lines starting with # chkconfig and # description are mandatory, so you
might not find the rest in different init files. The text enclosed between the BEGIN INIT INFO and END
INIT INFO lines is called Linux Standard Base (LSB) header. If specified, LSB headers contain
directives defining the service description, dependencies, and default runlevels. What follows is an
overview of analytic tasks aiming to collect the data needed for a new unit file. The postfix init script is
used as an example, see the resulting postfix unit file in Example 3.16, “postfix.service unit file” .
Find descriptive information about the script on the line starting with #description. Use this description
107
Red Hat Enterprise Linux 8 Configuring basic system settings
Find descriptive information about the script on the line starting with #description. Use this description
together with the service name in the Description option in the [Unit] section of the unit file. The LSB
header might contain similar data on the #Short-Description and #Description lines.
The other two values specified on the #chkconfig line represent startup and shutdown priorities of the
init script. These values are interpreted by systemd if it loads the init script, but there is no unit file
equivalent.
108
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
The key information that is not included in the init script header is the path to the service executable,
and potentially some other files required by the service. In previous versions of Red Hat Enterprise Linux,
init scripts used a Bash case statement to define the behavior of the service on default actions, such as
start, stop, or restart, as well as custom-defined actions. The following excerpt from the postfix init
script shows the block of code to be executed at service start.
conf_check() {
[ -x /usr/sbin/postfix ] || exit 5
[ -d /etc/postfix ] || exit 6
[ -d /var/spool/postfix ] || exit 5
}
make_aliasesdb() {
if [ "$(/usr/sbin/postconf -h alias_database)" == "hash:/etc/aliases" ]
then
# /etc/aliases.db might be used by other MTA, make sure nothing
# has touched it since our last newaliases call
[ /etc/aliases -nt /etc/aliases.db ] ||
[ "$ALIASESDB_STAMP" -nt /etc/aliases.db ] ||
[ "$ALIASESDB_STAMP" -ot /etc/aliases.db ] || return
/usr/bin/newaliases
touch -r /etc/aliases.db "$ALIASESDB_STAMP"
else
/usr/bin/newaliases
fi
}
start() {
[ "$EUID" != "0" ] && exit 4
# Check that networking is up.
[ ${NETWORKING} = "no" ] && exit 1
conf_check
# Start daemons.
echo -n $"Starting postfix: "
make_aliasesdb >/dev/null 2>&1
[ -x $CHROOT_UPDATE ] && $CHROOT_UPDATE
/usr/sbin/postfix start 2>/dev/null 1>&2 && success || failure $"$prog start"
RETVAL=$?
[ $RETVAL -eq 0 ] && touch $lockfile
echo
return $RETVAL
}
The extensibility of the init script allowed specifying two custom functions, conf_check() and
make_aliasesdb(), that are called from the start() function block. On closer look, several external files
and directories are mentioned in the above code: the main service executable /usr/sbin/postfix, the
/etc/postfix/ and /var/spool/postfix/ configuration directories, as well as the /usr/sbin/postconf/
directory.
Systemd supports only the predefined actions, but enables executing custom executables with
109
Red Hat Enterprise Linux 8 Configuring basic system settings
Converting complex init scripts requires understanding the purpose of every statement in the script.
Some of the statements are specific to the operating system version, therefore you do not need to
translate them. On the other hand, some adjustments might be needed in the new environment, both in
unit file as well as in the service executable and supporting files.
In order to return to the default configuration of the unit, just delete custom-created configuration files
in /etc/systemd/system/. To apply changes to unit files without rebooting the system, execute:
systemctl daemon-reload
The daemon-reload option reloads all unit files and recreates the entire dependency tree, which is
needed to immediately apply any change to a unit file. As an alternative, you can achieve the same result
with the following command, which must be executed under the root user:
init q
Also, if the modified unit file belongs to a running service, this service must be restarted to accept new
settings:
IMPORTANT
110
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
IMPORTANT
For example, to extend the configuration of the network service, do not modify the
/etc/rc.d/init.d/network initscript file. Instead, create new directory
/etc/systemd/system/network.service.d/ and a systemd drop-in file
/etc/systemd/system/network.service.d/my_config.conf. Then, put the modified values
into the drop-in file. Note: systemd knows the network service as network.service,
which is why the created directory must be called network.service.d
mkdir /etc/systemd/system/name.service.d/
Replace name with the name of the service you want to extend. The above syntax applies to all unit
types.
Create a configuration file in the directory made in the previous step. Note that the file name must end
with the .conf suffix. Type:
touch /etc/systemd/system/name.service.d/config_name.conf
Replace config_name with the name of the configuration file. This file adheres to the normal unit file
structure, therefore all directives must be specified under appropriate sections, see Section 3.5.1,
“Understanding the unit file structure”.
For example, to add a custom dependency, create a configuration file with the following content:
[Unit]
Requires=new_dependency
After=new_dependency
Where new_dependency stands for the unit to be marked as a dependency. Another example is a
configuration file that restarts the service after its main process exited, with a delay of 30 seconds:
[Service]
Restart=always
RestartSec=30
It is recommended to create small configuration files focused only on one task. Such files can be easily
moved or linked to configuration directories of other services.
systemctl daemon-reload
systemctl restart name.service
111
Red Hat Enterprise Linux 8 Configuring basic system settings
To modify the httpd.service unit so that a custom shell script is automatically executed when starting
the Apache service, perform the following steps. First, create a directory and a custom configuration
file:
# mkdir /etc/systemd/system/httpd.service.d/
# touch /etc/systemd/system/httpd.service.d/custom_script.conf
Provided that the script you want to start automatically with Apache is located at
/usr/local/bin/custom.sh, insert the following text to the custom_script.conf file:
[Service]
ExecStartPost=/usr/local/bin/custom.sh
# systemctl daemon-reload
NOTE
cp /usr/lib/systemd/system/name.service /etc/systemd/system/name.service
Where name stands for the name of the service unit you wish to modify. The above syntax applies to all
unit types.
Open the copied file with a text editor, and make the desired changes. To apply the unit changes,
execute as root:
systemctl daemon-reload
systemctl restart name.service
You can specify a timeout value per service to prevent a malfunctioning service from freezing the
112
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
You can specify a timeout value per service to prevent a malfunctioning service from freezing the
system. Otherwise, timeout is set by default to 90 seconds for normal services and to 300 seconds
for SysV-compatible services.
cp /usr/lib/systemd/system/httpd.service /etc/systemd/system/httpd.service
…
[Service]
…
PrivateTmp=true
TimeoutStartSec=10
[Install]
WantedBy=multi-user.target
…
systemctl daemon-reload
NOTE
systemd-delta
For example, the output of the above command can look as follows:
113
Red Hat Enterprise Linux 8 Configuring basic system settings
-TimeoutSec=180
+TimeoutSec=240
+Restart=Always
[Install]
WantedBy=multi-user.target
Table 3.13, “systemd-delta difference types” lists override types that can appear in the output of
systemd-delta. Note that if a file is overridden, systemd-delta by default displays a summary of
changes similar to the output of the diff command.
Type Description
It is good practice to run systemd-delta after system update to check if there are any updates to the
default units that are currently overridden by custom configuration. It is also possible to limit the output
only to a certain difference type. For example, to view just the overridden units, execute:
systemd-delta --type=overridden
If you want to edit a unit file and automatically create a drop-in file with the submitted changes, use the
following command:
To dump the unit configuration applying all overrides and drop-ins, use this command:
114
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
Replace the unit_name.type_extension by the name of the required unit and its type, for example
tuned.service.
template_name@instance_name.service
Where template_name stands for the name of the template configuration file. Replace instance_name
with the name for the unit instance. Several instances can point to the same template file with
configuration options common for all instances of the unit. Template unit name has the form of:
unit_name@.service
Wants=getty@ttyA.service getty@ttyB.service
first makes systemd search for given service units. If no such units are found, the part between "@" and
the type suffix is ignored and systemd searches for the getty@.service file, reads the configuration
from it, and starts the services.
Wildcard characters, called unit specifiers, can be used in any unit configuration file. Unit specifiers
substitute certain unit parameters and are interpreted at runtime. Table 3.14, “Important unit specifiers”
lists unit specifiers that are particularly useful for template units.
115
Red Hat Enterprise Linux 8 Configuring basic system settings
For a complete list of unit specifiers, see the systemd.unit(5) manual page.
[Unit]
Description=Getty on %I
…
[Service]
ExecStart=-/sbin/agetty --noclear %I $TERM
…
When the getty@ttyA.service and getty@ttyB.service are instantiated from the above template,
Description= is resolved as Getty on ttyA and Getty on ttyB.
The purpose of systemd units enabled by default, and circumstances under which you can safely
disable such systemd units in order to shorten the boot time.
For a complete list and detailed description of all options, see the systemd-analyze man page.
Prerequisites
Before starting to examine systemd in order to tune the boot time, you may want to list all enabled
services:
116
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
Procedure
For the overall information about the time that the last successful boot took, use:
$ systemd-analyze
Procedure
For the information about the initialization time of each systemd unit, use:
$ systemd-analyze blame
The output lists the units in descending order according to the time they took to initialize during the last
successful boot.
Procedure
To identify the units that took most time to initialize at the last successful boot, use:
$ systemd-analyze critical-chain
The output highlights the units that critically slow down the boot with the red color.
117
Red Hat Enterprise Linux 8 Configuring basic system settings
However, certain services must stay enabled in order that your operating system is safe and functions in
the way you need.
You can use the table below as a guide to selecting the services that you can safely disable. The table
lists all services enabled by default on a minimal installation of Red Hat Enterprise Linux 8, and for each
service it states whether this service can be safely disabled.
The table also provides more information about the circumstances under which the service can be
disabled, or the reason why you should not disable the service.
auditd.servic yes Disable auditd.service only if you do not need audit messages
e from the kernel. Be aware that if you disable auditd.service, the
/var/log/audit/audit.log file is not produced. Consequently, you
are not able to retroactively review some commonly-reviewed
actions or events, such as user logins, service starts or password
changes. Also note that auditd has two parts: a kernel part, and a
service itself. By using the systemctl disable auditd command,
you only disable the service, but not the kernel part. To disable
system auditing in its entirety, set audit=0 on kernel command
line.
autovt@.servi no This service runs only when it is really needed, so it does not need
ce to be disabled.
crond.service yes Be aware that no items from crontab will run if you disable
crond.service.
118
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
getty@.servic no This service runs only when it is really needed, so it does not need
e to be disabled.
irqbalance.se yes Disable irqbalance.service only if you have just one CPU. Do not
rvice disable irqbalance.service on systems with multiple CPUs.
kdump.servic yes Disable kdump.service only if you do not need reports from
e kernel crashes.
119
Red Hat Enterprise Linux 8 Configuring basic system settings
rhsmcertd.se no
rvice
rngd.service yes Disable rngd.service only if you do not need a lot of entropy on
your system, or you do not have any sort of hardware generator.
Note that the service is necessary in environments that require a
lot of good entropy, such as systems used for generation of X.509
certificates (for example the FreeIPA server).
rsyslog.servic yes Disable rsyslog.service only if you do not need persistent logs,
e or you set systemd-journald to persistent mode.
sshd.service yes Disable sshd.service only if you do not need remote logins by
OpenSSH server.
sssd.service yes Disable sssd.service only if there are no users who log in the
system over the network (for example by using LDAP or Kerberos).
Red Hat recommends to disable all sssd-* units if you disable
sssd.service.
120
CHAPTER 3. MANAGING SERVICES WITH SYSTEMD
To find more information about a service, you can run one of the following commands:
The systemctl cat command provides the content of the service file located under
/usr/lib/systemd/system/<service>, as well as all applicable overrides. The applicable overrides include
unit file overrides from the /etc/systemd/system/<service> file or drop-in files from a corresponding
unit.type.d directory.
For more information on drop-in files, see the systemd.unit man page.
The systemctl help command shows the man page of the particular service.
systemd(1) — The manual page for the systemd system and service manager provides more
information about its concepts and documents available command line options and
environment variables, supported configuration files and directories, recognized signals, and
available kernel options.
systemd-delta(1) — The manual page for the systemd-delta utility that allows to find extended
and overridden configuration files.
systemd.unit(5) — The manual page named systemd.unit provides detailed information about
systemd unit files and documents all available configuration options.
systemd.target(5) — The manual page named systemd.target documents the format of target
unit files.
systemd.kill(5) — The manual page named systemd.kill documents the configuration of the
process killing procedure.
121
Red Hat Enterprise Linux 8 Configuring basic system settings
A user who creates a file is the owner of that file and the group owner of that file. The file is assigned
separate read, write, and execute permissions for the owner, the group, and those outside that group.
The file owner can be changed only by the root user. Access permissions to the file can be changed by
both the root user and the file owner. A regular user can change group ownership of a file they own to a
group of which they are a member of.
Each user is associated with a unique numerical identification number called user ID (UID). Each group is
associated with a group ID (GID). Users within a group share the same permissions to read, write, and
execute files owned by that group.
cat /usr/share/doc/setup*/uidgid
It is recommended to assign IDs to the new users and groups starting at 5000, as the reserved range
can increase in the future.
To make the IDs assigned to new users start at 5000 by default, modify the UID_MIN and GID_MIN
parameters in the /etc/login.defs file.
Procedure
To modify make the IDs assigned to new users start at 5000 by default, use:
2. Find the lines that define the minimum value for automatic UID selection.
122
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
4. Find the lines that define the minimum value for automatic GID selection.
Note that for users and groups created before you changed the UID_MIN and GID_MIN values, UIDs
and GIDs still start at the default 1000.
WARNING
Do not raise IDs reserved by the system above 1000 by changing SYS_UID_MAX to
avoid conflict with systems that retain the 1000 limit.
UPGs simplify the collaboration on a project between multiple users. In addition, UPG system
configuration makes it safe to set default permissions for a newly created file or directory, as it allows
both the user, and the group this user is a part of, to make modifications to the file or directory.
Prerequisites
123
Red Hat Enterprise Linux 8 Configuring basic system settings
Enabled networking.
The RHEL web console is a Red Hat Enterprise Linux 8 web-based interface designed for managing and
monitoring your local system, as well as Linux servers located in your network environment.
The RHEL web console enables you a wide range of administration tasks, including:
Managing services
Configuring SELinux
124
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
Updating software
The RHEL web console uses the same system APIs as you would in a terminal, and actions performed in
a terminal are immediately reflected in the RHEL web console.
You can monitor the logs of systems in the network environment, as well as their performance, displayed
as graphs. In addition, you can change the settings directly in the web console or through the terminal.
Red Hat Enterprise Linux 8 includes the RHEL 8 web console installed by default in many installation
variants.
If this is not the case on your system, install the cockpit package and set up the cockpit.socket service
to enable the RHEL 8 web console.
Procedure
2. Enable and start the cockpit.socket service, which runs a web server:
3. If you are using a custom firewall profile, add the cockpit service to firewalld to open port 9090
in the firewall:
Verification steps
1. To verify the previous installation and configuration, you open the web console.
Use the steps in this procedure for the first login to the RHEL web console using a system user name
and password.
Prerequisites
Use one of the following browsers for opening the web console:
The RHEL web console uses a specific PAM stack located at /etc/pam.d/cockpit. Authentication
with PAM allows you to log in with the user name and password of any local account on the
system.
Procedure
Locally: https://localhost:9090
The console loads a certificate from the /etc/cockpit/ws-certs.d directory and uses the last
file with a .cert extension in alphabetical order. To avoid having to grant security exceptions,
install a certificate signed by a certificate authority (CA).
2. In the login screen, enter your system user name and password.
It is possible to connect to your web console interface from any client operating system and also from
126
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
It is possible to connect to your web console interface from any client operating system and also from
mobile phones or tablets. The following procedure shows how to do it.
Prerequisites
RHEL 8 server you want to access with an installed and accessible web console. For more
information about the installation of the web console see Installing the web console .
Procedure
3. After the login interface opens, log in with your RHEL machine credentials.
Complete this procedure to login into the RHEL web console using a one-time password (OTP).
IMPORTANT
It is possible to log in using a one-time password only if your system is part of an Identity
Management (IdM) domain with enabled OTP configuration. For more information about
OTP in IdM, see One-time password in Identity Management .
Prerequisites
Procedure
Locally: https://localhost:PORT_NUMBER
127
Red Hat Enterprise Linux 8 Configuring basic system settings
The console loads a certificate from the /etc/cockpit/ws-certs.d directory and uses the last
file with a .cert extension in alphabetical order. To avoid having to grant security exceptions,
install a certificate signed by a certificate authority (CA).
2. The Login window opens. In the Login window, enter your system user name and password.
4. Enter the one-time password into a new field that appears in the web console interface after
you confirm your password.
6. Succesful login takes you to the Overview page of the web console interface.
Prerequisites
Being logged into the RHEL web console with an account that has administrator permissions
assigned. For details, see Logging in to the RHEL web console .
With user accounts displayed in the RHEL web console you can:
The RHEL web console displays all user accounts located in the system. Therefore, you can see at least
one user account just after the first login to the web console.
After logging into the RHEL web console, you can perform the following operations:
Lock accounts.
128
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
Use the following steps for adding user accounts to the system and setting administration rights to the
accounts through the RHEL web console.
Prerequisites
The RHEL web console must be installed and accessible. For details, see Installing the web
console.
Procedure
2. Click Accounts.
4. In the Full Name field, enter the full name of the user.
The RHEL web console automatically suggests a user name from the full name and fills it in the
User Name field. If you do not want to use the original naming convention consisting of the first
letter of the first name and the whole surname, update the suggestion.
5. In the Password/Confirm fields, enter the password and retype it for verification that your
password is correct. The color bar placed below the fields shows you security level of the
entered password, which does not allow you to create a user with a weak password.
129
Red Hat Enterprise Linux 8 Configuring basic system settings
6. Click Create to save the settings and close the dialog box.
Now you can see the new account in the Accounts settings and you can use the credentials to connect
to the system.
By default, user accounts have set passwords to never expire. To enforce password expiration, as
administrator, set system passwords to expire after a defined number of days.
When the password expires, the next login attempt will prompt for a password change.
130
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
Procedure
2. Click Accounts.
5. In the Password Expiration dialog box, select Require password change every … days and
enter a positive whole number representing the number of days when the password expires.
6. Click Change.
To verify the settings, open the account settings. The RHEL 8 web console displays a link with the date
of expiration.
A user creates user sessions when logging into the system. Terminating user sessions means to log the
user out from the system.
131
Red Hat Enterprise Linux 8 Configuring basic system settings
It can be helpful if you need to perform administrative tasks sensitive to configuration changes, for
example, system upgrades.
In each user account in the RHEL 8 web console, you can terminate all sessions for the account except
for the web console session you are currently using. This prevents you from cutting yourself off the
system.
Procedure
2. Click Accounts.
3. Click the user account for which you want to terminate the session.
If the Terminate Session button is inactive, the user is not logged in to the system.
Prerequisites
Root access.
132
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
Procedure
Replace options with the command-line options for the useradd command, and replace
username with the name of the user.
Example
Verification steps
# id sarah
Additional resources
For more information about useradd, see the useradd man page.
Procedure
Replace options with the command-line options for the groupadd command, and replace
group-name with the name of the group.
Example
Verification steps
133
Red Hat Enterprise Linux 8 Configuring basic system settings
Verification steps
# tail /etc/group
sysadmins:x:5000:
Additional resources
For more information about useradd, see the groupadd man page.
Procedure
Replace group-name with the name of the group, and replace username with the name of the
user.
Example
Verification steps
To verify the new groups is added to the supplementary groups of the user sysadmin, use:
# groups sysadmin
134
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
This section describes how to use the usermod command to override the primary group of the user.
Procedure
Replace group-name with the name of the group, and replace username with the name of the
user.
Example
If the user sarah belongs to the primary groups sarah1, and you want to change the primary
group of the user to sarah2, use:
Verification steps
# groups sarah
sarah : sarah2
This section describes how to use the usermod command to override the supplementary groups of the
user.
Procedure
Replace group-name with the name of the group, and replace username with the name of the
user.
Example
If the user sarah belongs to the system-administrator group and to the developer group and
you want to remove the user sarah from the system-administrator group, you can do that by
replacing the old list of groups with a new one. To do that, use:
135
Red Hat Enterprise Linux 8 Configuring basic system settings
Verification steps
To verify that the supplementary groups of the user are overridden, use:
# groups sarah
Procedure
1. Create a directory:
# mkdir directory-name
2. Create a group:
# groupadd group-name
Replace group-name with the name of the group, and replace username with the name of the
user.
4. Associate the user and group ownership of the directory with the group-name group:
Replace group-name with the name of the group, and replace directory-name with the name of
the directory.
5. Set the write permissions to allow the users to create and modify files and directories and set
the setgid bit to make this permission be applied within the directory-name directory:
136
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
Now all members of the group-name group can create and edit files in the directory-name
directory. Newly created files retain the group ownership of group-name group.
Verification steps
# ls -ld directory-name
When users need to perform an administrative command, they can precede that command with sudo.
The command is then executed as if they were the root user.
Only users listed in the /etc/sudoers configuration file can use the sudo command.
The command is executed in the shell of the user, not in the root shell.
Prerequisites
Root access.
Procedure
# visudo
The /etc/sudoers file defines the policies applied by the sudo command.
2. In the /etc/sudoers file find the lines that grant sudo access to users in the administrative
137
Red Hat Enterprise Linux 8 Configuring basic system settings
2. In the /etc/sudoers file find the lines that grant sudo access to users in the administrative
wheel group.
3. Make sure the line that starts with %wheel does not have # comment character before it.
5. Add users you want to grant sudo access to into the administrative wheel group .
Example
Verification steps
To verify the user is added to the administrative wheel group, use the id utility.
# id sarah
Prerequisites
Root access.
138
CHAPTER 4. MANAGING USER AND GROUP ACCOUNTS
Procedure
# passwd
You are prompted to enter your current password before you can change it.
Prerequisites
Procedure
To change or reset the root password as a non-root user that belongs to the wheel group, use:
You are prompted to enter your current non-root password before you can change the root
password.
Procedure
1. Reboot the system and, on the GRUB 2 boot screen, press the e key to interrupt the boot
process.
The kernel boot parameters appear.
load_video
set gfx_payload=keep
insmod gzio
linux ($root)/vmlinuz-4.18.0-80.e18.x86_64 root=/dev/mapper/rhel-root ro crash\
kernel=auto resume=/dev/mapper/rhel-swap rd.lvm.lv/swap rhab quiet
initrd ($root)/initramfs-4.18.0-80.e18.x86_64.img $tuned_initrd
3. Add rd.break to the end of the line that starts with linux.
139
Red Hat Enterprise Linux 8 Configuring basic system settings
The file system is mounted as read-only in the /sysroot directory. Remounting the file system
as writable allows you to change the password.
chroot /sysroot
passwd
Follow the instructions displayed by the command line to finalize the change of the root
password.
touch /.autorelabel
exit
exit
11. Wait until the SELinux relabeling process is finished. Note that relabeling a large disk might take
a long time. The system reboots automatically when the process is complete.
140
CHAPTER 5. MANAGING FILE PERMISSIONS
Others (o).
Read (r).
Write (w).
Execute (x).
Note that the execute permission for a file allows you to execute that file. The execute permission for a
directory allows you to access the contents of the directory, but not execute it.
When a new file or directory is created, the default set of permission is automatically assigned to it. The
default permission for a file or directory is based on two factors:
Base permission.
Base permissions for a file or directory can be expressed in symbolic or octal values.
No permission --- 0
Execute --x 1
Write -w- 2
Read r-- 4
141
Red Hat Enterprise Linux 8 Configuring basic system settings
The base permission for a directory is 777 (drwxrwxrwx), which grants everyone the permissions to
read, write, and execute. This means that the directory owner, the group, and others can list the
contents of the directory, create, delete, and edit items within the directory, and descend into it.
Note that individual files within a directory can have their own permission that might prevent you from
editing them, despite having unrestricted access to the directory.
The base permission for a file is 666 (-rw-rw-rw-), which grants everyone the permissions to read and
write. This means that the file owner, the group, and others can read and edit the file.
Example 1
If a file has the following permissions:
$ ls -l
-rwxrw----. 1 sysadmins sysadmins 2 Mar 2 08:43 file
- indicates it is a file.
rwx indicates that the file owner has permissions to read, write, and execute the file.
rw- indicates that the group has permissions to read and write, but not execute the file.
--- indicates that other users have no permission to read, write, or execute the file.
. indicates that the SELinux security context is set for the file.
Example 2
If a directory has the following permissions:
$ ls -dl
drwxr-----. 1 sysadmins sysadmins 2 Mar 2 08:43 directory
d indicates it is a directory.
rwx indicates that the directory owner has the permissions to read, write, and access the
contents of the directory.
As a directory owner, you can list the items (files, subdirectories) within the directory, access the
content of those items, and modify them.
r-- indicates that the group has permissions to read, but not write or access the contents of the
directory.
As a member of the group that owns the directory, you can list the items within the directory.
You cannot access information about the items within the directory or modify them.
--- indicates that other users have no permission to read, write, or access the contents of the
directory.
As someone who is not an user owner, or as group owner of the directory, you cannot list the
items within the directory, access information about those items, or modify them.
. indicates that the SELinux security context is set for the directory.
NOTE
142
CHAPTER 5. MANAGING FILE PERMISSIONS
NOTE
The base permission that is automatically assigned to a file or directory is not the default
permission the file or directory ends up with. When you create a file or directory, the base
permission is altered by the umask. The combination of the base permission and the
umask creates the default permission for files and directories.
Read r-- 3
Write -w- 5
Execute --x 6
No permissions --- 7
The default umask for a standard user is 0002. The default umask for a root user is 0022.
The first digit of the umask represents special permissions (sticky bit, ). The last three digits of the
umask represent the permissions that are removed from the user owner ( u), group owner (g), and
others (o) respectively.
Example
The following example illustrates how the umask with an octal value of 0137 is applied to the file with the
base permission of 777, to create the file with the default permission of 640.
Example 1
When a standard user creates a new directory, the umask is set to 002 (rwxrwxr-x), and the base
permission for a directory is set to 777 (rwxrwxrwx). This brings the default permission to 775
(drwxrwxr-x).
This means that the directory owner and the group can list the contents of the directory, create, delete,
and edit items within the directory, and descend into it. Other users can only list the contents of the
directory and descend into it.
Example 2
When a standard user creates a new file, the umask is set to 002 (rwxrwxr-x), and the base permission
for a file is set to 666 (rw-rw-rw-). This brings the default permission to 664 (-rw-rw-r--).
144
CHAPTER 5. MANAGING FILE PERMISSIONS
This means that the file owner and the group can read and edit the file, while other users can only read
the file.
Example 3
When a root user creates a new directory, the umask is set to 022 (rwxr-xr-x), and the base permission
for a directory is set to 777 (rwxrwxrwx). This brings the default permission to 755 (rwxr-xr-x).
This means that the directory owner can list the contents of the directory, create, delete, and edit items
within the directory, and descend into it. The group and others can only list the contents of the directory
and descend into it.
Example 4
When a root user creates a new file, the umask is set to 022 (rwxr-xr-x), and the base permission for a
file is set to 666 (rw-rw-rw-). This brings the default permission to 644 (-rw-r—r--).
This means that the file owner can read and edit the file, while the group and others can only read the
file.
NOTE
For security reasons, regular files cannot have execute permissions by default, even if the
umask is set to 000 (rwxrwxrwx). However, directories can be created with execute
permissions.
145
Red Hat Enterprise Linux 8 Configuring basic system settings
Procedure
$ ls -dl directory-name
To see the permissions for a particular directory and all files within that directory, use:
$ ls -l directory-name
$ ls -l file-name
Additional information
Read (r).
Write (w).
Execute (x).
Other (o).
146
CHAPTER 5. MANAGING FILE PERMISSIONS
All (a).
To add or take away the permissions you can use the following signs:
= to omit the existing permissions and explicitly define the new ones.
The following section describes how to set and remove file permissions using the symbolic values.
Procedure
Replace file-name with the name of the file or directory, and replace symbolic_value for user,
groups, and others with corresponding symbolic values. See Section 5.1.1, “Base permissions” for
more details.
Example
To change file permissions for my-file.txt from 664 (-rw-rw-r--) to 740 (-rwx-r---), use:
Note that any permission that is not specified after the equals sign (=) is automatically
prohibited.
To set the same permissions for user, group, and others, use:
Replace file-name with the name of the file or directory, and replace symbolic_value with a
symbolic value. See Section 5.1.1, “Base permissions” for more details.
Example
To set the permission for my-file.txt to 777 (-rwxrwxrwx or drwxrwxrwx), use:
To change the permissions for a directory and all its sub-directories, add the -R option:
Replace directory-name with the name of the directory, and replace symbolic_value with a
symbolic value. See Section 5.1.1, “Base permissions” for more details.
Example
To change the permissions for /my-directory/ and all its sub-directories from 775 (drwxrwxr-x)
to 740 (drwx-r---), use:
147
Red Hat Enterprise Linux 8 Configuring basic system settings
Procedure
Replace file-name with the name of the file or directory, and replace octal_value with an octal
value. See Section 5.1.1, “Base permissions” for more details.
Procedure:
To display the current octal value of the umask for a standard user, use:
$ umask
To display the current octal value of the umask for a root user, use:
$ sudo umask
Or:
# umask
NOTE
When displaying the umask, you may notice it displayed as a four digit number ( 0002 or
0022). The first digit of the umask represents a special bit (sticky bit, SGID bit, or SUID
bit). If the first digit is set to 0, the special bit is not set.
148
CHAPTER 5. MANAGING FILE PERMISSIONS
The following section describes how to use the umask command to display the current umask.
Procedure
$ umask -S
To display the current symbolic value of the umask for a root user, use:
$ sudo umask -S
Or:
# umask -S
Those shells can behave as login or non-login shells. The login shell is typically invoked by opening a
native or a GUI terminal.
To determine whether you are executing a command in a login or a non-login shell, use the echo $0
command.
In bash shell, if the output returns bash, you are executing a command in a non-login shell.
$ echo $0
bash
The default umask for the non-login shell is set in /etc/bashrc configuration file.
If the output returns -bash, you are executing a command in a login shell.
# echo $0
-bash
The default umask for the login shell is set in /etc/profile configuration file.
Procedure
To display the default bash umask for the non-login shell, use:
# By default, we want umask to get set. This sets it for non-login shell.
umask 002
umask 022
To display the default bash umask for the login shell, use:
149
Red Hat Enterprise Linux 8 Configuring basic system settings
# By default, we want umask to get set. This sets it for login shell
umask 002
umask 022
Note that the umask is valid only during the current shell session and reverts to the default umask after
the session is complete.
Procedure
To set or remove permissions for the current shell session, you can use minus (-), plus (+), and
equals (=) signs in combination with symbolic values.
$ umask -S u=symbolic_value,g+symbolic_value,o-symbolic_value
Replace symbolic_value for user, group, and others with symbolic values. See Section 5.1.2,
“User file-creation mode mask” for more details.
Example
If your current umask is set to 113 (u=rw-,g=rw-,o=r--) and you want to set it to 037 (u=rwx,g=-
r-,o=---), use:
$ umask -S u+x,g-w,o=
Note that any permission that is not specified after the equals sign (=) is automatically
prohibited.
To set the same permissions for user, group, and others, use:
$ umask a=symbolic_value
Replace symbolic_value with a symbolic value. See Section 5.1.2, “User file-creation mode mask”
for more details.
Example
To set the umask to 000 (u=rwx,g=rwx,o=rwx), use:
150
CHAPTER 5. MANAGING FILE PERMISSIONS
$ umask a=rwx
Note that the umask is only valid for the current shell session.
Procedure
To set the umask for the current shell session using octal values, use:
$ umask octal_value
Replace octal_value with an octal value. See Section 5.1.2, “User file-creation mode mask” for
more details.
Note that the umask is only valid for the current shell session.
Prerequisites
Root access.
Procedure
Replace the default octal value of the umask (002) with another octal value. See Section 5.1.2,
“User file-creation mode mask” for more details.
151
Red Hat Enterprise Linux 8 Configuring basic system settings
Procedure
Replace the default octal value of the umask (022) with another octal value. See Section 5.1.2,
“User file-creation mode mask” for more details.
Procedure
Put the line that specifies the octal value of the umask into the .bashrc file for the particular
user.
Replace octal_value with an octal value and replace username with the name of the user. See
Section 5.1.2, “User file-creation mode mask” for more details.
Procedure
Replace the default octal value (077) with another octal value. See Section 5.1.2, “User file-
creation mode mask” for more details.
152
CHAPTER 5. MANAGING FILE PERMISSIONS
Procedure
$ getfacl file-name
Prerequisites
Root access
Procedure
Replace username with the name of the user, symbolic_value with a symbolic value, and file-name with
the name of the file or directory. For more information see the setfacl man page.
Example
The following example describes how to modify permissions for the group-project file owned by the
root user that belongs to the root group so that this file is:
153
Red Hat Enterprise Linux 8 Configuring basic system settings
Procedure
Verification steps
To verify that the user andrew has the rw- permission, the user susan has the --- permission,
and other users have the r-- permission, use:
$ getfacl group-project
# file: group-project
# owner: root
# group: root
user:andrew:rw-
user:susan:---
group::r--
mask::rw-
other::r--
154
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
The user space daemon updates the system clock running in the kernel. The system clock can keep time
by using various clock sources. Usually, the Time Stamp Counter (TSC) is used. The TSC is a CPU
register which counts the number of cycles since it was last reset. It is very fast, has a high resolution,
and there are no interruptions.
In Red Hat Enterprise Linux 8, the NTP protocol is implemented by the chronyd daemon, available from
the repositories in the chrony package.
To synchronize the system clock with a reference clock, for example a GPS receiver
As an NTPv4(RFC 5905) server or peer to provide a time service to other computers in the
network
chrony performs well in a wide range of conditions, including intermittent network connections, heavily
congested networks, changing temperatures (ordinary computer clocks are sensitive to temperature),
and systems that do not run continuously, or run on a virtual machine.
Typical accuracy between two machines synchronized over the Internet is within a few milliseconds, and
for machines on a LAN within tens of microseconds. Hardware timestamping or a hardware reference
clock may improve accuracy between two machines synchronized to a sub-microsecond level.
chrony consists of chronyd, a daemon that runs in user space, and chronyc, a command line program
which can be used to monitor the performance of chronyd and to change various operating parameters
when it is running.
The chrony daemon, chronyd, can be monitored and controlled by the command line utility chronyc.
This utility provides a command prompt which allows entering a number of commands to query the
current state of chronyd and make changes to its configuration. By default, chronyd accepts only
commands from a local instance of chronyc, but it can be configured to accept monitoring commands
also from remote hosts. The remote access should be restricted.
# chronyc
155
Red Hat Enterprise Linux 8 Configuring basic system settings
chronyc must run as root if some of the restricted commands are to be used.
chronyc>
The utility can also be invoked in non-interactive command mode if called together with a command as
follows:
chronyc command
NOTE
Changes made using chronyc are not permanent, they will be lost after a chronyd
restart. For permanent changes, modify /etc/chrony.conf.
Both ntp and chrony can operate as an NTP client in order to synchronize the system clock with NTP
servers and they can operate as an NTP server for other computers in the network. Each implementation
has some unique features. For comparison of ntp and chrony, see Comparison of NTP
implementations.
Configuration specific to an NTP client is identical in most cases. NTP servers are specified with the
server directive. A pool of servers can be specified with the pool directive.
Configuration specific to an NTP server differs in how the client access is controlled. By default, ntpd
responds to client requests from any address. The access can be restricted with the restrict directive,
but it is not possible to disable the access completely if ntpd uses any servers as a client. chronyd
allows no access by default and operates as an NTP client only. To make chrony operate as an NTP
server, you need to specify some addresses within the allow directive.
ntpd and chronyd differ also in the default behavior with respect to corrections of the system clock.
ntpd corrects the clock by step when the offset is larger than 128 milliseconds. If the offset is larger than
1000 seconds, ntpd exits unless it is the first correction of the clock and ntpd is started with the -g
option. chronyd does not step the clock by default, but the default chrony.conf file provided in the
chrony package allows steps in the first three updates of the clock. After that, all corrections are made
slowly by speeding up or slowing down the clock. The chronyc makestep command can be issued to
force chronyd to step the clock at any time.
In Red Hat Enterprise Linux 8, ntp is no longer supported. chrony is enabled by default. For this reason,
you might need to migrate from ntp to chrony.
156
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
Migrating from ntp to chrony is straightforward in most cases. The corresponding names of the
programs, configuration files and services are:
Table 6.1. Corresponding names of the programs, configuration files and services when migrating
from ntp to chrony
/etc/ntp.conf /etc/chrony.conf
/etc/ntp/keys /etc/chrony.keys
ntpd chronyd
ntpq chronyc
ntpd.service chronyd.service
ntp-wait.service chrony-wait.service
The ntpdate and sntp utilities, which are included in the ntp distribution, can be replaced with chronyd
using the -q option or the -t option. The configuration can be specified on the command line to avoid
reading /etc/chrony.conf. For example, instead of running ntpdate ntp.example.com, chronyd could
be started as:
The ntpstat utility, which was previously included in the ntp package and supported only ntpd, now
supports both ntpd and chronyd. It is available in the ntpstat package.
By default, the script does not overwrite any files. If /etc/chrony.conf or /etc/chrony.keys already exist,
the -b option can be used to rename the file as a backup. The script supports other options. The --help
option prints all supported options.
An example of an invocation of the script with the default ntp.conf provided in the ntp package is:
# python3 /usr/share/doc/chrony/ntp2chrony.py -b -v
Reading /etc/ntp.conf
157
Red Hat Enterprise Linux 8 Configuring basic system settings
Reading /etc/ntp/crypto/pw
Reading /etc/ntp/keys
Writing /etc/chrony.conf
Writing /etc/chrony.keys
The only directive ignored in this case is disable monitor, which has a chrony equivalent in the
noclientlog directive, but it was included in the default ntp.conf only to mitigate an amplification attack.
The generated chrony.conf file typically includes a number of allow directives corresponding to the
restrict lines in ntp.conf. If you do not want to run chronyd as an NTP server, remove all allow directives
from chrony.conf.
Additional resources
For a detailed reference on timesync role variables, install the rhel-system-roles package, and
see the README.md or README.html files in the /usr/share/doc/rhel-system-
roles/timesync directory.
For more information on RHEL System Roles, see Introduction to RHEL System Roles .
Comments
Comments should be preceded by #, %, ; or !
allow
Optionally specify a host, subnet, or network from which to allow NTP connections to a machine
acting as NTP server. The default is not to allow connections.
Examples:
allow 192.0.2.0/24
allow 2001:0db8:85a3::8a2e:0370:7334
The UDP port number 123 needs to be open in the firewall in order to allow the client access:
158
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
If you want to open port 123 permanently, use the --permanent option:
cmdallow
This is similar to the allow directive (see section allow), except that it allows control access (rather
than NTP client access) to a particular subnet or host. (By "control access" is meant that chronyc
can be run on those hosts and successfully connect to chronyd on this computer.) The syntax is
identical. There is also a cmddeny all directive with similar behavior to the cmdallow all directive.
dumpdir
Path to the directory to save the measurement history across restarts of chronyd (assuming no
changes are made to the system clock behavior whilst it is not running). If this capability is to be used
(via the dumponexit command in the configuration file, or the dump command in chronyc), the
dumpdir command should be used to define the directory where the measurement histories are
saved.
dumponexit
If this command is present, it indicates that chronyd should save the measurement history for each
of its time sources recorded whenever the program exits. (See the dumpdir command above).
hwtimestamp
The hwtimestamp directive enables hardware timestamping for extremely accurate synchronization.
For more details, see the chrony.conf(5) manual page.
local
The local keyword is used to allow chronyd to appear synchronized to real time from the viewpoint
of clients polling it, even if it has no current synchronization source. This option is normally used on
the "master" computer in an isolated network, where several computers are required to synchronize
to one another, and the "master" is kept in line with real time by manual input.
An example of the command is:
local stratum 10
A large value of 10 indicates that the clock is so many hops away from a reference clock that its time
is unreliable. If the computer ever has access to another computer which is ultimately synchronized to
a reference clock, it will almost certainly be at a stratum less than 10. Therefore, the choice of a high
value like 10 for the local command prevents the machine’s own time from ever being confused with
real time, were it ever to leak out to clients that have visibility of real servers.
log
The log command indicates that certain information is to be logged. It accepts the following options:
measurements
This option logs the raw NTP measurements and related information to a file called
measurements.log.
statistics
This option logs information about the regression processing to a file called statistics.log.
tracking
This option logs changes to the estimate of the system’s gain or loss rate, and any slews made, to
a file called tracking.log.
rtc
This option logs information about the system’s real-time clock.
159
Red Hat Enterprise Linux 8 Configuring basic system settings
refclocks
This option logs the raw and filtered reference clock measurements to a file called refclocks.log.
tempcomp
This option logs the temperature measurements and system rate compensations to a file called
tempcomp.log.
The log files are written to the directory specified by the logdir command.
logdir
This directive allows the directory where log files are written to be specified.
An example of the use of this directive is:
logdir /var/log/chrony
makestep
Normally chronyd will cause the system to gradually correct any time offset, by slowing down or
speeding up the clock as required. In certain situations, the system clock may be so far adrift that this
slewing process would take a very long time to correct the system clock. This directive forces
chronyd to step system clock if the adjustment is larger than a threshold value, but only if there were
no more clock updates since chronyd was started than a specified limit (a negative value can be used
to disable the limit). This is particularly useful when using reference clock, because the initstepslew
directive only works with NTP sources.
An example of the use of this directive is:
makestep 1000 10
This would step the system clock if the adjustment is larger than 1000 seconds, but only in the first
ten clock updates.
maxchange
This directive sets the maximum allowed offset corrected on a clock update. The check is performed
only after the specified number of updates to allow a large initial adjustment of the system clock.
When an offset larger than the specified maximum occurs, it will be ignored for the specified number
of times and then chronyd will give up and exit (a negative value can be used to never exit). In both
cases a message is sent to syslog.
An example of the use of this directive is:
maxchange 1000 1 2
After the first clock update, chronyd will check the offset on every clock update, it will ignore two
adjustments larger than 1000 seconds and exit on another one.
maxupdateskew
One of chronyd's tasks is to work out how fast or slow the computer’s clock runs relative to its
reference sources. In addition, it computes an estimate of the error bounds around the estimated
value.
160
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
If the range of error is too large, it indicates that the measurements have not settled down yet, and
that the estimated gain or loss rate is not very reliable.
The maxupdateskew parameter is the threshold for determining whether an estimate is too
unreliable to be used. By default, the threshold is 1000 ppm.
maxupdateskew skew-in-ppm
Typical values for skew-in-ppm might be 100 for a dial-up connection to servers over a telephone
line, and 5 or 10 for a computer on a LAN.
It should be noted that this is not the only means of protection against using unreliable estimates. At
all times, chronyd keeps track of both the estimated gain or loss rate, and the error bound on the
estimate. When a new estimate is generated following another measurement from one of the
sources, a weighted combination algorithm is used to update the master estimate. So if chronyd has
an existing highly-reliable master estimate and a new estimate is generated which has large error
bounds, the existing master estimate will dominate in the new master estimate.
minsources
The minsources directive sets the minimum number of sources that need to be considered as
selectable in the source selection algorithm before the local clock is updated.
The format of the syntax is:
minsources number-of-sources
By default, number-of-sources is 1. Setting minsources to a larger number can be used to improve the
reliability, because multiple sources will need to correspond with each other.
noclientlog
This directive, which takes no arguments, specifies that client accesses are not to be logged.
Normally they are logged, allowing statistics to be reported using the clients command in chronyc
and enabling the clients to use interleaved mode with the xleave option in the server directive.
reselectdist
When chronyd selects synchronization source from available sources, it will prefer the one with
minimum synchronization distance. However, to avoid frequent reselecting when there are sources
with similar distance, a fixed distance is added to the distance for sources that are currently not
selected. This can be set with the reselectdist option. By default, the distance is 100 microseconds.
The format of the syntax is:
reselectdist dist-in-seconds
stratumweight
The stratumweight directive sets how much distance should be added per stratum to the
synchronization distance when chronyd selects the synchronization source from available sources.
The format of the syntax is:
stratumweight dist-in-seconds
By default, dist-in-seconds is 1 millisecond. This means that sources with lower stratum are usually
161
Red Hat Enterprise Linux 8 Configuring basic system settings
By default, dist-in-seconds is 1 millisecond. This means that sources with lower stratum are usually
preferred to sources with higher stratum even when their distance is significantly worse. Setting
stratumweight to 0 makes chronyd ignore stratum when selecting the source.
rtcfile
The rtcfile directive defines the name of the file in which chronyd can save parameters associated
with tracking the accuracy of the system’s real-time clock (RTC).
The format of the syntax is:
rtcfile /var/lib/chrony/rtc
chronyd saves information in this file when it exits and when the writertc command is issued in
chronyc. The information saved is the RTC’s error at some epoch, that epoch (in seconds since
January 1 1970), and the rate at which the RTC gains or loses time. Not all real-time clocks are
supported as their code is system-specific. Note that if this directive is used then the real-time clock
should not be manually adjusted as this would interfere with chrony's need to measure the rate at
which the real-time clock drifts if it was adjusted at random intervals.
rtcsync
The rtcsync directive is present in the /etc/chrony.conf file by default. This will inform the kernel the
system clock is kept synchronized and the kernel will update the real-time clock every 11 minutes.
Unix domain socket, which is accessible locally by the root or chrony user.
By default, chronyc connects to the Unix domain socket. The default path is
/var/run/chrony/chronyd.sock. If this connection fails, which can happen for example when chronyc is
running under a non-root user, chronyc tries to connect to 127.0.0.1 and then ::1.
Only the following monitoring commands, which do not affect the behavior of chronyd, are allowed from
the network:
activity
manual list
rtcdata
smoothing
sources
sourcestats
tracking
waitsync
The set of hosts from which chronyd accepts these commands can be configured with the cmdallow
162
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
The set of hosts from which chronyd accepts these commands can be configured with the cmdallow
directive in the configuration file of chronyd, or the cmdallow command in chronyc. By default, the
commands are accepted only from localhost (127.0.0.1 or ::1).
All other commands are allowed only through the Unix domain socket. When sent over the network,
chronyd responds with a Not authorised error, even if it is from localhost.
1. Allow access from both IPv4 and IPv6 addresses by adding the following to the
/etc/chrony.conf file:
bindcmdaddress 0.0.0.0
or
bindcmdaddress :
2. Allow commands from the remote IP address, network, or subnet by using the cmdallow
directive.
Add the following content to the /etc/chrony.conf file:
cmdallow 192.168.1.0/24
Note that the allow directive is for NTP access whereas the cmdallow directive is to enable receiving of
remote commands. It is possible to make these changes temporarily using chronyc running locally. Edit
the configuration file to make permanent changes.
The default location for the chrony daemon is /usr/sbin/chronyd. The command line utility will be
installed to /usr/bin/chronyc.
163
Red Hat Enterprise Linux 8 Configuring basic system settings
To ensure chronyd starts automatically at system start, issue the following command as root:
To prevent chronyd from starting automatically at system start, issue the following command as root:
$ chronyc tracking
Reference ID : CB00710F (foo.example.net)
Stratum :3
Ref time (UTC) : Fri Jan 27 09:49:17 2017
System time : 0.000006523 seconds slow of NTP time
Last offset : -0.000006747 seconds
RMS offset : 0.000035822 seconds
Frequency : 3.225 ppm slow
Residual freq : 0.000 ppm
Skew : 0.129 ppm
Root delay : 0.013639022 seconds
Root dispersion : 0.001100737 seconds
Update interval : 64.2 seconds
Leap status : Normal
Reference ID
This is the reference ID and name (or IP address) if available, of the server to which the computer is
164
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
This is the reference ID and name (or IP address) if available, of the server to which the computer is
currently synchronized. Reference ID is a hexadecimal number to avoid confusion with IPv4
addresses.
Stratum
The stratum indicates how many hops away from a computer with an attached reference clock we
are. Such a computer is a stratum-1 computer, so the computer in the example is two hops away (that
is to say, a.b.c is a stratum-2 and is synchronized from a stratum-1).
Ref time
This is the time (UTC) at which the last measurement from the reference source was processed.
System time
In normal operation, chronyd never steps the system clock, because any jump in the timescale can
have adverse consequences for certain application programs. Instead, any error in the system clock is
corrected by slightly speeding up or slowing down the system clock until the error has been removed,
and then returning to the system clock’s normal speed. A consequence of this is that there will be a
period when the system clock (as read by other programs using the gettimeofday() system call, or by
the date command in the shell) will be different from chronyd's estimate of the current true time
(which it reports to NTP clients when it is operating in server mode). The value reported on this line is
the difference due to this effect.
Last offset
This is the estimated local offset on the last clock update.
RMS offset
This is a long-term average of the offset value.
Frequency
The "frequency" is the rate by which the system’s clock would be wrong if chronyd was not
correcting it. It is expressed in ppm (parts per million). For example, a value of 1 ppm would mean that
when the system’s clock thinks it has advanced 1 second, it has actually advanced by 1.000001
seconds relative to true time.
Residual freq
This shows the "residual frequency" for the currently selected reference source. This reflects any
difference between what the measurements from the reference source indicate the frequency
should be and the frequency currently being used.
The reason this is not always zero is that a smoothing procedure is applied to the frequency. Each
time a measurement from the reference source is obtained and a new residual frequency computed,
the estimated accuracy of this residual is compared with the estimated accuracy (see skew) of the
existing frequency value. A weighted average is computed for the new frequency, with weights
depending on these accuracies. If the measurements from the reference source follow a consistent
trend, the residual will be driven to zero over time.
Skew
This is the estimated error bound on the frequency.
Root delay
This is the total of the network path delays to the stratum-1 computer from which the computer is
ultimately synchronized. Root delay values are printed in nanosecond resolution. In certain extreme
situations, this value can be negative. (This can arise in a symmetric peer arrangement where the
computers’ frequencies are not tracking each other and the network delay is very short relative to the
turn-around time at each computer.)
Root dispersion
This is the total dispersion accumulated through all the computers back to the stratum-1 computer
165
Red Hat Enterprise Linux 8 Configuring basic system settings
This is the total dispersion accumulated through all the computers back to the stratum-1 computer
from which the computer is ultimately synchronized. Dispersion is due to system clock resolution,
statistical measurement variations etc. Root dispersion values are printed in nanosecond resolution.
Leap status
This is the leap status, which can be Normal, Insert second, Delete second or Not synchronized.
The sources command displays information about the current time sources that chronyd is accessing.
The optional argument -v can be specified, meaning verbose. In this case, extra caption lines are shown
as a reminder of the meanings of the columns.
$ chronyc sources
210 Number of sources = 3
MS Name/IP address Stratum Poll Reach LastRx Last sample
===============================================================================
M
This indicates the mode of the source. ^ means a server, = means a peer and # indicates a locally
connected reference clock.
S
This column indicates the state of the sources. "*" indicates the source to which chronyd is currently
synchronized. "+" indicates acceptable sources which are combined with the selected source. "-"
indicates acceptable sources which are excluded by the combining algorithm. "?" indicates sources to
which connectivity has been lost or whose packets do not pass all tests. "x" indicates a clock which
chronyd thinks is a falseticker (its time is inconsistent with a majority of other sources). "~" indicates
a source whose time appears to have too much variability. The "?" condition is also shown at start-
up, until at least 3 samples have been gathered from it.
Name/IP address
This shows the name or the IP address of the source, or reference ID for reference clock.
Stratum
This shows the stratum of the source, as reported in its most recently received sample. Stratum 1
indicates a computer with a locally attached reference clock. A computer that is synchronized to a
stratum 1 computer is at stratum 2. A computer that is synchronized to a stratum 2 computer is at
stratum 3, and so on.
Poll
This shows the rate at which the source is being polled, as a base-2 logarithm of the interval in
seconds. Thus, a value of 6 would indicate that a measurement is being made every 64 seconds.
chronyd automatically varies the polling rate in response to prevailing conditions.
Reach
This shows the source’s reach register printed as an octal number. The register has 8 bits and is
updated on every received or missed packet from the source. A value of 377 indicates that a valid
reply was received for all of the last eight transmissions.
166
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
LastRx
This column shows how long ago the last sample was received from the source. This is normally in
seconds. The letters m, h, d or y indicate minutes, hours, days or years. A value of 10 years indicates
there were no samples received from this source yet.
Last sample
This column shows the offset between the local clock and the source at the last measurement. The
number in the square brackets shows the actual measured offset. This may be suffixed by ns
(indicating nanoseconds), us (indicating microseconds), ms (indicating milliseconds), or s
(indicating seconds). The number to the left of the square brackets shows the original measurement,
adjusted to allow for any slews applied to the local clock since. The number following the +/- indicator
shows the margin of error in the measurement. Positive offsets indicate that the local clock is ahead
of the source.
The sourcestats command displays information about the drift rate and offset estimation process for
each of the sources currently being examined by chronyd.
The optional argument -v can be specified, meaning verbose. In this case, extra caption lines are shown
as a reminder of the meanings of the columns.
$ chronyc sourcestats
210 Number of sources = 1
Name/IP Address NP NR Span Frequency Freq Skew Offset Std Dev
===============================================================================
Name/IP address
This is the name or IP address of the NTP server (or peer) or reference ID of the reference clock to
which the rest of the line relates.
NP
This is the number of sample points currently being retained for the server. The drift rate and current
offset are estimated by performing a linear regression through these points.
NR
This is the number of runs of residuals having the same sign following the last regression. If this
number starts to become too small relative to the number of samples, it indicates that a straight line
is no longer a good fit to the data. If the number of runs is too low, chronyd discards older samples
and re-runs the regression until the number of runs becomes acceptable.
Span
This is the interval between the oldest and newest samples. If no unit is shown the value is in seconds.
In the example, the interval is 46 minutes.
Frequency
This is the estimated residual frequency for the server, in parts per million. In this case, the
computer’s clock is estimated to be running 1 part in 109 slow relative to the server.
Freq Skew
This is the estimated error bounds on Freq (again in parts per million).
Offset
167
Red Hat Enterprise Linux 8 Configuring basic system settings
# chronyc makestep
If the rtcfile directive is used, the real-time clock should not be manually adjusted. Random adjustments
would interfere with chrony's need to measure the rate at which the real-time clock drifts.
On the system selected to be the master, using a text editor running as root, edit /etc/chrony.conf as
follows:
driftfile /var/lib/chrony/drift
commandkey 1
keyfile /etc/chrony.keys
initstepslew 10 client1 client3 client6
local stratum 8
manual
allow 192.0.2.0
Where 192.0.2.0 is the network or subnet address from which the clients are allowed to connect.
On the systems selected to be direct clients of the master, using a text editor running as root, edit the
/etc/chrony.conf as follows:
server master
driftfile /var/lib/chrony/drift
logdir /var/log/chrony
log measurements statistics tracking
keyfile /etc/chrony.keys
commandkey 24
local stratum 10
initstepslew 20 master
allow 192.0.2.123
Where 192.0.2.123 is the address of the master, and master is the host name of the master. Clients with
this configuration will resynchronize the master if it restarts.
168
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
On the client systems which are not to be direct clients of the master, the /etc/chrony.conf file should
be the same except that the local and allow directives should be omitted.
In an isolated network, you can also use the local directive that enables a local reference mode, which
allows chronyd operating as an NTP server to appear synchronized to real time, even when it was never
synchronized or the last update of the clock happened a long time ago.
To allow multiple servers in the network to use the same local configuration and to be synchronized to
one another, without confusing clients that poll more than one server, use the orphan option of the
local directive which enables the orphan mode. Each server needs to be configured to poll all other
servers with local. This ensures that only the server with the smallest reference ID has the local
reference active and other servers are synchronized to it. When the server fails, another one will take
over.
Another protocol for time synchronization that uses hardware timestamping is PTP.
Unlike NTP, PTP relies on assistance in network switches and routers. If you want to reach the best
accuracy of synchronization, use PTP on networks that have switches and routers with PTP support, and
prefer NTP on networks that do not have such switches and routers.
# ethtool -T eth0
Output:
169
Red Hat Enterprise Linux 8 Configuring basic system settings
hwtimestamp eth0
hwtimestamp eth1
hwtimestamp *
The following directive in /etc/chrony.conf specifies a local NTP server using one second polling
interval:
170
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
clientloglimit 100000000
Example 6.3. Log messages for interfaces with enabled hardware timestamping
When chronyd is configured as an NTP client or peer, you can have the transmit and receive
timestamping modes and the interleaved mode reported for each NTP source by the chronyc ntpdata
command:
Example 6.4. Reporting the transmit, receive timestamping and interleaved mode for each NTP
source
# chronyc ntpdata
Output:
171
Red Hat Enterprise Linux 8 Configuring basic system settings
Authenticated : No
TX timestamping : Hardware
RX timestamping : Hardware
Total TX : 27
Total RX : 27
Total valid RX : 27
# chronyc sourcestats
With hardware timestamping enabled, stability of NTP measurements should be in tens or hundreds
of nanoseconds, under normal load. This stability is reported in the Std Dev column of the output of
the chronyc sourcestats command:
Output:
Configure the ptp4l and phc2sys programs from the linuxptp packages to use one interface to
synchronize the system clock using PTP.
Configure chronyd to provide the system time using the other interface:
Example 6.6. Configuring chronyd to provide the system time using the other interface
bindaddress 203.0.113.74
hwtimestamp eth1
local stratum 1
chronyd cannot be monitored by the ntpq and ntpdc utilities from the ntp distribution, because
chrony does not support the NTP modes 6 and 7. It supports a different protocol and chronyc is the
client implementation. For more information, see the chronyc(1) man page.
To monitor the status of the system clock sychronized by chronyd, you can:
Use the ntpstat utility, which supports chrony and provides a similar output as it used to with
ntpd
$ chronyc -n tracking
Reference ID : 0A051B0A (10.5.27.10)
Stratum :2
Ref time (UTC) : Thu Mar 08 15:46:20 2018
System time : 0.000000338 seconds slow of NTP time
Last offset : +0.000339408 seconds
RMS offset : 0.000339408 seconds
Frequency : 2.968 ppm slow
Residual freq : +0.001 ppm
Skew : 3.336 ppm
Root delay : 0.157559142 seconds
Root dispersion : 0.001339232 seconds
Update interval : 64.5 seconds
Leap status : Normal
$ ntpstat
synchronised to NTP server (10.5.27.10) at stratum 2
time correct to within 80 ms
polling server every 64 s
On a Red Hat Enterprise Linux 8 system, it is recommended to use symmetric keys instead. Generate
the keys with the chronyc keygen command. A client and server need to share a key specified in
/etc/chrony.keys. The client can enable authentication using the key option in the server, pool, or peer
directive.
173
Red Hat Enterprise Linux 8 Configuring basic system settings
Note that using the client/server mode enabled by the server or pool directive is more secure
compared to the symmetric mode enabled by the peer directive.
In Red Hat Enterprise Linux 8, chronyd does not support the broadcast/multicast mode. The main
reason is that it is less accurate and less secure than the ordinary client/server and symmetric modes.
PTP was designed for multicast messaging and works similarly to the NTP broadcast mode. A
PTP implementation is available in the linuxptp package.
PTP normally requires hardware timestamping and support in network switches to perform well.
However, PTP is expected to work better than NTP in the broadcast mode even with software
timestamping and no support in network switches.
In networks with very large number of PTP slaves in one communication path, it is recommended
to configure the PTP slaves with the hybrid_e2e option in order to reduce the amount of
network traffic generated by the slaves. You can configure a computer running chronyd as an
NTP client, and possibly NTP server, to operate also as a PTP grandmaster to distribute
synchronized time to a large number of computers using multicast messaging.
chronyd(8) man page — Describes the chronyd daemon including commands and command
options.
174
CHAPTER 6. USING THE CHRONY SUITE TO CONFIGURE NTP
https://chrony.tuxfamily.org/doc/3.3/chronyd.html
https://chrony.tuxfamily.org/doc/3.3/chrony.conf.html
The timesync role installs and configures an NTP or PTP implementation to operate as an NTP client or
PTP slave in order to synchronize the system clock with NTP servers or grandmasters in PTP domains.
Note that using the timesync role also facilitates migration to chrony , because you can use the same
playbook on all versions of Red Hat Enterprise Linux starting with RHEL 6 regardless of whether the
system uses ntp or chrony to implement the NTP protocol.
WARNING
The timesync role replaces the configuration of the given or detected provider
service on the managed host. Previous settings are lost, even if they are not
specified in the role variables. The only preserved setting is the choice of provider if
the timesync_ntp_provider variable is not defined.
The following example shows how to apply the timesync role in a situation with just one pool of servers.
Example 6.9. An example playbook applying the timesync role for a single pool of servers
---
- hosts: timesync-test
vars:
timesync_ntp_servers:
- hostname: 2.rhel.pool.ntp.org
pool: yes
iburst: yes
roles:
- rhel-system-roles.timesync
Additional resources
For a detailed reference on timesync role variables, install the rhel-system-roles package, and
175
Red Hat Enterprise Linux 8 Configuring basic system settings
For a detailed reference on timesync role variables, install the rhel-system-roles package, and
see the README.md or README.html files in the /usr/share/doc/rhel-system-
roles/timesync directory.
For more information on RHEL System Roles, see Introduction to RHEL System Roles .
176
CHAPTER 7. USING SECURE COMMUNICATIONS BETWEEN TWO SYSTEMS WITH OPENSSH
Red Hat Enterprise Linux includes the basic OpenSSH packages: the general openssh package, the
openssh-server package and the openssh-clients package. Note that the OpenSSH packages require
the OpenSSL package openssl-libs, which installs several important cryptographic libraries that enable
OpenSSH to provide encrypted communications.
The SSH protocol mitigates security threats, such as interception of communication between two
systems and impersonation of a particular host, when you use it for remote shell login or file copying.
This is because the SSH client and server use digital signatures to verify their identities. Additionally, all
communication between the client and server systems is encrypted.
OpenSSH is an implementation of the SSH protocol supported by a number of Linux, UNIX, and similar
operating systems. It includes the core files necessary for both the OpenSSH client and server. The
OpenSSH suite consists of the following user-space tools:
ssh-copy-id is a script that adds local public keys to the authorized_keys file on a remote SSH
server
Two versions of SSH currently exist: version 1, and the newer version 2. The OpenSSH suite in Red Hat
Enterprise Linux 8 supports only SSH version 2, which has an enhanced key-exchange algorithm not
vulnerable to known exploits in version 1.
OpenSSH, as one of the RHEL core cryptographic subsystems uses system-wide crypto policies. This
ensures that weak cipher suites and cryptographic algorithms are disabled in the default configuration.
To adjust the policy, the administrator must either use the update-crypto-policies command to make
settings stricter or looser or manually opt-out of the system-wide crypto policies.
177
Red Hat Enterprise Linux 8 Configuring basic system settings
The OpenSSH suite uses two different sets of configuration files: those for client programs (that is, ssh,
scp, and sftp), and those for the server (the sshd daemon). System-wide SSH configuration
information is stored in the /etc/ssh/ directory. User-specific SSH configuration information is stored in
~/.ssh/ in the user’s home directory. For a detailed list of OpenSSH configuration files, see the FILES
section in the sshd(8) man page.
Additional resources
Man pages for the ssh topic listed by the man -k ssh command.
Prerequisites
Procedure
1. Start the sshd daemon in the current session and set it to start automatically at boot time:
2. To specify different addresses than the default 0.0.0.0 (IPv4) or :: (IPv6) for the
ListenAddress directive in the /etc/ssh/sshd_config configuration file and to use a slower
dynamic network configuration, add the dependency on the network-online.target target unit
to the sshd.service unit file. To achieve this, create the
/etc/systemd/system/sshd.service.d/local.conf file with the following content:
[Unit]
Wants=network-online.target
After=network-online.target
3. Review if OpenSSH server settings in the /etc/ssh/sshd_config configuration file meet the
requirements of your scenario.
4. Optionally, change the welcome message that your OpenSSH server displays before a client
authenticates by editing the /etc/issue file, for example:
Welcome to ssh-server.example.com
Warning: By accessing this server, you agree to the referenced terms and conditions.
Note that to change the message displayed after a successful login you have to edit the
/etc/motd file on the server. See the pam_motd man page for more information.
# systemctl daemon-reload
178
CHAPTER 7. USING SECURE COMMUNICATIONS BETWEEN TWO SYSTEMS WITH OPENSSH
Verification steps
# ssh user@ssh-server-example.com
ECDSA key fingerprint is SHA256:dXbaS0RG/UzlTTku8GtXSz0S1++lPegSy31v3L/FAEc.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'ssh-server-example.com' (ECDSA) to the list of known hosts.
user@ssh-server-example.com's password:
Additional resources
Prerequisites
Procedure
179
Red Hat Enterprise Linux 8 Configuring basic system settings
# vi /etc/ssh/sshd_config
PasswordAuthentication no
On a system other than a new default installation, check that PubkeyAuthentication no has not
been set and the ChallengeResponseAuthentication directive is set to no. If you are
connected remotely, not using console or out-of-band access, test the key-based login process
before disabling password authentication.
# setsebool -P use_nfs_home_dirs 1
Additional resources
IMPORTANT
If you complete the following steps as root, only root is able to use the keys.
Procedure
$ ssh-keygen -t ecdsa
Generating public/private ecdsa key pair.
Enter file in which to save the key (/home/joesec/.ssh/id_ecdsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/joesec/.ssh/id_ecdsa.
Your public key has been saved in /home/joesec/.ssh/id_ecdsa.pub.
The key fingerprint is:
SHA256:Q/x+qms4j7PCQ0qFd09iZEFHA+SqwBKRNaU72oZfaCI
joesec@localhost.example.com
The key's randomart image is:
+---[ECDSA 256]---+
|.oo..o=++ |
|.. o .oo . |
|. .. o. o |
180
CHAPTER 7. USING SECURE COMMUNICATIONS BETWEEN TWO SYSTEMS WITH OPENSSH
|....o.+... |
|o.oo.o +S . |
|.=.+. .o |
|E.*+. . . . |
|.=..+ +.. o |
| . oo*+o. |
+----[SHA256]-----+
You can also generate an RSA key pair by using the -t rsa option with the ssh-keygen
command or an Ed25519 key pair by entering the ssh-keygen -t ed25519 command.
$ ssh-copy-id joesec@ssh-server-example.com
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are
already installed
...
Number of key(s) added: 1
Now try logging into the machine, with: "ssh 'joesec@ssh-server-example.com'" and check to
make sure that only the key(s) you wanted were added.
If you do not use the ssh-agent program in your session, the previous command copies the
most recently modified ~/.ssh/id*.pub public key if it is not yet installed. To specify another
public-key file or to prioritize keys in files over keys cached in memory by ssh-agent, use the
ssh-copy-id command with the -i option.
NOTE
If you reinstall your system and want to keep previously generated key pairs, back up the
~/.ssh/ directory. After reinstalling, copy it back to your home directory. You can do this
for all users on your system, including root.
Verification steps
$ ssh joesec@ssh-server-example.com
Welcome message.
...
Last login: Mon Nov 18 18:28:42 2019 from ::1
Additional resources
Prerequisites
181
Red Hat Enterprise Linux 8 Configuring basic system settings
On the client side, the opensc package is installed and the pcscd service is running.
Procedure
1. List all keys provided by the OpenSC PKCS #11 module including their PKCS #11 URIs and save
the output to the keys.pub file:
2. To enable authentication using a smart card on a remote server (example.com), transfer the
public key to the remote server. Use the ssh-copy-id command with keys.pub created in the
previous step:
3. To connect to example.com using the ECDSA key from the output of the ssh-keygen -D
command in step 1, you can use just a subset of the URI, which uniquely references your key, for
example:
4. You can use the same URI string in the ~/.ssh/config file to make the configuration permanent:
$ cat ~/.ssh/config
IdentityFile "pkcs11:id=%01?module-path=/usr/lib64/pkcs11/opensc-pkcs11.so"
$ ssh example.com
Enter PIN for 'SSH key':
[example.com] $
Because OpenSSH uses the p11-kit-proxy wrapper and the OpenSC PKCS #11 module is
registered to PKCS#11 Kit, you can simplify the previous commands:
If you skip the id= part of a PKCS #11 URI, OpenSSH loads all keys that are available in the proxy module.
This can reduce the amount of typing required:
Additional resources
182
CHAPTER 7. USING SECURE COMMUNICATIONS BETWEEN TWO SYSTEMS WITH OPENSSH
IMPORTANT
To make SSH truly effective, prevent the use of insecure connection protocols that are replaced
by the OpenSSH suite. Otherwise, a user’s password might be protected using SSH for one
session only to be captured later when logging in using Telnet. For this reason, consider
disabling insecure protocols, such as telnet, rsh, rlogin, and ftp.
Disabling passwords for authentication and allowing only key pairs reduces the attack surface
and it also might save users’ time. On clients, generate key pairs using the ssh-keygen tool and
use the ssh-copy-id utility to copy public keys from clients on the OpenSSH server. To disable
password-based authentication on your OpenSSH server, edit /etc/ssh/sshd_config and
change the PasswordAuthentication option to no:
PasswordAuthentication no
Key types
Although the ssh-keygen command generates a pair of RSA keys by default, you can instruct it
to generate ECDSA or Ed25519 keys by using the -t option. The ECDSA (Elliptic Curve Digital
Signature Algorithm) offers better performance than RSA at the equivalent symmetric key
strength. It also generates shorter keys. The Ed25519 public-key algorithm is an implementation
of twisted Edwards curves that is more secure and also faster than RSA, DSA, and ECDSA.
OpenSSH creates RSA, ECDSA, and Ed25519 server host keys automatically if they are missing.
To configure the host key creation in RHEL 8, use the sshd-keygen@.service instantiated
service. For example, to disable the automatic creation of the RSA key type:
183
Red Hat Enterprise Linux 8 Configuring basic system settings
To exclude particular key types for SSH connections, comment out the relevant lines in
/etc/ssh/sshd_config, and reload the sshd service. For example, to allow only Ed25519 host
keys:
# HostKey /etc/ssh/ssh_host_rsa_key
# HostKey /etc/ssh/ssh_host_ecdsa_key
HostKey /etc/ssh/ssh_host_ed25519_key
Non-default port
By default, the sshd daemon listens on TCP port 22. Changing the port reduces the exposure
of the system to attacks based on automated network scanning and thus increase security
through obscurity. You can specify the port using the Port directive in the
/etc/ssh/sshd_config configuration file.
You also have to update the default SELinux policy to allow the use of a non-default port. To do
so, use the semanage tool from the policycoreutils-python-utils package:
In the previous commands, replace port_number with the new port number specified using the
Port directive.
No root login
If your particular use case does not require the possibility of logging in as the root user, you
should consider setting the PermitRootLogin configuration directive to no in the
/etc/ssh/sshd_config file. By disabling the possibility of logging in as the root user, the
administrator can audit which users run what privileged commands after they log in as regular
users and then gain root rights.
Alternatively, set PermitRootLogin to prohibit-password:
PermitRootLogin prohibit-password
This enforces the use of key-based authentication instead of the use of passwords for logging
in as root and reduces risks by preventing brute-force attacks.
The X server in Red Hat Enterprise Linux clients does not provide the X Security extension.
Therefore, clients cannot request another security layer when connecting to untrusted SSH
servers with X11 forwarding. Most applications are not able to run with this extension enabled
anyway.
By default, the ForwardX11Trusted option in the /etc/ssh/ssh_config.d/05-redhat.conf file is
set to yes, and there is no difference between the ssh -X remote_machine (untrusted host)
and ssh -Y remote_machine (trusted host) command.
If your scenario does not require the X11 forwarding feature at all, set the X11Forwarding
directive in the /etc/ssh/sshd_config configuration file to no.
184
CHAPTER 7. USING SECURE COMMUNICATIONS BETWEEN TWO SYSTEMS WITH OPENSSH
AllowUsers *@192.168.1.*,*@10.0.0.*,!*@192.168.1.2
AllowGroups example-group
The previous configuration lines accept connections from all users from systems in 192.168.1.*
and 10.0.0.* subnets except from the system with the 192.168.1.2 address. All users must be in
the example-group group. The OpenSSH server denies all other connections.
Note that using whitelists (directives starting with Allow) is more secure than using blacklists
(options starting with Deny) because whitelists block also new unauthorized users or groups.
OpenSSH uses RHEL system-wide cryptographic policies, and the default system-wide
cryptographic policy level offers secure settings for current threat models. To make your
cryptographic settings more strict, change the current policy level:
To opt-out of the system-wide crypto policies for your OpenSSH server, uncomment the line
with the CRYPTO_POLICY= variable in the /etc/sysconfig/sshd file. After this change, values
that you specify in the Ciphers, MACs, KexAlgoritms, and GSSAPIKexAlgorithms sections in
the /etc/ssh/sshd_config file are not overridden. Note that this task requires deep expertise in
configuring cryptographic options.
See Using system-wide cryptographic policies in the RHEL 8 Security hardening title for more
information.
Additional resources
Prerequisites
A remote server accepts SSH connections only from the jump host.
Procedure
1. Define the jump host by editing the ~/.ssh/config file, for example:
185
Red Hat Enterprise Linux 8 Configuring basic system settings
Host jump-server1
HostName jump1.example.com
2. Add the remote server jump configuration with the ProxyJump directive to ~/.ssh/config, for
example:
Host remote-server
HostName remote1.example.com
ProxyJump jump-server1
$ ssh remote-server
NOTE
You can specify more jump servers and you can also skip adding host definitions to the
configurations file when you provide their complete host names, for example:
$ ssh -J jump1.example.com,jump2.example.com,jump3.example.com
remote1.example.com
Change the host name-only notation in the previous command if the user names or SSH
ports on the jump servers differ from the names and ports on the remote server, for
example:
$ ssh -J
johndoe@jump1.example.com:75,johndoe@jump2.example.com:75,johndoe@jump3.e
xample.com:75 joesec@remote1.example.com:220
Additional resources
Installed documentation
sshd(8) man page documents available command-line options and provides a complete list of
supported configuration files and directories.
ssh(1) man page provides a complete list of available command-line options and supported
configuration files and directories.
scp(1) man page provides a more detailed description of the scp utility and its usage.
sftp(1) man page provides a more detailed description of the sftp utility and its usage.
186
CHAPTER 7. USING SECURE COMMUNICATIONS BETWEEN TWO SYSTEMS WITH OPENSSH
ssh-keygen(1) man page documents in detail the use of the ssh-keygen utility to generate,
manage, and convert authentication keys used by ssh.
sshd_config(5) man page provides a full description of available SSH daemon configuration
options.
Online documentation
OpenSSH Home Page - contains further documentation, frequently asked questions, links to
the mailing lists, bug reports, and other useful resources.
Configuring SELinux for applications and services with non-standard configurations - you can
apply analogous procedures for OpenSSH in a non-standard configuration with SELinux in
enforcing mode.
Controlling network traffic using firewalld - provides guidance on updating firewalld settings
after changing an SSH port
187
Red Hat Enterprise Linux 8 Configuring basic system settings
The rsyslogd daemon also provides extended filtering, encryption protected relaying of messages,
input and output modules, and support for transportation using the TCP and UDP protocols.
In /etc/rsyslog.conf, which is the main configuration file for rsyslog, you can specify the rules according
to which rsyslogd handles the messages. Generally, you can classify messages by their source and topic
(facility) and urgency (priority), and then assign an action that should be performed when a message fits
these criteria.
In /etc/rsyslog.conf, you can also see a list of log files maintained by rsyslogd. Most log files are
located in the /var/log/ directory. Some applications, such as httpd and samba, store their log files in a
subdirectory within /var/log/.
Additional resources
Prerequisites
Procedure
Verification
188
CHAPTER 8. CONFIGURING A REMOTE LOGGING SOLUTION
$ firefox file:///usr/share/doc/rsyslog/html/index.html
With the Rsyslog application, you can maintain a centralized logging system where log messages are
forwarded to a server over the network. To avoid message loss when the server is not available, you can
configure an action queue for the forwarding action. This way, messages that failed to be sent are stored
locally until the server is reachable again. Note that such queues cannot be configured for connections
using the UDP protocol.
The omfwd plug-in provides forwarding over UDP or TCP. The default protocol is UDP. Because the
plug-in is built in, it does not have to be loaded.
Prerequisites
Procedure
1. Optional: To use a different port for rsyslog traffic, add the syslogd_port_t SELinux type to
port. For example, enable port 30514:
2. Optional: To use a different port for rsyslog traffic, configure firewalld to allow incoming
rsyslog traffic on that port. For example, allow TCP traffic on port 30514 in zone zone:
3. Create a new file in the /etc/rsyslog.d/ directory named, for example, remotelog.conf, and
insert the following content:
189
Red Hat Enterprise Linux 8 Configuring basic system settings
constant(value=".log")
}
template(name="TmplMsg" type="list") {
constant(value="/var/log/remote/msg/")
property(name="hostname")
constant(value="/")
property(name="programname" SecurePath="replace")
constant(value=".log")
}
5. Make sure the rsyslog service is running and enabled on the logging server:
7. Optional: If rsyslog is not enabled, ensure the rsyslog service starts automatically after reboot:
Your log server is now configured to receive and store log files from the other systems in your
environment.
Verification
# rsyslogd -N 1
rsyslogd: version 8.1911.0-2.el8, config validation run (level 1), master config
/etc/rsyslog.conf
rsyslogd: End of config validation run. Bye.
Additional resources
190
CHAPTER 8. CONFIGURING A REMOTE LOGGING SOLUTION
Prerequisites
The rsyslog package is installed on the client systems that should report to the server.
Procedure
1. Create a new file in the /etc/rsyslog.d/ directory named, for example, remotelog.conf, and
insert the following content:
*.* action(type="omfwd"
queue.type="linkedlist"
queue.filename="example_fwd"
action.resumeRetryCount="-1"
queue.saveOnShutdown="on"
target="example.com" port="30514" protocol="tcp"
)
Where:
queue.filename defines a disk storage. The backup files are created with the example_fwd
prefix in the working directory specified by the preceding global workDirectory directive,
the last line forwards all received messages to the logging server, port specification is
optional.
With this configuration, rsyslog sends messages to the server but keeps messages in memory if
the remote server is not reachable. A file on disk is created only if rsyslog runs out of the
configured memory queue space or needs to shut down, which benefits the system
performance.
Verification
To verify that the client system sends messages to the server, follow these steps:
191
Red Hat Enterprise Linux 8 Configuring basic system settings
# logger test
# cat /var/log/remote/msg/hostname/root.log
Feb 25 03:53:17 hostname root[6064]: test
Where hostname is the host name of the client system. Note that the log contains the user
name of the user that entered the logger command, in this case root.
Additional resources
8.4.1. Configuring a server for receiving remote logging information over UDP
Follow this procedure to configure a server for collecting and analyzing logs sent by one or more client
systems over the UDP protocol.
Prerequisites
Procedure
1. Optional: To use a different port for rsyslog traffic than the default port 514:
a. Add the syslogd_port_t SELinux type to the SELinux policy configuration, replacing
portno with the port number you want rsyslog to use:
b. Configure firewalld to allow incoming rsyslog traffic, replacing portno with the port
number and zone with the zone you want rsyslog to use:
# firewall-cmd --reload
2. Create a new .conf file in the /etc/rsyslog.d/ directory, for example, remotelogserv.conf, and
192
CHAPTER 8. CONFIGURING A REMOTE LOGGING SOLUTION
2. Create a new .conf file in the /etc/rsyslog.d/ directory, for example, remotelogserv.conf, and
insert the following content:
template(name="TmplMsg" type="list") {
constant(value="/var/log/remote/msg/")
property(name="hostname")
constant(value="/")
property(name="programname" SecurePath="replace")
constant(value=".log")
}
Where 514 is the port number rsyslog uses by default. You can specify a different port instead.
4. Optional: If rsyslog is not enabled, ensure the rsyslog service starts automatically after reboot:
Verification
1. Verify the syntax of the /etc/rsyslog.conf file and all .conf files in the /etc/rsyslog.d/ directory:
# rsyslogd -N 1
rsyslogd: version 8.1911.0-2.el8, config validation run (level 1), master config
/etc/rsyslog.conf
rsyslogd: End of config validation run. Bye.
Additional resources
193
Red Hat Enterprise Linux 8 Configuring basic system settings
Browser-based documentation, which you can install from the rsyslog-doc package, at
file:///usr/share/doc/rsyslog/html/index.html
Prerequisites
The rsyslog package is installed on the client systems that should report to the server.
You have configured the server for remote logging as described in Configuring a server for
receiving remote logging information over UDP.
Procedure
1. Create a new .conf file in the /etc/rsyslog.d/ directory, for example, remotelogcli.conf, and
insert the following content:
*.* action(type="omfwd"
queue.type="linkedlist"
queue.filename="example_fwd"
action.resumeRetryCount="-1"
queue.saveOnShutdown="on"
target="example.com" port="portno" protocol="udp"
)
Where:
queue.filename defines a disk storage. The backup files are created with the example_fwd
prefix in the working directory specified by the preceding global workDirectory directive.
portno is the port number you want rsyslog to use. The default value is 514.
The last line forwards all received messages to the logging server, port specification is
optional.
With this configuration, rsyslog sends messages to the server but keeps messages in
memory if the remote server is not reachable. A file on disk is created only if rsyslog runs
out of the configured memory queue space or needs to shut down, which benefits the
system performance.
194
CHAPTER 8. CONFIGURING A REMOTE LOGGING SOLUTION
3. Optional: If rsyslog is not enabled, ensure the rsyslog service starts automatically after reboot:
Verification
To verify that the client system sends messages to the server, follow these steps:
# logger test
# cat /var/log/remote/msg/hostname/root.log
Feb 25 03:53:17 hostname root[6064]: test
Where hostname is the host name of the client system. Note that the log contains the user
name of the user that entered the logger command, in this case root.
Additional resources
Browser-based documentation, which you can install from the rsyslog-doc package, at
file:///usr/share/doc/rsyslog/html/index.html
Prerequisites
You have installed the rsyslog, librelp, and rsyslog-relp packages on the server and the client
systems.
Procedure
a. On the client system, create a new .conf file in the /etc/rsyslog.d/ directory named, for
example, relpcli.conf, and insert the following content:
module(load="omrelp")
*.* action(type="omrelp" target="target_IP" port="target_port")
Where:
195
Red Hat Enterprise Linux 8 Configuring basic system settings
d. Optional: If rsyslog is not enabled, ensure the rsyslog service starts automatically after
reboot:
a. On the server system, create a new .conf file in the /etc/rsyslog.d/ directory named, for
example, relpserv.conf, and insert the following content:
ruleset(name="relp"){
*.* action(type="omfile" file="log_path")
}
module(load="imrelp")
input(type="imrelp" port="target_port" ruleset="relp")
Where:
target_port is the port of the logging server. Use the same value as in the client
configuration file.
d. Optional: If rsyslog is not enabled, ensure the rsyslog service starts automatically after
reboot:
Verification
To verify that the client system sends messages to the server, follow these steps:
# logger test
2. On the server system, view the log at the specified log_path, for example:
196
CHAPTER 8. CONFIGURING A REMOTE LOGGING SOLUTION
# cat /var/log/remote/msg/hostname/root.log
Feb 25 03:53:17 hostname root[6064]: test
Where hostname is the host name of the client system. Note that the log contains the user
name of the user that entered the logger command, in this case root.
Additional resources
Browser-based documentation, which you can install from the rsyslog-doc package, at
file:///usr/share/doc/rsyslog/html/index.html
List the input and output modules installed on your system with the following command:
# ls /usr/lib64/rsyslog/{i,o}m*
To view the list of all available rsyslog modules, open the following page from documentation installed
from the rsyslog-doc package.
$ firefox file:///usr/share/doc/rsyslog/html/configuration/modules/idx_output.html
The Configuring system logging without journald or with minimized journald usage
Knowledgebase article
The Negative effects of the RHEL default logging setup on performance and their mitigations
article
197
Red Hat Enterprise Linux 8 Configuring basic system settings
With Red Hat Enterprise Linux, many packages that are installed on the system, such as packages
providing system tools, tools for data analysis or web applications are written in Python. To be able to
use these packages, you need to have the python packages installed.
See Red Hat Enterprise Linux Life Cycle and Red Hat Enterprise Linux 8 Application Streams Life Cycle
for details about the length of support.
Each of the Python versions is distributed in a separate module, and by design, you can install multiple
modules in parallel on the same system.
The python38 module does not include the same bindings to system tools (RPM, DNF, SELinux, and
others) that are provided for the python36 module.
IMPORTANT
Always specify the version of Python when installing it, invoking it, or otherwise
interacting with it. For example, use python3 instead of python in package and
command names. All Python-related commands should also include the version, for
example, pip3, pip2, or pip3.8.
As a system administrator, you are recommended to use preferably Python 3 for the following reasons:
198
CHAPTER 9. USING PYTHON
Python 2 in Red Hat Enterprise Linux 8 will have a shorter life cycle and its aim is to facilitate
smoother transition to Python 3 for customers.
Python 3 allows writing expressive, maintainable, and correct code more easily.
Python 3 has new features, including asyncio, f-strings, advanced unpacking, keyword only
arguments, chained exceptions and more.
However, existing software tends to require /usr/bin/python to be Python 2. For this reason, no default
python package is distributed with Red Hat Enterprise Linux 8, and you can choose between using
Python 2 and 3 as /usr/bin/python, as described in Section 9.2.5, “Configuring the unversioned Python” .
WARNING
Using the unversioned python command to install or run Python does not work by
default due to ambiguity. Always specify the version of Python, or configure the
system default version by using the alternatives command.
Procedure
To install Python 3.6 from the python36 module, execute the following command:
199
Red Hat Enterprise Linux 8 Configuring basic system settings
For details regarding modules in RHEL 8, see Installing, managing, and removing user-space
components.
NOTE
By design, RHEL 8 modules can be installed in parallel, including the python27, python36,
and python38 modules. Note that parallel installation is not supported for multiple
streams within a single module.
Python 3.8 and packages built for it can be installed in parallel with Python 3.6 on the
same system, with the exception of the mod_wsgi module. Due to a limitation of the
Apache HTTP Server, only one of the python3-mod_wsgi and python38-mod_wsgi
packages can be installed on a system.
Packages with add-on modules for Python 3.6 generally use the python3- prefix; packages for Python
3.8 include the python38- prefix. Always include the prefix when installing additional Python packages,
as shown in the examples below.
Procedure
To install the Requests module for Python 3.6, execute this command:
Additional Python 3.8 packages for developers are distributed through the CodeReady Linux Builder
repository in the python38-devel module. This module contains the python38-pytest package and its
dependencies: the pyparsing, atomicwrites, attrs, packaging, py, more-itertools, pluggy, and
wcwidth packages.
IMPORTANT
The CodeReady Linux Builder repository and its content is unsupported by Red Hat.
To install packages from the python38-devel module, follow the procedure below.
Procedure
200
CHAPTER 9. USING PYTHON
For more information about the CodeReady Linux Builder repository, see How to enable and make use
of content within CodeReady Linux Builder.
WARNING
Note that Python 3 is the main development direction of the Python project. The
support for Python 2 is being phased out. The python27 module has a shorter
support period than Red Hat Enterprise Linux 8.
Procedure
To install Python 2.7 from the python27 module, execute this command:
NOTE
By design, RHEL 8 modules can be installed in parallel, including the python27, python36,
and python38 modules.
For details regarding modules, see Installing, managing, and removing user-space components .
Packages with add-on modules for Python 2 generally use the python2- prefix. Always include the prefix
when installing additional Python packages, as shown in the examples below.
Procedure
201
Red Hat Enterprise Linux 8 Configuring basic system settings
When running the Python interpreter or Python-related commands, always specify the version.
Procedure
To run the Python 3.6 interpreter or related commands, use, for example:
$ python3
$ python3 -m cython --help
$ pip3 install <package>
To run the Python 3.8 interpreter or related commands, use, for example:
$ python3.8
$ python3.8 -m cython --help
$ pip3.8 install <package>
Procedure
$ python2
$ python2 -m cython --help
$ pip2 install <package>
IMPORTANT
To configure the unversioned python command directly to a selected version of Python, use this
procedure.
Procedure
To configure the unversioned python command to Python 3.6, execute this command:
202
CHAPTER 9. USING PYTHON
To configure the unversioned python command to Python 3.8, use the following command:
9.2.5.2. Configuring the unversioned python command to the required Python version
interactively
You can also configure the unversioned python command to the required Python version interactively.
Procedure
3. To reset this configuration and remove the unversioned python command, run:
Note that after this migration, the original Python 2 code becomes interpretable by the Python 3
interpreter and stays interpretable for the Python 2 interpreter as well.
You can also package your Python project into an RPM package, which provides the following
advantages compared to Setuptools packaging:
Cryptographic signing
With cryptographic signing, content of RPM packages can be verified, integrated, and tested
with the rest of the operating system.
A SPEC file contains instructions that the rpmbuild utility uses to build an RPM. The instructions are
203
Red Hat Enterprise Linux 8 Configuring basic system settings
A SPEC file contains instructions that the rpmbuild utility uses to build an RPM. The instructions are
included in a series of sections. A SPEC file has two main parts in which the sections are defined:
Preamble (contains a series of metadata items that are used in the Body)
For further information about SPEC files, see Packaging and distributing software .
An RPM SPEC file for Python projects has some specifics compared to non-Python RPM SPEC files.
Most notably, a name of any RPM package of a Python library must always include the prefix
determining the version, for example, python3 for Python 3.6 or python38 for Python 3.8.
Other specifics are shown in the following SPEC file example for the python3-detox package. For
description of such specifics, see the notes below the example.
Name: python3-detox 2
Version: 0.12
Release: 4%{?dist}
Summary: Distributing activities of the tox tool
License: MIT
URL: https://pypi.io/project/detox
Source0: https://pypi.io/packages/source/d/%{modname}/%{modname}-%{version}.tar.gz
BuildArch: noarch
BuildRequires: python36-devel 3
BuildRequires: python3-setuptools
BuildRequires: python36-rpm-macros
BuildRequires: python3-six
BuildRequires: python3-tox
BuildRequires: python3-py
BuildRequires: python3-eventlet
%?python_enable_dependency_generator 4
%description
Detox is the distributed version of the tox python testing tool. It makes efficient use of multiple CPUs
by running all possible activities in parallel.
Detox has the same options and configuration that tox has, so after installation you can run it in the
same way and with the same options that you use for tox.
$ detox
%prep
%autosetup -n %{modname}-%{version}
%build
%py3_build 5
%install
%py3_install
204
CHAPTER 9. USING PYTHON
%check
%{__python3} setup.py test 6
%files -n python3-%{modname}
%doc CHANGELOG
%license LICENSE
%{_bindir}/detox
%{python3_sitelib}/%{modname}/
%{python3_sitelib}/%{modname}-%{version}*
%changelog
...
1 The modname macro contains the name of the Python project. In this example it is detox.
2 When packaging a Python project into RPM, the python3 prefix always needs to be added to the
original name of the project. The original name here is detox and the name of the RPM is
python3-detox.
3 BuildRequires specifies what packages are required to build and test this package. In
BuildRequires, always include items providing tools necessary for building Python packages:
python36-devel and python3-setuptools. The python36-rpm-macros package is required so
that files with /usr/bin/python3 shebangs are automatically changed to /usr/bin/python3.6. For
more information, see Section 9.4.4, “Handling hashbangs in Python scripts” .
4 Every Python package requires some other packages to work correctly. Such packages need to be
specified in the SPEC file as well. To specify the dependencies, you can use the
%python_enable_dependency_generator macro to automatically use dependencies defined in
the setup.py file. If a package has dependencies that are not specified using Setuptools, specify
them within additional Requires directives.
5 The %py3_build and %py3_install macros run the setup.py build and setup.py install commands,
respectively, with additional arguments to specify installation locations, the interpreter to use, and
other details.
6 The check section provides a macro that runs the correct version of Python. The %{__python3}
macro contains a path for the Python 3 interpreter, for example /usr/bin/python3. We recommend
to always use the macro rather than a literal path.
In macro names, always use python3 or python2 instead of unversioned python. Configure the
particular Python 3 version in the BuildRequires of the SPEC file to either python36-rpm-macros or
python38-rpm-macros.
205
Red Hat Enterprise Linux 8 Configuring basic system settings
.dist-info
.egg-info
.egg-link
From these directories, the RPM build process automatically generates virtual pythonX.Ydist provides,
for example, python3.6dist(detox). These virtual provides are used by packages that are specified by
the %python_enable_dependency_generator macro.
NOTE
The BRP script generates errors when encountering a Python script with an ambiguous
hashbang, such as:
#! /usr/bin/python
or
#! /usr/bin/env python
206
CHAPTER 9. USING PYTHON
To modify hashbangs in the Python scripts that cause the build errors at RPM build time, use this
procedure.
Procedure
Note that multiple PATHs can be specified. If a PATH is a directory, pathfix.py recursively
scans for any Python scripts matching the pattern ^[a-zA-Z0-9_]+\.py$, not only those with an
ambiguous hashbang. Add this command to the %prep section or at the end of the %install
section.
Alternatively, modify the packaged Python scripts so that they conform to the expected format. For this
purpose, pathfix.py can be used outside the RPM build process, too. When running pathfix.py outside a
RPM build, replace __python3 from the example above with a path for the hashbang, such as
/usr/bin/python3.
If the packaged Python scripts require other version than Python 3.6, adjust the commands above to
include the respective version.
Additionally, hashbangs in the form /usr/bin/python3 are by default replaced with hashbangs pointing to
Python from the platform-python package used for system tools with Red Hat Enterprise Linux.
To change the /usr/bin/python3 hashbangs in their custom packages to point to a version of Python
installed from Application Stream, in the form /usr/bin/python3.6, use the following procedure.
Procedure
Add the python36-rpm-macros package into the BuildRequires section of the SPEC file by
including the following line:
BuildRequires: python36-rpm-macros
NOTE
To prevent hashbang check and modification by the BRP script, use the following RPM
directive:
%undefine %brp_mangle_shebangs
If you are using other version than Python 3.6, adjust the commands above to include the respective
version.
207
Red Hat Enterprise Linux 8 Configuring basic system settings
In RHEL 8, the PHP scripting language is provided by the php module, which is available in multiple
streams (versions).
Depending on your use case, you can install a specific profile of the selected module stream:
common - The default profile for server-side scripting using a web server. It includes several
widely used extensions.
minimal - This profile installs only the command-line interface for scripting with PHP without
using a web server.
devel - This profile includes packages from the common profile and additional packages for
development purposes.
Procedure
The default common profile installs also the php-fpm package, and preconfigures PHP for use
with the Apache HTTP Server or nginx.
Replace stream with the desired version and profile with the name of the profile you wish to
install.
For example, to install PHP 7.3 for use without a web server:
Additional resources
If you want to upgrade from an earlier version of PHP available in RHEL 8, see Switching to a
later stream.
For more information on managing RHEL 8 modules and streams, see Installing, managing, and
208
CHAPTER 10. USING THE PHP SCRIPTING LANGUAGE
For more information on managing RHEL 8 modules and streams, see Installing, managing, and
removing user-space components.
This section describes how to run the PHP code using the FastCGI process server.
Prerequisites
Procedure
Or, if the Apache HTTP Server is already running on your system, restart the httpd service
after installing PHP:
5. To obtain information about your PHP settings, create the index.php file with the following
content in the /var/www/html/ directory:
http://<hostname>/
209
Red Hat Enterprise Linux 8 Configuring basic system settings
Example 10.1. Running a "Hello, World!" PHP script using the Apache HTTP Server
# mkdir hello
2. Create a hello.php file in the /var/www/html/hello/ directory with the following content:
# <!DOCTYPE html>
<html>
<head>
<title>Hello, World! Page</title>
</head>
<body>
<?php
echo 'Hello, World!';
?>
</body>
</html>
http://<hostname>/hello/hello.php
Additional resources
Prerequisites
210
CHAPTER 10. USING THE PHP SCRIPTING LANGUAGE
Procedure
Or, if the nginx server is already running on your system, restart the nginx service after
installing PHP:
5. To obtain information about your PHP settings, create the index.php file with the following
content in the /usr/share/nginx/html/ directory:
http://<hostname>/
Example 10.2. Running a "Hello, World!" PHP script using the nginx server
# mkdir hello
211
Red Hat Enterprise Linux 8 Configuring basic system settings
# <!DOCTYPE html>
<html>
<head>
<title>Hello, World! Page</title>
</head>
<body>
<?php
echo 'Hello, World!';
?>
</body>
</html>
http://<hostname>/hello/hello.php
If you want to run php scripts using only command-line, install the minimal profile of a php module
stream.
See Section 10.1, “Installing the PHP scripting language” for details.
Prerequisites
Procedure
# php filename.php
Example 10.3. Running a "Hello, World!" PHP script using the command-line interface
1. Create a hello.php file with the following content using a text editor:
212
CHAPTER 10. USING THE PHP SCRIPTING LANGUAGE
<?php
echo 'Hello, World!';
?>
# php hello.php
httpd.conf(5) — The manual page for httpd configuration, describing the structure and location
of the httpd configuration files.
nginx(8) — The manual page for the nginx web server containing the complete list of its
command-line options and list of signals.
php-fpm(8) — The manual page for PHP FPM describing the complete list of its command-line
options and configuration files.
213
Red Hat Enterprise Linux 8 Configuring basic system settings
On a Red Hat Enterprise Linux 8 system, langpacks installation is based on the langpacks-<langcode>
language meta-packages and RPM weak dependencies (Supplements tag).
There are two prerequisites to be able to use langpacks for a selected language. If these prerequisites
are fulfilled, the language meta-packages pull their langpack for the selected language automatically in
the transaction set.
Prerequisites
The langpacks-<langcode> language meta-package for the selected language has been
installed on the system.
On Red Hat Enterprise Linux 8, the langpacks meta packages are installed automatically with
the initial installation of the operating system using the Anaconda installer, because these
packages are available in the in Application Stream repository.
For more information, see Section 11.1, “Checking languages that provide langpacks”
The base package, for which you want to search the local packages, has already been installed on
the system.
Procedure
Procedure
214
CHAPTER 11. USING LANGPACKS
To check if language support is available for any language, use the following procedure.
Procedure
Procedure
Procedure
Procedure
On systems where disk space is a critical issue, such as containers and cloud images, or only a few locales
are needed, you can use the glibc locale langpack packages (glibc-langpack-<locale_code>).
To install locales individually, and thus gain a smaller package installation footprint, use the following
procedure.
Procedure
215
Red Hat Enterprise Linux 8 Configuring basic system settings
When installing the operating system with Anaconda, glibc-langpack-<locale_code> is installed for the
language you used during the installation and also for the languages you selected as additional
languages. Note that glibc-all-langpacks, which contains all locales, is installed by default, so some
locales are duplicated. If you installed glibc-langpack-<locale_code> for one or more selected
languages, you can delete glibc-all-langpacks after the installation to save the disk space.
NOTE
If disk space is not an issue, keep all locales installed by using the glibc-all-langpacks
package.
216
CHAPTER 12. GETTING STARTED WITH TCL/TK
Using Tcl paired with Tk (Tcl/Tk) enables creating cross-platform GUI applications. Tk is provided by
the tk package.
A Tk C library bindings available for multiple languages, such as C, Ruby, Perl and Python
For more information about Tcl/Tk, see the Tcl/Tk manual or Tcl/Tk documentation web page .
List processing
Two new commands, lmap and dict map are available, which allow the expression of
transformations over Tcl containers.
217
Red Hat Enterprise Linux 8 Configuring basic system settings
Busy windows
A new command, tk busy is available, which disables user interaction for a window or a widget
and shows the busy cursor.
For the detailed list of changes between Tcl 8.5 and Tcl 8.6, see Changes in Tcl/Tk 8.6 .
Developers writing Tcl extensions or embedding Tcl interpreter into their applications
Procedure
1. Rewrite the code to use the interp structure. For example, if your code reads
interp→errorLine, rewrite it to use the following function:
Tcl_GetErrorLine(interp)
This is necessary because Tcl 8.6 limits direct access to members of the interp structure.
2. To make your code compatible with both Tcl 8.5 and Tcl 8.6, use the following code snippet in
a header file of your C or C++ application or extension that includes the Tcl library:
# include <tcl.h>
# if !defined(Tcl_GetErrorLine)
# define Tcl_GetErrorLine(interp) (interp→errorLine)
# endif
12.3.2. Migration path for users scripting their tasks with Tcl/Tk
In Tcl 8.6, most scripts work the same way as with the previous version of Tcl.
Procedure
When writing a portable code, make sure to not use the commands that are no longer supported
in Tk 8.6:
218
CHAPTER 12. GETTING STARTED WITH TCL/TK
tkIconList_Arrange
tkIconList_AutoScan
tkIconList_Btn1
tkIconList_Config
tkIconList_Create
tkIconList_CtrlBtn1
tkIconList_Curselection
tkIconList_DeleteAll
tkIconList_Double1
tkIconList_DrawSelection
tkIconList_FocusIn
tkIconList_FocusOut
tkIconList_Get
tkIconList_Goto
tkIconList_Index
tkIconList_Invoke
tkIconList_KeyPress
tkIconList_Leave1
tkIconList_LeftRight
tkIconList_Motion1
tkIconList_Reset
tkIconList_ReturnKey
tkIconList_See
tkIconList_Select
tkIconList_Selection
tkIconList_ShiftBtn1
tkIconList_UpDown
Note that you can check the list of unsupported commands also in the
/usr/share/tk8.6/unsupported.tcl file.
219
Red Hat Enterprise Linux 8 Configuring basic system settings
However, Red Hat recommends to use the default naming scheme, which is the same as in Red Hat
Enterprise Linux 7.
For more details about this scheme, see Consistent network interface device naming .
To set and activate the required prefix for your Ethernet network interfaces, use the following
procedure.
Procedure
net.ifnames.prefix=<required prefix>
WARNING
Red Hat does not support the use of prefixdevname on already deployed systems.
After the prefix was once set, and the operating system was rebooted, the prefix is effective every time
when a new network interface appears. The new device is assigned a name in the form of <PREFIX>
<INDEX>. For example, if your selected prefix is net, and the interfaces with net0 and net1 prefixes
already exist on the system, the new interface is named net2. The prefixdevname utility then generates
the new .link file in the /etc/systemd/network directory that applies the name to the interface with the
MAC address that just appeared. The configuration is persistent across reboots.
The prefix that you choose must meet the following requirements:
Be ASCII string
220
CHAPTER 13. USING PREFIXDEVNAME FOR NAMING OF ETHERNET NETWORK INTERFACES
Be alphanumeric string
WARNING
The prefix cannot conflict with any other well-known prefix used for network
interface naming on Linux. Specifically, you cannot use these prefixes: eth, eno,
ens, em.
221
Linux Boot Sequence
1. BIOS
BIOS stands for Basic Input/Output System
Performs some system integrity checks
Searches, loads, and executes the boot loader program.
It looks for boot loader in floppy, cd-rom, or hard drive. You can press a key (typically F12 or F2,
but it depends on your system) during the BIOS startup to change the boot sequence.
Once the boot loader program is detected and loaded into the memory, BIOS gives the control to
it.
So, in simple terms BIOS loads and executes the MBR boot loader.
2. MBR
MBR stands for Master Boot Record.
It is located in the 1st sector of the bootable disk. Typically /dev/hda, or /dev/sda
MBR is less than 512 bytes in size. This has three components 1) primary boot loader info in 1st
446 bytes 2) partition table info in next 64 bytes 3) mbr validation check in last 2 bytes.
It contains information about GRUB (or LILO in old systems).
So, in simple terms MBR loads and executes the GRUB boot loader.
3. GRUB
GRUB stands for Grand Unified Bootloader.
If you have multiple kernel images installed on your system, you can choose which one to be
executed.
GRUB displays a splash screen, waits for few seconds, if you don’t enter anything, it loads the
default kernel image as specified in the grub configuration file.
GRUB has the knowledge of the filesystem (the older Linux loader LILO didn’t understand
filesystem).
Grub configuration file is /boot/grub/grub.conf (/etc/grub.conf is a link to this). The following is
sample grub.conf of CentOS.
#boot=/dev/sda
default=0
timeout=5
splashimage=(hd0,0)/boot/grub/splash.xpm.gz
hiddenmenu
title CentOS (2.6.18-194.el5PAE)
root (hd0,0)
kernel /boot/vmlinuz-2.6.18-194.el5PAE ro root=LABEL=/
initrd /boot/initrd-2.6.18-194.el5PAE.img
As you notice from the above info, it contains kernel and initrd image.
So, in simple terms GRUB just loads and executes Kernel and initrd images.
4. Kernel
Mounts the root file system as specified in the “root=” in grub.conf
Kernel executes the /sbin/init program
Since init was the 1st program to be executed by Linux Kernel, it has the process id (PID) of 1. Do
a ‘ps -ef | grep init’ and check the pid.
initrd stands for Initial RAM Disk.
initrd is used by kernel as temporary root file system until kernel is booted and the real root file
system is mounted. It also contains necessary drivers compiled inside, which helps it to access the
hard drive partitions, and other hardware.
5. Init
Looks at the /etc/inittab file to decide the Linux run level.
Following are the available run levels
o 0 – halt
o 1 – Single user mode
o 2 – Multiuser, without NFS
o 3 – Full multiuser mode
o 4 – unused
o 5 – X11
o 6 – reboot
Init identifies the default initlevel from /etc/inittab and uses that to load all appropriate program.
Execute ‘grep initdefault /etc/inittab’ on your system to identify the default run level
If you want to get into trouble, you can set the default run level to 0 or 6. Since you know what 0
and 6 means, probably you might not do that.
Typically you would set the default run level to either 3 or 5.
6. Runlevel programs
When the Linux system is booting up, you might see various services getting started. For
example, it might say “starting sendmail …. OK”. Those are the runlevel programs, executed
from the run level directory as defined by your run level.
Depending on your default init level setting, the system will execute the programs from one of
the following directories.
o Run level 0 – /etc/rc.d/rc0.d/
o Run level 1 – /etc/rc.d/rc1.d/
o Run level 2 – /etc/rc.d/rc2.d/
o Run level 3 – /etc/rc.d/rc3.d/
o Run level 4 – /etc/rc.d/rc4.d/
o Run level 5 – /etc/rc.d/rc5.d/
o Run level 6 – /etc/rc.d/rc6.d/
Please note that there are also symbolic links available for these directory under /etc directly. So,
/etc/rc0.d is linked to /etc/rc.d/rc0.d.
Under the /etc/rc.d/rc*.d/ directories, you would see programs that start with S and K.
Programs starts with S are used during startup. S for startup.
Programs starts with K are used during shutdown. K for kill.
There are numbers right next to S and K in the program names. Those are the sequence number
in which the programs should be started or killed.
For example, S12syslog is to start the syslog deamon, which has the sequence number of 12.
S80sendmail is to start the sendmail daemon, which has the sequence number of 80. So, syslog
program will be started before sendmail.