Linux I/O redirection refers to the standard input/output such as stdin, stdout, stderr. This article gives you some examples with basic commands that you can use to accomplish I/O redirection in Linux.
Cool commands
- The following command saves stdout and stderr to the files “out” and “err”, respectively.
[root@server /root]# ./cmd 1>out 2>err |
- The following command appends stdout and stderr to the files “out” and “err”, respectively.
[root@server /root]# ./cmd 1>>out 2>>err |
- The following command functions similar to the above two commands, but also copies stdout and stderr to the files “stdout” and “stderr”, respectively.
[root@server /root]# (((./cmd | tee stdout) 3>&1 1>&2 2>&3\ |tee stderr) 3>&1 1>&2 2>&3) 1>out 2>err |
Note: Lines that end in a backslash are continued on the next line. Any such lines should be keyed in as one complete line. The lines are too long to fit on the web page without formatting them this way.
- Cool Tar Command
[root@server /root]# (cd /var/ftp/pub/rh71prof/disk1.iso.dir \ && tar -cvf - .) | (cd /var/ftp/pub/rh71prof/i386 && tar -xvf -) |
Note: Lines that end in a backslash are continued on the next line. Any such lines should be keyed in as one complete line. The lines are too long to fit on the web page without formatting them this way.
- Cool Find Command – looks in each file for searchstring
[root@server /root]# find . -type f -exec grep -i \
searchstring \{\} --with-filename \;
|
Note: Lines that end in a backslash are continued on the next line. Any such lines should be keyed in as one complete line. The lines are too long to fit on the web page without formatting them this way.
- Sample Test Script
#!/bin/sh #You can use this sample script for testing. The echo # statements explain how this script works. echo "This is Standard Out" >&1 echo "This is Standard Error" >&2 |
- For loop demonstrating stderr and stdout
echo Standard Out >stdout.out
echo Standard Error >stderr.out
for X in bzImage modules modules_install; do
make $X;
done 1>>stdout.out 2>>stderr.out
|
- Redirection in Linux
0 = stdin
1 = stdout
2 = stderr
- Using the tee command to save stdout to tee.out. stdout is still displayed on the screen.
[root@server /root]# cmd | tee tee.out |
- Using the tee command to append stdout to tee.out. stdout is still displayed on the screen.
[root@server /root]# cmd | tee -a tee.out |
- Using the script command to capture both stderr and stdout
[root@server stdout]# script Script started, file is typescript [root@server stdout]# ./cmd This is Standard Out This is Standard Error [root@server stdout]# exit exit Script done, file is typescript [root@server stdout]# cat typescript Script started on Thu Oct 11 11:47:36 2001 [root@server stdout]# ./cmd This is Standard Out This is Standard Error [root@server stdout]# exit exit Script done on Thu Oct 11 11:47:39 2001 [root@server stdout]# |
- Notes about pipe “|”
- Lets consider a channel one of stdout or stderr.
- The pipe can only carry one channel, namely stdout.
- When you have a command line which utilizes the pipe command, stderr gets sent to the display while stdout gets sent through the pipe on to the other awaiting commands.
- Swapping stdout and stderr will allow stdout to be sent to the display while stderr can be sent through the pipe.
- Pipe by itself will only take stdout. If you swap stdout and stderr before you get to the pipe then the pipe will take stdout (which is now stderr).
- stdout and stderr can be combined and sent through the pipe; however, you have now combined both stderr and stdout and there is no way to separate them.
- using a pipe in a subshell “()” causes stdout to go through the pipe and causes stderr to pass through the subshell back to the display. This provides a way to grab stdout and stderr. Basically you could get both stdout and stderr out of a subshell.
- Order of redirecting
- Method 1
[root@server /root]# cmd 2>&1 1>outfile |
#The above command causes the original stderr to go to stdout,
# and causes the original stdout to go to outfile
#Notice that 1=outfile when 2 is redefined, so 2 goes to outfile
- Method 2
#The following command causes both the original stdout and stderr to go to outfile.
[root@server /root]# cmd 1>outfile 2>&1 |
#Notice that 1=outfile when 2 is redefined, so 2 goes to outfile (the two
# channels are combined).
Capturing stderr with tee
Swapping stderr and stdout
- The full command
[root@server /root]# (((./cmd | tee stdout) 3>&1 1>&2 2>&3 \ | tee stderr) 3>&1 1>&2 2>&3) 1>out 2>err |
- The walk through
The following section will walk through the theory behind this command. Once you have a general understanding of this theory, you should be able to regenerate this entire command without notes.
- Contents of the ./cmd script
#!/bin/sh #You can use this sample script for testing. The echo # statements explain how this script works. echo "This is Standard Out" >&1 echo "This is Standard Error" >&2 |
- Results from running the ./cmd script
[root@server /root]# ./cmd This is Standard Out This is Standard Error [root@server /root]# |
Although you see both lines printed on the screen, behind the scenes one actually went to stdout and the other went to stderr. If you were to do a pipe, only stdout goes through the pipe. Normally this is the desired effect.
- Capturing stdout
The following will capture a copy of stdout and save it to a file called “stdout”
[root@server /root]# ./cmd | tee stdout |
stdout goes through the pipe and tee is able to save a copy of it to the file “stdout”; however, we just lost control of stderr. stderr will not go through the pipe, instead it goes directly to our display.
- Gaining control of stderr and stdout.
Lets gain control again of stderr and stdout. We do this by surrounding our command with a set of parenthesis.
[root@server /root]# (./cmd | tee stdout) |
- Swapping stdout and stderr.
Now that we have captured stdout, we wish to capture stderr using tee as well. The pipe will only accept stdout, so we must swap stderr and stdout to do this.
Note: The switch is using the standard variable switch (you have 2 variables and you need to switch the contents – you must bring in a 3rd temporary variable to hold the contents of one value so you can properly swap them).
[root@server /root]# (./cmd | tee stdout) 3>&1 1>&2 2>&3 |
- Capturing stderr
Now that we have swapped our stdout and stderr, lets hook up tee once again. tee will now capture stderr (tee believes that it is really stdout because stdout is the only thing that can come through the pipe).
[root@server /root]# (./cmd | tee stdout) 3>&1 1>&2 2>&3 \ | tee stderr |
- Gaining control of stderr and stdout, for the 2nd time.
Tee grabs stderr, but once again the channel that doesn’t go through the pipe gets sent to the display and we loose it. Lets capture both our stderr and stdout, once again, by using parenthesis.
[root@server /root]# ((./cmd | tee stdout) 3>&1 1>&2 2>&3 \ | tee stderr) |
- Swapping stdout and stderr back to their normal state.
Now we have, once again, captured both stderr and stdout for our use. Currently they are reversed. Lets switch them back for proper use in our pipeline. Again, lets use the standard variable switch to swap them around.
[root@server /root]# ((./cmd | tee stdout) 3>&1 1>&2 2>&3 \ | tee stderr) 3>&1 1>&2 2>&3 |
- Gaining control of stderr and stdout, for the 3rd time.
At this point we have swapped stdout and stderr back to their normal positions; however, if we will be manipulating stdout and stderr any further, we should complete this command with either a pipe or another set of parenthesis.
Since we want to be as complete as possible in this example we will use parenthesis. Using parenthesis will gain control over both stdout and stderr. Using a pipe will only gain control over stdout.
Note: If we use a pipe or parenthesis the next process that hooks up to this command will see stderr and stdout in their proper place. If we don’t add the last set of parenthesis, or go through a pipe, the order will remain messed up.
[root@server /root]# (((./cmd | tee stdout) 3>&1 1>&2 2>&3 \ | tee stderr) 3>&1 1>&2 2>&3) |
- Redirecting stdout and stderr to separate files
Now lets do something productive with stdout and stderr so that we can really prove that everything went back to their proper place. Lets tell our command to redirect stdout to “out” and stderr to “err”.
[root@server /root]# (((./cmd | tee stdout) 3>&1 1>&2 2>&3 \ | tee stderr) 3>&1 1>&2 2>&3) 1>out 2>err |
Note: This last step is optional, normally you would insert your other required commands here, commands that would more than likely operate on stdout.
Please note that the results for “out” and “err” are the same as when you run the following command. This proves that we restored stdout and stderr back to their normal usable posisitions. The above command; however, gives us the capability to copy out stdout and stderr using tee and still be able to use stdout and stderr like we always have.
[root@server /root]# ./cmd 1>out 2>err |