sed.org 14 KB
Sed cheatsheat
sed flags
-n do not print out each line. This means sed only prints things when it sees the p command.
-r use extended regexps
Some sed example
weird example
sed SCRIPT file sed [options] SCRIPT file
sed -n '/enabled/ s/^.*- // p ' disabled-systemd-files.org | awk '{print $1}' -
avahi-daemon.service avahi-dnsconfd.service console-getty.service console-shell.service gssproxy.service nscd.service serial-getty@.service systemd-bootchart.service systemd-journal-upload.service systemd-networkd-wait-online.service systemd-networkd.service systemd-nspawn@.service systemd-resolved.service udisks2.service avahi-daemon.socket sshd.socket systemd-journal-gatewayd.socket systemd-journal-remote.socket systemd-networkd.socket uuidd.socket ctrl-alt-del.target exit.target halt.target kexec.target machines.target poweroff.target reboot.target rescue.target fstrim.timer pacman_keyring.timer
make sed print out lines matching a regexp
journalctl -b | grep -m 30 ".*" | sed -nr '/system/ p'
make sed print out a numbered line
Mar 30 07:49:51 parabola systemd-journald[168]: Runtime journal (/run/log/journal/) is 8.0M, max 184.7M, 176.7M free. Mar 30 07:49:52 parabola systemd-journald[168]: System journal (/var/log/journal/) is 62.5M, max 50.0M, 0B free. Mar 30 07:49:52 parabola systemd-journald[168]: Time spent on flushing to /var is 1.103ms for 2 entries.
journalctl -b | grep -m 30 ".*" | sed -nr '1 p'
make sed print out lines 1-10 and matching regexps
-- Logs begin at Tue 2016-03-29 15:07:04 EDT, end at Wed 2016-03-30 08:01:28 EDT. --
journalctl -b | grep -m 30 ".*" | sed -nr '1,10 p
/cgroup/ p
/linux/ p'
-- Logs begin at Tue 2016-03-29 15:07:04 EDT, end at Wed 2016-03-30 08:16:08 EDT. -- Mar 30 07:49:51 parabola systemd-journald[168]: Runtime journal (run/log/journal) is 8.0M, max 184.7M, 176.7M free. Mar 30 07:49:52 parabola systemd-journald[168]: System journal (var/log/journal) is 62.5M, max 50.0M, 0B free. Mar 30 07:49:52 parabola systemd-journald[168]: Time spent on flushing to /var is 1.103ms for 2 entries. Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuset Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuset Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpu Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpu Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuacct Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuacct Mar 30 07:49:52 parabola kernel: Linux version 4.4.6-gnu-1 (builduser@emulatorman-pn) (gcc version 5.3.0 (GCC) ) #1 SMP PREEMPT Tue Mar 22 19:10:53 UYT 2016 Mar 30 07:49:52 parabola kernel: Command line: BOOT_IMAGE=/vmlinuz-linux-libre root=UUID=159e1ea0-111c-4d3c-9ec2-c1bcd77e96ca rw quiet Mar 30 07:49:52 parabola kernel: Command line: BOOT_IMAGE=/vmlinuz-linux-libre root=UUID=159e1ea0-111c-4d3c-9ec2-c1bcd77e96ca rw quiet Mar 30 07:49:52 parabola kernel: x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers'
make sed select the odd lines
journalctl -b | grep -m 30 ".*" | sed -nr '1~2 p'
-- Logs begin at Tue 2016-03-29 15:07:04 EDT, end at Wed 2016-03-30 08:03:18 EDT. -- Mar 30 07:49:52 parabola systemd-journald[168]: System journal (var/log/journal) is 62.5M, max 50.0M, 0B free. Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuset Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuacct Mar 30 07:49:52 parabola kernel: Command line: BOOT_IMAGE=/vmlinuz-linux-libre root=UUID=159e1ea0-111c-4d3c-9ec2-c1bcd77e96ca rw quiet Mar 30 07:49:52 parabola kernel: x86/fpu: Supporting XSAVE feature 0x02: 'SSE registers' Mar 30 07:49:52 parabola kernel: x86/fpu: Using 'lazy' FPU context switches. Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000af000000-0x00000000beffffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bf719000-0x00000000bf938fff] ACPI NVS Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bfef9000-0x00000000bfefefff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000d3200000-0x00000000d3200fff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000ffc00000-0x00000000ffffffff] reserved
make sed select the even lines
journalctl -b | grep -m 30 ".*" | sed -nr '2~2 p'
Mar 30 07:49:51 parabola systemd-journald[168]: Runtime journal (run/log/journal) is 8.0M, max 184.7M, 176.7M free. Mar 30 07:49:52 parabola systemd-journald[168]: Time spent on flushing to /var is 1.103ms for 2 entries. Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpu Mar 30 07:49:52 parabola kernel: Linux version 4.4.6-gnu-1 (builduser@emulatorman-pn) (gcc version 5.3.0 (GCC) ) #1 SMP PREEMPT Tue Mar 22 19:10:53 UYT 2016 Mar 30 07:49:52 parabola kernel: x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers' Mar 30 07:49:52 parabola kernel: x86/fpu: Enabled xstate features 0x3, context size is 576 bytes, using 'standard' format. Mar 30 07:49:52 parabola kernel: e820: BIOS-provided physical RAM map: Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000aeffffff] usable Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bf000000-0x00000000bf718fff] usable Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bf939000-0x00000000bfef8fff] ACPI data Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bfeff000-0x00000000bfefffff] ACPI data Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000f0000000-0x00000000f3ffffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x0000000100000000-0x000000013fffffff] usable
delete the pattern space
journalctl -b | grep -m 30 ".*"
-- Logs begin at Tue 2016-03-29 15:07:04 EDT, end at Wed 2016-03-30 08:16:42 EDT. -- Mar 30 07:49:51 parabola systemd-journald[168]: Runtime journal (run/log/journal) is 8.0M, max 184.7M, 176.7M free. Mar 30 07:49:52 parabola systemd-journald[168]: System journal (var/log/journal) is 62.5M, max 50.0M, 0B free. Mar 30 07:49:52 parabola systemd-journald[168]: Time spent on flushing to /var is 1.103ms for 2 entries. Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuset Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpu Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuacct Mar 30 07:49:52 parabola kernel: Linux version 4.4.6-gnu-1 (builduser@emulatorman-pn) (gcc version 5.3.0 (GCC) ) #1 SMP PREEMPT Tue Mar 22 19:10:53 UYT 2016 Mar 30 07:49:52 parabola kernel: Command line: BOOT_IMAGE=/vmlinuz-linux-libre root=UUID=159e1ea0-111c-4d3c-9ec2-c1bcd77e96ca rw quiet Mar 30 07:49:52 parabola kernel: x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers' Mar 30 07:49:52 parabola kernel: x86/fpu: Supporting XSAVE feature 0x02: 'SSE registers' Mar 30 07:49:52 parabola kernel: x86/fpu: Enabled xstate features 0x3, context size is 576 bytes, using 'standard' format. Mar 30 07:49:52 parabola kernel: x86/fpu: Using 'lazy' FPU context switches. Mar 30 07:49:52 parabola kernel: e820: BIOS-provided physical RAM map: Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000aeffffff] usable Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000af000000-0x00000000beffffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bf000000-0x00000000bf718fff] usable Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bf719000-0x00000000bf938fff] ACPI NVS Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bf939000-0x00000000bfef8fff] ACPI data Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bfef9000-0x00000000bfefefff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000bfeff000-0x00000000bfefffff] ACPI data Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000d3200000-0x00000000d3200fff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000f0000000-0x00000000f3ffffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x00000000ffc00000-0x00000000ffffffff] reserved Mar 30 07:49:52 parabola kernel: BIOS-e820: [mem 0x0000000100000000-0x000000013fffffff] usable
do many s commands. NOT WORKING.
How can I perform more than 1 command on one address? A sed address is can be a REGEXP or a line number, etc.
journalctl -b | grep -m 30 ".*" | sed -nr '1,10 {p}
/cgroup/ {p}
/linux/ {p}
/BIOS/ {s/BIOS/HELLO/p}'
-- Logs begin at Tue 2016-03-29 15:07:04 EDT, end at Wed 2016-03-30 08:22:45 EDT. -- Mar 30 07:49:51 parabola systemd-journald[168]: Runtime journal (run/log/journal) is 8.0M, max 184.7M, 176.7M free. Mar 30 07:49:52 parabola systemd-journald[168]: System journal (var/log/journal) is 62.5M, max 50.0M, 0B free. Mar 30 07:49:52 parabola systemd-journald[168]: Time spent on flushing to /var is 1.103ms for 2 entries. Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuset Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuset Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpu Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpu Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuacct Mar 30 07:49:52 parabola kernel: Initializing cgroup subsys cpuacct Mar 30 07:49:52 parabola kernel: Linux version 4.4.6-gnu-1 (builduser@emulatorman-pn) (gcc version 5.3.0 (GCC) ) #1 SMP PREEMPT Tue Mar 22 19:10:53 UYT 2016 Mar 30 07:49:52 parabola kernel: Command line: BOOT_IMAGE=/vmlinuz-linux-libre root=UUID=159e1ea0-111c-4d3c-9ec2-c1bcd77e96ca rw quiet Mar 30 07:49:52 parabola kernel: Command line: BOOT_IMAGE=/vmlinuz-linux-libre root=UUID=159e1ea0-111c-4d3c-9ec2-c1bcd77e96ca rw quiet Mar 30 07:49:52 parabola kernel: x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers' Mar 30 07:49:52 parabola kernel: e820: HELLO-provided physical RAM map: Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x0000000000100000-0x00000000aeffffff] usable Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000af000000-0x00000000beffffff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000bf000000-0x00000000bf718fff] usable Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000bf719000-0x00000000bf938fff] ACPI NVS Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000bf939000-0x00000000bfef8fff] ACPI data Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000bfef9000-0x00000000bfefefff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000bfeff000-0x00000000bfefffff] ACPI data Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000d3200000-0x00000000d3200fff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000f0000000-0x00000000f3ffffff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x00000000ffc00000-0x00000000ffffffff] reserved Mar 30 07:49:52 parabola kernel: HELLO-e820: [mem 0x0000000100000000-0x000000013fffffff] usable
make sed delete lines in a file matching a pattern
sed -i '/pattern to match/d' ./infile
How sed works
selecting lines with sed
NUMBER
FIRST~STEP
sed goes through the input line by line, if a line matches a particular condition, then some action is performed. only select this line number select line number at number FIRST, then every following STEP-th number.
REGEXP match every line that matches that regexp
sed commands
# comment
q exit sed NOW
d delete pattern space, start next cycle
p print out the pattern space
s the substitute command
ie: 1~2 selects all odd numbered lines ie: 2~2 selects all even numbered lines ie 5~5 selects all factors of 5 s/REGEXP/REPLACEMENT/FLAGS
{ COMMANDS } do more than one command on one match
The most common flag used is "p", which is print.