Arch, Raspberry PI, MPD, DAC = Hi-Fi

Yesterday I setup a headless Raspberry PI Arch based MPD server. It was a breeze (for me) and I thought I’d like to share the procedure with you guys. If you intend to use a Debian image the guide below will not work
without adapting the configuration for Debian – other guides cover this.

96Khz and 192Khz 24bit files work flawlessly.

Resources:
http://www.musicpd.org/
http://www.raspberrypi.org/downloads/
https://wiki.archlinux.org
https://wiki.archlinux.org/index.php/Autofs

Hardware:
Raspberry PI Model B
Edimax ew-7811un wireless usb dongle
Powered USB hub (mine is 7 port logik brand)
External USB Storage for music (or smb/nfs mount)
External USB DAC (Mine is Cambridge Audio DacMagic Plus)
2 GB SD card (I use a 4 GB, which more than is needed)

For:

Remotely controlled via smart phone
Headless aka screenless
Does not hurt too much budget wise

Against:

Moderate command line profiency is needed
Access to Linux command line is presumed

Guide:
1. Get Arch linux image here: http://www.raspberrypi.org/downloads/
2. Write image to SD card:
Linux:

sudo dd if=ArchLinuxARM-<current-version>-rpi.img bs=1M of=/dev/mmcblk0

1	sudo dd if=ArchLinuxARM-<current-version>-rpi.img bs=1M of=/dev/mmcblk0

http://www.raspberrypi.org/documentation/installation/installing-images/linux.md
Windows:
http://www.raspberrypi.org/documentation/installation/installing-images/windows.md
Mac:
http://www.raspberrypi.org/documentation/installation/installing-images/mac.md
3. Before booting the Pi the first time it will be helpful to configure wireless using netctl so the machine can be accessed via ssh.

sudo mount /dev/mmcblk0p5 /mnt
cd /mnt/etc/netctl
sudo vi wlan0-pi-conf

sudo mount /dev/mmcblk0p5 /mnt

cd /mnt/etc/netctl

sudo vi wlan0-pi-conf

Paste and adapt the following configuration to fit your needs:

Description='Wireless network for my MPD Pi'
Interface=wlan0
Connection=wireless
Security=wpa
ESSID=<your-ssid>
IP=dhcp
Key=<your-wlan-password>

Description='Wireless network for my MPD Pi'

Interface=wlan0

Connection=wireless

Security=wpa

ESSID=<your-ssid>

IP=dhcp

Key=<your-wlan-password>

Save file and cd away from dir.
Activate profile:

sudo ln -s /usr/lib/systemd/system/netctl-auto@.service /mnt/etc/systemd/system/multi-user.target.wants/netctl-auto@wlan0.service

1	sudo ln -s /usr/lib/systemd/system/netctl-auto@.service /mnt/etc/systemd/system/multi-user.target.wants/netctl-auto@wlan0.service

sudo umount /mnt

1	sudo umount /mnt

4. Transfer SD card to you PI and turn on power. Watch the wireless dongle to check for activity.
5. Scan your network to identify with nmap (adjust ip-range to match your local network)i:

nmap -sP 192.168.0.1-20

1	nmap -sP 192.168.0.1-20

6. ssh to the alarmpi.

ssh -l root <alarmpi ip>

1	ssh -l root <alarmpi ip>

password is root.
7. Update system:
Adjust /etc/pacman.d/mirrorlist to a country near you.
Update system:

pacman -Syu

1	pacman -Syu

reboot

reboot

ssh back in to system after reboot.
8. Install mpd and mpc:

pacman -S mpd mpc alsa-utils

1	pacman -S mpd mpc alsa-utils

Edit mpd.conf so it looks like this:

user "mpd"
pid_file "/run/mpd/mpd.pid"
db_file "/var/lib/mpd/mpd.db"
state_file "/var/lib/mpd/mpdstate"
playlist_directory "/var/lib/mpd/playlists"
music_directory "/media"
mixer_type			"software"
audio_output {
        type            "alsa"
        name            "Cambridge Audio USB Audio 2.0"
	device		"hw:1,0"
}

user "mpd"

pid_file "/run/mpd/mpd.pid"

db_file "/var/lib/mpd/mpd.db"

state_file "/var/lib/mpd/mpdstate"

playlist_directory "/var/lib/mpd/playlists"

music_directory "/media"

mixer_type "software"

audio_output {

type "alsa"

name "Cambridge Audio USB Audio 2.0"

device "hw:1,0"

}

Create media dir

mkdir /media

1	mkdir /media

You need to adjust audio_output variables to fit your external DAC and adjust music_directory to where you store your music.
Read mpd.conf man page for more information on the variables.
Since mpd will run as mpd change ownership of the mpd dirs:

chown -R mpd /var/lib/mpd

1	chown -R mpd /var/lib/mpd

Enable and start mpd:

systemctl enable mpd && systemctl start mpd

1	systemctl enable mpd && systemctl start mpd

Check for errors:

journalctl -xn

1	journalctl -xn

9. I’ve found that autofs is the most reliable solution for removable storage:

pacman -S autofs

1	pacman -S autofs

Add automount to nsswitch.conf

echo "automount: files" >> /etc/nsswitch.conf

1	echo "automount: files" >> /etc/nsswitch.conf

Configure autofs:

echo "/-     /etc/autofs/auto.rpi" >> /etc/autofs/auto.master

1	echo "/- /etc/autofs/auto.rpi" >> /etc/autofs/auto.master

Add external device:

echo "/media/musik -fstype=ext4,async,nodev,nosuid :/dev/sda1" >> /etc/autofs/auto.rpi

1	echo "/media/musik -fstype=ext4,async,nodev,nosuid :/dev/sda1" >> /etc/autofs/auto.rpi

Adjust to your needs. Usb drives usually come with a vfat filesystem, I use ext4 myself as you can see.
Enable autofs:

systemctl enable autofs && systemctl start autofs

1	systemctl enable autofs && systemctl start autofs

Cd to dir and check if it gets automounted with:

df -h

df -h

10. Set /etc/localtime and setup ntpd (adjust zoneinfo link to your needs):

rm /etc/localtime && ln -s /usr/share/zoneinfo/Europe/Copenhagen /etc/localtime

1	rm /etc/localtime && ln -s /usr/share/zoneinfo/Europe/Copenhagen /etc/localtime

Configure timesyncd to your country’s pool.
Enable and start timesyncd:

systemctl enable systemd-timesyncd && systemctl start systemd-timesyncd

1	systemctl enable systemd-timesyncd && systemctl start systemd-timesyncd

11. Install mpdroid or similar app on your phone. Point the app to the ip of your rpi.

Bonus info:
You can add radio channel streams to mpd’s playlists. I’ve only tried m3u links.
Example for Danish Radio’s Jazz station:

wget http://live-icy.gss.dr.dk/A/A22H.mp3.m3u && mpc load A22H.mp3.m3u

1	wget http://live-icy.gss.dr.dk/A/A22H.mp3.m3u && mpc load A22H.mp3.m3u

Enjoy. If you have any questions please ask.

Delete from known_hosts – .bashrc function

Add to .bashrc:

function sd()  {
 sed -i ''"${1}"'d' $HOME/.ssh/known_hosts
}

function sd() {

sed -i ''"${1}"'d' $HOME/.ssh/known_hosts

}

Source .bashrc:

. .bashrc

. .bashrc

Delete offending line:

sd 230

sd 230

Dead simple templating with sed (gnuplot, ipvs, lvs)

I thought I’d share my simple templating technique with sed and bash I use to generate gnuplots. The example below is used to generate plot from data collected from a LVS-DR loadbalancer, using the following command:

printf "$(date +'%Y-%m-%d %T'),%s,%s,%s,%s,%s\n" $(/sbin/ipvsadm -Lnc |
egrep -v "entries|state"|
awk '{print $3}' | sort | uniq -c | sed 's/[A-Z_]//g') >> output.file

printf "$(date +'%Y-%m-%d %T'),%s,%s,%s,%s,%s\n" $(/sbin/ipvsadm -Lnc |

egrep -v "entries|state"|

awk '{print $3}' | sort | uniq -c | sed 's/[A-Z_]//g') >> output.file

Here’s the gnuplot template used:

set terminal pngcairo size 800,600 enhanced font 'Verdana,10'
set datafile separator ","
set title 'IPVS connections'
set output 'title-DATE.png'
set ylabel 'No. conns'
set xdata time
set autoscale x
set format y "%.f"
set timefmt "%Y-%m-%d %H:%M:%S"
set xrange ["DSTART":"DEND"]
set format x "%m/%d %H:%M"
set xtics "DSTART", INT, "DEND" rotate font ",8"
set style line 11 lc rgb '#808080' lt 1
set border 3 ls 11
set key box opaque vert right top
set style line 12 lc rgb'#808080' lt 0 lw 1
set grid back ls 12
set style line 1 lc rgb '#FF5200' lt 1 lw 2 # Orange
set style line 2 lc rgb '#0115F8' lt 1 lw 2 # Blue
set style line 3 lc rgb '#FF00E2' lt 1 lw 2 # Purple
set style line 4 lc rgb '#02FF00' lt 1 lw 2 # Green
set style line 5 lc rgb '#FF000A' lt 1 lw 2 # Red
set style fill transparent solid 0.5 noborder
set tics
plot "conns.csv" using 1:2 title 'CLOSE' w lines ls 1,\
'' using 1:3 title 'ESTABLISHED' w lines ls 2,\
'' using 1:4 title 'FIN\_WAIT' w lines ls 3,\
'' using 1:5 title 'NONE (HTTPS)' w lines ls 4,\
'' using 1:6 title 'SYN\_RECV' w lines ls 5

set terminal pngcairo size 800,600 enhanced font 'Verdana,10'

set datafile separator ","

set title 'IPVS connections'

set output 'title-DATE.png'

set ylabel 'No. conns'

set xdata time

set autoscale x

set format y "%.f"

set timefmt "%Y-%m-%d %H:%M:%S"

set xrange ["DSTART":"DEND"]

set format x "%m/%d %H:%M"

set xtics "DSTART", INT, "DEND" rotate font ",8"

set style line 11 lc rgb '#808080' lt 1

set border 3 ls 11

set key box opaque vert right top

set style line 12 lc rgb'#808080' lt 0 lw 1

set grid back ls 12

set style line 1 lc rgb '#FF5200' lt 1 lw 2 # Orange

set style line 2 lc rgb '#0115F8' lt 1 lw 2 # Blue

set style line 3 lc rgb '#FF00E2' lt 1 lw 2 # Purple

set style line 4 lc rgb '#02FF00' lt 1 lw 2 # Green

set style line 5 lc rgb '#FF000A' lt 1 lw 2 # Red

set style fill transparent solid 0.5 noborder

set tics

plot "conns.csv" using 1:2 title 'CLOSE' w lines ls 1,\

'' using 1:3 title 'ESTABLISHED' w lines ls 2,\

'' using 1:4 title 'FIN\_WAIT' w lines ls 3,\

'' using 1:5 title 'NONE (HTTPS)' w lines ls 4,\

'' using 1:6 title 'SYN\_RECV' w lines ls 5

The CAPS are the template placeholders.

And the simple script used to generate the actual plots, which is where the sed is used for templating:

#!/bin/bash

plottpl='plotconn.plot'
plotwrk='plotwrk.plot'

dstart=$1
dend=$2
int=$3

date=$(echo $dend | awk '{print $1}')

sed 's/DSTART/'"$dstart"'/g;
     s/DEND/'"$dend"'/g;
     s/INT/'"$int"'/g;
     s/DATE/'"$date"'/g' $plottpl > $plotwrk

gnuplot $plotwrk

#!/bin/bash

plottpl='plotconn.plot'

plotwrk='plotwrk.plot'

dstart=$1

dend=$2

int=$3

date=$(echo $dend | awk '{print $1}')

sed 's/DSTART/'"$dstart"'/g;

s/DEND/'"$dend"'/g;

s/INT/'"$int"'/g;

s/DATE/'"$date"'/g' $plottpl > $plotwrk

gnuplot $plotwrk

Server Change Log Script

I’ve been a UNIX sysadm for several years now, and I have come to appreciate change logs on servers.

I wrote a script which I currently deploy to servers with puppet.

# ChangeLog script v. 0.4 -  Ashren

chlogpath="/ChangeLog"
 
if [[ -z "${SUDO_USER}" ]] && [[ $UID != 0 ]]; then
    echo "Please use sudo or root."
    exit 1
fi
 
if [[ ! -a $chlogpath ]]; then
    echo -e "\nChangeLog for ${HOSTNAME}" >> $chlogpath
fi
 
if [[ -z "${SUDO_USER}" ]]; then
    read -p "Please enter initials: " init
    sed -i '1i '"$(date)"' '"$init"'\n\n\n' $chlogpath
    vi +3 $chlogpath
    exit 0
else
    sed -i '1i '"$(date)"' '"$SUDO_USER"'\n\n\n' $chlogpath
    vi +3 $chlogpath
fi

# ChangeLog script v. 0.4 - Ashren

chlogpath="/ChangeLog"

if [[ -z "${SUDO_USER}" ]] && [[ $UID != 0 ]]; then

echo "Please use sudo or root."

exit 1

if [[ ! -a $chlogpath ]]; then

echo -e "\nChangeLog for ${HOSTNAME}" >> $chlogpath

if [[ -z "${SUDO_USER}" ]]; then

read -p "Please enter initials: " init

sed -i '1i '"$(date)"' '"$init"'\n\n\n' $chlogpath

vi +3 $chlogpath

exit 0

else

sed -i '1i '"$(date)"' '"$SUDO_USER"'\n\n\n' $chlogpath

vi +3 $chlogpath

XMobar clickable workspaces

After years of using xfce for daily work I’ve headed back to tiling territory.

Stumbled on a git bug report discussing clickable workspaces with xmobar, which lead me to the xmobar plugin: UnsafeStdinReader that would enable escape sequences in workspace to be accepted by xmobar.

Below is a working example:

import XMonad
import XMonad.Hooks.DynamicLog
import XMonad.Hooks.ManageDocks
import XMonad.Util.Run(spawnPipe)
import XMonad.Util.EZConfig(additionalKeys)
import System.IO
 
myManageHook = composeAll
    [ className =? "Gimp"      --> doFloat
    , className =? "rdesktop" --> doFloat
    ]

xmobarEscape = concatMap doubleLts
  where doubleLts '<' = "<<"
        doubleLts x   = [x]

myWorkspaces :: [String]        
myWorkspaces = clickable . (map xmobarEscape) $ ["1","2","3","4","5"]
                                                                              
  where                                                                       
         clickable l = [ "<action=xdotool key alt+" ++ show (n) ++ ">" ++ ws ++ "</action>" |
                             (i,ws) <- zip [1..5] l,                                        
                            let n = i ]
main = do
    xmproc <- spawnPipe "xmobar /home/regj/.xmobarrc"
    xmonad $ defaultConfig
        { manageHook = manageDocks <+> myManageHook -- make sure to include myManageHook definition from above
                        <+> manageHook defaultConfig
        , layoutHook = avoidStruts  $  layoutHook defaultConfig
        , workspaces = myWorkspaces
        , logHook = dynamicLogWithPP xmobarPP
                        { ppOutput = hPutStrLn xmproc
                        , ppCurrent = xmobarColor "yellow" "" . wrap "[" "]"
                        , ppHiddenNoWindows = xmobarColor "grey" ""
                        , ppTitle   = xmobarColor "green"  "" . shorten 40
                        , ppVisible = wrap "(" ")"
                        , ppUrgent  = xmobarColor "red" "yellow"
                        }
        , modMask = mod1Mask     -- Rebind Mod to the Windows key
        } `additionalKeys`
        [ ((mod1Mask, xK_f), spawn "firefox")
        , ((mod1Mask, xK_Print), spawn "/home/regj/bin/scrotter")
        , ((mod1Mask, xK_Return), spawn "urxvt")
        ]

import XMonad

import XMonad.Hooks.DynamicLog

import XMonad.Hooks.ManageDocks

import XMonad.Util.Run(spawnPipe)

import XMonad.Util.EZConfig(additionalKeys)

import System.IO

myManageHook = composeAll

[ className =? "Gimp" --> doFloat

, className =? "rdesktop" --> doFloat

]

xmobarEscape = concatMap doubleLts

where doubleLts '<' = "<<"

doubleLts x = [x]

myWorkspaces :: [String]

myWorkspaces = clickable . (map xmobarEscape) $ ["1","2","3","4","5"]

where

clickable l = [ "<action=xdotool key alt+" ++ show (n) ++ ">" ++ ws ++ "</action>" |

(i,ws) <- zip [1..5] l,

let n = i ]

main = do

xmproc <- spawnPipe "xmobar /home/regj/.xmobarrc"

xmonad $ defaultConfig

{ manageHook = manageDocks <+> myManageHook -- make sure to include myManageHook definition from above

<+> manageHook defaultConfig

, layoutHook = avoidStruts $ layoutHook defaultConfig

, workspaces = myWorkspaces

, logHook = dynamicLogWithPP xmobarPP

{ ppOutput = hPutStrLn xmproc

, ppCurrent = xmobarColor "yellow" "" . wrap "[" "]"

, ppHiddenNoWindows = xmobarColor "grey" ""

, ppTitle = xmobarColor "green" "" . shorten 40

, ppVisible = wrap "(" ")"

, ppUrgent = xmobarColor "red" "yellow"

}

, modMask = mod1Mask -- Rebind Mod to the Windows key

} `additionalKeys`

[ ((mod1Mask, xK_f), spawn "firefox")

, ((mod1Mask, xK_Print), spawn "/home/regj/bin/scrotter")

, ((mod1Mask, xK_Return), spawn "urxvt")

]

And the xmobarrc:

Config { font = "xft:Dina:pixelsize=13"
       , bgColor = "black"
       , fgColor = "grey"
       , position = TopW L 100
       , lowerOnStart = True
       , commands = [ Run Cpu ["-L","3","-H","50","--normal","green","--high","red"] 10
                    , Run Memory ["-t","Mem: <usedratio>%"] 10
                    , Run Swap [] 10
                    , Run Date "%a %b %_d %H:%M" "date" 10
                    , Run UnsafeStdinReader
                    ]
       , sepChar = "%"
       , alignSep = "}{"
       , template = "%UnsafeStdinReader% }{ %cpu% | %memory% * %swap%    <fc=#ee9a00>%date%</fc>" 
       }

Config { font = "xft:Dina:pixelsize=13"

, bgColor = "black"

, fgColor = "grey"

, position = TopW L 100

, lowerOnStart = True

, commands = [ Run Cpu ["-L","3","-H","50","--normal","green","--high","red"] 10

, Run Memory ["-t","Mem: <usedratio>%"] 10

, Run Swap [] 10

, Run Date "%a %b %_d %H:%M" "date" 10

, Run UnsafeStdinReader

]

, sepChar = "%"

, alignSep = "}{"

, template = "%UnsafeStdinReader% }{ %cpu% | %memory% * %swap% <fc=#ee9a00>%date%</fc>"

}

RHEL 6.4 – user crontabs – pam error

Recently after updating some customer systems from RHEL 6.3 to RHEL 6.4 user crontabs stopped working.

Checking crontabs with the user gave the following warning:

-bash-4.1$ crontab -l

Permission denied
You (test) are not allowed to access to (crontab) because of pam configuration.

-bash-4.1$ crontab -l

Permission denied

You (test) are not allowed to access to (crontab) because of pam configuration.

This is because /etc/pam.d/crond is configured with the access module pam_access.so and seperate /etc/security/access.conf entries for cron is needed:

# Server access control
# After installation, the last line - : ALL : ALL must be uncommented,
# which will deny access to root.
#
# *** Allow access for relevant users
+ : otheruser : ALL
# Allow test user to have crontab
+ : test : cron
# Deny everything else
- : ALL : ALL

# Server access control

# After installation, the last line - : ALL : ALL must be uncommented,

# which will deny access to root.

# *** Allow access for relevant users

+ : otheruser : ALL

# Allow test user to have crontab

+ : test : cron

# Deny everything else

- : ALL : ALL

XMonad – Clickable workspaces

One feature DWM has which is missing in XMonad is the clickable workspaces in status bar. There is a very good reason for this, which is that statusbars in XMonad are external applications i.e. XMobar and Dzen2.

To achieve clickable workspaces in XMonad with Dzen2 the following is needed:

– dzen2 (the latest SVN chekout which includes the ^ca functionality)
– XMonad
– xdotool

Include these modules in your xmonad.hs:

import XMonad.Hooks.DynamicLog import XMonad.Hooks.ManageDocks import Data.List

Comment out your current workspace listing and enter following instead:

myWorkspaces            :: [String]
myWorkspaces            = clickable . (map dzenEscape) $ ["1","2","3","4","5"]

  where clickable l     = [ "^ca(1,xdotool key alt+" ++ show (n) ++ ")" ++ ws ++ "^ca()" |
                            (i,ws) <- zip [1..] l,
                            let n = i ]

myWorkspaces :: [String]

myWorkspaces = clickable . (map dzenEscape) $ ["1","2","3","4","5"]

where clickable l = [ "^ca(1,xdotool key alt+" ++ show (n) ++ ")" ++ ws ++ "^ca()" |

(i,ws) <- zip [1..] l,

let n = i ]

If you have any redirects in your ManageHook change them accordingly:

, className =? "Firefox"  --> doF (W.shift (myWorkspaces !! 1))

1	, className =? "Firefox" --> doF (W.shift (myWorkspaces !! 1))

If this does not work report back here: ** regj arch-ed dot dk **

Reference: McManiac @ http://bbs.archlinux.org/viewtopic.php?id=40637&p=8

Simulate port listen with Perl

On servers behind firewalls were netcat is not available this script can come in handy:

 #!/usr/bin/perl

if ($#ARGV != 1 ) {
	print "usage: Use hostname as first argument and port as second argument.\n";
	exit;
}

$ho=$ARGV[0];
$po=$ARGV[1];

use IO::Socket; 
my $sock = new IO::Socket::INET ( 
                                LocalHost => $ho, 
                                LocalPort => $po, 
                                Proto => 'tcp', 
                                Listen => 1, 
                                Reuse => 1, 
                                ); 
die "Could not create socket: $!\n" unless $sock;
my $new_sock = $sock->accept(); 
while(<$new_sock>) { 
     print $_; 
} 
close($sock)

#!/usr/bin/perl

if ($#ARGV != 1 ) {

print "usage: Use hostname as first argument and port as second argument.\n";

exit;

}

$ho=$ARGV[0];

$po=$ARGV[1];

use IO::Socket;

my $sock = new IO::Socket::INET (

LocalHost => $ho,

LocalPort => $po,

Proto => 'tcp',

Listen => 1,

Reuse => 1,

);

die "Could not create socket: $!\n" unless $sock;

my $new_sock = $sock->accept();

while(<$new_sock>) {

print $_;

}

close($sock)

The above script takes to arguments: and

In effect:

./portsim.pl localhost 3278

1	./portsim.pl localhost 3278

would listen on port 3278 until someone tries to connect.

IO::Socket::INET is usually available on servers where Perl is installed.

The above version is a slightly modified version of a script found here: http://www.perlfect.com/articles/sockets.shtml

systemd, lircd, mceusb, xbmc and Arch Linux

NOTICE!!! This guide may be outdated, please check if your distro has a suitable lircd.service already.

After migrating my Arch based media center to systemd, my IR mceusb remote stopped working with lircd.

I needed to do the following steps in order to make it function again.

1. Copy /usr/lib/systemd/system/lirc.service to /etc/systemd/system/lirc.service (service files in /etc/systemd/system always takes precedence to files located in /usr/lib/systemd/system).

2. Edit /etc/systemd/system/lirc.service accordingly:

[Unit]
Description=Linux Infrared Remote Control

[Service]
EnvironmentFile=/etc/conf.d/lircd.conf
ExecStartPre=/usr/bin/ln -sf /dev/lirc0 /dev/lirc
ExecStartPre=/usr/bin/ln -sf /run/lirc/lircd /dev/lircd
ExecStart=/usr/sbin/lircd --pidfile=/run/lirc/lircd.pid
Type=forking
PIDFile=/run/lirc/lircd.pid

[Install]
WantedBy=multi-user.target

[Unit]

Description=Linux Infrared Remote Control

[Service]

EnvironmentFile=/etc/conf.d/lircd.conf

ExecStartPre=/usr/bin/ln -sf /dev/lirc0 /dev/lirc

ExecStartPre=/usr/bin/ln -sf /run/lirc/lircd /dev/lircd

ExecStart=/usr/sbin/lircd --pidfile=/run/lirc/lircd.pid

Type=forking

PIDFile=/run/lirc/lircd.pid

[Install]

WantedBy=multi-user.target

diff /etc/systemd/system/lirc.service /usr/lib/systemd/system/lirc.service
5,6d4
< EnvironmentFile=/etc/conf.d/lircd.conf
< ExecStartPre=/usr/bin/ln -sf /dev/lirc0 /dev/lirc

diff /etc/systemd/system/lirc.service /usr/lib/systemd/system/lirc.service

5,6d4

< EnvironmentFile=/etc/conf.d/lircd.conf

< ExecStartPre=/usr/bin/ln -sf /dev/lirc0 /dev/lirc

The creation of the symlink to /dev/lirc eliminates lircd errors like this:

could not get file information for /dev/lirc
default_init(): No such file or directory

1 2	could not get file information for /dev/lirc default_init(): No such file or directory

There may be more “correct” ways of fixing this, but creating the symlink satifies lircd.

3. Now adjust variables in /etc/conf.d/lircd.conf:

LIRC_DEVICE="/dev/lirc0"
LIRC_DRIVER="mceusb"
LIRC_EXTRAOPTS=""
LIRC_CONFIGFILE="/etc/lirc/lircd.conf"

LIRC_DEVICE="/dev/lirc0"

LIRC_DRIVER="mceusb"

LIRC_EXTRAOPTS=""

LIRC_CONFIGFILE="/etc/lirc/lircd.conf"

My /etc/lirc/lircd.conf looks like this and works with a mceusb based RC:

#
# brand:                        HP
# model no. of remote control:  TSGH-IR01
# devices being controlled by this remote: HP Slimline S3100y
#
# RC-6 config file
#
# source: http://home.hccnet.nl/m.majoor/projects_remote_control.htm
#         http://home.hccnet.nl/m.majoor/pronto.pdf
#
# used by: Philips
#
#########
#
# Philips Media Center Edition remote control
# For use with the USB MCE ir receiver
#
# Dan Conti  dconti|acm.wwu.edu
#
# Updated with codes for MCE 2005 Remote additional buttons
# *, #, Teletext, Red, Green, Yellow & Blue Buttons
# Note: TV power button transmits no code until programmed.
# Updated 12th September 2005
# Graham Auld - mce|graham.auld.me.uk
#
# Radio, Print, RecTV are only available on the HP Media Center remote control
#
#
# Updated with codes for MCE 2007 Remote additional buttons
# Visualization, Aspect, SlideShow, Eject
# Note:
# Renamed some buttons: DVD->DVDMenu, More->MoreInfo, Star->Asterisk, Hash->Pound
# Note:
# Blue, Yellow, Green, Red, and Teletext buttons do not exist on the HP remote

begin remote

  name        mceusb
  bits                 16
  flags  RC6|CONST_LENGTH
  eps                  30
  aeps                100

  header       2667   889
  one           444   444
  zero          444   444
  pre_data_bits        21
  pre_data        0x37FF0
  gap              105000
  toggle_bit           22
  rc6_mask    0x100000000


      begin codes

#seen on HP Pavilion dv3t remote  --Tim Mann, 3 Nov 2009
        Media         0x00007b7f
        PlayPause     0x00007b91


#unused by HP remote
        Blue          0x00007ba1
        Yellow        0x00007ba2
        Green         0x00007ba3
        Red           0x00007ba4
        Teletext      0x00007ba5

#ba6 - bae unused
        BA6           0x00007ba6
        BA7           0x00007ba7
        BA8           0x00007ba8
        BA9           0x00007ba9
        BAA           0x00007baa
        BAB           0x00007bab
        BAC           0x00007bac
        BAD           0x00007bad
        BAE           0x00007bae

        Radio         0x00007baf
        Print         0x00007bb1

#bb2 - bb4 unused
        BB2           0x00007bb2
        BB3           0x00007bb3
        BB4           0x00007bb4

        Videos        0x00007bb5
        Pictures      0x00007bb6
        RecTV         0x00007bb7
        Music         0x00007bb8
        TV            0x00007bb9

#bba - bbf unused
        BBA           0x00007bba
        BBB           0x00007bbb
        BBC           0x00007bbc
        BBD           0x00007bbd
        BBE           0x00007bbe
        BBF           0x00007bbf
#bc1 - bca unused
        BC1           0x00007bc1
        BC2           0x00007bc2
        BC3           0x00007bc3
        BC4           0x00007bc4
        BC5           0x00007bc5
        BC6           0x00007bc6
        BC7           0x00007bc7
        BC8           0x00007bc8
        BC9           0x00007bc9
        BCA           0x00007bca

        Eject         0x00007bcb
        SlideShow     0x00007bcc
        Visualization 0x00007bcd

#bce - bcf unused
        BCE           0x00007bce
        BCF           0x00007bcf
#bd1 - bd7 unused
        BD1           0x00007bd1
        BD2           0x00007bd2
        BD3           0x00007bd3
        BD4           0x00007bd4
        BD5           0x00007bd5
        BD6           0x00007bd6
        BD7           0x00007bd7

        Aspect        0x00007bd8
        Guide         0x00007bd9
        LiveTV        0x00007bda
        DVD           0x00007bdb
#NoGap
        Back          0x00007bdc
        OK            0x00007bdd
        Right         0x00007bde
        Left          0x00007bdf
        Down          0x00007be0
        Up            0x00007be1
#NoGap
        Star          0x00007be2
        Hash          0x00007be3
#NoGap
        Replay        0x00007be4
        Skip          0x00007be5
        Stop          0x00007be6
        Pause         0x00007be7
        Record        0x00007be8
        Play          0x00007be9
        Rewind        0x00007bea
        Forward       0x00007beb
#NoGap
        ChanDown      0x00007bec
        ChanUp        0x00007bed
        VolDown       0x00007bee
        VolUp         0x00007bef
#NoGap
        More          0x00007bf0
        Mute          0x00007bf1
        Home          0x00007bf2
        Power         0x00007bf3
#NoGap
        Enter         0x00007bf4
        Clear         0x00007bf5
#NoGap
        Nine          0x00007bf6
        Eight         0x00007bf7
        Seven         0x00007bf8
        Six           0x00007bf9
        Five          0x00007bfa
        Four          0x00007bfb
        Three         0x00007bfc
        Two           0x00007bfd
        One           0x00007bfe
        Zero          0x00007bff
      end codes

end remote
#
# this config file was automatically generated
# using lirc-0.8.4a(default) on Mon Feb 23 23:55:04 2009
#
# contributed by
#
# brand:                       Hauppauge
# model no. of remote control:
# devices being controlled by this remote: PVR-150 Remote (MCE kit)
# SMK dongle 0609:031d
#

begin remote

  name  mceusb_hauppauge
  bits           13
  flags RC6|CONST_LENGTH
  eps            30
  aeps          100

  header       2674   870
  one           455   427
  zero          455   427
  pre_data_bits   24
  pre_data       0x1BFF82
  gap          106288
  min_repeat      1
  toggle_bit_mask 0x8000
  rc6_mask    0x100000000

      begin codes
          TV                       0x1BB9
          Music                    0x1BB8
          Pictures                 0x1BB6
          Videos                   0x1BB5
          Power                    0x1BF3
          Stop                     0x1BE6
          Record                   0x1BE8
          Pause                    0x1BE7
          Play                     0x1BE9
          Rewind                   0x1BEA
          Foward                   0x1BEB
          Replay                   0x1BE4
          Skip                     0x1BE5
          Back                     0x1BDC
          More                     0x1BF0
          Up                       0x1BE1
          Left                     0x1BDF
          Right                    0x1BDE
          OK                       0x1BDD
          Down                     0x1BE0
          VolUp                    0x1BEF
          VolDown                  0x1BEE
          Home                     0x1BF2
          ChanDown                 0x1BED
          ChanUp                   0x1BEC
          Mute                     0x1BF1
          RecTV                    0x1BB7
          Guide                    0x1BD9
          LiveTV                   0x1BDA
          DVD                      0x1BDB
          One                      0x1BFE
          Two                      0x1BFD
          Three                    0x1BFC
          Four                     0x1BFB
          Five                     0x1BFA
          Six                      0x1BF9
          Seven                    0x1BF8
          Eight                    0x1BF7
          Nine                     0x1BF6
          Star                     0x1BE2
          Zero                     0x1BFF
          Hash                     0x1BE3
          Clear                    0x1BF5
          Enter                    0x1BF4
      end codes

end remote


#
# this config file was automatically generated
# using lirc-0.8.4a(default) on Tue Mar 10 19:27:09 2009
#
# contributed by
#
# brand:  SIIG Vista MCE remote
# model no. of remote control:
# devices being controlled by this remote:
#

begin remote

  name  vista_mce
  bits           16
  flags RC6
  eps            30
  aeps          100

  header       2654   889
  one           427   427
  zero          427   427
  pre_data_bits   21
  pre_data       0x37FF0
  gap          69850
  toggle_bit_mask 0x8000
  rc6_mask    0x100000000

      begin codes
          Power                    0xEBF3
          Pictures                 0x6BB6
          Radio                    0xEBAF
          Videos                   0x6BB5
          Music                    0xEBB8
          Rec                      0x6BE8
          Pause                    0xEBE7
          Stop                     0x6BE6
          Skipback                 0xEBE4
          Play                     0x6BE9
          Skipfwd                  0xEBE5
          Rwd                      0x6BEA
          Fwd                      0xEBEB
          Start                    0x6BF2
          Back                     0xEBDC
          More                     0x6BF0
          Volup                    0xEBEF
          Voldown                  0x6BEE
          Chup                     0xEBED
          Chdown                   0x6BEC
          Up                       0xEBE1
          Down                     0x6BE0
          Left                     0xEBDF
          Right                    0x6BDE
          Mute                     0xEBF1
          Rectv                    0x6BB7
          Guide                    0xEBD9
          Livetv                   0x6BDA
          Dvdmenu                  0xEBDB
          1                        0x6BFE
          2                        0xEBFD
          3                        0x6BFC
          4                        0xEBFB
          5                        0x6BFA
          6                        0xEBF9
          7                        0x6BF8
          8                        0xEBF7
          9                        0x6BF6
          *                        0xEBE2
          0                        0x6BFF
          #                        0xEBE3
          Clear                    0x6BF5
          Enter                    0xEBF4
      end codes

end remote

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

289

290

291

292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332

# brand: HP

# model no. of remote control: TSGH-IR01

# devices being controlled by this remote: HP Slimline S3100y

# RC-6 config file

# source: http://home.hccnet.nl/m.majoor/projects_remote_control.htm

# http://home.hccnet.nl/m.majoor/pronto.pdf

# used by: Philips

#########

# Philips Media Center Edition remote control

# For use with the USB MCE ir receiver

# Dan Conti dconti|acm.wwu.edu

# Updated with codes for MCE 2005 Remote additional buttons

# *, #, Teletext, Red, Green, Yellow & Blue Buttons

# Note: TV power button transmits no code until programmed.

# Updated 12th September 2005

# Graham Auld - mce|graham.auld.me.uk

# Radio, Print, RecTV are only available on the HP Media Center remote control

# Updated with codes for MCE 2007 Remote additional buttons

# Visualization, Aspect, SlideShow, Eject

# Note:

# Renamed some buttons: DVD->DVDMenu, More->MoreInfo, Star->Asterisk, Hash->Pound

# Note:

# Blue, Yellow, Green, Red, and Teletext buttons do not exist on the HP remote

begin remote

name mceusb

bits 16

flags RC6|CONST_LENGTH

eps 30

aeps 100

header 2667 889

one 444 444

zero 444 444

pre_data_bits 21

pre_data 0x37FF0

gap 105000

toggle_bit 22

rc6_mask 0x100000000

begin codes

#seen on HP Pavilion dv3t remote --Tim Mann, 3 Nov 2009

Media 0x00007b7f

PlayPause 0x00007b91

#unused by HP remote

Blue 0x00007ba1

Yellow 0x00007ba2

Green 0x00007ba3

Red 0x00007ba4

Teletext 0x00007ba5

#ba6 - bae unused

BA6 0x00007ba6

BA7 0x00007ba7

BA8 0x00007ba8

BA9 0x00007ba9

BAA 0x00007baa

BAB 0x00007bab

BAC 0x00007bac

BAD 0x00007bad

BAE 0x00007bae

Radio 0x00007baf

Print 0x00007bb1

#bb2 - bb4 unused

BB2 0x00007bb2

BB3 0x00007bb3

BB4 0x00007bb4

Videos 0x00007bb5

Pictures 0x00007bb6

RecTV 0x00007bb7

Music 0x00007bb8

TV 0x00007bb9

#bba - bbf unused

BBA 0x00007bba

BBB 0x00007bbb

BBC 0x00007bbc

BBD 0x00007bbd

BBE 0x00007bbe

BBF 0x00007bbf

#bc1 - bca unused

BC1 0x00007bc1

BC2 0x00007bc2

BC3 0x00007bc3

BC4 0x00007bc4

BC5 0x00007bc5

BC6 0x00007bc6

BC7 0x00007bc7

BC8 0x00007bc8

BC9 0x00007bc9

BCA 0x00007bca

Eject 0x00007bcb

SlideShow 0x00007bcc

Visualization 0x00007bcd

#bce - bcf unused

BCE 0x00007bce

BCF 0x00007bcf

#bd1 - bd7 unused

BD1 0x00007bd1

BD2 0x00007bd2

BD3 0x00007bd3

BD4 0x00007bd4

BD5 0x00007bd5

BD6 0x00007bd6

BD7 0x00007bd7

Aspect 0x00007bd8

Guide 0x00007bd9

LiveTV 0x00007bda

DVD 0x00007bdb

#NoGap

Back 0x00007bdc

OK 0x00007bdd

Right 0x00007bde

Left 0x00007bdf

Down 0x00007be0

Up 0x00007be1

#NoGap

Star 0x00007be2

Hash 0x00007be3

#NoGap

Replay 0x00007be4

Skip 0x00007be5

Stop 0x00007be6

Pause 0x00007be7

Record 0x00007be8

Play 0x00007be9

Rewind 0x00007bea

Forward 0x00007beb

#NoGap

ChanDown 0x00007bec

ChanUp 0x00007bed

VolDown 0x00007bee

VolUp 0x00007bef

#NoGap

More 0x00007bf0

Mute 0x00007bf1

Home 0x00007bf2

Power 0x00007bf3

#NoGap

Enter 0x00007bf4

Clear 0x00007bf5

#NoGap

Nine 0x00007bf6

Eight 0x00007bf7

Seven 0x00007bf8

Six 0x00007bf9

Five 0x00007bfa

Four 0x00007bfb

Three 0x00007bfc

Two 0x00007bfd

One 0x00007bfe

Zero 0x00007bff

end codes

end remote

# this config file was automatically generated

# using lirc-0.8.4a(default) on Mon Feb 23 23:55:04 2009

# contributed by

# brand: Hauppauge

# model no. of remote control:

# devices being controlled by this remote: PVR-150 Remote (MCE kit)

# SMK dongle 0609:031d

begin remote

name mceusb_hauppauge

bits 13

flags RC6|CONST_LENGTH

eps 30

aeps 100

header 2674 870

one 455 427

zero 455 427

pre_data_bits 24

pre_data 0x1BFF82

gap 106288

min_repeat 1

toggle_bit_mask 0x8000

rc6_mask 0x100000000

begin codes

TV 0x1BB9

Music 0x1BB8

Pictures 0x1BB6

Videos 0x1BB5

Power 0x1BF3

Stop 0x1BE6

Record 0x1BE8

Pause 0x1BE7

Play 0x1BE9

Rewind 0x1BEA

Foward 0x1BEB

Replay 0x1BE4

Skip 0x1BE5

Back 0x1BDC

More 0x1BF0

Up 0x1BE1

Left 0x1BDF

Right 0x1BDE

OK 0x1BDD

Down 0x1BE0

VolUp 0x1BEF

VolDown 0x1BEE

Home 0x1BF2

ChanDown 0x1BED

ChanUp 0x1BEC

Mute 0x1BF1

RecTV 0x1BB7

Guide 0x1BD9

LiveTV 0x1BDA

DVD 0x1BDB

One 0x1BFE

Two 0x1BFD

Three 0x1BFC

Four 0x1BFB

Five 0x1BFA

Six 0x1BF9

Seven 0x1BF8

Eight 0x1BF7

Nine 0x1BF6

Star 0x1BE2

Zero 0x1BFF

Hash 0x1BE3

Clear 0x1BF5

Enter 0x1BF4

end codes

end remote

# this config file was automatically generated

# using lirc-0.8.4a(default) on Tue Mar 10 19:27:09 2009

# contributed by

# brand: SIIG Vista MCE remote

# model no. of remote control:

# devices being controlled by this remote:

begin remote

name vista_mce

bits 16

flags RC6

eps 30

aeps 100

header 2654 889

one 427 427

zero 427 427

pre_data_bits 21

pre_data 0x37FF0

gap 69850

toggle_bit_mask 0x8000

rc6_mask 0x100000000

begin codes

Power 0xEBF3

Pictures 0x6BB6

Radio 0xEBAF

Videos 0x6BB5

Music 0xEBB8

Rec 0x6BE8

Pause 0xEBE7

Stop 0x6BE6

Skipback 0xEBE4

Play 0x6BE9

Skipfwd 0xEBE5

Rwd 0x6BEA

Fwd 0xEBEB

Start 0x6BF2

Back 0xEBDC

More 0x6BF0

Volup 0xEBEF

Voldown 0x6BEE

Chup 0xEBED

Chdown 0x6BEC

Up 0xEBE1

Down 0x6BE0

Left 0xEBDF

Right 0x6BDE

Mute 0xEBF1

Rectv 0x6BB7

Guide 0xEBD9

Livetv 0x6BDA

Dvdmenu 0xEBDB

1 0x6BFE

2 0xEBFD

3 0x6BFC

4 0xEBFB

5 0x6BFA

6 0xEBF9

7 0x6BF8

8 0xEBF7

9 0x6BF6

* 0xEBE2

0 0x6BFF

# 0xEBE3

Clear 0x6BF5

Enter 0xEBF4

end codes

end remote

4. Disable lircd conflicting kernel modules by creating a blacklist file /etc/modprobe.d/blacklist_mce.conf containing:

# Disabling kernel modules for mce
install ir_rc6_decoder /bin/false
install rc_rc6_mce /bin/false
install ir_rc5_decoder /bin/false

# Disabling kernel modules for mce

install ir_rc6_decoder /bin/false

install rc_rc6_mce /bin/false

install ir_rc5_decoder /bin/false

Reboot or remove these modules using modprobe -r.

5. Reenable lirc.service:

# systemctl reenable lirc.service
# systemctl start lirc.service
# systemctl status lirc.service

# systemctl reenable lirc.service

# systemctl start lirc.service

# systemctl status lirc.service

Performance reporting with bash, gnuplot and LaTex

In an earlier earlier blog post I demonstrated how to create a simple CPU performance graph using the TiKz LaTeX class. I soon found out that generating graphs for longer periods and for many servers using TiKz took a very long time to compile and I started to look for other solutions – GNUplot with the gnuplottex class proved to be the right solution.

It all starts out by collecting data on the individual servers using the following bash script as a cronjob, which saves the data to a NFS share:

#!/bin/bash
# Sarcopy script by Rasmus Edgar Joergensen 2012.05
sardir=/path/to/nfsshare/sardata/$HOSTNAME
cpudir=$sardir/cpu
iodir=$sardir/io
memdir=$sardir/mem
# Check if host dir has been created, create if not present
if [ ! -d $sardir ]; then
	mkdir -p $sardir/{cpu,mem,io}
fi
saday=$(ls -c /var/log/sa/sa[0-9][0-9] | head -n 1)
sadf -d -- -u $saday | cut -d';' -f3- > $cpudir/$(uname -n)-$(date '+%Y-%m-%d')-cpu.csv
sadf -d -- -r $saday | cut -d';' -f3- > $memdir/$(uname -n)-$(date '+%Y-%m-%d')-mem.csv
sadf -d -- -b $saday | cut -d';' -f3- > $iodir/$(uname -n)-$(date '+%Y-%m-%d')-io.csv

#!/bin/bash

# Sarcopy script by Rasmus Edgar Joergensen 2012.05

sardir=/path/to/nfsshare/sardata/$HOSTNAME

cpudir=$sardir/cpu

iodir=$sardir/io

memdir=$sardir/mem

# Check if host dir has been created, create if not present

if [ ! -d $sardir ]; then

mkdir -p $sardir/{cpu,mem,io}

saday=$(ls -c /var/log/sa/sa[0-9][0-9] | head -n 1)

sadf -d -- -u $saday | cut -d';' -f3- > $cpudir/$(uname -n)-$(date '+%Y-%m-%d')-cpu.csv

sadf -d -- -r $saday | cut -d';' -f3- > $memdir/$(uname -n)-$(date '+%Y-%m-%d')-mem.csv

sadf -d -- -b $saday | cut -d';' -f3- > $iodir/$(uname -n)-$(date '+%Y-%m-%d')-io.csv

The reason it is run locally on the server is because sar data files are not backwards compatible with earlier versions of sadf and vice-versa.

This cron job runs every day a 23:55 :

# Copy sardata for perf reports - Rasmus 2012.05
55 23 * * * /path/to/script/sarcopy > /dev/null 2>&1

1 2	# Copy sardata for perf reports - Rasmus 2012.05 55 23 * * * /path/to/script/sarcopy > /dev/null 2>&1

Since I need to create graphs for many servers using SAR data extracted from the servers I created the following template:

% REGJ - 20120113
\documentclass{article}
\usepackage[danish]{babel}
\usepackage[utf8]{inputenc}
\usepackage{palatino}
\pdfcompresslevel=0
\pdfobjcompresslevel=0
\usepackage{fancyhdr}
\usepackage[left=1.5in, right=1in, top=1in, bottom=1in, includefoot, headheight=13.6pt]{geometry}
\setlength{\headheight}{0.6in}
\fancyheadoffset[LE,RO]{1cm}
\fancyhead[L]{Performance plots for SERVERNAME - TIME}% empty left
\fancyhead[R]{ % right
   \includegraphics[height=0.43in]{$HOME/bitmaps/logo.eps}
}
\fancyfoot[L] {\tiny Written by Rasmus Edgar Fink Jørgensen in \LaTeX/bash.}
\usepackage{tikz,pgfplots}
\usepackage{eurosym}
\usepackage{gnuplottex}
\usepgfplotslibrary{dateplot}
\pagestyle{fancy}
\begin{document}
\begin{figure}
\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]
set datafile separator ";"
set ylabel 'CPU/wait time \% used'
set xdata time
set autoscale x
set yrange [0:100]
set timefmt "%Y-%m-%d %H:%M:%S"
set xrange ["DATEMIN":"DATEMAX"]
set style line 11 lc rgb '#808080' lt 1
set border 3 ls 11
set key box opaque vert right top
set tics
set style line 12 lc rgb'#808080' lt 0 lw 1
set grid back ls 12
set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange
set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green
set style line 3 lc rgb '#0005FD' lt 1 lw 2.5 # Blue
plot "/tmp/SERVERNAME-concatcpu.csv" using 1:3 title '\%user' w lines ls 1, '' using 1:5 title '\%sys' w lines ls 2, '' 
using 1:6 title '\%iowait' w lines ls 3
\end{gnuplot}
\end{figure}
\begin{itemize}
\item{user:}
Percentage of CPU utilization that occurred while executing at the user level (application).
\item{iowait:}
Percentage  of  time that the CPU or CPUs were idle during which the system had an outstanding disk I/O request.
\end{itemize}
\newpage
\begin{figure}
\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]
set datafile separator ";"
set autoscale ymax
set format y "%.f"
set xdata time
#set autoscale x
set ylabel "Mem. in KB"
set timefmt "%Y-%m-%d %H:%M:%S"
set xrange ["DATEMIN":"DATEMAX"]
set style line 11 lc rgb '#808080' lt 1
set border front 3 ls 11
set style line 12 lc rgb'#808080' lt 0 lw 1
set grid back ls 12
set key box opaque vert right top
set style fill
set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange
set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green
set style line 3 lc rgb '#0005FD' lt 1 lw 2.5 # Blue
set style line 4 lc rgb '#9B438E' lt 1 lw 2.5 # Purple
set tics
plot "/tmp/SERVERNAME-concatmem.csv" using 1:3 title 'kbmemused' w filledcurve x1 ls 1, '' using 1:6 title 'kbcached' w 
filledcurve x1 ls 2, '' using 1:2 title 'kbmemfree' ls 3 with filledcurve x1, '' using 1:5 title 'kbbuffers' w filledcur
ve x1 ls 4
\end{gnuplot}
\end{figure}
\begin{itemize}
\item{kbmemused:}
Amount  of used memory in kilobytes. This does not take into account memory used by the kernel itself.
\item{kbcached:}
Amount of memory used to cache data by the kernel in kilobytes.
\item{kbmemfree:}
Amount of free memory available in kilobytes.
\item{kbbuffers:}
Amount of memory used as buffers by the kernel in kilobytes.
\item{Extra info:}
Linux treats unused memory as a wasted resource and so uses as much RAM as it can to cache process/kernel information.
\end{itemize}
\newpage
\begin{figure}
\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]
set datafile separator ";"
set ylabel "Transfers/request /s"
set format y "%.f"
set xdata time
set autoscale x
set yrange [0:*]
set timefmt "%Y-%m-%d %H:%M:%S"
set xrange ["DATEMIN":"DATEMAX"]
set style line 11 lc rgb '#808080' lt 1
set border 3 front ls 11
set key box opaque vert right top
set tics
set style line 12 lc rgb'#808080' lt 0 lw 1
set grid back ls 12
set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange
set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green
set style line 3 lc rgb '#0005FD' lt 1 lw 2.5 # Blue
plot "/tmp/SERVERNAME-concatio.csv" using 1:2 title 'tps' w lines ls 1, '' using 1:2 title 'rtps' w lines ls 2, '' using
 1:3 title 'wtps' w lines ls 3
\end{gnuplot}
\end{figure}
\begin{itemize}
\item{tps:}
Total number of transfers per second that were issued to physical devices.  A  transfer
is  an I/O request to a physical device. Multiple logical requests can be combined into
a single I/O request to the device.  A transfer is of indeterminate size.
\item{rtps:}
Total number of read requests per second issued to physical devices.
\item{wtps:}
Total number of write requests per second issued to physical devices.
\item{bwrtn/s:}
Total amount of data written to devices in blocks per second.
\end{itemize}
\newpage
\begin{figure}
\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]
set datafile separator ";"
set ylabel "Transfers,Blocks /s"
set format y "%.f"
set xdata time
set autoscale x
set yrange [0:*]
set timefmt "%Y-%m-%d %H:%M:%S"
set xrange ["DATEMIN":"DATEMAX"]
set style line 11 lc rgb '#808080' lt 1
set border 3 front ls 11
set key box opaque vert right top
set tics
set style line 12 lc rgb'#808080' lt 0 lw 1
set grid back ls 12
set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange
set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green
plot "/tmp/SERVERNAME-concatio.csv" using 1:5 title 'bread/s' w lines ls 1, '' using 1:6 title 'bwrtn/s' w lines ls 2
\end{gnuplot}
\end{figure}
\begin{itemize}
\item{bread/s:}
Total number of transfers per second that were issued to physical devices.  A  transfer
is  an I/O request to a physical device. Multiple logical requests can be combined into
a single I/O request to the device.  A transfer is of indeterminate size.
\item{bwrtn/s:}
Total amount of data written to devices in blocks per second.
\end{itemize}
\end{document}

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

% REGJ - 20120113

\documentclass{article}

\usepackage[danish]{babel}

\usepackage[utf8]{inputenc}

\usepackage{palatino}

\pdfcompresslevel=0

\pdfobjcompresslevel=0

\usepackage{fancyhdr}

\usepackage[left=1.5in, right=1in, top=1in, bottom=1in, includefoot, headheight=13.6pt]{geometry}

\setlength{\headheight}{0.6in}

\fancyheadoffset[LE,RO]{1cm}

\fancyhead[L]{Performance plots for SERVERNAME - TIME}% empty left

\fancyhead[R]{ % right

\includegraphics[height=0.43in]{$HOME/bitmaps/logo.eps}

}

\fancyfoot[L] {\tiny Written by Rasmus Edgar Fink Jørgensen in \LaTeX/bash.}

\usepackage{tikz,pgfplots}

\usepackage{eurosym}

\usepackage{gnuplottex}

\usepgfplotslibrary{dateplot}

\pagestyle{fancy}

\begin{document}

\begin{figure}

\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]

set datafile separator ";"

set ylabel 'CPU/wait time \% used'

set xdata time

set autoscale x

set yrange [0:100]

set timefmt "%Y-%m-%d %H:%M:%S"

set xrange ["DATEMIN":"DATEMAX"]

set style line 11 lc rgb '#808080' lt 1

set border 3 ls 11

set key box opaque vert right top

set tics

set style line 12 lc rgb'#808080' lt 0 lw 1

set grid back ls 12

set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange

set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green

set style line 3 lc rgb '#0005FD' lt 1 lw 2.5 # Blue

plot "/tmp/SERVERNAME-concatcpu.csv" using 1:3 title '\%user' w lines ls 1, '' using 1:5 title '\%sys' w lines ls 2, ''

using 1:6 title '\%iowait' w lines ls 3

\end{gnuplot}

\end{figure}

\begin{itemize}

\item{user:}

Percentage of CPU utilization that occurred while executing at the user level (application).

\item{iowait:}

Percentage of time that the CPU or CPUs were idle during which the system had an outstanding disk I/O request.

\end{itemize}

\newpage

\begin{figure}

\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]

set datafile separator ";"

set autoscale ymax

set format y "%.f"

set xdata time

#set autoscale x

set ylabel "Mem. in KB"

set timefmt "%Y-%m-%d %H:%M:%S"

set xrange ["DATEMIN":"DATEMAX"]

set style line 11 lc rgb '#808080' lt 1

set border front 3 ls 11

set style line 12 lc rgb'#808080' lt 0 lw 1

set grid back ls 12

set key box opaque vert right top

set style fill

set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange

set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green

set style line 3 lc rgb '#0005FD' lt 1 lw 2.5 # Blue

set style line 4 lc rgb '#9B438E' lt 1 lw 2.5 # Purple

set tics

plot "/tmp/SERVERNAME-concatmem.csv" using 1:3 title 'kbmemused' w filledcurve x1 ls 1, '' using 1:6 title 'kbcached' w

filledcurve x1 ls 2, '' using 1:2 title 'kbmemfree' ls 3 with filledcurve x1, '' using 1:5 title 'kbbuffers' w filledcur

ve x1 ls 4

\end{gnuplot}

\end{figure}

\begin{itemize}

\item{kbmemused:}

Amount of used memory in kilobytes. This does not take into account memory used by the kernel itself.

\item{kbcached:}

Amount of memory used to cache data by the kernel in kilobytes.

\item{kbmemfree:}

Amount of free memory available in kilobytes.

\item{kbbuffers:}

Amount of memory used as buffers by the kernel in kilobytes.

\item{Extra info:}

Linux treats unused memory as a wasted resource and so uses as much RAM as it can to cache process/kernel information.

\end{itemize}

\newpage

\begin{figure}

\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]

set datafile separator ";"

set ylabel "Transfers/request /s"

set format y "%.f"

set xdata time

set autoscale x

set yrange [0:*]

set timefmt "%Y-%m-%d %H:%M:%S"

set xrange ["DATEMIN":"DATEMAX"]

set style line 11 lc rgb '#808080' lt 1

set border 3 front ls 11

set key box opaque vert right top

set tics

set style line 12 lc rgb'#808080' lt 0 lw 1

set grid back ls 12

set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange

set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green

set style line 3 lc rgb '#0005FD' lt 1 lw 2.5 # Blue

plot "/tmp/SERVERNAME-concatio.csv" using 1:2 title 'tps' w lines ls 1, '' using 1:2 title 'rtps' w lines ls 2, '' using

1:3 title 'wtps' w lines ls 3

\end{gnuplot}

\end{figure}

\begin{itemize}

\item{tps:}

Total number of transfers per second that were issued to physical devices. A transfer

is an I/O request to a physical device. Multiple logical requests can be combined into

a single I/O request to the device. A transfer is of indeterminate size.

\item{rtps:}

Total number of read requests per second issued to physical devices.

\item{wtps:}

Total number of write requests per second issued to physical devices.

\item{bwrtn/s:}

Total amount of data written to devices in blocks per second.

\end{itemize}

\newpage

\begin{figure}

\begin{gnuplot}[terminal=epslatex,terminaloptions={color colortext solid size 15.4cm,9.35cm}]

set datafile separator ";"

set ylabel "Transfers,Blocks /s"

set format y "%.f"

set xdata time

set autoscale x

set yrange [0:*]

set timefmt "%Y-%m-%d %H:%M:%S"

set xrange ["DATEMIN":"DATEMAX"]

set style line 11 lc rgb '#808080' lt 1

set border 3 front ls 11

set key box opaque vert right top

set tics

set style line 12 lc rgb'#808080' lt 0 lw 1

set grid back ls 12

set style line 1 lc rgb '#F33600' lt 1 lw 2.5 # Orange

set style line 2 lc rgb '#0DF300' lt 1 lw 2.5 # Green

plot "/tmp/SERVERNAME-concatio.csv" using 1:5 title 'bread/s' w lines ls 1, '' using 1:6 title 'bwrtn/s' w lines ls 2

\end{gnuplot}

\end{figure}

\begin{itemize}

\item{bread/s:}

Total number of transfers per second that were issued to physical devices. A transfer

is an I/O request to a physical device. Multiple logical requests can be combined into

a single I/O request to the device. A transfer is of indeterminate size.

\item{bwrtn/s:}

Total amount of data written to devices in blocks per second.

\end{itemize}

\end{document}

This template gets filled out, the data handled and the PDFs compiled by the following script:

#!/bin/bash
basedir=$(pwd)
csvpath=${basedir}/csv
outpath=${basedir}/out
texpath=${basedir}/texfiles
pdfpath=${basedir}/pdfs
datetex=$(date +'%Y-%m')
sarmin="2012-08-01"
sarmax="2012-08-31"
sarserver=$2
srvnamecut=$(echo $sarserver | awk -F"." '{print $1}')sar$(date +'%Y%m%d').tex

# Clean up

rm -f $outpath/*
rm -f $pdfpath/aux/*
rm -f $pdfpath/log/*

sartex() {
                sed -e 's/SERVERNAME/'"$sarserver"'/
                        s/DATEMIN/'"$sarmin"'/
			s/TID/'"$datetex"'/
                        s/DATEMAX/'"$sarmax"'/' $texpath/sarplot.tpl > \
                $outpath/$srvnamecut
}


sargen() {
        # Concatentate sar data
        cat /path/to/csvdata/$customer/linux/$sarserver/cpu/*cpu* > /tmp/$sarserver-concatcpu.csv
        cat /path/to/csvdata/$customer/linux/$sarserver/mem/*mem* > /tmp/$sarserver-concatmem.csv
        cat /path/to/csvdata/$customer/linux/$sarserver/io/*io*  > /tmp/$sarserver-concatio.csv

        sartex

}

case $1 in

-sar)
        sargen
        ;;
*)
        echo "Please specify -sar"
        exit 1

esac

# Generate plot

cd $outpath ; latexmk -f -pdfdvi -e '$latex=q/latex --shell-escape %O %S/' -outdir=$outpath $srvnamecut > /dev/null 2>&1

cp $outpath/*.pdf $pdfpath

#!/bin/bash

basedir=$(pwd)

csvpath=${basedir}/csv

outpath=${basedir}/out

texpath=${basedir}/texfiles

pdfpath=${basedir}/pdfs

datetex=$(date +'%Y-%m')

sarmin="2012-08-01"

sarmax="2012-08-31"

sarserver=$2

srvnamecut=$(echo $sarserver | awk -F"." '{print $1}')sar$(date +'%Y%m%d').tex

# Clean up

rm -f $outpath/*

rm -f $pdfpath/aux/*

rm -f $pdfpath/log/*

sartex() {

sed -e 's/SERVERNAME/'"$sarserver"'/

s/DATEMIN/'"$sarmin"'/

s/TID/'"$datetex"'/

s/DATEMAX/'"$sarmax"'/' $texpath/sarplot.tpl > \

$outpath/$srvnamecut

}

sargen() {

# Concatentate sar data

cat /path/to/csvdata/$customer/linux/$sarserver/cpu/*cpu* > /tmp/$sarserver-concatcpu.csv

cat /path/to/csvdata/$customer/linux/$sarserver/mem/*mem* > /tmp/$sarserver-concatmem.csv

cat /path/to/csvdata/$customer/linux/$sarserver/io/*io* > /tmp/$sarserver-concatio.csv

sartex

}

case $1 in

-sar)

sargen

;;

echo "Please specify -sar"

exit 1

esac

# Generate plot

cd $outpath ; latexmk -f -pdfdvi -e '$latex=q/latex --shell-escape %O %S/' -outdir=$outpath $srvnamecut > /dev/null 2>&1

cp $outpath/*.pdf $pdfpath

Which creates graphs that looks like this:

testservergraph (PDF)