Tag unix

Gawking out

I've been processing log files recently to see how a live system is being used. When you have millions of hits daily, you need these processors to be fast. Today the best way is to have your log files shipped over onto a Hadoop cluster...

"grep -o" - really quite useful

One really quite useful command is “grep -o” - it allows you to fire off something like this: grep -o "Location supplier=\"\w*\"" locations.xml And the output will be the phrases matching the regular expressions that start with...

Piping content through SSH

Thanks to http://www.contentwithstyle.co.uk/content/4-ssh-config-tips-for-faster-remote-working/ I can avoid creating files which need to be scp’d: I can pipe the content directly: local$ cat localfile.txt | ssh remote "cat - >>...

Colloquy demystifying JIRA references

The BBC’s Forge engineering team uses an IRC channel to hold meetings. It allows our team to not bother about exactly where everyone is - some folks work from home, people are (mostly) in the office, but can be in different parts of our...

Running stunnel at startup

You might want your stunnels to be running all the time - and to start automatically when you log in. Here’s how: get your stunnel working. You’ll need to fix your certs, choose the correct ports, and all that yourself. write a script...