Tag work

Gawking out

I've been processing log files recently to see how a live system is being used. When you have millions of hits daily, you need these processors to be fast. Today the best way is to have your log files shipped over onto a Hadoop cluster...

A Place Registry view of the world

Here’s another view of the Places in the Nokia Places Registry. Each pixel is the location of one or more points of interest that we have as of the end of June 2011. Under each pixel there may only be one place or there may be thousands...

Nokia Place Registry visualisation

Here’s a little visualisation of what I am up to at Nokia. You see a KML representation of the Points of Interest we currently have - the taller the tower the more active places we have in that spatial area.

CouchDB compaction - big impacts

CouchDB needs to have it’s databases compacted regularly. It’s quite easy to do but the ease of doing so may lead you into thinking that it’s not worthy of serious consideration. You need to be aware of a few things. Here at the beeb we...

Problems with replication maps

For a long set of reasons that I must sometime write about, I have a set of CouchDB databases which replicate with each other. Each database replicates with two others: one in the same datacentre, one in the other datacentre (we’re only...

CouchDB 0.9x - 1st read from v large views serially

On a server, we run 4 different CouchDB nodes, each with 30 or so databases. We can therefore have over 100 databases - and if you’re reading from large views - or view over large databases - you will need to do so serially. We have 4...

Colloquy demystifying JIRA references

The BBC’s Forge engineering team uses an IRC channel to hold meetings. It allows our team to not bother about exactly where everyone is - some folks work from home, people are (mostly) in the office, but can be in different parts of our...

Top 25 Most Dangerous Programming Errors

The 2009 CWE/SANS Top 25 Most Dangerous Programming Errors is a list of the most significant programming errors that can lead to serious software vulnerabilities. They occur frequently, are often easy to find, and easy to exploit. They...

Running stunnel at startup

You might want your stunnels to be running all the time - and to start automatically when you log in. Here’s how: get your stunnel working. You’ll need to fix your certs, choose the correct ports, and all that yourself. write a script...