Register CV

Data Engineer, £50-£95k

  • Permanent
  • London
  • Posted 9 months ago

My client are based in the Old Street area and have a typical startup culture, although they are more established now. To start off with they develop cutting edge products in the social video space using a combination of lean and agile development practices. They recruit ‘software craftsman’ style developers, those with a genuine enthusiasm for constantly improving both software and software development processes. They are extremely keen on TDD and pair programming too, you can see from this that development is extremely highly regarded rather than the classic startup approach which can have time favoured over quality. One of the real unique selling points about them is that they have a unique system in which you spend up to 20% of your time working on new technologies that you can investigate yourself. Say you attend an event or read about something you are interested in, you can investigate it in more detail and use this time to see if it would add value.

Does data float your boat? Fanatical about databases? Love representing data in an intuitive manner? They are looking for someone to come and help them improve and scale their low latency, high throughput reporting system, which handles around 10k events a second with a data set growing by 1TB per day with 10x year on year growth, and even more growth expected this year.

There are monthly bowling nights, weekly deliveries of muffins, beer, and fruit, an interdepartmental foosball contest, Xbox contests, film nights, occasional poker nights and an annual company festival. Plus they spend way too much time watching and sharing the most awesome videos on the web.

They work with a diverse set of technologies. They predominately use Java and JavaScript across their teams. They also use Scala, Spark, Hadoop, Cascading/Scalding, Postgresql, and Actian Vector. Most of their infrastructure is hosted on AWS, and managed with Puppet.

You should have knowledge of:
Test Driven Development
Domain Driven Design
Both structured and schema-less datastores: e.g. Postgres, Vectorwise, Cassandra, Redis, Spark, Splunk
Linux systems
Experience with at least two of the following:
Reporting on large batches of data
Infrastructure as code: we use AWS, Puppet, and Terraform
Building fault tolerant, performance critical system
Profiling and performance monitoring

If you like the sound of this role, we’d love to hear from you. You can send your CV to or call us on 020 7866 8155.

To apply for this job email your details to

Apply using webmail: Gmail / AOL / Yahoo / Outlook