In my previous post, I talked about how to speed up reads and writes coupling Redis with Neo4J. Now I want to share with you how it’s possible to unload your server and use Elasticsearch to speed up news feed and user wall. 1/ Show me your news feed A news feed is the main page of traditional social networks. Its main goal is to show you all recents updates from your friends and your interests.

Continue reading

For another personal project (that I can’t talk about for the moment ;-)), I wanted to have a Changelog file to get a better following of the infrastructure evolution (configuration management, scripts…all under git). Of course the documentation is very important, but when you do not write it at the same time you’re building the infrastructure, it may be complex to remember each little things you’ve done. That’s why a Changelog can help to understand how the infrastructure has been built step by step.

Continue reading

For my company, I recently had to find a good solution to make Snapshots from Instance IDs or from tags on AWS. I made several searches but unfortunately didn’t find what I was searching for. That’s why I started to make a tool to do this kind of job. It’s written in Python and requires the Boto library. Here is what you can do with Simple EC2 snapshots: Hot snapshots (by default) and Cold snapshots Multiple instances snapshot in one line Detection of doubles Filters by tags (allowing wildcards) or by instance IDs Credentials file multiple with profiles Limit the number of snapshots Restrict snapshots to data disks only The tool is open source and can be downloaded on GitHub :-).

Continue reading

As you may know, I’m using Vagrant for more than a year now with VirtualBox. Docker is a faster alternative that needs to be taken into consideration. Having the possibility to manage both of them with the same tool can be very interesting. For information, I mainly use it with VirtualBox because it’s any platform compatible and Docker because it’s perfect for a CI like Jenkins. I recently talked about my implication into the Smash project.

Continue reading

In the last blog posts, I talked about Galera Innoptimizer tool I’ve made in Python. As a VIM lover, I’ve wrote it with that editor and installed additional them with Vundle. Here are the one I’m using (to my .vimrc file): " Python completion Plugin 'klen/python-mode' " Tabular Plugin 'godlygeek/tabular' " Git Gutter Plugin 'airblade/vim-gitgutter' Python completion helps to autocomplete some Python functions automatically. Tabular helps on correctly aligning multiple lines and gitguuter helps you with git to see a live gitdiff !

Continue reading

One of my ex-boss talked to me about Coursera a year ago. It’s a website where you can freely learn several things from high graduated school. Most ofter, it’s technology related and I wanted to test it to learn Java. I subscribed to 2 sessions. One for the java basics and the other one for the object oriented aspect (in french). I’ve started it a few weeks ago the first part and what I can say is, it’s very good.

Continue reading

You may remember the first introduction of that tool here. I’ve made changes to support tables’ partition, to avoid a big lock on huge tables. The solution is to rebuild every partition one by one instead of rebuilding the whole table. This is smoother and less stressing Galera. I hope you’ll enjoy this new version (v0.2). Note: I still got issues on MariaDB 10 with such thing, I’m working on it.

Continue reading

Author's picture

Pierre Mavro / Deimosfr


SRE Lead DevOps at Criteo  •  Nousmotards Co-Founder

Paris - France