Today is the dotScale European conference. This is the first time I go to this event and it looks like very interesting. Thanks to eNovance to give me the possibility to be there. There is a lot of hackers here. I’ll make a short review about it in the next post…keep connected :-) To get more information on the event: http://www.dotscale.eu/

Continue reading

Next Tuesday, an OpenZFS conference will take place in Paris. I would like to assist as I’m a ZFS fan, however I couldn’t so easily. I didn’t really follow OpenZFS and hope we could see videos when the event will be finished. If you don’t really know about ZFS and can have the chance to assist, I strongly recommend it to you. To get more informations on the event, follow the link.

Continue reading

I started to play with Ansible a little bit more than a week ago and I really enjoy it compared to Puppet. I still do not have all my reflex that I can have on Puppet, however what I can say is how easy it is to start making complicated things on Ansible! I started to rewrite my Puppet manifests to Ansible playbooks and what I can say is it’s really fast and easy.

Continue reading

Regarding one of my latest post, talking about Fluentd, some of you asked me why I’ve chosen Fluentd instead of Logstash. First of all, I’ve looked at this blog post, which kindly resume the current situation. Looking at this and with feedback I got, I could establish this array: <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #c9daf8; font-weight: bold; text-align: center;" data-sheets-value="[null,2,&quot;Logstash&quot;]"> Logstash </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #c9daf8; font-weight: bold; text-align: center;" data-sheets-value="[null,2,&quot;Fluentd&quot;]"> Fluentd </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; text-align: center;" data-sheets-value="[null,2,&quot;Flexibility/Interoperability&quot;]"> Flexibility/Interoperability </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; text-align: center;" data-sheets-value="[null,2,&quot;Simplicity/Robustness&quot;]"> Simplicity/Robustness </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; text-align: center;" data-sheets-value="[null,2,&quot;JRuby&quot;]"> JRuby </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; text-align: center;" data-sheets-value="[null,2,&quot;Cruby&quot;]"> Cruby </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;More&quot;]"> More </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #f4cccc; text-align: center;" data-sheets-value="[null,2,&quot;Fewer&quot;]"> Fewer </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #f4cccc; text-align: center;" data-sheets-value="[null,2,&quot;Basics&quot;]"> Basics </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;Scalables&quot;]"> Scalables </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #f4cccc; text-align: center;" data-sheets-value="[null,2,&quot;Lot&quot;]"> Lot </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;Lot more&quot;]"> Lot more </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;Simple (drop a jar)&quot;]"> Simple (drop a jar) </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #fff2cc; text-align: center;" data-sheets-value="[null,2,&quot;Can be complex (dependancies)&quot;]"> Can be complex (dependencies) </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;Yes&quot;]"> Yes </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;Yes&quot;]"> Yes </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #f4cccc; text-align: center;" data-sheets-value="[null,2,&quot;Forward to 2 hosts&quot;]"> Forward to 2 hosts </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;LB A/A or A/P&quot;]"> LB A/A or A/P </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #f4cccc; text-align: center;" data-sheets-value="[null,2,&quot;Can loss messages&quot;]"> Can loss messages </td> <td style="padding: 2px 3px 2px 3px; vertical-align: bottom; background-color: #d9ead3; text-align: center;" data-sheets-value="[null,2,&quot;No message loss&quot;]"> No message loss </td> Logstash and Fluentd are both powerful solutions, they both got pros and cons.

Continue reading

Next Wednesday, a meetup will take place in Paris talking about Elasticsearch. My previous post was talking about a log solution using Elasticsearch. During that meetup, an overview of how Elasticsearch powerful real-time capabilities enrich Hadoop development. The session will showcase how to perform real-time searches on top and within Hadoop, Hive, Pig or Cascading jobs to get better answers, fast. We’ll cover architectural topics such as index scalability, data locality and partitioning between the Hadoop cluster and the search index, using off and on-premise storages (HDFS, S3, local file-systems) and multi-tenancy.

Continue reading

Managing logs is not a complicated tasks with classical syslog systems (syslog-ng, rsyslog…). However, being able to search in them quickly when you have several gigabit of logs, with scalability, with a nice graphical interface etc…is not the same thing. Hopefully today, tools that permit to do it very well exists, here are the list of tools that’s we’re going to use to achieve it: Elasticsearch: Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

Continue reading