Spark – Configure and use log4j

Hello, a little tutorial to configure and use log4j with Scala and Spark

Then create a file called “log4j.properties” and put this code inside

This configuration will log to /var/log/spark.log and on console. I partially review this post: http://blog.quantifind.com/posts/logging-post/ Bye 🙂 Related posts: Spark – consumer from Kafka Python – daemons Pacemaker – […]

Pacemaker – Configure cluster

Today some simple commands to configure a cluster with two ip adresses and a service on two servers with ubuntu 14.04 Let start installing some packages

Than adjust some configuration. The first is to enable pacemaker to run without quorum (you need it if the servers are less than three)

Now edit corosync […]

Python – Send AVRO messages over RabbitMQ

After crawling web sites for a lot of days and find nothing, I can send avro encoded messages with rabbitmq:

 

Bye 🙂   Related posts: Python – Tornado and Celery integration Python – daemons

Python – daemons

Today a little post on how to create a daemon with python. I started from this article:  http://www.jejik.com/articles/2007/02/a_simple_unix_linux_daemon_in_python/  and then I added logging and scheduler. Normally I don’t like to coerce sysadmins to install a lot of dependencies, so I try to put this way of thinking in this package. Requirements: python3 If you used […]

Apache – beautify directory index

Have you ever wonder on how to cheange the very ugly apache directory index page? There are various ways to change the look and feel of this page, one of this is h5ai (http://larsjung.de/h5ai/). Lets start by installing some prerequisites:

Now we can install h5ai:

Modify virtual host settings by insert the row […]

Linux – Change “message of the day” (motd)

Today a very rapid tutorial on how to modify motd, the messega the server prints when we login via ssh. Lets start by installing some prerequisites:

Now make a backup of the actual motd:

The last command will exit with error, never mind about it 🙂 Create our motd by writing the following […]

OpenCPU – Using it with php

OpenCPU (https://public.opencpu.org/) is a software which allow to use R to produce data (text, graph, etc) and serve them using a webserver (apache or nginx if you enable cache server). Another similar software is Shiny (http://www.rstudio.com/shiny/) which use node.js. You must see what is the best solution for your needs 😉 I don’t now node.js, but […]