Monthly Archives: January 2012

UBUNTU使用Ganglia监控Hadoop集群

Ganglia是一个监控服务器,集群的开源软件,能够用曲线图表现最近一个小时,最近一天,最近一周,最近一月,最近一年的服务器或者集群的cpu负载,内存,网络,硬盘等指标。

Ganglia的强大在于:ganglia服务端能够通过一台客户端收集到同一个网段的所有客户端的数据,ganglia集群服务端能够通过一台服务端收集到它下属的所有客户端数据。这个体系设计表示一台服务器能够通过不同的分层能够管理上万台机器。

操作系统环境:Ubuntu 11.10 Server x64

集群环境:

namenode 192.168.1.1

datanode1 192.168.1.2

datanode2 192.168.1.3

ganglia的服务端安装在namenode上

$ sudo apt-get install  ganglia-monitor ganglia-webfront gmetad

安装脚本可能会出错,解决方法是执行以下语句在ganglia用户组下添加用户ganglia:

$ sudo useradd ganglia -g ganglia

在/etc/ganglia/下会产生一个gmond.conf的配置文件。 Read more »

Build Nutch 1.4 cluster with Hadoop

The current released version of Apache Nutch is 1.4. Since Nutch 1.3, there was no Hadoop distribution integrated with Nutch’s release package. So I have to build a Hadoop cluster seperately first, and then configure Nutch 1.4 work with Hadoop. My server OS is ubuntu 10.04 LTS, I have two server names cluster1 and cluster2. I’ll note the steps here. Read more »

WordPress with Nginx: Solve the 404 after changing permalinks structure

Today I tried to change my site’s permalinks, but I can’t visit all old posts with a 404 error. I searched for a solution and found that I can add following section in my vhost conf file under nginx configurations.

location / {
        ……
if (!-e $request_filename) {

rewrite ^(.*)$ /index.php?q=$1 last;
break;

        }
}
Then restart nginx and change the permalinks structure in wordpress. Everything goes on track now.