UBUNTU使用Ganglia监控Hadoop集群

Posted by on January 25, 2012 No comments

Ganglia是一个监控服务器，集群的开源软件，能够用曲线图表现最近一个小时，最近一天，最近一周，最近一月，最近一年的服务器或者集群的cpu负载,内存,网络,硬盘等指标。

Ganglia的强大在于：ganglia服务端能够通过一台客户端收集到同一个网段的所有客户端的数据，ganglia集群服务端能够通过一台服务端收集到它下属的所有客户端数据。这个体系设计表示一台服务器能够通过不同的分层能够管理上万台机器。

操作系统环境：Ubuntu 11.10 Server x64

集群环境:

namenode 192.168.1.1

datanode1 192.168.1.2

datanode2 192.168.1.3

ganglia的服务端安装在namenode上

$ sudo apt-get install  ganglia-monitor ganglia-webfront gmetad

安装脚本可能会出错，解决方法是执行以下语句在ganglia用户组下添加用户ganglia:

$ sudo useradd ganglia -g ganglia

在/etc/ganglia/下会产生一个gmond.conf的配置文件。 Read more »

Build Nutch 1.4 cluster with Hadoop

Posted by on January 14, 2012 No comments

The current released version of Apache Nutch is 1.4. Since Nutch 1.3, there was no Hadoop distribution integrated with Nutch’s release package. So I have to build a Hadoop cluster seperately first, and then configure Nutch 1.4 work with Hadoop. My server OS is ubuntu 10.04 LTS, I have two server names cluster1 and cluster2. I’ll note the steps here. Read more »

WordPress with Nginx: Solve the 404 after changing permalinks structure

Posted by on January 11, 2012 No comments

Today I tried to change my site’s permalinks, but I can’t visit all old posts with a 404 error. I searched for a solution and found that I can add following section in my vhost conf file under nginx configurations.

location / {
        ……
if (!-e $request_filename) {

rewrite ^(.*)$ /index.php?q=$1 last;
break;

        }
}
Then restart nginx and change the permalinks structure in wordpress. Everything goes on track now.

苦逼的“挨踢”

Posted by on November 24, 2011 No comments

A：“挨踢啊，这个yy软件产品这个月要出一个最终发布版本，不能再拖了。”

挨踢心想：“那个xx模块，只做一个简单原型应该没有问题。”

B：“嗯，这个产品也做了很长时间了，不过有些原先说的功能还没看到，这个月一定要做出来才能作为发布版本。那个xx模块，虽然之前没有什么经验，不过有个客户那里有几个现成的需求，可以根据这些需求，做一个尽量灵活通用的功能出来，方便以后扩展。”

挨踢心想：“灵活通用你妹啊，这玩意到底能干嘛提需求的家伙自己都没搞明白，我怎么知道以后人家要看神马啊？”

第二天，交流会议
C：“有个投标要用yy软件的xx模块做演示，这两天你帮忙做一个demo吧，是个很重要的客户，做成了对以后进入这个行业有帮助，麻烦你了，尽量快点把demo做出来吧。”

挨踢心想：“投标，又见投标，demo，又见dem。，尼玛的，钞票还不知道在哪里飘着呢，就先把一大堆脏活给人先干了，干完了就算赚到钱也基本跟我半毛钱关系没有……香蕉你个巴辣的！” Read more »

Skydive in Australia

Posted by on October 27, 2011 No comments

I’ve been back from Australia for lots of days yet, but I’m too busy to update my blog these days. I’ll post some articles about our travel in Australia in the coming days. I want to share my skydive experience in this post. I have to say, skydive is amazing!!!