Chad Metcalf's dashboard

Chad Metcalf replied on December 17, 2009 23:32 to the question "Looking for the eclipse plugin for hadoop" in Cloudera:

http://wiki.apache.org/hadoop/Eclipse...

All the latest information on Eclipse and Hadoop as it currently stands.

Chad

Chad Metcalf replied on December 17, 2009 23:08 to the question "Monitor Hadoop processes with watchdog" in Cloudera:

Hadoop daemons (namenode, tasktracker, etc) do drop pid files in CDH. In CDH up to now they are dropping in /tmp. For example, /tmp/hadoop-hadoop-namenode.pid.

In future releases of CDH (after patch level 152) these can be found in /var/run/hadoop-0.20.

That said monit is fine.

Cheers
Chad

Chad Metcalf replied on December 15, 2009 18:58 to the question "Trouble with Installing Cloudera's hadoop-hive-webinterface" in Cloudera:

Try:

rpm --nodeps -Uvh http://archive.cloudera.com/redhat/cd...

That should install it. I'll check the dependencies and make sure it doesn't happen in the next release.

Cheers
Chad

Chad Metcalf replied on December 11, 2009 22:27 to the question "Where is contrib hbase-src rpm??" in Cloudera:

Sure. In this case its Cloudera magic provided by HBase labor. Just making sure everyone gets what the need. :)

Chad

Chad Metcalf replied on December 11, 2009 19:23 to the question "Where is contrib hbase-src rpm??" in Cloudera:

http://archive.cloudera.com/redhat/cd...

This is a contributed rpm from the HBase guys. Any improvements you make they might like to know about. They might be able/interested in folding those changes into the next version.

Chad

Chad Metcalf replied on December 08, 2009 19:18 to the problem "HBASE RPM's run checkconfig on RH haddoop RPM's do not." in Cloudera:

The various rpms for namenode, secondarynamenode, tasktracker, etc do run chkconfig. We only enable services explicitly. We'll work with the HBase developers to change their rpms to do something similar.

Thanks
Chad

Chad Metcalf replied on December 02, 2009 01:49 to the problem "hbase init script bug" in Cloudera:

Yup. This is fixed in a forthcoming rpm. For now you can hand edit the @HADOOP_USERNAME@ to be hadoop.

Cheers
Chad

Chad Metcalf replied on November 12, 2009 18:24 to the problem "Empty packages and others not up to date." in Cloudera:

Jaunty wasn't released when CDH1 was released. There are no Jaunty packages for CDH1. These will not be built. You can use the 18.3 release in testing which is pretty stable by this point.

Desktop only works with 0.20.1 which is in the testing repositories.

Karmic support will be coming in the future. In the meanwhile you can load jaunty packages on Karmic and they will work.

Cheers
Chad

Chad Metcalf replied on November 07, 2009 21:03 to the question "cloudera desktop for hadoop 0.18" in Cloudera:

The installation instructions for Cloudera Desktop are here:
http://archive.cloudera.com/desktop/p...

The relevant section for you is:

1.2. Required Hadoop Version

To use Cloudera Desktop, you must be running Cloudera's Distribution for Hadoop with a version number of at least 0.20.1+133. If you are not running at least this version of Hadoop, please upgrade your cluster before proceeding.

Cheers
Chad

Chad Metcalf replied on November 02, 2009 00:04 to the problem "Cloudera-desktop FS error" in Cloudera:

Have you configured Cloudera Desktop to use your Hadoop installation? There are instructions here: http://archive.cloudera.com/desktop/p...

Cheers
Chad

Chad Metcalf replied on November 01, 2009 23:30 to the question "cloudera-desktop missing from debian repo" in Cloudera:

I spoke with someone else having this problem. Please make sure you are using on the testing repositories. Cloudera Desktop is only available in the testing repositories.

Cheers
Chad

A comment on the idea "Support for HBase" in Cloudera:

There are not currently any deb packages. The HBase team is working on debian packaging but there is no date for when this work will be complete. – Chad Metcalf, on November 01, 2009 23:28

A comment on the idea "Support for HBase" in Cloudera:

These are still in the contrib repo:

http://archive.cloudera.com/redhat/cd... – Chad Metcalf, on November 01, 2009 21:25

Chad Metcalf replied on October 27, 2009 01:02 to the question "cloudera-desktop missing from debian repo" in Cloudera:

This works for me. What version of debian or Ubuntu are you running and have you run an apt-get update recently?

Chad

Chad Metcalf replied on October 22, 2009 19:22 to the problem "Problem installing HBase from cloudera-contrib repo" in Cloudera:

It looks like the hbase-native package overlaps with the base package. This is a packaging error. We will notify the HBase team (it's a "contrib" package) and work with them to get a fix into the next release cycle.

For now, since the HBase package apparently includes the native libraries, the solution is to simply not install the hbase-native package.

Cheers
Chad

Chad Metcalf replied on October 13, 2009 20:33 to the idea "Suse support?" in Cloudera:

To echo Christophe's comments above if you are interested in Suse support chime in. We currently only build for the redhat'ish (centos, rhel, fedora) and debian'ish (Ubuntu - intrepid, jaunty, etc, lenny).

In the meanwhile, the tarballs are available at http://archive.cloudera.com/cdh/testing/

Cheers
Chad

A comment on the idea "Suse support?" in Cloudera:

Cloudera Desktop is available in RPMs. However, these are for Centos/RHEL/Fedora distributions. We currently do not support Suse. – Chad Metcalf, on October 13, 2009 20:30

Chad Metcalf replied on October 13, 2009 20:26 to the question "PRM version for Cloudera Desktop?" in Cloudera:

The -dev packages can sometimes be found in the full packages. For example running on Mac OS X you would need to install libxslt, libxml2, python2.5 and the Xcode tools for gcc.

Unfortunately, we just don't have the bandwidth to support all the various flavors of Linux.

If you can't use Centos/RHEL/Fedora or one of the supported Debians, I would recommend trying the VM.

Cheers
Chad

Chad Metcalf replied on October 13, 2009 18:49 to the problem "Unable to setup your configuration RPMs: [Errno 28] No space left on device" in Cloudera:

We've fixed this issue again. Hopefully for the last time.

Chad Metcalf replied on October 01, 2009 20:00 to the question "Hive with Hadoop 0.21 (CDH2, Sep 30)" in Cloudera:

CDH doesn't have Hadoop 0.21 it has 0.20.1.

That said:

yum install hadoop-hive
or
apt-get install hadoop-hive

$ hive

Its configured for you to work out of the box but you can tailor your configuration by editing the files in /etc/hive

Cheers
Chad