Tue, 24 Nov 2009
Lazyweb query: CloudStore (or KosmosFS)
Does anyone have any experience with CloudStore, formerly known as KosmosFS? From http://en.wikipedia.org/wiki/CloudStore:
CloudStore (KFS, previously Kosmosfs) is Kosmix's C++ implementation of Google File System. ... CloudStore supports incremental scalability, replication, checksumming for data integrity, client side fail-over and access from C++, Java and Python.
The project site is here: http://kosmosfs.sourceforge.net/
I'd be interested in comments on general usability, quality, and "feel"...
thanks!
--titus
posted at: 20:14 | path: /nov-09 | 4 comments
Comments:
Posted by Jonathan Ellis at Wed Nov 25 06:13:43 2009:
My impression is that HDFS has at least one and maybe two orders of magnitude more users shaking the bugs out. So if I needed a GFS clone I would use that one.
Also, if I needed to use the source I'd much rather read someone else's Java than C++.
Posted by Titus Brown at Wed Nov 25 17:33:10 2009:
hey Jonathan, thanks -- GFS advertised differently so I didn't think it would fit my needs, but it does seem to in actuality. It's pretty usable from Python?
Posted by Jonathan Ellis at Thu Nov 26 19:20:57 2009:
Dunno, but I would think that between the Jython, Thrift, and libhdfs options something probably works. It looks like third-party SWIG and ctypes wrappers for libhdfs are out there.
The command line is pretty complete, too: http://hadoop.apache.org/common/docs/current/hdfs_shell.html