As discussed in previous post, HDFS files in Hadoop can be accessed in many ways. One of such way of accessing HDFS files is through HDFS’s Java API as entire Hadoop is written in Java after all. Here are the File System implementations in HDFS.
File system is an abstract class in Hadoop, serves as a generic file system representation. Note that it’s a class and not an interface. Other concrete classes implement from this class. It is implemented in several flavors such as Distributed and Local.Some of the concrete File System implementations include –
It represents a good old native filesystem using local disks. No need to start hdfs or hdfs need to be running for accessing this file system. We will make use of this file system generally to debug code in developer environment.
Represents a fault tolerant, highly available distributed file system. Known as Hadoop Distributed File System.
Using this filesystem we can access HDFS in read-only mode over http.
Used to access file system on FTP server.
For accessing files on cloud such as Amazon S3 cloud, more infomation at
Kosmos FileSystem is backed by Cloud Store. more details can be found here.