Infinit alpha
HDFS logo

HDFS

The Hadoop Distributed File system (HDFS) is a distributed, scalable, and portable file-system written in Java for the Hadoop framework. A Hadoop cluster is composed of a single namenode plus a cluster of datanodes, although redundancy options are available for the namenode due to its criticality.

architecture

Architecture

File-based solutions provide humans with a way to store and collaborate around files organized through a hierarchy of folders. Read more.

File
HDFS logo File, Object & Block
interface

Interface

File systems are better suited for accessing storage infrastructure with large amounts of data since, unlike file synchronization, the files do not need to be downloaded locally first but can be accessed on-demand. Read more.

File System
HDFS logo File System
model

Model

Distributed storage systems distribute the data between a set of storage servers while some specific metadata server control the overall infrastructure, possibly acting as single points of failure and/or bottlenecks. Read more.

Distributed
HDFS logo Decentralized
environment

Environment

A controlled environment is a set of servers and clients that are under the control of a single entity e.g a company. Read more.

Controlled
HDFS logo Controlled & Worldwide
redundancy

Redundancy

Replication is a simple redundancy mechanism that consumes more storage capacity than erasure codes but are more adapted to primary storage.

Replication
HDFS logo Replication
fault_tolerance

Fault Tolerance

The ability to maintain a storage system operational depends on algorithms that need to adapt depending on the nature of the environment. Read more.

Standard
HDFS logo Byzantine
security

Security

Communications are not encrypted (in transit) and pieces of data are stored in plain text i.e not encrypted on disk (at-rest). Read more.

None
HDFS logo In-Transit & At-Rest
scalability

Scalability

Homogeneous systems can scale up and out but are limited to resources that are under the control of the infrastructure's administrator: local disk, NAS etc. Read more.

Homogeneous
HDFS logo Heterogeneous
interoperability

Interoperability

The ways a user or program can interact with a storage system; either through specific desktop/mobile applications or standard protocols. Read more.

Protocols
HDFS logo Applications (Windows, MacOS X, Linux, iOS, Android)