The article explains Apache Spark’s memory‑based distributed computing model, its advantages over Hadoop’s MapReduce, key features, fault tolerance, deployment modes, ecosystem components, and the scenarios where Spark is most effective for large‑scale data analytics.
This article explains Hadoop 2.0's High Availability architecture, comparing the NFS and Quorum Journal Manager methods, detailing their principles, failover mechanisms, and practical tips for reliable NameNode redundancy in big‑data deployments.
This article walks through the essential steps to install and configure Hadoop 2.0 on a two‑node Linux cluster, covering version selection, directory setup, core XML files, YARN settings, service startup, verification commands, and basic troubleshooting tips.
The interview with Fourinone creator Peng Yuan reveals the framework's evolution from a parallel computing library to a lightweight 220KB distributed system with its own NoSQL database engine, compares it to Hadoop, discusses the CoolHash design, and outlines Huawei's FusionInsight big‑data platform, while providing open‑source repository links.
The interview with Fourinone founder Peng Yuan explores the framework's evolution from a parallel computing project to a 220 KB distributed system with its own NoSQL database engine CoolHash, compares it to Hadoop, and discusses its open‑source release, technical design choices, and real‑world deployments in finance and enterprise environments.
This article provides a concise overview of several widely-used distributed file systems—including Lustre, Hadoop, MogileFS, FreeNAS, FastDFS, NFS, OpenAFS, MooseFS, pNFS, and GoogleFS—highlighting their origins, key features, supported platforms, and typical use cases.
This article explains how to evaluate Hadoop workloads and select balanced hardware—covering storage, compute, network, and memory specifications for master and worker nodes—to build an efficient, cost‑effective Hadoop cluster.
The article warns that mastering Free Open Source Software—from cloud and big‑data tools like OpenStack, Hadoop and NoSQL to web technologies such as Drupal, PHP, HTML5 and jQuery, mobile app development, popular programming languages, and security certifications—will become essential for IT job seekers, prompting universities to embed FOSS curricula.
