Eric Sammer - Hadoop Operations [2012, PDF, ENG] torrent

Книги и журналы » Компьютерная литература » Программирование (книги)

Hadoop Operations

Год: 2012
Автор: Eric Sammer
Издательство: O'Reilly Media
ISBN: 978-1-4493-2705-7
Язык: Английский
Формат: PDF
Качество: Изначально компьютерное (eBook)
Интерактивное оглавление: Да
Количество страниц: 298
Описание:
If you’ve been asked to maintain large and complex Hadoop clusters, this book is a must. Demand for operations-specific material has skyrocketed now that Hadoop is becoming the de facto standard for truly large-scale data processing in the data center. Eric Sammer, Principal Solution Architect at Cloudera, shows you the particulars of running Hadoop in production, from planning, installing, and configuring the system to providing ongoing maintenance.

Rather than run through all possible scenarios, this pragmatic operations guide calls out what works, as demonstrated in critical deployments.
• Get a high-level overview of HDFS and MapReduce: why they exist and how they work
• Plan a Hadoop deployment, from hardware and OS selection to network requirements
• Learn setup and configuration details with a list of critical properties
• Manage resources by sharing a cluster across multiple groups
• Get a runbook of the most common cluster maintenance tasks
• Monitor Hadoop clusters—and learn troubleshooting with the help of real-world war stories
• Use basic tools and techniques to handle backup and catastrophic failure
[spoiler="Примеры страниц"]

[/spoiler]
[spoiler="Оглавление"]
Chapter 1 : Introduction

Chapter 2 HDFS
Goals and Motivation
Design
Daemons
Reading and Writing Data
Managing Filesystem Metadata
Namenode High Availability
Namenode Federation
Access and Integration

Chapter 3 : MapReduce
The Stages of MapReduce
Introducing Hadoop MapReduce
YARN

Chapter 4 : Planning a Hadoop Cluster
Picking a Distribution and Version of Hadoop
Hardware Selection
Operating System Selection and Preparation
Kernel Tuning
Disk Configuration
Network Design

Chapter 5 : Installation and Configuration
Installing Hadoop
Configuration: An Overview
Environment Variables and Shell Scripts
Logging Configuration
HDFS
Namenode High Availability
Namenode Federation
MapReduce
Rack Topology
Security

Chapter 6 : Identity, Authentication, and Authorization
Identity
Kerberos and Hadoop
Authorization
Tying It Together

Chapter 7 : Resource Management
What Is Resource Management?
HDFS Quotas
MapReduce Schedulers

Chapter 8 : Cluster Maintenance
Managing Hadoop Processes
HDFS Maintenance Tasks
MapReduce Maintenance Tasks

Chapter 9 : Troubleshooting
Differential Diagnosis Applied to Systems
Common Failures and Problems
“Is the Computer Plugged In?”
Treatment and Care
War Stories

Chapter 10 : Monitoring
An Overview
Hadoop Metrics
Health Monitoring

Chapter 11 : Backup and Recovery
Data Backup
Namenode Metadata

Appendix : Deprecated Configuration Properties

Colophon
[/spoiler]