Information Storage and Management Storing, Managing, and Protecting Digital Information EMC Education Services Information Storage and Management Storing, Managing, and Protecting Digital Information Edited by G. Somasundaram Alok Shrivastava EMC Education Services Information Storage and Management Published by Wiley Publishing, Inc. 10475 Crosspoint Boulevard Indianapolis, IN 46256 www.com Copyright © 2009 by EMC Corporation Published by Wiley Publishing, Inc., Indianapolis, Indiana Published simultaneously in Canada ISBN: 978-0-470-29421-5 Manufactured in the United States of America 10 9 8 7 6 5 4 3 2 1 No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except as permitted under Sections 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 646-8600. Requests to the Publisher for permission should be addressed to the Legal Department, Wiley Publishing, Inc., Indianapolis, IN 46256, (317) 572-3447, fax (317) 572-4355, or online at www.com/go/permissions.
Limit of Liability/Disclaimer of Warranty: The publisher and the author make no representations or war- ranties with respect to the accuracy or completeness of the contents of this work and specifically disclaim all warranties, including without limitation warranties of fitness for a particular purpose. No warranty may be created or extended by sales or promotional materials. The advice and strategies contained herein may not be suitable for every situation. This work is sold with the understanding that the publisher is not engaged in rendering legal, accounting, or other professional services.
If professional assistance is required, the services of a competent professional person should be sought. Neither the publisher nor the author shall be liable for damages arising herefrom. The fact that an organization or Web site is referred to in this work as a citation and/or a potential source of further information does not mean that the author or the publisher endorses the information the organization or Web site may provide or recommendations it may make. Further, readers should be aware that Internet Web sites listed in this work may have changed or disappeared between when this work was written and when it is read.
For general information on our other products and services please contact our Customer Care Department within the United States at (800) 762-2974, outside the United States at (317) 572-3993 or fax (317) 572-4002. Library of Congress Cataloging-in-Publication Data is available from the publisher. Trademarks: Wiley and the Wiley logo are trademarks or registered trademarks of John Wiley & Sons, Inc. and/or its affiliates, in the United States and other countries, and may not be used without written permission.
All other trademarks are the property of their respective owners. Wiley Publishing, Inc. is not associated with any product or vendor mentioned in this book. Wiley also publishes its books in a variety of electronic formats.
Some content that appears in print may not be available in electronic books. EMC2, EMC, EMC Centera, EMC ControlCenter, AdvantEdge, AlphaStor, ApplicationXtender, Avamar, Captiva, Catalog Solution, Celerra, Centera, CentraStar, ClaimPack, ClaimsEditor, ClaimsEditor Professional, CLARalert, CLARiiON, ClientPak, CodeLink, Connectrix, Co-StandbyServer, Dantz, Direct Matrix Architecture, Dis- kXtender, DiskXtender 2000, Document Sciences, Documentum, EmailXaminer, EmailXtender, EmailXtract, eRoom, Event Explorer, FLARE, FormWare, HighRoad, InputAccel, Invista, ISIS, Max Retriever, Navisphere, NetWorker, nLayers, OpenScale, PixTools, Powerlink, PowerPath, Rainfinity, RepliStor, ResourcePak, Retrospect, Smarts, SnapShotServer, SnapView/IP, SRDF, Symmetrix, TimeFinder, VisualSAN, Voyence, VSAM-Assist, WebXtender, where information lives, xPression, xPresso, Xtender, and Xtender Solutions are registered trade- marks and EMC LifeLine, EMC OnCourse, EMC Proven, EMC Snap, EMC Storage Administrator, Acartus, Access Logix, ArchiveXtender, Atmos, Authentic Problems, Automated Resource Manager, AutoStart, Auto- Swap, AVALONidm, C-Clip, Celerra Replicator, CenterStage, CLARevent, Codebook Correlation Technology, Common Information Model, CopyCross, CopyPoint, DatabaseXtender, Digital Mailroom, Direct Matrix, EDM, E-Lab, eInput, Enginuity, FarPoint, FirstPass, Fortress, Global File Virtualization, Graphic Visualization, Infini- Flex, InfoMover, Infoscape, InputAccel Express, MediaStor, MirrorView, Mozy, MozyEnterprise, MozyHome, MozyPro, OnAlert, PowerSnap, QuickScan, RepliCare, SafeLine, SAN Advisor, SAN Copy, SAN Manager, SDMS, SnapImage, SnapSure, SnapView, StorageScope, SupportMate, SymmAPI, SymmEnabler, Symmetrix DMX, UltraFlex, UltraPoint, UltraScale, Viewlets, Virtual Provisioning, and VisualSRM are trademarks of EMC Corporation. All other trademarks used herein are the property of their respective owners. © Copyright 2009 EMC Corporation.
All rights reserved. Published in the USA. 01/09 About the Editors G Somasundaram (Somu) is a graduate from the Indian Institute of Technology in Mumbai, India, and has over 22 years of experience in the IT industry, the last 10 with EMC Corporation. Currently he is director, EMC Global Services, leading worldwide industry readiness initiatives.
Somu is the architect of EMC’s open storage curriculum, aimed at addressing the storage knowledge “gap” that exists in the IT industry. Under his leadership and direction, industry readiness initiatives, such as the EMC Learning Partner and Academic Alliance programs, continue to experience significant growth and educate thousands of students worldwide on information storage and management technologies. Key areas of Somu’s responsibility include guiding a global team of professionals, identifying and partnering with global IT education providers, and setting the overall direction for EMC’s industry readiness initiatives. Prior to his current role, Somu held various managerial and leadership roles with EMC as well as other leading IT vendors.
Alok Shrivastava is senior director, EMC Global Services and has focused on education since 2003. Alok is the architect of several of EMC’s successful education initiatives including the industry leading EMC Proven Professional program, industry readiness programs such as EMC’s Academic Alliance, and most recently this unique and valuable book on information storage technology. Alok provides vision and leadership to a team of highly talented experts and professionals that develops world-class technical education for EMC’s employ- ees, partners, customers, and other industry professionals. Prior to his success in education, Alok built and led a highly successful team of EMC presales engineers in Asia-Pacific and Japan.
Earlier in his career, Alok was a systems manager, storage manager, and a backup/restore/disaster recovery consultant working with some of the world’s largest data centers and IT installations. He holds dual Masters degrees from the Indian Institute of Technology in Mumbai, India, and the University of Sagar in India. Alok has worked in information storage technology and has held a unique passion for this field for most of his 25-plus year career in IT. iii Credits Executive Editor Vice President and Executive Carol Long Publisher Barry Pruett Senior Development Editor Tom Dinse Project Coordinator, Cover Lynsey Stanford Production Editor Dassi Zeidel Compositor Jeffrey Lytle, Happenstance Copy Editor Type-O-Rama Luann Rouff Proofreader Editorial Manager Nancy Bell Mary Beth Wakefield Indexer Production Manager Robert Swanson Tim Tate Cover Image Vice President and Executive © 2008 Ron Chapple/Ron Chapple Group Publisher Stock/Photos To Go Richard Swadley Cover Designer EMC Creative Development iv Acknowledgments When we embarked upon the project to develop this book, the very first chal- lenge was to identify a team of subject matter experts covering the vast range of technologies that form the modern information storage infrastructure.
A key factor working in our favor is that at EMC, we have the technologies, the know-how, and many of the best talents in the industry. When we reached out to individual experts, they were as excited as we were about the prospect of publishing a comprehensive book on information storage technology. This was an opportunity to share their expertise with professionals and students worldwide. This book is the result of efforts and contributions from a number of key EMC organizations led by EMC Education Services and supported by the office of CTO, Global Marketing, and EMC Engineering.
In addition to his own research and expertise, Ganesh Rajaratnam, from EMC Education Services, led the efforts with other subject matter experts to develop the first draft of the book. David Black, from the EMC CTO office, devoted many valuable hours to combing through the content and providing cogent advice on the key topics covered in this book. We are very grateful to the following experts from EMC Education Services for developing the content for various sections and chapters of this book: Rodrigo Alves Anbuselvi Jeyakumar Charlie Brooks Sagar Kotekar Patil Debasish Chakrabarty Andre Rossouw Diana Davis Tony Santamaria Amit Deshmukh Saravanaraj Sridharan Michael Dulavitz Ganesh Sundaresan Ashish Garg Jim Tracy Dr. Vanchi Gurumoorthy Anand Varkar Simon Hawkshaw Dr.
Viswanth VS v vi Acknowledgments The following experts thoroughly reviewed the book at various stages and provided valuable feedback and guidance: Ronen Artzi Jack Harwood Eric Baize Arthur Johnson Greg Baltazar Michelle Lavoie Edward Bell Tom McGowan Christopher Chaulk Jeffery Moore Roger Dupuis Toby Morral Deborah Filer Peter Popieniuck Bala Ganeshan Kevin Sheridan Jason Gervickas Ed VanSickle Nancy Gessler Jody Goncalves We also thank NIIT Limited for their help with the initial draft, Muthaiah Thiagarajan of EMC and DreaMarT Interactive Pvt. for their support in creating all illustrations, and the publisher, John Wiley & Sons, for their timely support in bringing this book to the industry. Somasundaram Director, Education Services, EMC Corporation — Alok Shrivastava Senior Director, Education Services, EMC Corporation March 2009 Contents Foreword xvii Introduction xix Section I Storage System 1 Chapter 1 Introduction to Information Storage and Management 3 1.2 Types of Data 7 1.2 Evolution of Storage Technology and Architecture 9 1.3 Data Center Infrastructure 10 1.2 Key Requirements for Data Center Elements 11 1.3 Managing Storage Infrastructure 13 1.4 Key Challenges in Managing Information 14 1.1 Information Lifecycle Management 15 1.3 ILM Benefits 17 Summary 18 Chapter 2 Storage System Environment 21 2.1 Components of a Storage System Environment 21 2.3 Storage 26 vii viii Contents 2.2 Disk Drive Components 27 2.3 Read/Write Head 28 2.4 Actuator Arm Assembly 29 2.6 Physical Disk Structure 30 2.7 Zoned Bit Recording 31 2.8 Logical Block Addressing 32 2.3 Disk Drive Performance 33 2.1 Disk Service Time 33 2.4 Fundamental Laws Governing Disk Performance 35 2.5 Logical Components of the Host 38 2.6 Application Requirements and Disk Performance 45 Summary 48 Chapter 3 Data Protection: RAID 51 3.1 Implementation of RAID 52 3.2 RAID Array Components 53 3.5 RAID Impact on Disk Performance 66 3.1 Application IOPS and RAID Configurations 67 3.6 Hot Spares 68 Summary 68 Chapter 4 Intelligent Storage System 71 4.1 Components of an Intelligent Storage System 72 4.4 Physical Disk 79 Contents ix 4.2 Intelligent Storage Array 82 4.1 High-end Storage Systems 82 4.2 Midrange Storage System 83 4.3 Concepts in Practice: EMC CLARiiON and Symmetrix 84 4.1 CLARiiON Storage Array 85 4.2 CLARiiON CX4 Architecture 86 4.3 Managing the CLARiiON 88 4.4 Symmetrix Storage Array 89 4.5 Symmetrix Component Overview 91 4.6 Direct Matrix Architecture 93 Summary 95 Section II Storage Networking Technologies and Virtualization 97 Chapter 5 Direct-Attached Storage and Introduction to SCSI 99 5.1 Types of DAS 99 5.2 DAS Benefits and Limitations 101 5.3 Disk Drive Interfaces 101 5.4 Introduction to Parallel SCSI 104 5.1 Evolution of SCSI 104 5.4 Parallel SCSI Addressing 111 5.5 SCSI Command Model 112 5.4 Status 114 Summary 115 Chapter 6 Storage Area Networks 117 6.1 Fibre Channel: Overview 118 6.2 The SAN and Its Evolution 119 6.3 Components of SAN 120 6.5 SAN Management Software 124 6.1 Point-to-Point 125 6.2 Fibre Channel Arbitrated Loop 125 6.3 Fibre Channel Switched Fabric 127 x Contents 6.5 Fibre Channel Ports 129 6.6 Fibre Channel Architecture 131 6.1 Fibre Channel Protocol Stack 132 6.2 Fibre Channel Addressing 133 6. Structure and Organization of FC Data 137 6.6 Classes of Service 138 6.8 Fibre Channel Login Types 141 6.1 Core-Edge Fabric 142 6.10 Concepts in Practice: EMC Connectrix 145 Summary 148 Chapter 7 Network-Attached Storage 149 7.1 General-Purpose Servers vs.2 Benefits of NAS 150 7.1 File Systems and Remote File Sharing 152 7.2 Accessing a File System 152 7.4 Components of NAS 153 7.3 Integrated NAS Connectivity 155 7.4 Gateway NAS Connectivity 156 7.6 NAS File-Sharing Protocols 157 7.1 Hosting and Accessing Files on NAS 160 7.8 Factors Affecting NAS Performance and Availability 160 7.
