Complete SCSI / iSCSI / RAID / SAS Information

By David Woodsmall

5/08/2008 - Optimized for Firefox 2.0.0.14

COPYRIGHT 1992 thru 2008 - David R. Woodsmall

Feel free to link to any of my pages

Testing Fibre Channel SAN / NAS / Storage IP Viruses Wireless Ethernet

SCSI INFO JUMP TABLE

ACRONYMS / GLOSSARIES | AoE | Articles / News | ASPI | BEGINNER's INTRODUCTION to SCSI | Bluetooth | BOOKS - SCSI Reference | Buses, Other | CAM (SCSI) | Comparisons | Connectors | Data recovery | DDF - Disk Data Format (SNIA) | Device Discovery | Drivers (SCSI) | EIDE / IDE / ATA | Ethernet (all) | EVMS - Enterprise Volume Management System (SourceForge - free) Fast SCSI (SCSI-2) | FC - Fibre Channel (all) | FCoE | Glossaries (SCSI) | HyperTransport | InfiniBand | IP | iSCSI | iSCSI White Papers | LUNS (Linux) | LVM | LVM Problems / Advisories | Mirror RAID / Mirrors | Other Information | Other Resources | PLEXES | RAID - all levels of - RAID 0 thru RAID 53 | RAID, SOFTWARE | Reference Books | REFERENCES | RFCs | RFC 3980 - SCSI storage devices containing both iSCSI ports & SAS ports to use the same NAA-based SCSI device name| SAM - SCSI Standards Architecture | SAS - Serial Attached SCSI | SAS2 | SAS Expanders | SATA - Serial ATA | SCAM | SCSI - GENERAL INFORMATION | SCSI-2 | SCSI-3 | SCSI RDMA Protocol (SRP) (formerly called: SCSI-4)| SCSI-4 | SCSI-5 | SCSI RDMA Protocol - 2 (SRP-2) | SSA SCSI-3 Protocol (SSA-S3P)| SENSE CODES | SENSE CODES - vendor proprietary | SENSE KEYS | SFF - Small Form Factor | SOFTWARE RAID | STATUS CODES | Storage Interfaces - SCSI | Striping | Termination | Test Equipment, SCSI | Testing Storage | Troubleshooting SCSI | SCSI TUTORIALS | Ultra-2 SCSI | Ultra-3 SCSI | Ultra-320 SCSI | Ultra-640 SCSI | Vendor IDs | Veritas Volume Manager | VoIP - Voice over IP | Link Of The Day - Great Technical Information - jonesnco smartmontools - control/monitor (SMART) built into most modern ATA and SCSI hard disks

BEGINNER's INTRODUCTION to SCSI / TUTORIALS

SCSI basics SCSI - good Into - Wikipedia SCSI - Answers.com SCSI Terms & Terminology - SCSITA SCSI Connectors SCSI Glossaries / Acronyms SAS - Serial Attached SCSI - Tutorials

ASPI - Advanced SCSI Programming Interface

ASPI What is ASPI? - A Word Definition - Webopedia Guide to ASPI Drivers - Radified Bart's page about ASPI Adaptec Windows ASPI Package Downloads ASPI Layer Installing a working ASPI layer ASPI 4.60 Info ASPI Information Nero 6 [ASPI Driver] ASPI Definition - PCmag ASPI FAQ - MACdisk What is ASPI & Where can I get the ASPI FIX ???

CAM - (SCSI) Common Access Method

Writing Device Drivers for the SCSI/CAM Architecture Interfaces CAM SCSI subsystem Macros in cam/scsi FreeBSD - Typedefs in cam/scsi

CONNECTORS & TERMINATORS - SCSI

SCSI Visual Guide to Connectors - scsita SCSI Termination Tutorial Different Types of SCSI

DDF - Common RAID Data Disk Format (SNIA)

DDF Improving data availability with RAID 6

PLEXES & Veritas Volume Manager

(Veritas) Plex (pl) is a mirror. Volume (v): A virtual disk, which can contain data. ... (mirrors) A group of one or more subdisks, typically from physical drives, that are used together in a concentration or striping arrangement. Plex, definition and more information Logical Storage Manager Glossary (scroll down for "plex") Concepts and Terminology for Disks and Filesystems Local Storage Manager - LSM Veritas VXVM commands (v4.0) VERITAS Volume Manager 3.1 Administrator’s Guide - HP objects contained in volumes are: VM disks, disk groups, subdisks, and plexes - HP Associating Plexes - HP Disk management with SUN's Volume Manager The RMON display of available Plexes - CICS - IBM Time taken to mirror striped plexes VERITAS Storage Foundation 4.1 for UNIX—Maintenance Commands - Veritas VxVM User's Guide - Volume Manager's CLI - Introduction vxassist How Virtual Disk Service Works - Windows Server 2003

RAID - Redundant Array of Independent Disks

RAID - Wikipedia RAID Background Tutorial on RAID one-page, ready to print RAID Guide - must join PCGuide - Ref - Single RAID Levels Performance Evaluation of Distributed iSCSI RAID RAID 0 - Striped Disk Array without Fault Tolerance. Provides NO data backup nor protection against the loss of a drive. The failure of just one drive will result in all data in an array being lost. RAID0 is ONLY used to provide faster throughput under heavy loads. Many Gamers use RAID0. RAID 0 - more info RAID 00 - Comprises RAID-0 striping across lower level RAID-0 arrays. RAID-00 provides no fault tolerance, but improves performance. RAID-01 - RAID 0+1 is implemented as a mirrored array whose segments are RAID 0 arrays RAID 0+1 has the same fault tolerance as RAID level 5 RAID-01 - more info RAID 1 - Mirroring and Duplexing - each stripe is duplicated (mirrored) on another disk RAID1 mirrors the data on one drive onto a second drive. If one drive fails, it can be replaced without loss of data. RAID 1 - more info RAID 1-E - Striping with disk mirroring RAID-1E0 - Comprises RAID-0 striping across lower level RAID-1E arrays. RAID 2 - Hamming Code ECC. RAID 2 - more info RAID 3 - Parallel transfer with parity. Only one I/O can be active in any array at any one time. RAID 3 RAID-3: What is it good for? RAID Level 3 RAID 4 - Independent Data disks with shared Parity disk RAID 4 - more info RAID 5 - Independent Data disks with distributed parity blocks RAID 5 - more info RAID 10 - Effectively creates a striped volume of a RAID-1 array. The disks are first mirrored together and then striped together as one volume. Very High Reliability combined with High Performance. RAID 10 info More info RAID 45 - uses a double inverse parity that is both on the last drive, and also spread across all the drives. Combines RAID 4 and RAID 5, but uses more drives. RAID 50 - comprises RAID-0 striping across lower level RAID-5 arrays. RAID-50 has the benefits of RAID5 while the spanned RAID-0 allows you to incorporate many more disks into a single logical drive. Up to one drive in each sub-array may fail without loss of data. RAID5DP - RAID5 with Double Parity (i.e., RAID6) - Hewlett-Packard RAID-5E - (Raid-5 Enhanced) puts hot spares to work to improve reliability & performance. RAID-5E creates a virtual distributed hot spare (DHS) by utilizing unallocated space on the drives. RAID 53 - High I/O Rates and Data Transfer Performance RAID-53: RAID by any other name RAID 6 - Independent Data disks with two independent distributed parity schemes. RAID-6 supports losing any two drives. RAID 6 - more information The mathematics of RAID-6 HP has patented all possible ways to produce a RAID 6 configuration. RAID 7 - Optimized Asynchrony for High I/O Rates as well as High Data Transfer Rates. RAID7 RAID DP - Double Parity. RAID-S - RAID-S is a form of RAID-5 where the stripe element size is large (in the order. of gigabytes) and each non-parity stripe element is presented to the host system as a logical unit (LUN) to be used in place of a disk. Click for more RAID-S information (scroll down) RAID x0 - IBM has added spanned arrays - RAID levels RAID-00, RAID-10, RAID-1E0 and RAID-50.

SOFWARE RAID

The Software-RAID HOWTO Linux Soft RAID - Recovering from a Failed Disk High Availability Linux with Software RAID Software RAID in the Linux 2.4 kernel, Part 1 Linux 2.4 Software RAID, Part 2 Software RAID

STRIPING (Raid)

Striping in a RAID Level 5 Disk Array Striping - storagereview.

ARTICLES / NEWS - Related

VMworld Confidential: DataCore iSCSI SAN Software and VMware Virtualization Make Virtual Infrastructures Practical for Everyone - 2/19/2007

SAM - SCSI-3 Architecture Model

SCSI Standards Architecture SCSI Revision Levels SCSI model for distributed communications

SAS / SAS2 - SERIAL ATTACHED SCSI

SAS controllers allow the use of SATA drives, but SATA controllers do not handle SAS. SAS2 (3.0 Gbps) is available. SAS-2 Standard - PDF Serial Attached SCSI supports three transport protocols: Serial SCSI Protocol (SSP) Serial ATA Tunneling Protocol (STP) Serial Management Protocol (SMP) SAS-FC-SCSI-iSCSI Comparison Chart - PDF SAS disk drive advantage? SAS and SATA Disk Drives in SAS Expander-Based - White Paper - .DOC file MAJOR VENDORS LOOK TO ENABLE SAS WITHIN iSCSI SAS - Wikipedia SCSITA Org Serial Attached SCSI - Tutorials Serial Attached SCSI FAQ Mixing SAS and SATA drives can cause problems Is There Magic in SATA and SAS? Serial Attached SCSI: The Universal Enterprise Storage Connection - PDF SAS (Serial Attached SCSI) - LeCroy Serial Attached SCSI - eWeek SAS and SATA compatibility: a new paradigm for disk interconnects Introduction to Serial Attached SCSI - PDF - Maxtor Serial Attached SCSI - Overview T10 Organization - SCSI Storage Interfaces SAS-2 SSC Investigation SAS 2 - Moving Forward Roadmap to SAS-2 Physical Layer Specification SAS-2 SMP Lists SAS-2 More counters SAS-2 zoning enhancements SAS2 BROADCAST (SCSI ASYNCHRONOUS EVENT) SAS-2 Zoning SAS-2 Multiplexing SAS-2 Add device name to IDENTIFY address frame SAS I/O Performance – Unprecedented Flexibility in I/O Bandwidth Selection - Fall 2005 Maximizing System Availability with Serial Attached SCSI Serial Attached SCSI - PDF - Intel FAQ - Serial Attached SCSI (SAS) - SCSITA Introduction - Serial Attached SCSI - Maxtor SAS and FCP Comparison SAS and SATA - Unparalleled serial interface compatibility In-Depth Exploration of Serial Attached SCSI (SAS) and Serial ATA ... SAS SCSI Upper Layers - pdf SAS Tutorial - Maxtor SAS Tutorial - SCSITA Serial Attached SCSI Technology
ANSI Agrees on Serial Attached SCSI Standard MAXTOR AND ADAPTEC SIMPLIFY NEW SERIAL ATTACHED SCSI TECHNOLOGY DEPLOYMENT Guide To SAS Raid web links - guideto

SAS ExPAnders

SAS Expanders add - essentially a SAS HUB, adding more SAS connections. SAS EDGE EXPANDERs - handle 128 SAS addresses. Can do direct Table Routing. SAS FANOUT EXPANDER - connects SAS Edge Expanders, up to 128 sets). SAS DUAL EXPANDERs - have redundant links and are either Edge or Fanout Expanders. SAS Expanders

SCAM - SCSI Configured AutoMatically (~Plug-N-Play)

Plug and Play SCSI (SCAM) Installing with SCSI SCAM hard drive - Redhat Linux SCAM - Windows 95 FAQ - SCSI SCAM / SCSI Info - Buildorbuy SCAM - Plug and Play SCSI: Designing to the New Standard (Device I/O ...

SCSI COMPARED TO OTHER BUSES

SCSI vs USB vs FireWire vs ATA vs EIDE vs IDE SATA vs FireWire 800 vs SCSI - 4 drive RAID

GENERAL SCSI INFO

SAS-FC-SCSI-iSCSI Comparison Chart - PDF SCSI Commands and Status/Sense Codes - Arkeia SCSI - good Into - Wikipedia SCSI basics SCSI Bus Overview SCSI - Answers.com SCSI - Nationmaster Gary Field's SCSI Info Central/SCSI FAQ Page "Storage Cornucopia" SCSI links SCSI Terms & Terminology - SCSITA Different Types of SCSI (scroll down) SCSI Guide - DELEC SCSI technical info SCSI Technology prime SCSI EDUCATION (AC&NC) How SCSI Works SCSI Trade Organization Site Search Seven Generations of SCSI - SCSI-1 to Ultra-320 Whatis SCSI - Techtarget Dot Com SCSI - Factbites DR. SCSI - Fixes SCSI Problems SCSI (scroll down) SCSI Cabeling Info SCSI FAQ (latest) - Part 1 SCSI FAQ (latest) - Part 2 (SCSI) Fast Hard Drives, Links to Sites - Dan Kegel Linux SCSI HOWTO Mixing Wide & Narrow Devices on an Adaptec Plug and Play SCSI Specification Plug and Play for Windows 2000 Plug and Play SCSI Specification Advanced Configuration and Power Interface Specification (ACPI), V.3.0 See also SCSI BOOKS (search for "scsi")

SCSI-2, INFORMATION ABOUT

SCSI-2 Specifications

SCSI-2 (including Fast SCSI & Wide SCSI variants) SPECIFICATION

ASPI - Advanced SCSI2 Programming Interface in Win32 SCSI 2/3 Interface Manual

Ultra-2 SCSI = LVD (Low Voltage Differential) = Ultra2 SCSI

Ultra2 SCSI - scsita

SCSI-3 (Ultra SCSI & fast-20 SCSI) = Ultra3 SPECIFICATION

Ultra3 - scsita SCSI Pinouts SCSI All pinouts and some information about pinouts SCSI2 Pinouts - 50 pin header) to an external DB25 connector SCSI cable Cautions

Ultra-3 SCSI = Ultra-160 SCSI = Ultra160 SCSI

ultra-3 is Sometimes called Ultra160/m. Maximum burst rate is 160 Mbps (double ultra-2)by using the full bus speed. ultra160/m uses CRC. Ultra-3 SCSI - SCSITA Ultra3 SCSI Low Voltage Differential Drives

SCSI 4 (now SCSI RDMA Protocol [SRP])

SCSI IV Bus Detailed Description and 'P' Connector Pin Out SATA vs FireWire 800 vs SCSI - 4 drive RAID SCSI FAQ

SCSI-5

SCSI V Bus Detailed Description and Connector Pin Out

Ultra-320 = Ultra320 SCSI

Ultra320 SCSI Ultra320 FAQ - SCSI Trade Association (SCSITA Ultra320 SCSI - storagereview Ultra-320 - computerplug
Maxtor.com - Ultra 320 SCSI

Ultra-640 = Ultra640 SCSI

Ultra640 SCSI - scsita Ultra640 SCSI Training Pattern Proposal Ultra640 SCSI Reduction of Crosstalk Errors During Timing Deskew Does Serial Attached SCSI affect the market for Ultra640 SCSI? Ultra-640 - computerplug

SCSI RDMA (formerly called SCSI-4)

SCSI RDMA Protocol (SRP)

SCSI RDMA Protocol - 2 (SRP-2)

SCSI RDMA Protocol - 2 (SRP-2)

SCSI Storage Interfaces

SCSI Storage Interfaces

iSCSI - SCSI Over IP

Also, compare to FCoE. iSCSI Storage - IP Storage Network Trends SCSI vs. iSCSI -- features, functionality and architecture SAS-FC-SCSI-iSCSI Comparison Chart - PDF MAJOR VENDORS LOOK TO ENABLE SAS WITHIN iSCSI iSCSI - Wikipedia iSCSI - whatis Networking iSCSI Storage technology rfc3720 - iSCSI - IETF Org Internet SCSI - Intel Linux-iSCSI Project iSCSI FAQ iSCSI Review The iSCSI Standards NAS and iSCSI Technology Overview - PDF - SNIA Microsoft Windows Server 2003 Storage Technologies - iSCSI iSCSI a Whatis definition iSCSI-Root mini-HOWTO Use crypto_hash interface instead of crypto_digest for iSCSI QLogic iSCSI Driver for Kernel 2.6.x iSCSI Configuration for Novell Netware - Adaptec (Pgs 19-23) IP Storage: A review of iSCSI, FCIP, IFCP VMworld Confidential: DataCore iSCSI SAN Software and VMware Virtualization Make Virtual Infrastructures Practical for Everyone - 2/19/2007 iSCSI Consortium - InterOperability Laboratory Intel iSCSI Reference - SourceForge Julian Satran's IPS archive iSCSI Review * iSCSI Storage Magazine News Performance Evaluation of Distributed iSCSI RAID Creating a SAN with iSCSI - Part 4 - Setting up a Windows Initiator - iSCSI Setup iSCSI target iSCSI companies (IP SAN) - STORAGEsearch.com iSCSI Development iSCSI gets Intel stamp of approval iSCSI: The Future of Network Storage - Intel DiskDrive.com -- The home of iSCSI knowledge iSCSI Storage - IP Network Storage Trends The skinny on iSCSI SANs Securing iSCSI Using IPSec Securing iSCSI Using IPSec, Part 2 Ardis: Linux iSCSI target How to decide between Fibre and iSCSI SANs iSCSI - Factbites What is iSCSI? - A Word Definition From the Webopedia Computer Dictionary iSCSI definition - webopedia Slashdot | "iSCSI killer" Native in Linux iscsi and scsi Resources on TechRepublic FCoE - Storage vendors propose FC over Ethernet standard - 4/2007

iSCSI - WHITE PAPERS

Is iSCSI on a Path to Disrupt Storage Technology? - White Paper - EMC Testing iSCSI iSCSI WHITE PAPERS: Clarifying Three Common Misconceptions of iSCSI - White Papers - Dell

MIRRORS

What is data mirroring? - A Word Definition From the Webopedia ... Data Protection and Disaster Recovery Revivio Takes on Mirror-Splits Disaster recovery in the data center Striping and Mirroring RAID under RedHat 6.0 mirroring two data disks (no system files on them)

RFC 3980

RFC 3980 - SCSI storage devices containing both iSCSI ports & SAS ports to use the same NAA-based SCSI device name RFC 3980 STD 1 (RFC3700) Internet Official Protocol Standards FULL STANDARD RFCs - IETF ORG

SENSE CODES

ASC/ASQ - Alphabetic order - t10 org ASC/ASQ - Numeric order - t10 org SCSI Commands and Status/Sense Codes - Arkeia LOOK UP Sense Keys, Additional Sense Codes, and Sense Qualifiers SCSI Sense Code - Answers dot com SCSI Additional Sense Data - t10 org SCSI Sense Code - wikipedia Interpreting the SCSI Sense Codes - HP Appendix A. SCSI Sense Codes - HP The Linux SCSI programming HOWTO: Additional sense codes and ... Linux sg and sense codes SCSI Error Codes - miditemp Scsi tape sense codes, getting last n (10) Data Storage (CD-ROM/SCSI/IDE...) - Sense Codes Optical drives return error codes - Error Codes / Sense Codes Advanced Diagnostics SCSI Errors Maps a SCSI sense code to a localized string - Developer Connection DVD Errors MMC-3 Revision 10e - Error Codes / Sense Codes - Yahama abd others Event ID 7 Event ID 3 - Media Error [03] - tape Event ID 51

SCSI SENSE CODES - Vendor Proprietary

still working on the sense codes (mostly) SCSI DISK DRIVE MANFACTURERS: ADAPTEC - Sense Codes Described ADAPTEC - Interpreting ASC & ASCQ Codes - Interpreting Codes 2 SCSI Sense Code - Answers dot com DLT 7000 errors DLT 8000 errors IBM - SCSI Sense Data Structure and Example MAXTOR - What are Sense Keys, Sense Codes, and Additional Sense Code Qualifiers? NERO - CD and DVD Burning Software - Nero SCSI/IDE ERROR Seagate - Extended SCSI Sense Key Chart Seagate Barracuda Proprietary SCSI Sense Codes - see pg 59 - PDF Seagate Medalist Proprietary SCSI Sense Codes - Start at page 59 - PDF SONY SDX-250 AIT Tape Drive - Proprietary SCSI Sense Codes - Appendix D VERITAS - Event ID 7 is generated in the System Event log YAMAHA - Sense Codes for the Yamaha CDR400

SENSE KEYS

Sense Keys - See 4.5.6 in SPC-3

SSA - Serial Storage Architecture

Currently (9/2005) 400 Mbit clock speed)) SSA - answers SSA - scroll down to SCSI interface overview table SSA SCSI-3 Protocol (SSA-S3P) SSA Transport Layer 2 (SSA-TL2) SSA Pysical Layer 2 (SSA-PH2)

STATUS CODES

Status Codes - See 5.3.1 in SAM-4 - T10 org

STRIPING - Click here

TERMINATION - Click here

TROUBLE SHOOTING SCSI

SCSI Commands and Status/Sense Codes - Arkeia

VENDOR CODES

Vendor IDs - T10

GLOSSARIES, SCSI

SCSI Glossary: Practical Definitions and Terminologies for SCSI Acronyms & Definitions - Technical PC/SAN/NAS/QA/Wireless/Linux/Network/Video/Pharma/WIN/wms.

REFERENCE BOOKS

A subset of My Recommended Technical Books (click here)

Clark, Tom IP SANs: A Guide to iSCSI, iFCP, and FCIP Protocols for Storage Area Networks. SW $45 0-201-75277-8 Deming, David A. The SCSI Tutor ENDL Publications $192 1-879936-08-9 Field, Gary & Peter M. Ridge, et al The Book of SCSI. 2nd Edtion No Starch Press $ 50 1-886411-10-7 [In my opinion, the Best Introduction & Advanced SCSI Book] Hernandez, Rowell, et al IP Storage Networking: IBM NAS & iSCSI Solutions IBM Redbooks $60 0738424226 Hufferd, John L. iSCSI The Universal Storage Connection AW $45 0-201-78419-x Jackson, Mike SAS Storage Architecture Mindshare, Inc 0-9770878-0-8 Kembel, Robert W. Comprehensive Guide to Serial Attached SCSI (SAS). Northwest Learning Assoc $95 0931836611 Amazon com Ridge, Peter M. Book of SCSI. [2nd edition is now out - see Field, Gary & Peter Ridge] No Starch Press 35 1-886411-02-6 Schmidt, Friedhelm The SCSI Bus and IDE Interface: Protocols, Applications and Programming AW 35 W/DISK 0-201-42284-0 Doesn't cover Enhanced IDE ???? Zadian Technologies SCSI, the Nuts & Bolts Knowledge TEK Zadian Technologies SCSI, the Nuts & Bolts: Workbook and reference Guide Knowledge TEK Zadian Technologies Zadian SCSI Navigator Zadian Technologies c1994 $ 11

OTHER RESOURCES - Caveat Emptor

SCSI - Factbites These sites have similar, but good SCSI info: SCSI - arikah SCSI - fi SCSI - biocrawler SCSI - algebra end of similar site list

DAVE's SCSI INFO JUMP TABLE

Top of this page| ACRONYMS / GLOSSARIES | AoE | Articles / News | ASPI | BOOKS - SCSI Reference | CAM (SCSI) | Comparisons | Connectors | Data recovery | Device Discovery | Drivers (SCSI) | Ethernet (all) | EVMS - Enterprise Volume Management System (SourceForge - free) Fast SCSI (SCSI-2) | FC - Fibre Channel (all) | FCoE | iSCSI | iSCSI White Papers | HyperTransport | InfiniBand | IPv6 | LVM | LVM Problems / Advisories | Other Information | Other Resources | PLEXES | RAID - all levels of - RAID 0 thru RAID x0 | RAID, SOFTWARE | Reference Books | REFERENCES | RFCs | RFC 3980 - SCSI storage devices containing both iSCSI ports & SAS ports to use the same NAA-based SCSI device name| SAM - SCSI Standards Architecture | SAS - Serial Attached SCSI | SAS Expanders | SATA - Serial ATA | SCAM | SCSI - GENERAL INFORMATION | SCSI | SCSI-2 | SCSI-3 | SCSI RDMA Protocol (SRP) (formerly called: SCSI-4)| SCSI-5 | SSA SCSI-3 Protocol (SSA-S3P)| SENSE CODES | SENSE CODES - vendor proprietary | SFF - Small Form Factor SOFTWARE RAID| Storage Interfaces - SCSI | Termination | Test Equipment, SCSI | Troubleshooting SCSI | Ultra-2 SCSI | Ultra-3 SCSI | Ultra-320 SCSI | Ultra-640 SCSI | Striping | VoIP - Voice over IP |

OTHER INFORMATION