What is in this article?:
- Storage: Picking a bit bucket: SAN and NAS
- File-based storage over Ethernet
File-based storage over Ethernet
NAS devices are purpose-built file servers designed to make sharing files between individuals and groups more efficient and secure. Since a NAS is connected to all the desktops, workstations and servers on standard Ethernet network, the NAS controls data access by managing user privileges, file locking and other security measures.
NAS devices provide data access to clients running different operating systems through a file system layer such as a Network File System (NFS) or Common Internet File System (CIFS). Because NAS devices use the existing Ethernet network, instead of requiring a special Fibre Channel storage network, deploying NAS storage is generally less expensive than a comparable SAN solution.
The downside of presenting data through a file system layer is that NFS and CIFS, the most commonly used protocols, are not optimized for large files of streaming data like video files. Also, the file data is transferred over Ethernet, a packet-based protocol that allows for latencies in the delivery of files, unlike Fibre Channel, which was designed to deliver blocks of streaming data with low-latency. Newer standards like 10Gb Ethernet approach SAN network speeds, but do not improve latency.
Faster file-system performance
One approach to boost NAS performance is clustered or distributed file systems, often combined with a building block storage architecture referred to as “scale-out” storage. (See Figure 5.) The clustered file system distributes data across the nodes in the scale-out storage, which spreads the data access load across more processors and more I/O connections.
By aggregating I/O across a cluster of nodes, each with its own network connection, scale-out NAS greatly improves performance over traditional NAS. However, even the industry-leading solutions can only reach up to 400MB/s for a single data stream, whereas SAN solutions can provide the 1.6GB/s performance required for editing streaming video files at resolutions at or greater than 2K uncompressed.
Best of both worlds?
Another approach, often referred to as “unified storage,” is to support both file-based NAS and block-based SAN access from the same storage system. Unified storage allows facilities to consolidate their storage and eliminate storage silos, giving applications the choice of attaching to storage using either IP or Fibre Channel protocols, depending on the applications’ performance requirements.
Some unified storage systems layer a NAS file system on top of SAN storage, offering true SAN-level performance for block-level access. Other vendors have modified their NAS platform to allow block-mode access through iSCSI, an Ethernet-based protocol. (See Figure 6.) While iSCSI has made performance gains due to faster 10Gb Ethernet networks and beyond, it hasn’t been widely adopted for video editing workflows.
One unified storage approach that works well for file-based workflows is to layer a NAS file system on top of a SAN, but replace the standard NFS or CIFS protocols with one optimized for streaming media, such as the DLC proprietary format from Quantum. (See Figure 7.) With this architecture, an optimal media workflow that aligns the performance needs with the cost of the storage infrastructure can be created.
In an ideal storage strategy, a single storage pool can be shared throughout workflow, but accessed according to the performance vs. cost requirements for each workflow application.
Fibre Channel access
To meet the high-performance storage demands of full-resolution video content, a SAN with Fibre Channel connections should be deployed for video editing workstations, ingest and playout servers, and any other workflow operation that requires the 700MB/s per user read or write performance needed to stream files at 2K resolution or above. With a SAN solution that includes a shared file system, files can easily be shared between editors or amongst steps in the workflow.
High-speed Ethernet access
Facilities with farms of transcoding or rendering servers that require streaming performance at approximately 70MB/s to110MB/s should look to high-performance storage that offers high-speed Ethernet access, either through a scale-out NAS or block-level storage with a specialty NAS protocol optimized for streaming media.
Standard Ethernet access
Producers and other staff who primarily access low-resolution proxies, images, scripts and other text documents can connect to the storage from their desktops through the standard NFS or CIFS file systems over standard
Ethernet connections of 1GbE or less.
Finally, high-performing disk systems are sold in both NAS and SAN configurations. Often it’s the access mechanism — the network type, protocol and number of connections — that drives the overall performance. The smartest, easiest to manage, lowest-overall cost solutions offer shared storage that allows facilities to choose the network and protocol that makes the most sense for each workflow activity, from high-speed SAN over Fibre Channel to standard NAS over Ethernet.
—Janet Lafleur is the StorNext product marketing manager, Quantum.