VIDEO STORAGE
Dec 1, 2007 12:00 PM, By David Austerberry
New storage systems enable stations to go tapeless
Imagine a television station that shoots on Panasonic P2 or Sony XDCAM. That station could potentially broadcast without using videotape at any stage in its production and transmission pipeline. Traditionally, video storage meant an archive or library of videocassettes. The drive for process efficiencies means that broadcasters are now looking to handle video as files rather than as videotape. As a consequence, video storage is undergoing a step change.
Click image to enlarge
The ideal video storage system would be reliable and scalable, with high packing density. It would sport high data transfer rates and facilitate collaborative workflows. And it would cost less than using videotape.
The classic islands for video files have been postproduction and playout. All other broadcast processes — such as acquisition, distribution and archive — have relied on videotape. The need to repurpose content for delivery over new platforms like mobile and the Web means that broadcasters are rebuilding their workflows from the ground up in order to lower operating costs.
Advances in storage devices and architectures now make it feasible to run a station without a single videotape on the premises. File-based broadcasting claims to leverage the low cost of commodity IT systems. This is partially true, but storage for video has a different set of requirements than typical IT files, such as a database record, or an e-mail or office document.
A 110-minute movie archived with MPEG-2 I-frame compression at 50Mb/s is a file size of about 50GB, with an HD version being much larger. That is 1 million times the size of a typical word processor file, so it is no surprise that regular IT storage is not going to be suitable. But it is not just file sizes. Broadcasters need many special features in order to get the optimum performance from a storage network. One is support for containers or wrappers. Another is read-while-write. A third is partial restore.
File storage for video
Video files are usually containers that store interleaved video and audio essence, or possibly references to external atomic audio and video files. The containers may also contain metadata: structural-like time code or production data that is essential for controlling operations. The video storage systems must be designed to handle these special features that set video apart from general office files. For example, storage may need to be MXF-aware.
A big issue with video operations is read-while-write. Small office files are written so quickly, we can wait for the process to finish before opening the file. In broadcast, we are used to video streaming through real-time connections. A waveform monitor or picture monitor can be used to view the content during the transfer.
A file cannot normally be viewed until the index is written, the final operation during a move or copy as the file is closed. In newsroom operations, it is essential to read files while they are being written. During long-form program ingest, a check of the process confirms the operation. What if the source VTR had a head clog? The operator would be unaware until the completion of the ingest, a process that may take over an hour. It is expected with video systems, and file-based storage must support a similar facility.
Partial restore
Another video issue is the partial restore. Often, a short excerpt of a file is needed. Consider the creation of a trailer. About two to three minutes of material is all that is needed to cut a promo for a one-hour program. Conventional IT systems would recall the entire file from the tape archive to disk in order to access the short clips. Not only will this take a long time, but it also ties up a data tape drive. A tape library will need additional drives to recall data that is not required, which is an unnecessary cost. Broadcasters need a partial restore of part of a file that can be defined by viewing a browse-resolution file. Then they need to mark the requisite time codes needed to edit the promo. SMPTE time-code values must be turned into tape locations so that efficient use can be made of the available drives and only part of the file is restored to disk. Such functionality can only be found in video-centric archive controllers.
Disk advances
One of the recent changes in disk technology has been the serial interface. Parallel SCSI has been the workhorse of editing systems, with Fibre Channel used for high-performance applications. In an effort to lower manufacturing costs and increase performance, a serial interface has been developed to replace parallel SCSI. The extension of parallel interconnections to support higher transfer speeds is limited by data skew as the data word travels along the ribbon cable. Cable dimensions stemming from variations in manufacturing tolerances lead to slight differences in propagation rates. The need to recover a single word from the skewed data limits cable length and transmission clock rates.
Moving to serial interconnects avoids these problems, but immediately pushes data rates up by a factor of the word length. Early examples were no faster than parallel interfaces at 3Gb/s, a similar rate to Ultra-320 SCSI, but future developments should take speeds up to 12Gb/s. Apart from the potential speed increase, the serial connector is much smaller than the old parallel connectors, which is a big advantage when constructing dense drive arrays.
Similar to SAS is SATA, the serial implementation of the ATA/IDE interface used for desktop PC drives. Current products support a 3Gb/s interface speed. As SAS/SATA is a point-to-point interconnection, bandwidth is not shared, unlike the multidrop bus used in parallel SCSI arrays.
Enterprise-class drives are now available with a choice of Fibre Channel, SCSI, SAS or SATA interfaces. It is possible to mix interconnection technologies, so a RAID controller may use Fibre Channel for external connections to the network and the lower-cost SATA for local links to the drives.
Network capacity
Just as disk capacities increase, network speeds improve. Gigabit Ethernet can now be found in domestic networks, but for video applications, 10GigE represents the current implementation of the technology. Fibre Channel offers 4Gb/s data rates, but real-time video is moving to 3Gb/s for 1080P50 and 1080P60. Data interconnections are only just keeping pace with typical video data rates for uncompressed HD, 2K and 4K files.
The saving grace for many systems is that compression is used. With the majority of multichannel systems still running SD, the real-time video data rates are more likely to be 50Mb/s, which gives current data networks plenty of capacity.
Storage networks
Classic storage networks used the network attached storage (NAS) or storage area network (SAN) architecture. Both feature a small number of processing heads and a large number of drives. The processors manage the indexing of files and run the filing system.
The NAS is lower cost and simple to administer, but it does not scale and suffers from a bottleneck at the network interface. Adding one or more NAS appliance to build higher capacity introduces file management issues, as a project can expand to span several drive arrays. The SAN manages a single pool of storage, but is generally more expensive to purchase and requires skilled personnel to maintain.
| Want to use this article? Click here for options! |  |
