HomeProductsProducts Details

Compression and security acceleration card doubles Hadoop performance

Date: 13/10/2014
Exar announced shipment of its DX2040 compression and security acceleration card for data analytics, storage, and cloud security markets. The low-profile half-length eight lane PCI-Express 3.0 card accelerates Hadoop applications by a factor of 2 while simultaneously reducing storage costs, claims Exar.

The DX2040 saves host CPU from running compression and security algorithms and so lesser I/O bottlenecks and optimises storage efficiency. DX2040 uses Exar's XR9240 compression and security co-processor to deliver 40 gigabits/second of simultaneous compression, encryption and hashing while providing compression ratios comparable to level 9 gzip. In addition, the high performance public key engine delivers 40,000 operations per second of RSA with 2048 bit keys.

Exar says its hardware accelerated compression solution for Apache Hadoop, AltraHD, has been enhanced to support the DX2040. AltraHD integrates seamlessly into the Apache Hadoop software stack and automatically compresses all files using the Hadoop Distributed File System (HDFS), as well as all intermediate data. The upgraded AltraHD integrating the DX2040 provides up to 2x the performance and 90% reduction in storage costs over native Hadoop, according to Exar.

"AltraHD running with the DX2040 provides the perfect solution to maximize efficiency for Hadoop clusters," said Robert Reiner, director of data compression and security, Exar. "In addition to increasing performance up to 2x and providing massive savings in storage capacity, Exar's single pass transform architecture enables hardware accelerated encryption for free."