DV Hardware bringing you the hottest news about processors, graphics cards, Intel, AMD, NVIDIA, hardware and technology!

   Home | News submit | News Archives | Reviews | Articles | Howto's | Advertise
 
DarkVision Hardware - Daily tech news
August 19, 2017 
Main Menu
Home
Info
News archives
Articles
Howto
Reviews
 

Who's Online
There are currently 73 people online.

 

Latest Reviews
Zowie P-TF Rough mousepad
Zowie FK mouse
BitFenix Ronin case
Ozone Rage ST headset
Lamptron FC-10 SE fan controller
ZOWIE G-TF Rough mousepad
ROCCAT Isku FX gaming keyboard
Prolimatech Magnetic Pin
 

Follow us
RSS
 

Facebook engineers come up with superior compression algorithm

Posted on Thursday, September 01 2016 @ 12:48:37 CEST by


FB logo
A team of Facebook engineers have come up with a new lossless compression algorithm that is much faster than zlib and xz at compression and decompression, while also offering a slightly better compression ratio than lz4 and zlib.

The algorithm is called Zstandard, Facebook shared the source code but the library comes with an important extra condition: that you won't sue Facebook for patent infringement, nor countersue the social network if Facebook sues you first.

As The Register reports, the news sounds a bit like the initial story of US TV sitcom Silicon Valley, where the protagonist develops an innovative compression algorithm. Here's a bit more info about how Zstandard works:
The idea, basically, is to replace zlib with code that is mostly branchless and is optimized for parallel execution, which boosts performance. The library also benefits from finite state entropy, which is a state-of-the-art probability compressor design, among other improvements over zlib. Zlib is used in pretty much everything, including compressing zip and gzip archives and in-transit web traffic, so Facebook is keen to get its superior library adopted.
FB compression performance

Facebook also shared MyRocks, a new open source project that uses the company's RocksDB as a new MySQL storage engine. With MyRocks, you get all the benefits from all the features in MySQL, combined with RocksDB as the backend storage engine. According to Facebook, the deployment of MyRocks enabled the social network to reduce its storage requirements by 50 percent thanks to the system's improved data compression.



 



 

DV Hardware - Privacy statement
All logos and trademarks are property of their respective owner.
The comments are property of their posters, all the rest © 2002-2017 DM Media Group bvba