...
  • 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>Journal of Sensors >Block-Split Array Coding Algorithm for Long-Stream Data Compression
【24h】

Block-Split Array Coding Algorithm for Long-Stream Data Compression

机译：用于长流数据压缩的块分割阵列编码算法

获取原文
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

With the advent of IR (Industrial Revolution) 4.0, the spread of sensors in IoT (Internet of Things) may generate massive data, which will challenge the limited sensor storage and network bandwidth. Hence, the study of big data compression is valuable in the field of sensors. A problem is how to compress the long-stream data efficiently with the finite memory of a sensor. To maintain the performance, traditional techniques of compression have to treat the data streams on a small and incompetent scale, which will reduce the compression ratio. To solve this problem, this paper proposes a block-split coding algorithm named “CZ-Array algorithm,” and implements it in the shareware named “ComZip.” CZ-Array can use a relatively small data window to cover a configurable large scale, which benefits the compression ratio. It is fast with the time complexity O(N) and fits the big data compression. The experiment results indicate that ComZip with CZ-Array can obtain a better compression ratio than gzip, lz4, bzip2, and p7zip in the multiple stream data compression, and it also has a competent speed among these general data compression software. Besides, CZ-Array is concise and fits the hardware parallel implementation of sensors.
机译：随着IR（工业革命）4.0的出现，IOT中传感器的传播（物联网）可能会产生大量数据，这将挑战有限的传感器存储和网络带宽。因此，对大数据压缩的研究在传感器领域有价值。问题是如何用传感器的有限内存有效地压缩长流数据。为了保持性能，传统的压缩技术必须在小而无能的尺度上对数据流进行处理，这将降低压缩比。为了解决这个问题，本文提出了一个名为“CZ-Array算法”的块分割编码算法，并在名为“comzip”的共享软件中实现它。 CZ-Array可以使用相对较小的数据窗口来覆盖可配置的大规模，这有利于压缩比。它与时间复杂度O（n）快并适合大数据压缩。实验结果表明，具有CZ阵列的COMZIP可以在多流数据压缩中获得比GZIP，LZ4，BZIP2和P7zip更好的压缩比，并且在这些一般数据压缩软件中也具有主管速度。此外，CZ阵列简洁并符合传感器的硬件并行实现。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号