分布式存储中的克隆piggybacking框架

doi:10.19665/j.issn1001-2400.2020.06.020

西安电子科技大学学报 ›› 2020, Vol. 47 ›› Issue (6): 139-147.doi: 10.19665/j.issn1001-2400.2020.06.020

• 面对B5G/6G的信息传输与接入技术进展 • 上一篇下一篇

分布式存储中的克隆piggybacking框架

张璐¹(),孙蓉^1,²(),刘景伟³

1.西安电子科技大学综合业务网理论及关键技术国家重点实验室,陕西西安 710071
2.华侨大学厦门市移动多媒体通信重点实验室,福建厦门 361021
3.西安电子科技大学陕西省区块链与安全计算重点实验室,陕西西安 710071

收稿日期:2020-06-28 出版日期:2020-12-20 发布日期:2021-01-06
通讯作者: 孙蓉
作者简介:胡建伟(1973—),男,副教授,E-mail: jhost@xidian.edu.cn|张璐(1996-),女,西安电子科技大学硕士研究生,E-mail: zhanglu123@stu.xidian.edu.cn
基金资助:
国家自然科学基金(61671340);陕西省重点研发计划重点产业创新链(2020ZDLGY05-04);陕西省重点研发计划重点产业创新链(2019ZDLGY13-05);陕西省重点研发计划重点产业创新链(2019ZDLGY12-01)

Cloned piggybacking framework for distributed storage

ZHANG Lu¹(),SUN Rong^1,²(),LIU Jingwei³

1. State Key Laboratory of Integrated Services Networks, Xidian University, Xi’an 710071, China
2. Xiamen Key Laboratory of Mobile Multimedia Communications, Huaqiao University, Xiamen 361021, China
3. Shaanxi Key Laboratory of Blockchain and Secure Computing, Xidian University, Xi’an 710071, China

Received:2020-06-28 Online:2020-12-20 Published:2021-01-06
Contact: Rong SUN

摘要/Abstract

摘要：

随着5G技术的快速发展,分布式存储系统凭借低成本、高可用性、高吞吐量和海量存储能力等特点,越来越受到人们的青睐。由于节点众多,节点故障频发,因此采用一定的数据容错技术来保证数据的可靠性尤为重要。近年来,piggybacking框架以其优异的修复性质受到了广泛关注。从piggybacking框架的修复度入手,为了同时降低修复带宽和修复度,提出了克隆piggybacking框架。与其他piggybacking框架不同,该框架只对一组节点进行嵌入设计和修复分析,其他组内对应节点通过克隆的方式简化设计过程。根据“一个节点的信息符号尽可能地只嵌入一个子条带”的设计思想,权衡修复带宽和修复度。与现有的piggybacking框架相比,克隆piggybacking框架设计简单,进一步降低了信息节点的修复带宽。

关键词: 抽象语法树, 深度学习, 循环神经网络, 漏洞挖掘, 分布式存储, piggybacking框架, 修复带宽, 修复度

Abstract:

With the rapid development of 5G technology, distributed storage systems are popular with its features such as low cost, high availability, high throughput and massive storage capacity. Due to the frequent node failures, it is important to adopt data fault tolerance technology to ensure the reliability of data. In recent years, the piggybacking framework has received extensive attention for its excellent repair properties. In this paper, we propose a cloned piggybacking framework design to optimize average repair bandwidth and repair locality. Different from other piggybacking frameworks, the piggybacking and repairing methods are carried out on one set of nodes. Then the corresponding nodes in other groups are piggybacked in the same way. The trade-off between repair bandwidth and repair locality is established by the idea of “one parity node only piggybacks symbols from one substripe”. Compared with the existing piggybacking framework, the cloned piggybacking framework is simple in design and can further reduce the repair bandwidth of information nodes.

Key words: abstract syntax tree, deep learning, recurrent neural network, vulnerability mining, distributed storage, piggybacking framework, repair bandwidth, repair locality

中图分类号:

TP311.5

张璐,孙蓉,刘景伟. 分布式存储中的克隆piggybacking框架[J]. 西安电子科技大学学报, 2020, 47(6): 139-147.

ZHANG Lu,SUN Rong,LIU Jingwei. Cloned piggybacking framework for distributed storage[J]. Journal of Xidian University, 2020, 47(6): 139-147.

图/表 7

图1

图2

图3

表1

表2

表3

不同piggybacking框架的子条带个数和修复带宽的比较"

piggybacking框架	子条带	平均修复带宽比率
RSR2^[11]	2r-3	$r + 1 2 r - 3$ $\stackrel{ r \to ∞ }{\longrightarrow}$ $12$
REPB^[12]	s'+p'	$2 r + 1$ $\stackrel{ r \to ∞ }{\longrightarrow}$0
SPB^[13]	r	$2 r - 1 r$ $\stackrel{ r \to ∞ }{\longrightarrow}$0
CPB	r	$r 3 + 61 r 2 - 155 r - 9 16 r 3$ $\stackrel{ r \to ∞ }{\longrightarrow}$0.062 5

表3

图4

参考文献 17

[1]	李鑫, 孙蓉, 刘景伟. 分布式存储系统中容错技术综述[J]. 无线电通信技术, 2019, 45(5): 463-475.
	LI Xin, SUN Rong, LIU Jingwei. Overview of Fault-tolerant Techniques in Distributed Storage Systems[J]. Radio Communications Technology, 2019, 45(5): 463-475.
[2]	王意洁, 许方亮, 裴晓强. 分布式存储中的纠删码容错技术研究[J]. 计算机学报, 2017, 40(1): 236-255.
	WANG Yijie, XU Fangliang, PEI Xiaoqiang. Research on Erasure Code-Based Fault-Tolerant Technology for Distribute Storage[J]. Chinese Journal of Computers, 2017, 40(1): 236-255.
[3]	SATHIAMOORTHY M, ASTERIS M, PAPAILIOPOULOS D, et al. XORing Elephants: Novel Erasure Codes for Big Data[J]. Proceedings of the VLDB Endowment, 2013, 6(5): 325-336.
[4]	HUANG C, SIMITCI H, XU Y, et al. Erasure Coding in Windows Azure Storage[C]// Proceedings of the 2012 USENIX Annual Technical Conference. Berkeley: USENIX Association, 2012: 15-26.
[5]	郝晓慧, 车书玲, 张欣瑜. LRC码最小距离限的深入分析[J]. 西安电子科技大学学报, 2018, 45(5): 75-79+135.
	HAO Xiaohui, CHE Shuling, ZHANG Xinyu. In-depth Analysis of Bounds on the Minimum Distance of LRCs[J]. Journal of Xidian University, 2018, 45(5): 75-79+135.
[6]	王祥旭, 车书玲, 纪玉晖. 一种有效的局部可修复码的构造方法[J]. 西安电子科技大学学报, 2019, 46(3): 26-31.
	WAN GXiangxu, CHE Shuling, JI Yuhui. Effective Construction Method for Locally Repairable Codes[J]. Journal of Xidian University, 2019, 46(3): 26-31.
[7]	DIMAKIS A G, GODFREY P B, WU Y, et al. Network Coding for Distributed Storage Systems[J]. IEEE Transactions on Information Theory, 2010, 56(9): 4539-4551. doi: 10.1109/TIT.2010.2054295
[8]	ALRABIAH O, GURUSWAMI V. An Exponential Lower Bound on the Sub-packetization of MSR Codes[C]// Proceedings of the 2019 Annual ACM Symposium on Theory of Computing. New York: ACM, 2019: 979-985.
[9]	RASHMI K V, SHAH N B, RAMCHANDRAN K. A Piggybacking Design Framework for Read-and Download-Efficient Distributed Storage Codes[C]// Proceedings of the 2013 IEEE International Symposium on Information Theory. Piscataway: IEEE, 2013: 331-335.
[10]	RASHMI K V, SHAH N B, GU D, et al. A “Hitchhiker’s” Guide to Fast and Efficient Data Reconstruction in Erasure-coded Data Centers[J]. Computer Communication Review, 2015, 44(4): 331-342.
[11]	RASHMI K V, SHAH N B, RAMCHANDRAN K. A Piggybacking Design Framework for Read-and Download-efficient Distributed Storage Codes[C]// Proceedings of the 2017 IEEE Transactions on Information Theory. Piscataway: IEEE, 2017: 5802-5820.
[12]	YUAN S, HUANG Q. Generalized Piggybacking Codes for Distributed Storage Systems[C]// Proceedings of the 2016 IEEE Global Communications Conference. Piscataway: IEEE, 2016: 1-6.
[13]	SHANGGUAN C, GE G. A New Piggybacking Design for Systematic MDS Storage Codes[J]. Designs, Codes and Cryptography, 2019, 87(12): 2753-2770.
[14]	YANG B, TANG X, LI J. A Systematic Piggybacking Design for Minimum Storage Regenerating Codes[J]. IEEE Transactions on Information Theory, 2015, 61(11): 5779-5786.
[15]	LI G Y, LIN X, TANG X. An Efficient One-to-One Piggybacking Design for Distributed Storage Systems[J]. IEEE Transactions on Communications, 2019, 67(12): 8193-8205.
[16]	SUN R, LI X, ZHANG L, et al. Distributed Storage Codes Based on Double-layered Piggybacking Framework[J]. IEEE Access, 2020, 8: 150447-150464.
[17]	SHAH N B, RASHMI K V, KUMAR P V, et al. Distributed Storage Codes with Repair-by-transfer and Nonachievability of Interior Points on the Storage-bandwidth Tradeoff[J]. IEEE Transactions on Information Theory, 2012, 58(3): 1837-1852.

余数	m=0	m=1	m=2	m=3	m=4
r=4	0.640 6	0.620 4	0.562 5	0.526 9	不存在
r=5	0.552 0	0.563 6	0.554 2	0.552 6	0.556 1

分布式存储中的克隆piggybacking框架

Cloned piggybacking framework for distributed storage

RichHTML

PDF (PC)

赞

可视化

摘要/Abstract

引用本文

使用本文

图/表 7

参考文献 17

相关文章 15

Metrics

本文评价

推荐阅读 10

piggybacking框架	RSR2^[11]	SPB^[13]	CPB
编码复杂度	(2r-3)kr	kr²	kr²
信息节点修复复杂度	(2r-3)k	kr	kr

[1]	代明军,李晓凤,邓海燕,陈彬. 具有低编解码复杂度的私有信息检索[J]. 西安电子科技大学学报, 2021, 48(6): 212-220.
[2]	刘佳玮,张文辉,寇晓丽,李雁妮. 增强型深度对抗样本攻击防御算法[J]. 西安电子科技大学学报, 2021, 48(6): 23-31.
[3]	李鹏,冯存前,许旭光,唐子翔. 一种利用贝叶斯优化的弹道目标微动分类网络[J]. 西安电子科技大学学报, 2021, 48(5): 139-148.
[4]	闫佳,曹玉东,任佳兴,陈冬昊,李晓会. 深度非对称压缩型哈希算法[J]. 西安电子科技大学学报, 2021, 48(5): 212-221.
[5]	宁阳,杜建超,韩硕,杨传凯. 改进DeeplabV3+的火焰分割与火情分析方法[J]. 西安电子科技大学学报, 2021, 48(5): 38-46.
[6]	周鹏,杨军. 采用神经网络架构搜索的遥感影像分割方法[J]. 西安电子科技大学学报, 2021, 48(5): 47-57.
[7]	戚艳军,孔月萍,王佳婧,朱旭东. 一种LSTM与CNN相结合的步态识别方法[J]. 西安电子科技大学学报, 2021, 48(5): 78-85.
[8]	宋建锋,苗启广,王崇晓,徐浩,杨瑾. 注意力机制的多尺度单目标跟踪算法[J]. 西安电子科技大学学报, 2021, 48(5): 110-116.
[9]	张宇浩,程培涛,张书豪,王秀美. 一种自适应权重学习的轻量超分辨率重建网络[J]. 西安电子科技大学学报, 2021, 48(5): 15-22.
[10]	回海生,张雪英,吴泽林,李凤莲. 一种主辅路径注意力补偿的脑卒中病灶分割方法[J]. 西安电子科技大学学报, 2021, 48(4): 200-208.
[11]	宋剑桥,王峰,牛锦,师泽洲,马军辉. 一种面向时空神经网络的潜在情绪识别方法[J]. 西安电子科技大学学报, 2021, 48(4): 159-167.
[12]	杨颜博,张嘉伟,马建峰. 一种使用区块链保护车联网数据隐私的方法[J]. 西安电子科技大学学报, 2021, 48(3): 21-30.
[13]	孙豪杰,李苗钰,章盼盼,许鹏飞. 用于面瘫分级的自监督非对称特征学习方法[J]. 西安电子科技大学学报, 2021, 48(3): 115-122.
[14]	徐彬,张永顺,张秦,王富平,郑桂妹. 采用乘性RNN的雷达HRRP目标识别[J]. 西安电子科技大学学报, 2021, 48(2): 49-54.
[15]	刘华渊,苏云飞,李瑞林,唐朝京. 结构状态覆盖导向的灰盒模糊测试技术[J]. 西安电子科技大学学报, 2021, 48(1): 117-123.