基于改进CDC的实验原始记录匹配算法. (Chinese)
In: Journal of Shenzhen University Science & Engineering, Jg. 39 (2022-09-01), Heft 5, S. 509-514
academicJournal
Zugriff:
Aiming at the problems such as long time and occasional errors in the generation process of the current laboratory test report, we present an automatic capture technology of general original experimental records based on fence factor. First, the read files of the day are accurately filtered by calculating the overall Hash value of file. Then, we use the improved content-defined chunking (CDC) algorithm for chunking. The improvement of CDC algorithm includes setting the unit of the sliding window as the spacing of between two lines and setting the range of the byte size in the sliding window. When the text block is completed, a string matching algorithm based on pattern string is used to complete the matching process. The string matching algorithm constructs the mapping relationship between the pattern string and data block in data block index table, and then quickly matches the pattern string Pn to corresponding data block through the data block index table. The original experimental record files of customs laboratory are used for testing. The algorithm occupies the least memory and has the largest chunking throughput. [ABSTRACT FROM AUTHOR]
针对当前实验室检测报告的生成过程存在时间长和易出现偶然性差错等问题, 提出基于栅栏 因子的通用实验原始记录文件自动抓取技术.先通过计算文件整体hash值准确过滤当日已读取文件, 再使 用改进的内容可变长度分块(content-defined chunking, CDC)算法进行文本分块.该CDC算法改进之处主要 体现在:设定滑动窗口下一单位为行与行间距之和的高度以及滑动窗口内字节大小的范围.待文本分块结 束后, 使用基于数据块索引的字符串匹配算法完成匹配.该字符串匹配算法结合数据块索引表构建模式串 与数据块的映射关系, 之后由模式串P"通过数据块索引表快速匹配到相应数据块.使用海关实验室的实验 原始记录文件进行测试, 实验证明, 该算法的内存占用量少且分块吞吐量更大. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Shenzhen University Science & Engineering is the property of Editorial Department of Journal of Shenzhen University Science & Engineering and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Titel: |
基于改进CDC的实验原始记录匹配算法. (Chinese)
|
---|---|
Autor/in / Beteiligte Person: | 蔡伊娜 ; 陈新 ; 覃志武 ; 王歆 ; 包先雨 ; 彭锦学 ; 林泳奇 ; 李俊霖 |
Zeitschrift: | Journal of Shenzhen University Science & Engineering, Jg. 39 (2022-09-01), Heft 5, S. 509-514 |
Veröffentlichung: | 2022 |
Medientyp: | academicJournal |
ISSN: | 1000-2618 (print) |
DOI: | 10.3724/SP.J.1249.2022.05509 |
Sonstiges: |
|