Hierarchical Temporal Attention Network for Thyroid Nodule Recognition Using Dynamic CEUS Imaging
In: IEEE Transactions on Medical Imaging, Jg. 40 (2021-06-01), S. 1646-1660
Online
unknown
Zugriff:
Contrast-enhanced ultrasound (CEUS) has emerged as a popular imaging modality in thyroid nodule diagnosis due to its ability to visualize vascular distribution in real time. Recently, a number of learning-based methods are dedicated to mine pathological-related enhancement dynamics and make prediction at one step, ignoring a native diagnostic dependency. In clinics, the differentiation of benign or malignant nodules always precedes the recognition of pathological types. In this paper, we propose a novel hierarchical temporal attention network (HiTAN) for thyroid nodule diagnosis using dynamic CEUS imaging, which unifies dynamic enhancement feature learning and hierarchical nodules classification into a deep framework. Specifically, this method decomposes the diagnosis of nodules into an ordered two-stage classification task, where diagnostic dependency is modeled by Gated Recurrent Units (GRUs). Besides, we design a local-to-global temporal aggregation (LGTA) operator to perform a comprehensive temporal fusion along the hierarchical prediction path. Particularly, local temporal information is defined as typical enhancement patterns identified with the guidance of perfusion representation learned from the differentiation level. Then, we leverage an attention mechanism to embed global enhancement dynamics into each identified salient pattern. In this study, we evaluate the proposed HiTAN method on the collected CEUS dataset of thyroid nodules. Extensive experimental results validate the efficacy of dynamic patterns learning, fusion and hierarchical diagnosis mechanism.
Titel: |
Hierarchical Temporal Attention Network for Thyroid Nodule Recognition Using Dynamic CEUS Imaging
|
---|---|
Autor/in / Beteiligte Person: | Zhang, Daoqiang ; Chen, Fang ; Wan, Peng ; Liu, Chunrui ; Kong, Wentao |
Link: | |
Zeitschrift: | IEEE Transactions on Medical Imaging, Jg. 40 (2021-06-01), S. 1646-1660 |
Veröffentlichung: | Institute of Electrical and Electronics Engineers (IEEE), 2021 |
Medientyp: | unknown |
ISSN: | 1558-254X (print) ; 0278-0062 (print) |
DOI: | 10.1109/tmi.2021.3063421 |
Schlagwort: |
|
Sonstiges: |
|