目的综合考虑B型超声(B-mode ultrasound,B-US)和对比增强超声(contrast-enhanced ultrasound,CEUS)双模态信息有助于提升乳腺肿瘤诊断的准确性,从而利于提高患者生存率。然而,目前大多数模型只关注B-US的特征提取,忽视了CEUS特征的学...目的综合考虑B型超声(B-mode ultrasound,B-US)和对比增强超声(contrast-enhanced ultrasound,CEUS)双模态信息有助于提升乳腺肿瘤诊断的准确性,从而利于提高患者生存率。然而,目前大多数模型只关注B-US的特征提取,忽视了CEUS特征的学习和双模态信息的融合处理。为解决上述问题,提出了一个融合时空特征与时间约束的双模态乳腺肿瘤诊断模型(spatio-temporal feature and temporal-constrained model,STFTCM)。方法首先,基于双模态信息的数据特点,采用异构双分支网络学习B-US和CEUS包含的时空特征。然后,设计时间注意力损失函数引导CEUS分支关注造影剂流入病灶区的时间窗口,从该窗口期内提取CEUS特征。最后,借助特征融合模块实现双分支网络之间的横向连接,通过将B-US特征作为CEUS分支补充信息的方式,完成双模态特征融合。结果在收集到的数据集上进行对比实验,STFTCM预测的正确率、敏感性、宏平均F1和AUC(area under the curve)指标均表现优秀,其中预测正确率达88.2%,领先于其他先进模型。消融实验中,时间注意力约束将模型预测正确率提升5.8%,特征融合使得模型诊断正确率相较于单分支模型至少提升2.9%。结论本文提出的STFTCM能有效地提取并融合处理B-US和CEUS双模态信息,给出准确的诊断结果。同时,时间注意力约束和特征融合模块可以显著地提升模型性能。展开更多
AIM: To evaluate the clinical value of various imageological methods in diagnosing the pancreato-biliary diseases and to seek the optimal procedure.METHODS: Eighty-two cases of pancreato-biliary diseases confirmed by ...AIM: To evaluate the clinical value of various imageological methods in diagnosing the pancreato-biliary diseases and to seek the optimal procedure.METHODS: Eighty-two cases of pancreato-biliary diseases confirmed by surgery and pathology were analyzed. There were 38 cases of cholelithiasis, 34 cases of pancreato-biliary tumors and 10 other cases. The imageological methods included B-US, CT, ERCP, PTC, cross-sectional MRI and MR cholangiopancreatography (MRCP).RESULTS: The accuracy rate of MRCP in detecting the location of pancreato-biliary obstruction was 100 %. In differentiating malignant from benign obstruction, the sensitivity of the combination of MRCP and cross-sectional MRI was 82.3 %, the specificity was 93.8 %, and the accuracy rate was 89.0 % . The accuracy rate for determining the nature of obstruction was 87.8 %, which was superior to that of B-US (P=0.0000) and CT (P=0.0330),but there was no significant difference between direct cholangiopancreatography and the combination of MRCP and conventional MRI (P=0.6666).CONCLUSION: In most cases, MRCP can substitute direct cholangiopancreatography for diagnosis. The combination of MRCP and cross-sectional MRI should be considered as an important means in diagnosing the pancreato-biliary diseases, pre-operative assessment and post-operative follow-ups.展开更多
文摘目的综合考虑B型超声(B-mode ultrasound,B-US)和对比增强超声(contrast-enhanced ultrasound,CEUS)双模态信息有助于提升乳腺肿瘤诊断的准确性,从而利于提高患者生存率。然而,目前大多数模型只关注B-US的特征提取,忽视了CEUS特征的学习和双模态信息的融合处理。为解决上述问题,提出了一个融合时空特征与时间约束的双模态乳腺肿瘤诊断模型(spatio-temporal feature and temporal-constrained model,STFTCM)。方法首先,基于双模态信息的数据特点,采用异构双分支网络学习B-US和CEUS包含的时空特征。然后,设计时间注意力损失函数引导CEUS分支关注造影剂流入病灶区的时间窗口,从该窗口期内提取CEUS特征。最后,借助特征融合模块实现双分支网络之间的横向连接,通过将B-US特征作为CEUS分支补充信息的方式,完成双模态特征融合。结果在收集到的数据集上进行对比实验,STFTCM预测的正确率、敏感性、宏平均F1和AUC(area under the curve)指标均表现优秀,其中预测正确率达88.2%,领先于其他先进模型。消融实验中,时间注意力约束将模型预测正确率提升5.8%,特征融合使得模型诊断正确率相较于单分支模型至少提升2.9%。结论本文提出的STFTCM能有效地提取并融合处理B-US和CEUS双模态信息,给出准确的诊断结果。同时,时间注意力约束和特征融合模块可以显著地提升模型性能。
文摘AIM: To evaluate the clinical value of various imageological methods in diagnosing the pancreato-biliary diseases and to seek the optimal procedure.METHODS: Eighty-two cases of pancreato-biliary diseases confirmed by surgery and pathology were analyzed. There were 38 cases of cholelithiasis, 34 cases of pancreato-biliary tumors and 10 other cases. The imageological methods included B-US, CT, ERCP, PTC, cross-sectional MRI and MR cholangiopancreatography (MRCP).RESULTS: The accuracy rate of MRCP in detecting the location of pancreato-biliary obstruction was 100 %. In differentiating malignant from benign obstruction, the sensitivity of the combination of MRCP and cross-sectional MRI was 82.3 %, the specificity was 93.8 %, and the accuracy rate was 89.0 % . The accuracy rate for determining the nature of obstruction was 87.8 %, which was superior to that of B-US (P=0.0000) and CT (P=0.0330),but there was no significant difference between direct cholangiopancreatography and the combination of MRCP and conventional MRI (P=0.6666).CONCLUSION: In most cases, MRCP can substitute direct cholangiopancreatography for diagnosis. The combination of MRCP and cross-sectional MRI should be considered as an important means in diagnosing the pancreato-biliary diseases, pre-operative assessment and post-operative follow-ups.
