期刊文献+
共找到4,165篇文章
< 1 2 209 >
每页显示 20 50 100
The Crossing Number of Two Classes of Join Graphs
1
作者 LU Shengxiang WANG Shu WANG Jing 《数学进展》 北大核心 2025年第5期983-991,共9页
Determining the crossing number of a given graph is NP-complete. The cycle of length m is denoted by Cm = v1v2…vmv1. G^((1))_(m) (m ≥ 5) is the graph obtained from Cm by adding two edges v1v3 and vlvl+2 (3 ≤ l ≤ m... Determining the crossing number of a given graph is NP-complete. The cycle of length m is denoted by Cm = v1v2…vmv1. G^((1))_(m) (m ≥ 5) is the graph obtained from Cm by adding two edges v1v3 and vlvl+2 (3 ≤ l ≤ m−2), G^((2))m (m ≥ 4) is the graph obtained from Cm by adding two edges v1v3 and v2v4. The famous Zarankiewicz’s conjecture on the crossing number of the complete bipartite graph Km,n states that cr(Km,n)=Z(m,n)=[m/2][m-1/2][n/2[n-1/2].Based on Zarankiewicz’s conjecture, a natural problem is to study the change in the crossingnumber of the graphs obtained from the complete bipartite graph by adding certain edge sets.If Zarankiewicz’s conjecture is true, this paper proves that cr(G^((1))_(m)+Kn)=Z(m,n)+2[n/2] and cr(G^((2))_(m)+Kn)=Z(m,n)+n. 展开更多
关键词 crossing number DRAWING join graph
原文传递
基于Fork/Join模式的模幂算法并行化实现
2
作者 张翔 《计算机应用文摘》 2025年第20期244-246,249,共4页
公钥加密与数字签名算法普遍依赖于模幂运算,而大整数模幂运算的核心瓶颈在于高计算复杂度的乘法与幂运算.在现有研究基础上,文章系统分析了二元法、Karatsuba算法及快速傅里叶变换(FFT)在模幂运算中的应用特点,并针对其计算效率与资源... 公钥加密与数字签名算法普遍依赖于模幂运算,而大整数模幂运算的核心瓶颈在于高计算复杂度的乘法与幂运算.在现有研究基础上,文章系统分析了二元法、Karatsuba算法及快速傅里叶变换(FFT)在模幂运算中的应用特点,并针对其计算效率与资源消耗进行了相应优化.进一步地,基于Java语言环境,采用多线程Fork/Join框架实现改进算法,以提升并行计算性能与整体运算效率. 展开更多
关键词 模幂 Karatsuba FFT JAVA Fork/join
在线阅读 下载PDF
Discrepant involvement of homologous repair and non-homologous end joining pathways in maize development and growth
3
作者 Shuanghui Zhao Leiming Zheng +5 位作者 Minghui Zheng Menghan Li Shuyue Li Nan Wu Yan He Jinghan Liu 《The Crop Journal》 2025年第2期406-417,共12页
Chromosomal DNA double-strand breaks(DSBs)are often generated in the genome of all living organisms.To combat DNA damage,organisms have evolved several DSB repair mechanisms,with nonhomologous end-joining(NHEJ)and hom... Chromosomal DNA double-strand breaks(DSBs)are often generated in the genome of all living organisms.To combat DNA damage,organisms have evolved several DSB repair mechanisms,with nonhomologous end-joining(NHEJ)and homologous recombination(HR)being the two most prominent.Although two major pathways have been extensively studied in Arabidopsis,rice and other mammals,the exact functions and differences between the two DSB repair pathways in maize still remain less well understood.Here,we characterized mre11a and rad50,mutants of HR pathway patterns,which showed drastic degradation of the typically persistent embryo and endosperm during kernel development.Loss of MRE11 or RAD50 function led to chromosomal fragments and chromosomal bridges in anaphase.While we also reported that the NHEJ pathway patterns,KU70 and KU80 are associated with developmental growth and genome stability.ku70 and ku80 both displayed an obvious dwarf phenotype.Cytological analysis of the mutants revealed extensive chromosome fragmentation in metaphase and subsequent stages.Loss of KU70/80 function upregulated the expression of genes involved in cell cycle progression and nuclear division.These results provide insights into how NHEJ and HR are mechanistically executed during different plant developmental periods and highlight a competitive and complementary relationship between the NHEJ and HR pathways for DNA double-strand break repair in maize. 展开更多
关键词 Homologous recombination Non-homologous end joining Double-strand break MAIZE
在线阅读 下载PDF
Numerical Simulation Analysis of FSPR Joint Forming for Steel / Al Alloy Hybrid Body⁃in⁃White
4
作者 Lijun Han Rui Wang Fuyang Liu 《Journal of Harbin Institute of Technology(New Series)》 2025年第3期46-53,共8页
The development and application of large Die⁃Casting Al Alloy(DCAA)parts and Thermo⁃Formed Steel Sheets(TFSS)in Body⁃in⁃White(BIW)have created higher demands for the joining technology of high⁃strength steel/Al dissim... The development and application of large Die⁃Casting Al Alloy(DCAA)parts and Thermo⁃Formed Steel Sheets(TFSS)in Body⁃in⁃White(BIW)have created higher demands for the joining technology of high⁃strength steel/Al dissimilar materials.As an emerging technology,Flush Self⁃Piercing Riveting(FSPR)is still in the experimental phase and undergoing small batch equipment verification.This paper focuses on the joining methods for DCAA and TFSS in BIW,investigating the joining mechanisms,technical features,and forming principles of FSPR for steel/Al dissimilar materials with two⁃layer or three⁃layer plate combinations.Considering the TL4225/C611/CR5 sheet combination as a subject,the forming mechanism of high⁃quality joints was studied,and a physical and mathematical model was established to depict the relationship between the filling amount of the arc⁃gap and die dimensions,as well as the extrusion amount.This model effectively illustrates the relationship between the filling amount of the flowing metal in the arc⁃gap and critical parameters,such as die dimensions and feeding amounts.By simplifying the process of selecting joining parameters,it significantly reduces both the time and experimental workload associated with parameter selection.This provides a technical foundation for the application of DAAA and TFSS parts in BIW,enabling the rapid choice of appropriate joining parameters to meet the requirements for obtaining high⁃quality joints.The model can be effectively utilized to investigate the relationships between key parameters,including arc⁃gap radius,plate thickness,rivet arc radius,nail head radius,groove width,and feeding amount,while keeping other parameters constant.This approach provides a theoretical foundation for the design of Friction Stir Processing(FSP)joints and aids in the selection of optimal parameters. 展开更多
关键词 flush self⁃piercing riveting(FSPR) joining die⁃casting Al alloy(DCAA) thermo⁃formed steel sheets(TFSS) two or three⁃layer plate
在线阅读 下载PDF
Refill friction stir spot welding (RFSSW): a review of processing, similar/dissimilar materials joining, mechanical properties and fracture mechanism
5
作者 Yun-qiang Zhao Hao-kun Yang +2 位作者 Aloshyn Andriia Hong-hang Lo Jia-xin Li 《Journal of Iron and Steel Research International》 SCIE EI CAS CSCD 2024年第8期1825-1839,共15页
Refill friction stir spot welding(RFSSW)provides a novel method to join similar and/or dissimilar metallic materials without a key-hole in the center of the joint.Having the key-hole free characterization,the similar/... Refill friction stir spot welding(RFSSW)provides a novel method to join similar and/or dissimilar metallic materials without a key-hole in the center of the joint.Having the key-hole free characterization,the similar/dissimilar RFSSW joint exhibits remarkable and endurable characteristics,including high shear strength,long fatigue life,and strong corrosion resistance.In the meanwhile,as the key-hole free joint has different microstructures compared with conventional friction stir spot welding,thus the RFSSW joint shall possess different shear and fatigue fracture mechanisms,which needs further investigation.To explore the underlying failure mechanism,the similar/dissimilar metallic material joining parameters and pre-treatment,mechanical properties,as well as fracture mechanisms under this novel technology will be discussed.In details,the welding tool design,welding parameters setting,and the influence of processing on the lap shear and fatigue properties,as well as the corrosion resistance will be mainly discussed.Moreover,the roadmap of RFFSW is also discussed. 展开更多
关键词 Refill friction stir spot welding PROCESSING MECHANISM Similar materials joining Dissimilar materials joining MICROSTRUCTURE Mechanical property Fracture mechanism
原文传递
AN URGENT JOINT CAUSE
6
《China Today》 2024年第12期24-25,共2页
COP29-the 29th session of the Conference of the Parties to the United Nations Framework Convention on Climate Change-has accentuated the urgency of jointly addressing climate change,our common global threat,by pushing... COP29-the 29th session of the Conference of the Parties to the United Nations Framework Convention on Climate Change-has accentuated the urgency of jointly addressing climate change,our common global threat,by pushing for a fair and ambitious new climate financing target.It has also brought into the global spotlight China’s progress in green transition and carbon emission reduction and its commitment to international cooperation. 展开更多
关键词 join jointly GLOBAL
在线阅读 下载PDF
并行数据库中JOIN运算的并行算法 被引量:2
7
作者 黄明和 钟萃相 《计算机工程与科学》 CSCD 2006年第2期90-92,共3页
JOIN运算的并行算法一直是并行数据库领域中研究的热点问题,先后出现了一系列并行JOIN算法或改进算法,但它们都存在着通信效率较低、负载调度频繁等问题。本文针对这些问题,在分析比较前人工作的基础上对SABJ+算法与ABJ+算法加以改进,... JOIN运算的并行算法一直是并行数据库领域中研究的热点问题,先后出现了一系列并行JOIN算法或改进算法,但它们都存在着通信效率较低、负载调度频繁等问题。本文针对这些问题,在分析比较前人工作的基础上对SABJ+算法与ABJ+算法加以改进,得到了效率更高的并行JOIN算法ABJ++。 展开更多
关键词 串行join算法 并行join算法 并行Hash join算法 分桶
在线阅读 下载PDF
MGMT activated by Wnt pathway promotes cisplatin tolerance through inducing slow-cycling cells and nonhomologous end joining in colorectal cancer
8
作者 Haowei Zhang Qixin Li +9 位作者 Xiaolong Guo Hong Wu Chenhao Hu Gaixia Liu Tianyu Yu Xiake Hu Quanpeng Qiu Gang Guo Junjun She Yinnan Chen 《Journal of Pharmaceutical Analysis》 SCIE CAS CSCD 2024年第6期863-877,共15页
Chemotherapy resistance plays a pivotal role in the prognosis and therapeutic failure of patients with colorectal cancer(CRC).Cisplatin(DDP)-resistant cells exhibit an inherent ability to evade the toxic chemotherapeu... Chemotherapy resistance plays a pivotal role in the prognosis and therapeutic failure of patients with colorectal cancer(CRC).Cisplatin(DDP)-resistant cells exhibit an inherent ability to evade the toxic chemotherapeutic drug effects which are characterized by the activation of slow-cycle programs and DNA repair.Among the elements that lead to DDP resistance,O^(6)-methylguanine(O^(6)-MG)-DNA-methyltransferase(MGMT),a DNA-repair enzyme,performs a quintessential role.In this study,we clarify the significant involvement of MGMT in conferring DDP resistance in CRC,elucidating the underlying mechanism of the regulatory actions of MGMT.A notable upregulation of MGMT in DDP-resistant cancer cells was found in our study,and MGMT repression amplifies the sensitivity of these cells to DDP treatment in vitro and in vivo.Conversely,in cancer cells,MGMT overexpression abolishes their sensitivity to DDP treatment.Mechanistically,the interaction between MGMT and cyclin dependent kinase 1(CDK1)inducing slow-cycling cells is attainted via the promotion of ubiquitination degradation of CDK1.Meanwhile,to achieve nonhomologous end joining,MGMT interacts with XRCC6 to resist chemotherapy drugs.Our transcriptome data from samples of 88 patients with CRC suggest that MGMT expression is co-related with the Wnt signaling pathway activation,and several Wnt inhibitors can repress drug-resistant cells.In summary,our results point out that MGMT is a potential therapeutic target and predictive marker of chemoresistance in CRC. 展开更多
关键词 Colorectal cancer MGMT Chemotherapy resistance Slow-cycling cells Nonhomologous end joining Wnt pathway
暂未订购
Application of energy,electronic and interface bonding properties in highly reliable brazing joints between dissimilar materials
9
作者 Xing-xing Wang Yuan-long Jiang +6 位作者 Jia-shuo Chang Zhi-peng Yuan Jian-jun Shi Zi-cheng Ling Jun-yi Jiang Hong-gang Dong Fei Gao 《Journal of Iron and Steel Research International》 SCIE EI CAS CSCD 2024年第10期2344-2364,共21页
Brazing,an important welding and joining technology,can achieve precision joining of materials in advanced manufacturing.And the first principle calculation is a new material simulation method in high-throughput compu... Brazing,an important welding and joining technology,can achieve precision joining of materials in advanced manufacturing.And the first principle calculation is a new material simulation method in high-throughput computing.It can calculate the interfacial structure,band structure,electronic structure,and other properties between dissimilar materials,predicting various properties.It plays an important role in assisting practical research and guiding experimental designs by predicting material properties.It can largely improve the quality of welded components and joining efficiency.The relevant theoretical foundation is reviewed,including the first principle and density functional theory.Exchange-correlation functional and pseudopotential plane wave approach was also introduced.Then,the latest research progress of the first principle in brazing was also summarized.The application of first principle calculation mainly includes formation energy,adsorption energy,surface energy,adhesion work,interfacial energy,interfacial contact angle,charge density differences,density of states,and mulliken population.The energy,mechanical,and electronic properties were discussed.Finally,the limitations and shortcomings of the research in the first principle calculation of brazed interface were pointed out.Future developmental directions were presented to provide reference and theoretical basis for realizing high-throughput calculations of brazed joint interfaces. 展开更多
关键词 BRAZING First principle joining interface Density functional theory Bonding property Dissimilar material
原文传递
Effect of hydrogen fluoride and magnesium oxide on AZ31 Mg alloy/carbon fiber-reinforced plastic composite by thermal laser joining technique
10
作者 Andrews Nsiah Ashong Barton Mensah Arkhurst +2 位作者 Youn Seoung Lee Mok-Young Lee Jeoung Han Kim 《Journal of Magnesium and Alloys》 SCIE EI CAS CSCD 2024年第7期2874-2889,共16页
Although hydrofluoric acid(HF)surface treatment is known to enhance the joining of metals with polymers,there is limited information on its effect on the joining of AZ31 alloy and carbon-fiber-reinforced plastics(CFRP... Although hydrofluoric acid(HF)surface treatment is known to enhance the joining of metals with polymers,there is limited information on its effect on the joining of AZ31 alloy and carbon-fiber-reinforced plastics(CFRPs)through laser-assisted metal and plastic direct joining(LAMP).This study uses the LAMP technique to produce AZ31-CFRP joints.The joining process involves as-received AZ31,HFpretreated AZ31,and thermally oxidized HF-pretreated AZ31 alloy sheets.Furthermore,the bonding strength of joints prepared with thermally oxidized AZ31 alloy sheets is examined to ascertain the combined effect of HF treatment and thermal oxidation on bonding strength.The microstructures,surface chemical interactions,and mechanical performances of joints are investigated under tensile shear loading.Various factors,such as bubble formation,CFRP resin decomposition,and mechanical interlocking considerably affect joint strength.Additionally,surface chemical interactions between the active species on metal parts and the polar amide along with carbonyl groups of polymer play a significant role in improving joint strength.Joints prepared with surface-pretreated AZ31 alloy sheets show significant improvements in bonding strength. 展开更多
关键词 Thermal laser joining Thermal oxidation Hydrofluoric acid pretreatment Mechanical interlocking Covalent bonds Chemical interactions
在线阅读 下载PDF
Study on Key Joining Technology and Test Method of Steel/Al Hybrid Structure Body-in-White
11
作者 Lijun Han Fuyang Liu Changhua Liu 《Journal of Materials Science and Chemical Engineering》 2024年第4期104-118,共15页
Green and low carbon promote the application and development of light-weight materials in body-in-white. Large-scale die-casting Al alloy (DCAA) and high-strength thermo-formed steel sheet (TFSS) have put forward high... Green and low carbon promote the application and development of light-weight materials in body-in-white. Large-scale die-casting Al alloy (DCAA) and high-strength thermo-formed steel sheet (TFSS) have put forward higher requirements for the application of joining technology of high-strength steel/Al dissimilar materials. Taking the new die-casting Al alloy body as an example, this paper systematically studies the progress of the latest joining methods of steel/Al dissimilar material with combination of two-layer plate and three-layer plate. By analyzing the joining technologies such as FSPR, RES, FDS and SPR, the technology and process characteristics of steel/Al dissimilar material joining are studied, and the joining technical feasibility and realization means of different material combination of the body are analyzed. The conditions of material combination, material thickness, material strength, flange height, preformed holes and joint spacing for achieving high-quality joining are given. The FSPR joining technology is developed and tested in order to meet with the joining of parts with DCAA and TFSS, especially for the joining of three-layer plates with them. It finds the method and technical basis for the realization of high quality joining of dissimilar materials, provides the early conditions for the application of large DCAA and TFSS parts in body-in-white, and meets the design requirements of new energy body. . 展开更多
关键词 BODY-IN-WHITE LIGHTWEIGHT Die-Casting Al Alloy Thermo-Formed Steel joining
在线阅读 下载PDF
并行数据库上的并行CMD-Join算法 被引量:5
12
作者 李建中 都薇 《软件学报》 EI CSCD 北大核心 1998年第4期256-262,共7页
并行数据库在多处理机之间的分布方法(简称数据分布方法)对并行数据操作算法的性能影响很大.如果在设计并行数据操作算法时充分利用数据分布方法的特点,可以得到十分有效的并行算法.本文研究如何充分利用数据分布方法的特点,设计... 并行数据库在多处理机之间的分布方法(简称数据分布方法)对并行数据操作算法的性能影响很大.如果在设计并行数据操作算法时充分利用数据分布方法的特点,可以得到十分有效的并行算法.本文研究如何充分利用数据分布方法的特点,设计并行数据操作算法的问题,提出了基于CMD多维数据分布方法的并行CMD-Join算法.理论分析和实验结果表明。 展开更多
关键词 并行数据库 并行join算法 CMD-join算法
在线阅读 下载PDF
An Overview of Self-piercing Riveting Process with Focus on Joint Failures, Corrosion Issues and Optimisation Techniques 被引量:16
13
作者 Hua Qian Ang 《Chinese Journal of Mechanical Engineering》 SCIE EI CAS CSCD 2021年第1期89-113,共25页
Self-piercing riveting(SPR)is a cold forming technique used to fasten together two or more sheets of materials with a rivet without the need to predrill a hole.The application of SPR in the automotive sector has becom... Self-piercing riveting(SPR)is a cold forming technique used to fasten together two or more sheets of materials with a rivet without the need to predrill a hole.The application of SPR in the automotive sector has become increasingly popular mainly due to the growing use of lightweight materials in transportation applications.However,SPR joining of these advanced light materials remains a challenge as these materials often lack a good combination of high strength and ductility to resist the large plastic deformation induced by the SPR process.In this paper,SPR joints of advanced materials and their corresponding failure mechanisms are discussed,aiming to provide the foundation for future improvement of SPR joint quality.This paper is divided into three major sections:1)joint failures focusing on joint defects originated from the SPR process and joint failure modes under different mechanical loading conditions,2)joint corrosion issues,and 3)joint optimisation via process parameters and advanced techniques. 展开更多
关键词 Self-piercing riveting Mechanical joining joint defects Failure mechanisms CORROSION joint optimisation
在线阅读 下载PDF
NES-Join算法的改进算法
14
作者 柯莉珍 苏厚勤 《计算机应用与软件》 CSCD 北大核心 2007年第9期175-178,共4页
NES-Join算法是一种无需外排序的连接运算算法,其复杂性优于经典的Sort-Merge Join算法及改进后的SDC-Join算法。在NES-Join算法基础上提出一种改进算法,该算法能够有效压缩原算法中未匹配记录暂存块中的空记录信息,从而使NES-Join算法... NES-Join算法是一种无需外排序的连接运算算法,其复杂性优于经典的Sort-Merge Join算法及改进后的SDC-Join算法。在NES-Join算法基础上提出一种改进算法,该算法能够有效压缩原算法中未匹配记录暂存块中的空记录信息,从而使NES-Join算法更具实用性。通过实验和分析表明,改进后的NES-Join算法与原算法时间复杂性相当,但显著提高了磁盘空间的使用率。 展开更多
关键词 join运算 join算法 NES-join算法
在线阅读 下载PDF
并行JOIN算法的优化子集合调整方法
15
作者 孙文隽 李建中 李金宝 《黑龙江大学自然科学学报》 CAS 1997年第3期39-46,54,共9页
子集合调整是克服数据偏斜影响的并行HASH-JOIN算法的关键组成部分,现有的克服数据偏斜影响的HASH-JOIN算法都没有很好地解决这个问题。作者深入地研究了子集合调整问题,提出了四种子集合调整算法。理论分析和实验... 子集合调整是克服数据偏斜影响的并行HASH-JOIN算法的关键组成部分,现有的克服数据偏斜影响的HASH-JOIN算法都没有很好地解决这个问题。作者深入地研究了子集合调整问题,提出了四种子集合调整算法。理论分析和实验结果都证明,这四种算法都能够很好地解决子集合调整问题,特别是启发式优化算法OP-ADJUST在多数情况下都能给出优化解。 展开更多
关键词 数据库 子集合调整 join操作 并行join算法
在线阅读 下载PDF
N台并联Fork-Join排队网络的弱收敛与强逼近 被引量:1
16
作者 侯为波 汪荣鑫 《淮北煤师院学报(自然科学版)》 1995年第4期9-15,共7页
本文借助于概率测度弱收敛与概率论强逼近理论,较为详细地研究了N台并联Fork-Join排队网络,得到了响应时间、队长、离去过程的弱收敛与强逼近定理。这些结果具有一定的实际意义,并为一般型Fork-Join网络的研究提供了必要的理论基础。
关键词 Fork-join排队 弱收敛 强逼近 Fork-join网络
在线阅读 下载PDF
CPU和DRAM加速任务划分方法:大数据处理中Hash Joins的加速实例 被引量:3
17
作者 吴林阳 罗蓉 +1 位作者 郭雪婷 郭崎 《计算机研究与发展》 EI CSCD 北大核心 2018年第2期289-304,共16页
硬件加速器能够有效地提高当前计算机系统的能效.然而,传统的硬件加速器(如GPU,FPGA和定制的加速器)和内存是相互分离的,加速器和内存之间的数据移动难以避免,这使得如何降低加速器和内存之间数据移动的开销成为极具挑战性的问题.随着... 硬件加速器能够有效地提高当前计算机系统的能效.然而,传统的硬件加速器(如GPU,FPGA和定制的加速器)和内存是相互分离的,加速器和内存之间的数据移动难以避免,这使得如何降低加速器和内存之间数据移动的开销成为极具挑战性的问题.随着靠近数据的处理技术(near-dataprocessing)和3D堆叠DRAM的出现,我们能够将硬件加速器集成到3D堆叠DRAM中,使得数据移动的开销大大降低.然而,由于3D堆叠DRAM对面积、功耗和散热具有严格的限制,所以不可能将一个功能复杂的硬件加速器完整地集成到DRAM中.因此,在设计内存端的硬件加速器时,应该考虑将加速任务在CPU和加速器之间合理地进行划分.以加速大数据系统中的一个关键操作hash joins为例子,阐述了CPU和内存端加速任务划分的设计思想.以减少数据移动为出发点,设计了一个包含内存端定制加速器和处理器端SIMD加速单元的混合加速系统,并对应用进行分析,将加速任务划分到不同的加速器.其中,内存端的加速器用于加速数据移动受限的执行阶段,而处理器端SIMD加速单元则用于加速数据移动开销较低成本的执行阶段.实验结果表明:与英特尔的Haswell处理器和Xeon Phi相比,设计的混合加速系统的能效分别提升了47.52倍和19.81倍.此外,提出的以数据移动为驱动的方法很容易扩展于指导其他应用的加速设计. 展开更多
关键词 3D堆叠内存 加速器 大数据 HASH joins RADIX joins算法的优化版本 hash分区加速器
在线阅读 下载PDF
Spark查询引擎中Join操作的优化 被引量:1
18
作者 赵丽梅 黄小菊 宫学庆 《计算机应用与软件》 北大核心 2022年第8期44-50,共7页
Spark是基于Map/Reduce计算模型进行大规模数据处理的分布式系统,每个任务都会被分为很多Map处理和Reduce处理在各个节点上并行执行。Shuffle操作是用于连接Map处理和Reduce处理的桥梁。在对两个大表进行Join操作的过程中,如果两表Join... Spark是基于Map/Reduce计算模型进行大规模数据处理的分布式系统,每个任务都会被分为很多Map处理和Reduce处理在各个节点上并行执行。Shuffle操作是用于连接Map处理和Reduce处理的桥梁。在对两个大表进行Join操作的过程中,如果两表Join列不完全匹配,Spark中现有的Join实现算法会对大量数据进行shuffle操作,严重影响执行效率。提出一种基于Semi Join思想的Join实现算法——Semi Sort Merge Join,通过对左表Join列数据所构建的HashMap对右表数据进行过滤,可以有效减少Shuffle操作过程中所需传输的数据量。算法分析和实验结果表明,对于Join列数据不完全匹配的大表间Join操作,该算法能有效减少Shuffle操作的开销,右表与左表匹配数据量越少,算法优化的效果越明显。 展开更多
关键词 SPARK join SHUFFLE Semi join
在线阅读 下载PDF
调度Fork-Join任务图的贪心算法 被引量:6
19
作者 杨斌 张建军 杨峰 《计算机工程与设计》 CSCD 北大核心 2008年第15期3864-3866,3894,共4页
任务调度算法的目标是把组成并行程序的一组任务分配到多个处理器以使得程序的完成时间最短,这是一个NP完全问题。虽然许多算法在任务满足某些条件时能产生最优调度,但大多都忽略了节省处理器个数和最小化程序总的完成时间等问题。Fork-... 任务调度算法的目标是把组成并行程序的一组任务分配到多个处理器以使得程序的完成时间最短,这是一个NP完全问题。虽然许多算法在任务满足某些条件时能产生最优调度,但大多都忽略了节省处理器个数和最小化程序总的完成时间等问题。Fork-Join结构是一种并行处理的基本结构。因此,专门针对Fork-Join任务图,提出了一个能产生最优调度的新的贪心调度算法,该算法具有高的加速比和总体效率,时间复杂度为2,其中,表示任务集中任务的个数。实验结果表明,相比其它算法,该算法具有较短的调度长度、较短的完成时间,使用的处理器数较少。 展开更多
关键词 最优调度算法 任务复制 Fork—join任务图 关键任务 加速比
在线阅读 下载PDF
一个调度Fork-Join任务图的最优算法(英文) 被引量:8
20
作者 李庆华 阮幼林 +2 位作者 刘干 蒋盛益 杨世达 《软件学报》 EI CSCD 北大核心 2005年第5期684-690,共7页
Fork-Join任务图是一种并行处理的基本结构.虽然许多算法在任务满足某些条件时能产生最优调度,但往往没有考虑节省处理器个数和减少任务集的总完成时间,从而降低算法的加速比和效率.因此,提出一种基于任务复制的平衡调度算法,其时间复... Fork-Join任务图是一种并行处理的基本结构.虽然许多算法在任务满足某些条件时能产生最优调度,但往往没有考虑节省处理器个数和减少任务集的总完成时间,从而降低算法的加速比和效率.因此,提出一种基于任务复制的平衡调度算法,其时间复杂度为O(vq+vlogv),v和q分别表示任务集中任务的个数和使用的处理器个数.通过分析已用处理器的负载和空闲时间段,把任务尽量分配到已用的处理器上以均衡负载,从而提高其利用率.实验结果表明,该算法的加速比和总体效率优于其他算法.因此,该算法对于高性能应用程序的调度是一个较好的选择. 展开更多
关键词 任务调度 任务复制 FORK-join任务图 加速比
在线阅读 下载PDF
上一页 1 2 209 下一页 到第
使用帮助 返回顶部