A Rapid Mode Pursuing Sampling Method for High Dimensional Optimization Problems

doi:10.3901/JME.2019.03.138

Abstract

Abstract: Approximate optimization strategies using design of computer experiments (DoCE) and metamodels have been widely applied in design of modern complex engineering systems. Mode pursuing sampling method (MPS) is a representative of such optimization algorithms. A rapid mode pursuing sampling method using significant design space concept (notated as RMPS-SDS) is proposed in this work to alleviate the low efficiency problem of MPS in solving high dimensional optimization problems. The idea of significant design space is incorporated into the MPS framework, and a sample point allocation strategy is designed to enhance the local search capability and convergence speed of MPS. RMPS-SDS is tested on a number of standard numerical benchmark problems and two engineering design problems and compared with MPS and GA. The comparison results indicate that with the same computational budget (i.e., the same number of function evaluations), results of RMPS-SDS are much closer to the theoretical global optima with lower standard deviation for multiple runs. It is thus demonstrated that the proposed RMPS-SDS outperforms the standard MPS in terms of efficiency, convergence, and robustness in solving high dimensional optimization problems, which is more promising for engineering practices.

Key words: adaptive metamodel, approximate optimization, global optimization, mode pursuing sampling, significant design space

CLC Number:

V221

WU Yufei, LONG Teng, SHI Renhe, WANG G Gary. A Rapid Mode Pursuing Sampling Method for High Dimensional Optimization Problems[J]. Journal of Mechanical Engineering, 2019, 55(3): 138-146.

References

[1] SIMPSON T W,BOOKE A J,GHOSH D,et al. Approximation methods in multidisciplinary analysis and optimization:a panel discussion[J]. Structural and Multidisciplinary Optimization,2004,27(5):302-313.
[2] WANG G G,SHAN S. Review of metamodeling techniques in support of engineering design optimization[J]. Journal of Mechanical Design,2007,129(4):370-380.
[3] MYERS R H,MONTGOMERY D C,ANDERSON- COOK C M. Response surface methodology:process and product optimization using designed experiments[D]. New Jersey:John Wiley & Sons,2016.
[4] BUHMANN M D. Radial basis functions:theory and implementations[D]. Cambridge:Cambridge University Press,2003.
[5] SIMPSON T W,MAUERY T M,KORTE J J,et al. Kriging models for global approximation in simulation-based multidisciplinary design optimization[J]. AIAA Journal,2001,39(12):2233-2241.
[6] 龙腾,刘建,WANG G G,等. 基于计算试验设计与代理模型的飞行器近似优化策略探讨[J]. 机械工程学报,2016,52(14):79-105. LONG Teng,LIU Jian,WANG G G,et al. Discuss on approximate optimization strategies using design of computer experiments and metamodels for flight vehicle design[J]. Journal of Mechanical Engineering,2016,52(14):79-105.
[7] 龙腾,郭晓松,彭磊,等. 基于信赖域的动态径向基函数代理模型优化策略[J]. 机械工程学报,2014,50(7):184-190. LONG Teng,GUO Xiaosong,PENG Lei,et al. Optimization strategy using dynamic radial basis function metamodel based on trust region[J]. Journal of Mechanical Engineering,2014,50(7):184-190.
[8] CHENG G H,YOUNIS A,HAJIKOLAEI K H,et al. Trust region based mode pursuing sampling method for global optimization of high dimensional design problems[J]. Journal of Mechanical Design,2015,137(2):021407.
[9] WANG G G,DONG Z,AITCHISON P. Adaptive response surface method - a global optimization scheme for approximation-based design problems[J]. Engineering Optimization,2001,33(6):707-733.
[10] PENG Lei,LIU Li,LONG Teng. Study of sequential radial basis function for computation-intensive design optimization problem[C]//12th AIAA Aviation Technology,Integration and Operations (ATIO) Conference,11st September,2012,Indianapolis,Indiana. Reston,Virginia:American Institute of Aeronautics and Astronautics,2012:5689.
[11] PENG Lei,LIU Li,LONG Teng,et al. An efficient truss structure optimization framework based on CAD/CAE integration and sequential radial basis function metamodel[J]. Structural and Multidisciplinary Optimization,2014,50(2):329-346.
[12] LONG Teng,WU Di,GUO Xiaosong,et al. Efficient adaptive response surface method using intelligent space exploration strategy[J]. Structural and Multidisciplinary Optimization,2015,51(6):1335-1362.
[13] JONES D R,SCHONLAU M,WELCH W J. Efficient global optimization of expensive black-box functions[J]. Journal of Global Optimization,1998,13:455-492.
[14] WANG L,SHAN S,WANG G G. Mode-pursuing sampling method for global optimization on expensive black-box functions[J]. Engineering Optimization,2004,36(4):419-438.
[15] LI Yulin,LIU Li,LONG Teng,et al. Metamodel-based global optimization using fuzzy clustering for design space reduction[J]. Chinese Journal of Mechanical Engineering,2013,26(5):928-939.
[16] DUAN X,WANG G G,KANG X,et al. Performance study of mode-pursuing sampling method[J]. Engineering Optimization,2009,41(1):1-21.
[17] BRANIN F H,HOO S K. A method for finding multiple extrema of a function of n variables[J]. Numerical Methods,1972:231-237.
[18] QUEIPO N V,HAFTKA R T,SHYY W,et al. Surrogate-based analysis and optimization[J]. Progress in Aerospace Sciences,2005,41(1):1-28.
[19] SCHITTKOWSKI K. More test examples for nonlinear programming codes[D]. New York:Springer Science & Business Media,2012.
[20] FORRESTER A,SOBESTER A,KEANE A. Engineering design via surrogate modelling:a practical guide[D]. Chichester:John Wiley & Sons,2008.
[21] 龙腾,刘莉,孟令涛,等. 基于代理模型的翼型多目标集成优化设计[J]. 系统仿真学报,2010,22(07):1604-1608. LONG Teng,LIU Li,MENG Lingtao,et al. Multi-objective integrated optimization of airfoil based on surrogate model[J]. Journal of System Integration,2010,22(07):1604-1608.
[22] KHURANA M,WINARTO H,SINHA A. Airfoil geometry parameterization through shape optimizer and computational fluid dynamics[C]//46th AIAA Aerospace Sciences Meeting and Exhibit,10th January,2008,Reno,Nevada. Reston, Virginia:American Institute of Aeronautics and Astronautics,2008:295.