{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T03:57:47Z","timestamp":1777694267883,"version":"3.51.4"},"reference-count":90,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ICA"],"published-print":{"date-parts":[[2023,8,31]]},"abstract":"<jats:p>3D reconstruction is extremely important in CAD (computer-aided design)\/CAE (computer-aided Engineering)\/CAM (computer-aided manufacturing). For interpretability, reinforcement learning (RL) is used to reconstruct 3D shapes from images by a series of editing actions. However, typical applications of RL for 3D reconstruction face problems. The search space will increase exponentially with the action space due to the curse of dimensionality, which leads to low performance, especially for complex action spaces in 3D reconstruction. Additionally, most works involve training a specific agent for each shape class without learning related experiences from others. Therefore, we present a hierarchical RL approach with transferability to reconstruct 3D shapes (HRLT3D). First, actions are grouped into macro actions that can be chosen by the top-agent. Second, the task is accordingly decomposed into hierarchically simplified sub-tasks solved by sub-agents. Different from classical hierarchical RL (HRL), we propose a sub-agent based on augmented state space (ASS-Sub-Agent) to replace a set of sub-agents, which can speed up the training process due to shared learning and having fewer parameters. Furthermore, the ASS-Sub-Agent is more easily transferred to data of other classes due to the augmented diverse states and the simplified tasks. The experimental results on typical public dataset show that the proposed HRLT3D performs overwhelmingly better than recent baselines. More impressingly, the experiments also demonstrate the extreme transferability of our approach among data of different classes.<\/jats:p>","DOI":"10.3233\/ica-230710","type":"journal-article","created":{"date-parts":[[2023,5,12]],"date-time":"2023-05-12T13:35:01Z","timestamp":1683898501000},"page":"327-339","source":"Crossref","is-referenced-by-count":49,"title":["3D reconstruction based on hierarchical reinforcement learning with transferability"],"prefix":"10.1177","volume":"30","author":[{"given":"Lan","family":"Li","sequence":"first","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan, Hubei, China"}]},{"given":"Fazhi","family":"He","sequence":"additional","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan, Hubei, China"}]},{"given":"Rubin","family":"Fan","sequence":"additional","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan, Hubei, China"}]},{"given":"Bo","family":"Fan","sequence":"additional","affiliation":[{"name":"Institute of Science and Technology Development, Wuhan University, Wuhan, Hubei, China"}]},{"given":"Xiaohu","family":"Yan","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Shenzhen Polytechnic, Shenzhen, Guangdong, China"}]}],"member":"179","reference":[{"key":"10.3233\/ICA-230710_ref1","first-page":"545","article-title":"Modeling 3d shapes by reinforcement learning","author":"Lin","year":"2020","journal-title":"European Conference on Computer Vision"},{"issue":"3","key":"10.3233\/ICA-230710_ref2","doi-asserted-by":"crossref","first-page":"295","DOI":"10.3233\/ICA-210655","article-title":"Auto-sharing parameters for transfer learning based on multi-objective optimization","volume":"28","author":"Liu","year":"2021","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"3","key":"10.3233\/ICA-230710_ref3","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/0045-7949(86)90313-5","article-title":"A MICROCAD system for design of steel connections\u00a0\u2013 II. Applications","volume":"24","author":"Adeli","year":"1986","journal-title":"Computers & Structures"},{"issue":"2","key":"10.3233\/ICA-230710_ref4","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/0045-7949(86)90286-5","article-title":"A MICROCAD system for design of steel connections\u00a0\u2013 I. Program structure and graphic algorithms","volume":"24","author":"Adeli","year":"1986","journal-title":"Computers & Structures"},{"issue":"3","key":"10.3233\/ICA-230710_ref5","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1016\/0045-7949(93)90319-9","article-title":"Design-independent CAD Window system using the object-oriented paradigm and HP X widget environment","volume":"48","author":"Chuang","year":"1993","journal-title":"Computers & Structures"},{"issue":"2","key":"10.3233\/ICA-230710_ref6","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/0045-7949(94)00323-U","article-title":"An integrated computing environment for solution of complex engineering problems using the object-oriented programming paradigm and a blackboard architecture","volume":"54","author":"Adeli","year":"1995","journal-title":"Computers & Structures"},{"issue":"2","key":"10.3233\/ICA-230710_ref7","doi-asserted-by":"crossref","first-page":"237","DOI":"10.14359\/51689560","article-title":"Supervised Deep Restricted Boltzmann Machine for Estimation of Concrete","volume":"114","author":"Rafiei","year":"2017","journal-title":"Aci Materials Journal"},{"key":"10.3233\/ICA-230710_ref8","doi-asserted-by":"crossref","unstructured":"Hassanpour A, Moradikia M, Adeli H, Khayami R, Babaki PS. A novel end-to-end deep learning scheme for classifying multi-class motor imagery electroencephalography signals. Expert Systems. 2019; 36(6).","DOI":"10.1111\/exsy.12494"},{"key":"10.3233\/ICA-230710_ref9","doi-asserted-by":"crossref","unstructured":"Martins GB, Papa JP, Adeli H. Deep learning techniques for recommender systems based on collaborative filtering. Expert Systems. 2020; 37.","DOI":"10.1111\/exsy.12647"},{"key":"10.3233\/ICA-230710_ref10","doi-asserted-by":"crossref","unstructured":"Nogay HS, Adeli H. Machine learning (ML) for the diagnosis of autism spectrum disorder (ASD) using brain imaging. Reviews in the Neurosciences. 2020; 31.","DOI":"10.1515\/revneuro-2020-0043"},{"key":"10.3233\/ICA-230710_ref11","doi-asserted-by":"crossref","unstructured":"Choy CB, Xu D, Gwak JY, Chen K, Savarese S. 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction. In: European Conference on Computer Vision. 2016.","DOI":"10.1007\/978-3-319-46484-8_38"},{"key":"10.3233\/ICA-230710_ref12","doi-asserted-by":"crossref","unstructured":"Fan H, Hao S, Guibas L. A Point Set Generation Network for 3D Object Reconstruction from a Single Image. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017.","DOI":"10.1109\/CVPR.2017.264"},{"key":"10.3233\/ICA-230710_ref13","doi-asserted-by":"crossref","unstructured":"Girdhar R, Fouhey DF, Rodriguez M, Gupta A. Learning a Predictable and Generative Vector Representation for Objects. In: European Conference on Computer Vision. 2016.","DOI":"10.1007\/978-3-319-46466-4_29"},{"key":"10.3233\/ICA-230710_ref14","doi-asserted-by":"crossref","unstructured":"Hne C, Tulsiani S, Malik J. Hierarchical Surface Prediction for 3D Object Reconstruction. In: 2017 International Conference on 3D Vision (3DV). 2017.","DOI":"10.1109\/3DV.2017.00054"},{"key":"10.3233\/ICA-230710_ref15","doi-asserted-by":"crossref","first-page":"103196","DOI":"10.1016\/j.cad.2022.103196","article-title":"A kernel correlation-based approach to adaptively acquire local features for learning 3D point clouds","volume":"146","author":"Song","year":"2022","journal-title":"Computer-Aided Design"},{"key":"10.3233\/ICA-230710_ref16","doi-asserted-by":"crossref","unstructured":"Mescheder L, Oechsle M, Niemeyer M, Nowozin S, Geiger A. Occupancy Networks: Learning 3D Reconstruction in Function Space. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019.","DOI":"10.1109\/CVPR.2019.00459"},{"issue":"1","key":"10.3233\/ICA-230710_ref17","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1145\/3503250","article-title":"Nerf: Representing scenes as neural radiance fields for view synthesis","volume":"65","author":"Mildenhall","year":"2021","journal-title":"Communications of the ACM"},{"key":"10.3233\/ICA-230710_ref18","doi-asserted-by":"crossref","unstructured":"Park JJ, Florence P, Straub J, Newcombe R, Lovegrove S. DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019.","DOI":"10.1109\/CVPR.2019.00025"},{"key":"10.3233\/ICA-230710_ref19","doi-asserted-by":"crossref","unstructured":"Chibane J, Alldieck T, Pons-Moll G. Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020.","DOI":"10.1109\/CVPR42600.2020.00700"},{"key":"10.3233\/ICA-230710_ref20","doi-asserted-by":"crossref","unstructured":"Jiang C, Sud A, Makadia A, Huang J, Funkhouser T. Local Implicit Grid Representations for 3D Scenes. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020.","DOI":"10.1109\/CVPR42600.2020.00604"},{"key":"10.3233\/ICA-230710_ref21","first-page":"13559","article-title":"3d shape generation with grid-based implicit functions","author":"Ibing","year":"2021","journal-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition"},{"key":"10.3233\/ICA-230710_ref22","unstructured":"Wu J, Zhang C, Xue T, Freeman B, Tenenbaum J. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. Advances in neural information processing systems. 2016; 29."},{"key":"10.3233\/ICA-230710_ref23","doi-asserted-by":"crossref","first-page":"102906","DOI":"10.1016\/j.cad.2020.102906","article-title":"Reconstruction of 3D Microstructures from 2D Images via Transfer Learning","volume":"128","author":"Bostanabad","year":"2020","journal-title":"Computer-Aided Design"},{"key":"10.3233\/ICA-230710_ref24","first-page":"6258","article-title":"Lifting 2d stylegan for 3d-aware face generation","author":"Shi","year":"2021","journal-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition"},{"key":"10.3233\/ICA-230710_ref25","first-page":"497","article-title":"2D GANs Meet Unsupervised Single-View 3D Reconstruction","author":"Liu","journal-title":"Computer Vision\u00a0\u2013 ECCV 2022: 17th European Conference, Proceedings, Part I"},{"key":"10.3233\/ICA-230710_ref26","first-page":"3664","article-title":"Style Agnostic 3D Reconstruction via Adversarial Style Transfer","author":"Petersen","year":"2022","journal-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision"},{"key":"10.3233\/ICA-230710_ref27","doi-asserted-by":"crossref","first-page":"101427","DOI":"10.1016\/j.aei.2021.101427","article-title":"3D CAD model retrieval based on sketch and unsupervised variational autoencoder","volume":"51","author":"Qin","year":"2022","journal-title":"Advanced Engineering Informatics"},{"issue":"2","key":"10.3233\/ICA-230710_ref28","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1109\/TCYB.2017.2780274","article-title":"Improving Metaheuristic Algorithms With Information Feedback Models","volume":"49","author":"Wang","year":"2019","journal-title":"IEEE Transactions on Cybernetics"},{"key":"10.3233\/ICA-230710_ref29","doi-asserted-by":"crossref","unstructured":"Wang Y. Controlled kinetic Monte Carlo simulation for computer-aided nanomanufacturing. Journal of Micro and Nano-Manufacturing. 2016; 4(1).","DOI":"10.1115\/1.4031461"},{"issue":"1","key":"10.3233\/ICA-230710_ref30","doi-asserted-by":"crossref","first-page":"105","DOI":"10.3233\/ICA-210668","article-title":"Stream-based explainable recommendations via blockchain profiling","volume":"29","author":"Leal","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"4","key":"10.3233\/ICA-230710_ref31","doi-asserted-by":"crossref","first-page":"349","DOI":"10.3233\/ICA-210659","article-title":"A three-step model for the detection of stable grasp points with machine learning","volume":"28","author":"Schwan","year":"2021","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"4","key":"10.3233\/ICA-230710_ref32","doi-asserted-by":"crossref","first-page":"335","DOI":"10.3233\/ICA-220683","article-title":"An explainable semi-personalized federated learning model","volume":"29","author":"Demertzis","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"key":"10.3233\/ICA-230710_ref33","doi-asserted-by":"crossref","first-page":"14864","DOI":"10.1038\/s41598-022-19212-6","article-title":"3D convolutional neural network for machining feature recognition with gradient-based visual explanations from 3D CAD models","volume":"12","author":"Lee","year":"2022","journal-title":"Scientific Reports"},{"key":"10.3233\/ICA-230710_ref34","doi-asserted-by":"crossref","first-page":"22147","DOI":"10.1038\/s41598-021-01313-3","article-title":"Machining feature recognition based on deep neural networks to support tight integration with 3D CAD systems","volume":"11","author":"Yeo","year":"2021","journal-title":"Scientific Reports"},{"key":"10.3233\/ICA-230710_ref35","doi-asserted-by":"crossref","first-page":"106996","DOI":"10.1016\/j.compag.2022.106996","article-title":"Iterative offset-based method for reconstructing a mesh model from the point cloud of a pig","volume":"198","author":"Kwon","year":"2022","journal-title":"Computers and Electronics in Agriculture"},{"key":"10.3233\/ICA-230710_ref36","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.advengsoft.2012.08.003","article-title":"A fast algorithm for approximate surface reconstruction from sampled points","volume":"53","author":"Repnik","year":"2012","journal-title":"Advances in Engineering Software"},{"issue":"2","key":"10.3233\/ICA-230710_ref37","doi-asserted-by":"crossref","first-page":"139","DOI":"10.3233\/ICA-190613","article-title":"Routing in congested baggage handling systems using deep reinforcement learning","volume":"27","author":"S\u00f8rensen","year":"2020","journal-title":"Integrated Computer-Aided Engineering"},{"key":"10.3233\/ICA-230710_ref38","doi-asserted-by":"crossref","unstructured":"Wang Y, Hou S, Wang X. Reinforcement Learning-based Bird-view Automated Vehicle Control to Avoid Crossing traffic. Computer-Aided Civil and Infrastructure Engineering. 2021; 37(7).","DOI":"10.1111\/mice.12572"},{"key":"10.3233\/ICA-230710_ref39","doi-asserted-by":"crossref","unstructured":"Chen S, Dong J, Ha PYJ, Li Y, Labi S. Graph Neural Network and Reinforcement Learning for Multiagent Cooperative Control of Connected Autonomous Vehicles. Computer-Aided Civil and Infrastructure Engineering. 2021; 36(7).","DOI":"10.1111\/mice.12702"},{"key":"10.3233\/ICA-230710_ref40","doi-asserted-by":"crossref","unstructured":"Gao T, Li Z, Gao Y, Schonfeld P, Feng X, Wang Q, et\u00a0al. A deep reinforcement learning approach to mountain railway alignment optimization. Computer-Aided Civil and Infrastructure Engineering. 2022; 37(1).","DOI":"10.1111\/mice.12694"},{"key":"10.3233\/ICA-230710_ref41","doi-asserted-by":"crossref","unstructured":"Shi H, Nie Q, Fu S, Wang X, Zhou Y, Ran B. A Distributed Deep Reinforcement Learning Based Integrated Dynamic Bus Control System in a Connected Environment. Computer-Aided Civil and Infrastructure Engineering. 2022; 37(15).","DOI":"10.1111\/mice.12825"},{"key":"10.3233\/ICA-230710_ref42","doi-asserted-by":"crossref","unstructured":"Shi H, Zhou Y, Wang X, Fu S, Gong S, Ran B. A Deep Reinforcement Learning based Distributed Connected Automated Vehicle Control under Communication Failure. Computer-Aided Civil and Infrastructure Engineering. 2022; 37(15).","DOI":"10.1111\/mice.12825"},{"key":"10.3233\/ICA-230710_ref43","doi-asserted-by":"crossref","unstructured":"Chen BW, Yang SH, Kuo CH, Chen JW, Lo YC, Kuo YT, et\u00a0al. Neuro-Inspired Reinforcement Learning to Improve Trajectory Prediction in Reward-Guided Behavior. International Journal of Neural Systems. 2022; 32(9).","DOI":"10.1142\/S0129065722500381"},{"key":"10.3233\/ICA-230710_ref44","first-page":"1","article-title":"Reinforcement learning strategies for vessel navigation","author":"Daranda","year":"2023","journal-title":"Integrated Computer-Aided Engineering"},{"key":"10.3233\/ICA-230710_ref45","doi-asserted-by":"crossref","unstructured":"Li S, Snaiki R, Wu T. A Knowledge-Enhanced Deep Reinforcement Learning-Based Shape Optimizer for Aerodynamic Mitigation of Wind-Sensitive Structures. Computer-Aided Civil and Infrastructure Engineering. 2021; 36(6).","DOI":"10.1111\/mice.12655"},{"key":"10.3233\/ICA-230710_ref46","doi-asserted-by":"crossref","unstructured":"Jeong JH, Jo H. Deep reinforcement learning for automated design of reinforced concrete structures. Computer-Aided Civil and Infrastructure Engineering. 2021; 36(12).","DOI":"10.1111\/mice.12773"},{"key":"10.3233\/ICA-230710_ref47","doi-asserted-by":"crossref","unstructured":"Fan X, Zhang X, Yu X. A Graph Convolution Network-Deep Reinforcement Learning Model for Resilient Water Distribution Network Repair Decisions. Computer-Aided Civil and Infrastructure Engineering. 2022; 37(12).","DOI":"10.1111\/mice.12813"},{"key":"10.3233\/ICA-230710_ref48","doi-asserted-by":"crossref","unstructured":"Kucukoglu B, Rueckauer B, Ahmad N, de\u00a0Ruyter\u00a0van Steveninck J, Guclu U, van Gerven M. Optimization of Neuroprosthetic Vision via End-to-end Deep Reinforcement Learning. International Journal of Neural Systems. 2022; 33(11).","DOI":"10.1142\/S0129065722500526"},{"key":"10.3233\/ICA-230710_ref49","first-page":"1","article-title":"A human-simulated fuzzy membrane approach for the joint controller of walking biped robots","author":"Liu","year":"2023","journal-title":"Integrated Computer-Aided Engineering"},{"key":"10.3233\/ICA-230710_ref50","doi-asserted-by":"crossref","unstructured":"Regli W. Design and Intelligent Machines. Ai Magazine. 2017; 38(3).","DOI":"10.1609\/aimag.v38i3.2727"},{"key":"10.3233\/ICA-230710_ref51","doi-asserted-by":"crossref","unstructured":"Ito S, Ju B, Kaneko N, Sumi K. Viewpoint-independent Single-view 3D Object Reconstruction using Reinforcement Learning. In: VISIGRAPP. 2022.","DOI":"10.5220\/0010825900003124"},{"key":"10.3233\/ICA-230710_ref52","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.ins.2014.02.123","article-title":"Chaotic Krill Herd algorithm","volume":"274","author":"Wang","year":"2014","journal-title":"Information Sciences"},{"key":"10.3233\/ICA-230710_ref53","unstructured":"Wan M, Gangwani T, Peng J. Mutual information based knowledge transfer under state-action dimension mismatch. JMLR: Workshop and Conference Proceedings. 2020; 124."},{"key":"10.3233\/ICA-230710_ref54","unstructured":"Dayan P, Hinton GE. Feudal Reinforcement Learning. In: Hanson S, Cowan J, Giles C, editors. Advances in Neural Information Processing Systems(NIPS). vol.\u00a05. Morgan-Kaufmann; 1992."},{"key":"10.3233\/ICA-230710_ref55","unstructured":"Parr R, Russell S. Reinforcement Learning with Hierarchies of Machines. In: Jordan M, Kearns M, Solla S, editors. Advances in Neural Information Processing Systems(NIPS). vol.\u00a010. MIT Press; 1997."},{"key":"10.3233\/ICA-230710_ref56","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1613\/jair.639","article-title":"Hierarchical reinforcement learning with the MAXQ value function decomposition","volume":"13","author":"Dietterich","year":"2000","journal-title":"Journal of artificial intelligence research"},{"issue":"1\u00e2\u0080\u00932","key":"10.3233\/ICA-230710_ref57","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/S0004-3702(99)00052-1","article-title":"Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning","volume":"112","author":"Sutton","year":"1999","journal-title":"Artificial Intelligence"},{"key":"10.3233\/ICA-230710_ref58","doi-asserted-by":"crossref","unstructured":"Bacon PL, Harb J, Precup D. The option-critic architecture. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol.\u00a031; 2017.","DOI":"10.1609\/aaai.v31i1.10916"},{"key":"10.3233\/ICA-230710_ref59","unstructured":"Kulkarni TD, Narasimhan K, Saeedi A, Tenenbaum J. Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation. In: Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R, editors. Advances in Neural Information Processing Systems(NIPS). vol.\u00a029. Curran Associates, Inc.; 2016."},{"issue":"1","key":"10.3233\/ICA-230710_ref60","doi-asserted-by":"crossref","first-page":"3","DOI":"10.3233\/ICA-210664","article-title":"A self-adaptive multi-objective feature selection approach for classification problems","volume":"29","author":"Xue","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"7","key":"10.3233\/ICA-230710_ref61","doi-asserted-by":"crossref","first-page":"2729","DOI":"10.1109\/TSMC.2018.2827391","article-title":"Avoiding Critical Members in a Team by Redundant Assignment","volume":"50","author":"Zhu","year":"2020","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics: Systems"},{"key":"10.3233\/ICA-230710_ref62","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.jmsy.2021.09.009","article-title":"Deep ensemble learning with non-equivalent costs of fault severities for rolling bearing diagnostics","volume":"61","author":"Yang","year":"2021","journal-title":"Journal of Manufacturing Systems"},{"key":"10.3233\/ICA-230710_ref63","unstructured":"Hinton G, Vinyals O, Dean J, et\u00a0al. Distilling the knowledge in a neural network. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2015."},{"key":"10.3233\/ICA-230710_ref64","unstructured":"Polino A, Pascanu R, Alistarh D. Model compression via distillation and quantization. In: International Conference on Learning Representations(ICLR). 2018."},{"key":"10.3233\/ICA-230710_ref65","doi-asserted-by":"crossref","unstructured":"Hester T, Vecerik M, Pietquin O, Lanctot M, Schaul T, Piot B, et\u00a0al. Deep q-learning from demonstrations. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol.\u00a032; 2018.","DOI":"10.1609\/aaai.v32i1.11757"},{"key":"10.3233\/ICA-230710_ref66","first-page":"11784","article-title":"Representation matters: offline pretraining for sequential decision making","author":"Yang","year":"2021","journal-title":"International Conference on Machine Learning"},{"issue":"8","key":"10.3233\/ICA-230710_ref67","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s40314-022-02085-w","article-title":"A hybrid trapezoidal fuzzy FUCOM-AHP approach and their application to identification of monkeypox risk factors","volume":"41","author":"Garg","year":"2022","journal-title":"Computational and Applied Mathematics"},{"issue":"4","key":"10.3233\/ICA-230710_ref68","doi-asserted-by":"crossref","first-page":"367","DOI":"10.3233\/ICA-220685","article-title":"A hybrid approach for improving the flexibility of production scheduling in flat steel industry","volume":"29","author":"Iannino","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"key":"10.3233\/ICA-230710_ref69","doi-asserted-by":"crossref","unstructured":"Tessler C, Givony S, Zahavy T, Mankowitz D, Mannor S. A deep hierarchical approach to lifelong learning in minecraft. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol.\u00a031; 2017.","DOI":"10.1609\/aaai.v31i1.10744"},{"key":"10.3233\/ICA-230710_ref70","unstructured":"Frans K, Ho J, Chen X, Abbeel P, Schulman J. Meta learning shared hierarchies. In: International Conference on Learning Representations(ICLR). 2017."},{"key":"10.3233\/ICA-230710_ref71","doi-asserted-by":"crossref","unstructured":"Yang T, Hao J, Meng Z, Zhang Z, Hu Y, Cheng Y, et\u00a0al. Efficient deep reinforcement learning via adaptive policy transfer. In: International Joint Conference on Artificial Intelligence (IJCAI). 2020.","DOI":"10.24963\/ijcai.2020\/428"},{"issue":"1","key":"10.3233\/ICA-230710_ref72","doi-asserted-by":"crossref","first-page":"23","DOI":"10.3233\/ICA-210661","article-title":"An improved loop subdivision to coordinate the smoothness and the number of faces via multi-objective optimization","volume":"29","author":"Liang","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"2","key":"10.3233\/ICA-230710_ref73","doi-asserted-by":"crossref","first-page":"141","DOI":"10.3233\/ICA-210672","article-title":"Perceptual metric-guided human image generation","volume":"29","author":"Wu","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"1","key":"10.3233\/ICA-230710_ref74","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1080\/09544828.2016.1258459","article-title":"An automated functional decomposition method based on morphological changes of material flows","volume":"28","author":"Yuan","year":"2017","journal-title":"Journal of Engineering Design"},{"issue":"1","key":"10.3233\/ICA-230710_ref75","doi-asserted-by":"crossref","first-page":"89","DOI":"10.3233\/ICA-220693","article-title":"An enhanced grey wolf optimizer with fusion strategies for identifying the parameters of photovoltaic models","volume":"30","author":"Luo","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"2","key":"10.3233\/ICA-230710_ref76","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1504\/IJBIC.2022.126764","article-title":"A novel whale optimisation algorithm with filtering disturbance and nonlinear step","volume":"20","author":"Luo","year":"2022","journal-title":"International Journal of Bio-Inspired Computation"},{"key":"10.3233\/ICA-230710_ref77","doi-asserted-by":"crossref","unstructured":"Van\u00a0Hasselt H, Guez A, Silver D. Deep reinforcement learning with double q-learning. In: Proceedings of the AAAI conference on artificial intelligence. vol.\u00a030; 2016.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"10.3233\/ICA-230710_ref78","doi-asserted-by":"crossref","unstructured":"Nogay HS, Adeli H. Detection of Epileptic Seizure Using Pre-trained Deep Convolutional Neural Network and Transfer Learning. European Neurology. 2020; 83(6).","DOI":"10.1159\/000512985"},{"issue":"1","key":"10.3233\/ICA-230710_ref79","doi-asserted-by":"crossref","first-page":"83","DOI":"10.3233\/ICA-210667","article-title":"Recognizing human activities in Industry 4.0 scenarios through an analysis-modeling-recognition algorithm and context labels","volume":"29","author":"Bordel","year":"2022","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"4","key":"10.3233\/ICA-230710_ref80","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3450626.3459818","article-title":"Fusion 360 gallery: A dataset and environment for programmatic cad construction from human design sequences","volume":"40","author":"Willis","year":"2021","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"10.3233\/ICA-230710_ref81","doi-asserted-by":"crossref","unstructured":"Taylor ME, Stone P. Transfer learning for reinforcement learning domains: A survey. Journal of Machine Learning Research. 2009; 10(7).","DOI":"10.1007\/978-3-642-01882-4_2"},{"key":"10.3233\/ICA-230710_ref82","unstructured":"Zhu Z, Lin K, Zhou J. Transfer learning in deep reinforcement learning: A survey. arXiv preprint arXiv:200907888. 2020."},{"issue":"2","key":"10.3233\/ICA-230710_ref83","doi-asserted-by":"crossref","first-page":"121","DOI":"10.3233\/ICA-190616","article-title":"A membrane parallel rapidly-exploring random tree algorithm for robotic motion planning","volume":"27","author":"P\u00e9rez-Hurtado","year":"2020","journal-title":"Integrated Computer-Aided Engineering"},{"key":"10.3233\/ICA-230710_ref84","doi-asserted-by":"crossref","unstructured":"Rafiei MH, Adeli H. A New Neural Dynamic Classification Algorithm. IEEE Transactions on Neural Networks and Learning Systems. 2017; 288(12).","DOI":"10.1109\/TNNLS.2017.2682102"},{"key":"10.3233\/ICA-230710_ref85","doi-asserted-by":"crossref","unstructured":"Alam KMR, Siddique N, Adeli H. A Dynamic Ensemble Learning Algorithm for Neural Networks. Neural Computing with Applications. 2020; 32(10).","DOI":"10.1007\/s00521-019-04359-7"},{"key":"10.3233\/ICA-230710_ref86","doi-asserted-by":"crossref","unstructured":"Pereira DR, Piteri MA, Souza AN, Papa J, Adeli H. FEMa: A Finite Element Machine for Fast Learning. IEEE Transactions on Neural Networks and Learning Systems. 2020; 32(10).","DOI":"10.1007\/s00521-019-04146-4"},{"issue":"2","key":"10.3233\/ICA-230710_ref87","doi-asserted-by":"crossref","first-page":"172703","DOI":"10.1007\/s11704-022-1523-9","article-title":"AIDEDNet: Anti-interference and detail enhancement dehazing network for real-world scenes","volume":"17","author":"Zhang","year":"2023","journal-title":"Frontiers of Computer Science"},{"key":"10.3233\/ICA-230710_ref88","doi-asserted-by":"crossref","unstructured":"Si T, He F, Zhang Z, Duan Y. Hybrid contrastive learning for unsupervised person re-identification. IEEE Transactions on Multimedia. 2022.","DOI":"10.1109\/TMM.2022.3174414"},{"key":"10.3233\/ICA-230710_ref89","unstructured":"Chang AX, Funkhouser T, Guibas L, Hanrahan P, Huang Q, Li Z, et\u00a0al. Shapenet: An information-rich 3d model repository. arXiv preprint arXiv:151203012. 2015."},{"key":"10.3233\/ICA-230710_ref90","first-page":"1912","article-title":"3d shapenets: A deep representation for volumetric shapes","author":"Wu","year":"2015","journal-title":"Proceedings of the IEEE conference on computer vision and pattern recognition"}],"container-title":["Integrated Computer-Aided Engineering"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/ICA-230710","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:14:47Z","timestamp":1777454087000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/ICA-230710"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,31]]},"references-count":90,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.3233\/ica-230710","relation":{},"ISSN":["1069-2509","1875-8835"],"issn-type":[{"value":"1069-2509","type":"print"},{"value":"1875-8835","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,31]]}}}