{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T18:08:10Z","timestamp":1777486090063,"version":"3.51.4"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"5s","license":[{"start":{"date-parts":[[2017,9,27]],"date-time":"2017-09-27T00:00:00Z","timestamp":1506470400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ERC Synergy Award \u201cIMPACT\u201d"},{"DOI":"10.13039\/501100004405","name":"Toyota","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004405","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2017,10,31]]},"abstract":"<jats:p>\n            Many problems in the design and analysis of cyber-physical systems (CPS) reduce to the following optimization problem: given a CPS which transforms continuous-time input traces in R\n            <jats:sub>\n              <jats:italic>m<\/jats:italic>\n            <\/jats:sub>\n            to continuous-time output traces in R\n            <jats:sub>n<\/jats:sub>\n            and a cost function over output traces, find an input trace which minimizes the cost. Cyber-physical systems are typically so complex that solving the optimization problem analytically by examining the system dynamics is not feasible. We consider a black-box approach, where the optimization is performed by testing the input-output behaviour of the CPS.\n          <\/jats:p>\n          <jats:p>We provide a unified, tool-supported methodology for CPS testing and optimization. Our tool is the first CPS testing tool that supports Bayesian optimization. It is also the first to employ fully automated dimensionality reduction techniques. We demonstrate the potential of our tool by running experiments on multiple industrial case studies. We compare the effectiveness of Bayesian optimization to state-of-the-art testing techniques based on CMA-ES and Simulated Annealing.<\/jats:p>","DOI":"10.1145\/3126521","type":"journal-article","created":{"date-parts":[[2017,9,27]],"date-time":"2017-09-27T12:33:53Z","timestamp":1506515633000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":54,"title":["Testing Cyber-Physical Systems through Bayesian Optimization"],"prefix":"10.1145","volume":"16","author":[{"given":"Jyotirmoy","family":"Deshmukh","sequence":"first","affiliation":[{"name":"Toyota Technical Center"}]},{"given":"Marko","family":"Horvat","sequence":"additional","affiliation":[{"name":"MPI-SWS, Kaiserslautern, Germany"}]},{"given":"Xiaoqing","family":"Jin","sequence":"additional","affiliation":[{"name":"Toyota Technical Center"}]},{"given":"Rupak","family":"Majumdar","sequence":"additional","affiliation":[{"name":"MPI-SWS, Kaiserslautern, Germany"}]},{"given":"Vinayak S.","family":"Prabhu","sequence":"additional","affiliation":[{"name":"MPI-SWS, Kaiserslautern, Germany"}]}],"member":"320","published-online":{"date-parts":[[2017,9,27]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"2012 50th Annual Allerton Conference on. IEEE, 1594--1601","author":"Abbas H."},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"T. Akazaki. 2016. Falsification of Conditional Safety Properties for Cyber-Physical Systems with Gaussian Process Regression. 439--446.  T. Akazaki. 2016. Falsification of Conditional Safety Properties for Cyber-Physical Systems with Gaussian Process Regression. 439--446.","DOI":"10.1007\/978-3-319-46982-9_27"},{"key":"e_1_2_1_3_1","volume-title":"Principles of Cyber-Physical Systems","author":"Alur R."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/227595.227602"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Y. Annpureddy C. Liu G. E. Fainekos and S. Sankaranarayanan. 2011. S-TaLiRo: A tool for temporal logic falsification for hybrid systems. In TACAS 11 (Lecture Notes in Computer Science) Vol. 6605. Springer 254--257.   Y. Annpureddy C. Liu G. E. Fainekos and S. Sankaranarayanan. 2011. S-TaLiRo: A tool for temporal logic falsification for hybrid systems. In TACAS 11 (Lecture Notes in Computer Science) Vol. 6605. Springer 254--257.","DOI":"10.1007\/978-3-642-19835-9_21"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"S. Bansal R. Calandra T. Xiao S. Levine and C. Tomlin. 2017. Goal-driven dynamics learning via Bayesian optimization. CoRR abs\/1703.09260 (2017).  S. Bansal R. Calandra T. Xiao S. Levine and C. Tomlin. 2017. Goal-driven dynamics learning via Bayesian optimization. CoRR abs\/1703.09260 (2017).","DOI":"10.1109\/CDC.2017.8264425"},{"key":"e_1_2_1_8_1","volume-title":"A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. CoRR abs\/1012.2599","author":"Brochu E.","year":"2010"},{"key":"e_1_2_1_9_1","volume-title":"Convergence rates of efficient global optimization algorithms. J. Mach. Learn. Res. 12 (Nov","author":"Bull A. D.","year":"2011"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"J. Deshmukh X. Jin J. Kapinski and O. Maler. 2015. Stochastic local search for falsification of hybrid systems. In ATVA. Springer 500--517.  J. Deshmukh X. Jin J. Kapinski and O. Maler. 2015. Stochastic local search for falsification of hybrid systems. In ATVA. Springer 500--517.","DOI":"10.1007\/978-3-319-24953-7_35"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14295-6_17"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"A. Donz\u00e9 and O. Maler. 2010. Robust Satisfaction of Temporal Logic over Real-Valued Signals. Springer 92--106.   A. Donz\u00e9 and O. Maler. 2010. Robust Satisfaction of Temporal Logic over Real-Valued Signals. Springer 92--106.","DOI":"10.1007\/978-3-642-15297-9_9"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"T. Dreossi T. Dang A. Donz\u00e9 J. Kapinski X. Jin and J. V. Deshmukh. 2015. Efficient Guiding Strategies for Testing of Temporal Properties of Hybrid Systems. Springer International Publishing 127--142.  T. Dreossi T. Dang A. Donz\u00e9 J. Kapinski X. Jin and J. V. Deshmukh. 2015. Efficient Guiding Strategies for Testing of Temporal Properties of Hybrid Systems. Springer International Publishing 127--142.","DOI":"10.1007\/978-3-319-17524-9_10"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0965-9978(97)00025-2"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACC.2015.7171969"},{"key":"e_1_2_1_16_1","volume-title":"Regret Bounds for Gaussian Process Bandit Problems. In AISTATS","author":"Gr\u00fcnew\u00e4lder S.","year":"2010"},{"key":"e_1_2_1_17_1","volume-title":"The CMA Evolution Strategy: A tutorial. CoRR abs\/1604.00772","author":"Hansen N.","year":"2016"},{"key":"e_1_2_1_18_1","first-page":"1","article-title":"Rate-based model predictive controller for diesel engine air path: Design and experimental evaluation","volume":"99","author":"Huang M.","year":"2016","journal-title":"IEEE Trans. on Control Systems Technology"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2562059.2562140"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1090\/conm\/026\/737400"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/3182688.3183134"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by simulated annealing. Science 220 4598 (1983) 671--680.  S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by simulated annealing. Science 220 4598 (1983) 671--680.","DOI":"10.1126\/science.220.4598.671"},{"key":"e_1_2_1_23_1","unstructured":"D. Lizotte T. Wang M. Bowling and D. Schuurmans. 2007. Automatic gait optimization with Gaussian process regression. In IJCAI 07. 944--949.   D. Lizotte T. Wang M. Bowling and D. Schuurmans. 2007. Automatic gait optimization with Gaussian process regression. In IJCAI 07. 944--949."},{"key":"e_1_2_1_24_1","volume-title":"Lawrence and M. A. Girolami (Eds.)","volume":"22","author":"Mahendran N."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10009-012-0247-9"},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"A. Marco P. Hennig J. Bohg S. Schaal and S. Trimpe. 2016. Automatic LQR tuning based on Gaussian process global optimization. In ICRA 16. 270--277.  A. Marco P. Hennig J. Bohg S. Schaal and S. Trimpe. 2016. Automatic LQR tuning based on Gaussian process global optimization. In ICRA 16. 270--277.","DOI":"10.1109\/ICRA.2016.7487144"},{"key":"e_1_2_1_27_1","unstructured":"Mathworks. 2017. Simulink\u2014Simulation and model-based design. https:\/\/www.mathworks.com\/products\/simulink.html.  Mathworks. 2017. Simulink\u2014Simulation and model-based design. https:\/\/www.mathworks.com\/products\/simulink.html."},{"key":"e_1_2_1_28_1","unstructured":"W. Messner and D. Tilbury. 2017. Control tutorials for MATLAB and Simulink. http:\/\/ctms.engin.umich.edu\/CTMS\/index.php?aux&equals;Basics_Simulink% #27.  W. Messner and D. Tilbury. 2017. Control tutorials for MATLAB and Simulink. http:\/\/ctms.engin.umich.edu\/CTMS\/index.php?aux&equals;Basics_Simulink% #27."},{"key":"e_1_2_1_30_1","volume-title":"Gaussian processes for machine learning","author":"Rasmussen C. E."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185632.2185653"},{"key":"e_1_2_1_32_1","volume-title":"Verification and Control of Hybrid Systems - A Symbolic Approach","author":"Tabuada P."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3013558.3013569"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3055004.3055017"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3126521","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3126521","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:01Z","timestamp":1750273501000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3126521"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,27]]},"references-count":32,"journal-issue":{"issue":"5s","published-print":{"date-parts":[[2017,10,31]]}},"alternative-id":["10.1145\/3126521"],"URL":"https:\/\/doi.org\/10.1145\/3126521","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,27]]},"assertion":[{"value":"2017-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}