{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T17:21:03Z","timestamp":1767374463338,"version":"3.41.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2013,12,1]],"date-time":"2013-12-01T00:00:00Z","timestamp":1385856000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001700","name":"Ministry of Education, Culture, Sports, Science, and Technology","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001700","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Speech Lang. Process."],"published-print":{"date-parts":[[2013,12]]},"abstract":"<jats:p>Our aim is to build listening agents that attentively listen to their users and satisfy their desire to speak and have themselves heard. This article investigates how to automatically create a dialogue control component of such a listening agent. We collected a large number of listening-oriented dialogues with their user satisfaction ratings and used them to create a dialogue control component that satisfies users by means of Partially Observable Markov Decision Processes (POMDPs). Using a hybrid dialog controller where high-level dialog acts are chosen with a statistical policy and low-level slot values are populated by a wizard, we evaluated our dialogue control method in a Wizard-of-Oz experiment. The experimental results show that our POMDP-based method achieves significantly higher user satisfaction than other stochastic models, confirming the validity of our approach. This article is the first to verify, by using human users, the usefulness of POMDP-based dialogue control for improving user satisfaction in nontask-oriented dialogue systems.<\/jats:p>","DOI":"10.1145\/2513145","type":"journal-article","created":{"date-parts":[[2014,1,6]],"date-time":"2014-01-06T20:42:39Z","timestamp":1389040959000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Learning to control listening-oriented dialogue using partially observable markov decision processes"],"prefix":"10.1145","volume":"10","author":[{"given":"Toyomi","family":"Meguro","sequence":"first","affiliation":[{"name":"NTT Corporation, Tokyo, Japan"}]},{"given":"Yasuhiro","family":"Minami","sequence":"additional","affiliation":[{"name":"NTT Corporation, Tokyo, Japan"}]},{"given":"Ryuichiro","family":"Higashinaka","sequence":"additional","affiliation":[{"name":"NTT Corporation, Tokyo, Japan"}]},{"given":"Kohji","family":"Dohsaka","sequence":"additional","affiliation":[{"name":"NTT Corporation, Tokyo, Japan"}]}],"member":"320","published-online":{"date-parts":[[2014,1,3]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_1_1_1","DOI":"10.1145\/365024.365304"},{"volume-title":"Proceedings of the NIPS Workshop of Machine Learning for Assistive Techniques. 1--9.","author":"Boularias A.","key":"e_1_2_1_2_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_3_1","DOI":"10.1177\/001316446002000104"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'04)","author":"Cohen W. W.","key":"e_1_2_1_4_1"},{"volume-title":"Proceedings of the Working Notes of the AAAI Fall Symposium on Communicative Action in Humans and Machines.","author":"Core M. G.","key":"e_1_2_1_5_1"},{"volume-title":"Proceedings of the 3rd Conference on AI Planning Systems. 70--77","author":"Ferguson G.","key":"e_1_2_1_6_1"},{"volume-title":"Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU'11)","author":"Ga\u0161i\u0107 M.","key":"e_1_2_1_7_1"},{"volume-title":"Proceedings of the Spoken Language Technology Workshop (SLT'08)","author":"Higashinaka R.","key":"e_1_2_1_8_1"},{"volume-title":"Proceedings of the 2nd International Conference on Spoken Dialogue Systems for Ambient Environments. Springer, 48--60","author":"Higashinaka R.","key":"e_1_2_1_9_1"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'08)","author":"Higuchi S.","key":"e_1_2_1_10_1"},{"volume-title":"Proceedings of the 5th International Conference on Spoken Language Processing (ICSLP'98)","author":"Hirasawa J.","key":"e_1_2_1_11_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.3115\/100964.1138528"},{"key":"e_1_2_1_13_1","first-page":"542","article-title":"Evaluation method of non-task-oriented dialogue system using HMM. IEICE","volume":"4","author":"Isomura N.","year":"2009","journal-title":"Trans. Inf. Syst. J92-D"},{"unstructured":"Ivey A. Ivey M. and Zalaquett C. 2009. Intentional Interviewing and Counseling: Facilitating Client Development in a Multicultural Society. Brooks\/Cole Publishing.  Ivey A. Ivey M. and Zalaquett C. 2009. Intentional Interviewing and Counseling: Facilitating Client Development in a Multicultural Society. Brooks\/Cole Publishing.","key":"e_1_2_1_14_1"},{"unstructured":"Ivey A. E. and Ivey M. B. 2002. Intentional Interviewing and Counseling: Facilitating Client Development in a Multicultural Society. Brooks\/Cole Publishing.  Ivey A. E. and Ivey M. B. 2002. Intentional Interviewing and Counseling: Facilitating Client Development in a Multicultural Society. Brooks\/Cole Publishing.","key":"e_1_2_1_15_1"},{"unstructured":"Jurafsky D. Shriberg L. and Biasca D. 1997. Switchboard SWBD-DAMSL shallow-discourse-function annotation coders manual. Tech. rep. 97-01 University of Colorado Institute of Cognitive Science.  Jurafsky D. Shriberg L. and Biasca D. 1997. Switchboard SWBD-DAMSL shallow-discourse-function annotation coders manual. Tech. rep. 97-01 University of Colorado Institute of Cognitive Science.","key":"e_1_2_1_16_1"},{"volume-title":"Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. 63--70","author":"Kang S.","key":"e_1_2_1_17_1"},{"volume-title":"Proceedings of the 5th ACM\/IEEE International Conference on Human-Robot Interaction (HRI'10)","author":"Kobayashi Y.","key":"e_1_2_1_18_1"},{"volume":"1","volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing.","author":"Lee A.","key":"e_1_2_1_19_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_20_1","DOI":"10.1007\/11550617_3"},{"volume-title":"Proceedings of the 12th National Conference on Artificial Intelligence (AAAI'94)","year":"1994","author":"Mauldin M. L.","key":"e_1_2_1_21_1"},{"volume-title":"Proceedings of the 10th Annual SIGDIAL Meeting on Discourse and Dialogue (SIGDIAL'09)","author":"Meguro T.","key":"e_1_2_1_22_1"},{"volume-title":"Proceedings of the 23rd International Conference on Computational Linguistics (COLING'10)","author":"Meguro T.","key":"e_1_2_1_23_1"},{"volume-title":"Proceedings of the 12th Annual Conference of the International Speech Communication Association (Interspeech'11)","author":"Meguro T.","key":"e_1_2_1_24_1"},{"volume-title":"Proceedings of the 1st International Workshop on Spoken Dialogue Systems Technology (IWSDS'09)","author":"Minami Y.","key":"e_1_2_1_25_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_26_1","DOI":"10.1145\/1322192.1322257"},{"doi-asserted-by":"publisher","key":"e_1_2_1_27_1","DOI":"10.3115\/1034678.1034715"},{"volume-title":"Proceedings of the 7th International Conference on Machine Learning (ICML'00)","author":"Ng A. Y.","key":"e_1_2_1_28_1"},{"volume-title":"Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJSAI'03)","author":"Pineau J.","key":"e_1_2_1_29_1"},{"volume-title":"Proceedings of the 12th Annual SIGDIAL Meeting on Discourse and Dialogue (SIGDIAL'11)","author":"Schmitt A.","key":"e_1_2_1_30_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_31_1","DOI":"10.1109\/ICSLP.1996.607073"},{"key":"e_1_2_1_32_1","first-page":"61","article-title":"Active listening system for dialogue robot. Tech. rep","volume":"58","author":"Shitaoka K.","year":"2010","journal-title":"SIG-SLUD"},{"doi-asserted-by":"publisher","key":"e_1_2_1_33_1","DOI":"10.1162\/089120100561737"},{"volume-title":"Proceedings of the 13th Annual Conference of the International Speech Communication Association.","author":"Sugiyama H.","key":"e_1_2_1_34_1"},{"volume-title":"Proceedings of the 9th International Conference on Spoken Language Processing (ICSLP'06). 1950","year":"1953","author":"Surendran D.","key":"e_1_2_1_35_1"},{"volume-title":"Proceedings of the 7th International Conference on Spoken Language Processing (ICSLP'02)","author":"Walker M.","key":"e_1_2_1_36_1"},{"unstructured":"Wallace R. S. 2004. The Anatomy of A.L.I.C.E. Artificial Intelligence Foundation Inc. http:\/\/www.alicebot. org\/anatomy.html.  Wallace R. S. 2004. The Anatomy of A.L.I.C.E. Artificial Intelligence Foundation Inc. http:\/\/www.alicebot. org\/anatomy.html.","key":"e_1_2_1_37_1"},{"key":"e_1_2_1_38_1","first-page":"145","article-title":"Artificial companions. Interdisciplinary Sci","volume":"30","author":"Wilks Y.","year":"2005","journal-title":"Rev."},{"doi-asserted-by":"publisher","key":"e_1_2_1_39_1","DOI":"10.1016\/j.csl.2006.06.008"},{"unstructured":"Yokoyama S. Yamamoto D. Kobayashi Y. and Doi M. 2010. Development of dialogue interface for elderly people\u2014Switching the topic presenting mode and the attentive listening mode to keep chatting. Tech. rep. IPSJ SIG vol. 2010-SLP-80 1--6 (in Japanese).  Yokoyama S. Yamamoto D. Kobayashi Y. and Doi M. 2010. Development of dialogue interface for elderly people\u2014Switching the topic presenting mode and the attentive listening mode to keep chatting. Tech. rep. IPSJ SIG vol. 2010-SLP-80 1--6 (in Japanese).","key":"e_1_2_1_40_1"}],"container-title":["ACM Transactions on Speech and Language Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2513145","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2513145","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:34:25Z","timestamp":1750232065000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2513145"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,12]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2013,12]]}},"alternative-id":["10.1145\/2513145"],"URL":"https:\/\/doi.org\/10.1145\/2513145","relation":{},"ISSN":["1550-4875","1550-4883"],"issn-type":[{"type":"print","value":"1550-4875"},{"type":"electronic","value":"1550-4883"}],"subject":[],"published":{"date-parts":[[2013,12]]},"assertion":[{"value":"2012-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-01-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}