Modeling conversation context by adapting cognitive architectures cognitive model

5 Xulosa va diskussiya

Kognitiv arxitekturalarda tasvirlangan uzoq muddatli va ishlaydigan xotirani dialogni yaratish uchun seq2seq modellarini qanday moslashtirish mumkinligini ko'rsatdik. Biz harakatlarni tanlash mexanizmi jiddiy so'zlarni aniqlay oladi va suhbat kontekstini saqlab qolish uchun mavjud usullardan ustun turadi. Biz uzoq muddatli (deklarativ) xotirada amaliy sabablarga ko'ra, masalan, o'quv vaqti va hisoblash manbalari bo'yicha kamida 8 ta so'z bor, degan soddalashtirilgan taxminni qilamiz. Davom etayotgan yaxshilanishlarda biz o'z modellarimizni ko'proq kontekstni, shu jumladan dunyo bilimlarini (masalan, dunyo bilimlarini) o'z ichiga olgan holda moslashtirmoqdamiz. Vikipediya) va transformator arxitekturalaridan foydalaning (masalan. BERT) (Devlin va boshqalar., 2019).

Foydalanilgan adabiyotlar.
Iuliia Kotseruba and John K Tsotsos. A review of 40 years of cognitive architecture research: Core cognitive abilities and practical applications. arXiv preprint arXiv:1610.08602, 2016.
Ankit Kumar, Ozan Irsoy, Peter Ondruska, Mohit Iyyer, James Bradbury, Ishaan Gulrajani, Victor Zhong, Romain Paulus, and Richard Socher. Ask me anything: Dynamic memory networks for natural language processing. In International Conference on Machine Learning, pp. 1378–1387, 2016.
Pat Langley, John E Laird, and Seth Rogers. Cognitive architectures: Research issues and challenges. Cognitive Systems Research, 10(2):141–160, 2009.
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. A diversity-promoting objective function for neural conversation models. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 110–119. Association for Computational Linguistics, 2016. doi: 10.18653/v1/ N16-1014. URL http://www.aclweb.org/anthology/N16-1014.
Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, and Li Deng. Bbq-networks: Efficient exploration in deep reinforcement learning for task-oriented dialogue systems. In ThirtySecond AAAI Conference on Artificial Intelligence, 2018.
Allen Newell. Unified theories of cognition. Harvard University Press, 1994.
Tong Niu and Mohit Bansal. Polite dialogue generation without parallel data. Transactions of the Association of Computational Linguistics, 6:373–389, 2018.