Research on the Evaluation Method of Interactive Cognitive Load of Intelligent Products for Dynamic Scenarios

doi:10.3901/JME.2023.11.106

Abstract

Abstract: In order to reduce the problems of inefficient human-computer interaction and poor user experience caused by cognitive load overload in dynamic scenarios, a user cognitive load experience matching model for multi-task interaction of intelligent products is constructed to evaluate the relationship between cognitive load, interaction tasks and user experience in dynamic scenarios. Considering the dynamic impact of scene changes on user needs, the model first combines questionnaire analysis to understand the tasks that users interact with high frequency, high attention span and long time, and combines the out-of-sound thinking method to sort out the user experience map in different scenarios to realize the visual mapping of tasks to experience and pain points in each scenario, and then analyses the cognitive load quantification index of each interaction task in different scenarios through Subjective Workload Assessment Technique (SWAT) The user experience is then matched with the cognitive load indicators to filter out the tasks and scenarios where the user experience is poor due to cognitive load overload. The cognitive load theory is used to optimize the interaction design and propose solutions for dynamic scenarios. The fuzzy KANO model is used to analyze the satisfaction of functional requirements in dynamic scenarios and to determine the hierarchy of functional requirements priority. Using a smart cycling product as an object, the functional shape and interaction interface of the product are designed and tested to verify the usability and validity of the above method and provide a reference for the development of intelligent product interaction design in dynamic scenarios.

Key words: interaction design, cognitive load, intelligent products, dynamic scenarios, evaluation methods

CLC Number:

TB472

WANG Weiwei, WEI Ting, YU Suihuai, CHEN Jian. Research on the Evaluation Method of Interactive Cognitive Load of Intelligent Products for Dynamic Scenarios[J]. Journal of Mechanical Engineering, 2023, 59(11): 106-116.

References

[1] 徐江，王修越，王奕，等. 基于语义链接的设计认知多维建模方法[J]. 机械工程学报，2017，53(15):32-39. XU Jiang，WANG Xiuyue，WANG Yi，et al. The multidimensional modeling method of design cognition based on semantic link[J]. Journal of Mechanical Engineering，2017，53(15):32-39.
[2] 罗仕鉴，李文杰，傅业焘. 消费者偏好驱动的SUV产品族侧面外形基因设计[J]. 机械工程学报，2016，52(2):173-181. LUO Shijian，LI Wenjie，FU Yetao. Consumer preference-driven SUV product family profile gene design[J]. Journal of Mechanical Engineering，2016，52(2):173-181.
[3] 梁永强，王崴，瞿珏. 人机交互领域脑力负荷研究进展[J]. 航天医学与医学工程，2018，31(04):483-488. LIANG Yongqiang，WANG Wei，QU Jue. Review of mental workload researches in human-computer interaction domain[J]. Space Medicine & Medical Engineering，2018，31(04):483-488.
[4] WEL P，STEENBERGEN H. Pupil dilation as an index of effort in cognitive control tasks:A review[J]. Psychonomic Bulletin & Review，2018，25(6):2005-2015.
[5] 谭浩，赵颖. 智能汽车的车内周边交互体验研究[J]. 包装工程，2018，39(16):1-4. TAN Hao，ZHAO Ying. Peripheral interactive experience in intelligent vehicle[J]. Packaging Engineering， 2018，39(16):1-4.
[6] 孙崇勇，刘丽丽，高春阳. 翻转教学法对高中生认知负荷及学习成绩的影响[J]. 心理与行为研究，2020，18(3):369-375. SUN Chongyong，LIU Lili，GAO Chunyang. Effects of flipped teaching method on cognitive load and academic achievement of senior high school students[J]. Studies of Psychology and Behavior，2020，18(3):369-375.
[7] 李金波. 人机交互中任务特征和个体特征对认知负荷的综合影响[J]. 心理科学，2010，33(4):972-975. LI Jinbo. The synthetic effect of task characteristics and individual characteristics on cognitive load in the human-machine interaction process[J]. Psychological Science，2010，33(4):972-975.
[8] KIRSCHNER P，SWELLER J，KIRSCHNER F，et al. From cognitive load theory to collaborative cognitive load theory[J]. International Journal of Computer-Supported Collaborative Learning，2018，13:213-233.
[9] SPARROW L， SIX H， VARONA L，et al. Validation of affect-tag affective and cognitive indicators [J]. Frontiers in Neuroinformatics，2021， 15:1-10.
[10] NA K. The effects of cognitive load on query reformulation:mental demand，temporal demand and frustration[J]. Aslib Journal of Information Management，2021，73(3):436-453.
[11] FIGUEROA A，JUAREZ-RAMIREZ R. The Problem of cognitive load in GUI’s:Towards establishing the relationship between cognitive load and our executive functions[C]//2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC)，July 4-8，2017，Torino，Italy. IEEE，2017.
[12] 吴晓莉，薛澄岐，王海燕，等. 复杂系统人机交互界面的E-C映射模型[J]. 机械工程学报，2014，50(12):206-212. WU Xiaoli，XUE Chengqi，WANG Haiyan，et al. E-C mapping model based on human computer interaction interface of complex system [J]. Journal of Mechanical Engineering，2014，50(12):206-212.
[13] 马超民，赵丹华，辛灏. 基于用户体验的智能装备人机交互界面设计[J]. 计算机集成制造系统，2020，26(10):2650-2660. MA Chaomin，ZHAO Danhua，XIN Hao. Human-machine interaction interface design of intelligent equipment based on user experience[J]. Computer Integrated Manufacturing Systems，2020，26(10):2650-2660.
[14] KHAWAJA M，CHEN F，MARCUS N. Measuring cognitive load using linguistic features: Implications for usability evaluation and adaptive interaction design[J]. International Journal of Human Computer Interaction， 2014，30(4-6):343-368.
[15] 贺孝梅，李剑钰. 人机交互中认知负荷的成因分析与设计策略研究[J]. 包装工程，2020，41(10):24-30. HE Xiaomei，LI Jianyu. Cause analysis and design strategies of cognitive load in human-computer interaction[J]. Packaging Engineering， 2020，41(10):24-30.
[16] 程时伟，刘肖健，孙守迁. 情境感知驱动的移动设备自适应用户界面模型[J]. 中国图象图形学报，2010，15(7):993-1000. CHENG Shiwei，LIU Xiaojian，SUN Shouqian. Context awareness driven adaptive mobile user interface model[J]. Journal of Image and Graphics，2010，15(7):993-1000.
[17] 赵颖，谭浩，朱敏，等. 智能音箱主动交互行为的用户满意度研究[J]. 包装工程，2021，42(14):224-229. ZHAO Ying，TAN Hao，ZHU Min，et al. User satisfaction of proactive interaction behavior of intelligent speakers[J]. Packaging Engineering，2021，42(14):224-229.
[18] 肖元梅，王治明，王绵珍，等. 主观负荷评估技术和NASA任务负荷指数量表的信度与效度评价[J]. 中华劳动卫生职业病杂志，2005(3):178-181. XIAO Yuanmei，WANG Zhiming，WANG Mianzhen，et al. The appraisal of reliability and validity of subjective workload assessment technique and NASA-task load index[J]. Chinese Journal of Industrial Hygiene and Occupational Diseases，2005(3):178-181.
[20] 唐伟财，陈善广，肖毅，等. 机械臂遥操作任务过程脑力负荷研究[J]. 载人航天，2017，23(5):688-696. TANG Weicai，CHEN Shanguang，XIAO Yi，et al. Study on mental workload in manipulator teleoperation mission[J]. Manned Spaceflight，2017，23(5):688-696.
[21] 孙崇勇，刘电芝. 认知负荷主观评价量表比较[J]. 心理科学，2013，36(1):194-201. SUN Chongyong，LIU Dianzhi. A comparison of several subjective rating scales of cognitive load[J]. Journal of Psychological Science，2013，36(1):194-201.
[22] 陈香，邱大鹏. 基于模糊Kano模型与TOPSIS法的产品设计研究[J]. 图学学报，2019，40(2):315-320. CHEN Xiang，QIU Dapeng. Research of product design based on Fuzzy-Kano model and TOPSIS[J]. Journal of Graphics，2019，40(2):315-320.
[23] 王崇梁，曹锦丹，邹男男. 信息用户认知需求与认知负荷相关性的理论探析[J]. 情报科学，2019，37(3):141-145. WANG Chongliang，CAO Jindan，ZOU Nannan. The theoretical analysis of the correlationship between cognition need and cognitive load of information users [J]. Information Science，2019，37(3):141-145.
[24] 张引，梁腾飞，陈江涛，等. 连接视觉长时记忆与视觉工作记忆的认知及其神经机制[J]. 生理学报，2019，71(1):62-72. ZHANG Yin，LIANG Tengfei，CHEN Jiangtao，et al. The underlying mechanism for the connection between visual long-term memory and visual working memory[J]. Acta Physiologica Sinica，2019，71(1):62-72.
[25] 刘伟，袁修干. 人机交互中情境认知的理论与应用[M]. 北京:中国科学技术出版社，2005. LIU Wei，YUAN Xiuqian. The theory and application of situational cognition in human-computer interaction[M]. Beijing:China Science and Technology Press，2005.
[26] 韦伟，吴春茂. 用户体验地图、顾客旅程地图与服务蓝图比较研究[J]. 包装工程，2019，40(14):217-223. WEI Wei，WU Chunmao. A comparative study of user experience maps，customer journey maps and service blueprints[J]. Packaging Engineering， 2019，40(14):217-223.
[27] 晋良海，李宬. 高处作业人员心理负荷的SWAT量表主观评定方法研究[J]. 安全与环境工程，2015，22(3):70-74，82. JIN Lianghai，LI Cheng. Study on the mental workload of high-place operating personnel with the subjective assessment method of SWAT scale[J]. Computer Engineering and Design，2015，22(3):70-74，82.
[28] 姬文渊，吕健，刘翔，等. 基于认知规律的用户界面信息布局设计方法[J]. 计算机工程与设计，2020，41(5):1358-1366. JI Wenyuan，LÜ Jian，LIU Xiang，et al. Design method of interface task information layout based on cognitive law[J]. Computer Engineering and Design， 2020，41(5):1358-1366.
[29] 汪海波，薛澄岐，黄剑伟，等. 基于认知负荷的人机交互数字界面设计和评价[J]. 电子机械工程，2013，29(5):57-60. WANG Haibo，XUE Chengqi，HUANG Jianwei，et al. Design and evaluation of human-computer digital interface based on cognitive load[J]. Electro-Mechanical Engineering，2013，29(5):57-60.