![\"Loading..\"](\"//bibbase.org/img/ajax-loader.gif\")
\n\n\n generated by\n \n ![\"bibbase.org\"\n](\"//bibbase.org/img/logo.svg\"\n "\\"BibBase")
\n \n
\n \n\n \n \n \n\n
\n\n\n - \n\n
- \n \n Group by\n \n \n
- \n
- \n Year\n \n
- \n Author\n \n
- \n Type\n \n
- \n Keyword\n \n
- \n Downloads\n \n
\n\n\n - \n \n \n \n \n
- \n
- \n \n Expand/Collapse All\n \n \n
- \n \n Download BibTeX\n \n \n
- \n \n RSS Feed\n \n \n
\n\n \n\n\n \n
\n\n Excellent! Next you can\n create a new website with this list, or\n embed it in an existing web page by copying & pasting\n any of the following snippets.\n\n
\n\n \n JavaScript\n (easiest)\n
\n \n
\n\n PHP\n \n <script src=\"https://bibbase.org/show?bib=https%3A%2F%2Fbibbase.org%2Fzotero-mypublications%2Fyywangvr&jsonp=1&jsonp=1\"></script>\n \n \n
\n\n iFrame\n (not recommended)\n \n <?php\n $contents = file_get_contents(\"https://bibbase.org/show?bib=https%3A%2F%2Fbibbase.org%2Fzotero-mypublications%2Fyywangvr&jsonp=1\");\n print_r($contents);\n ?>\n \n \n
\n\n \n <iframe src=\"https://bibbase.org/show?bib=https%3A%2F%2Fbibbase.org%2Fzotero-mypublications%2Fyywangvr&jsonp=1\"></iframe>\n \n \n For more details see the documention.\n
\n\n\n This is a preview! To use this list on your own web site\n or create a new web site from it,\n create a free account. The file will be added\n and you will be able to edit it in the File Manager.\n We will show you instructions once you've created your account.\n
\n\n \n\n
\n\n To the site owner:
\n\nAction required! Mendeley is changing its\n API. In order to keep using Mendeley with BibBase past April\n 14th, you need to:\n
- \n
- renew the authorization for BibBase on Mendeley, and \n
- update the BibBase URL\n in your page the same way you did when you initially set up\n this page.\n \n
\n \n \n Fix it now\n
\n\n \n \n
\n\n\n \n\n \n \n \n \n\n\n
\n\n \n \n 2026\n \n \n (7)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis.\n \n \n \n \n\n\n \n Zhu, Y.; Jiang, Y.; Jiang, G.; Hou, B.; Zhou, P. Y.; Kan, G. L.; and Wang, Y.\n\n\n \n\n\n\n April 2026.\n arXiv:2604.05704 [cs.AI]\n\n\n\n
\n\n\n\n \n \n![\"QA-MoE:](\"//bibbase.org/img/filetypes/link.svg\"\n\t "\\"Paper\\"\n")
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@misc{zhu_qa-moe:_2026,\n\ttitle = {{QA}-{MoE}: {Towards} a {Continuous} {Reliability} {Spectrum} with {Quality}-{Aware} {Mixture} of {Experts} for {Robust} {Multimodal} {Sentiment} {Analysis}},\n\tshorttitle = {{QA}-{MoE}},\n\turl = {http://arxiv.org/abs/2604.05704},\n\tdoi = {10.48550/arXiv.2604.05704},\n\tabstract = {Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, multimodal inputs are often compromised by dynamic noise or modality missingness. Existing methods typically treat these imperfections as discrete cases or assume fixed corruption ratios, which limits their adaptability to continuously varying reliability conditions. To address this, we first introduce a Continuous Reliability Spectrum to unify missingness and quality degradation into a single framework. Building on this, we propose QA-MoE, a Quality-Aware Mixture-of-Experts framework that quantifies modality reliability via self-supervised aleatoric uncertainty. This mechanism explicitly guides expert routing, enabling the model to suppress error propagation from unreliable signals while preserving task-relevant information. Extensive experiments indicate that QA-MoE achieves competitive or state-of-the-art performance across diverse degradation scenarios and exhibits a promising One-Checkpoint-for-All property in practice.},\n\turldate = {2026-06-09},\n\tpublisher = {arXiv},\n\tauthor = {Zhu, Yitong and Jiang, Yuxuan and Jiang, Guanxuan and Hou, Bojing and Zhou, Peng Yuan and Kan, Ge Lin and Wang, Yuyang},\n\tmonth = apr,\n\tyear = {2026},\n\tnote = {arXiv:2604.05704 [cs.AI]},\n}\n\n\n\n\n\n Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, multimodal inputs are often compromised by dynamic noise or modality missingness. Existing methods typically treat these imperfections as discrete cases or assume fixed corruption ratios, which limits their adaptability to continuously varying reliability conditions. To address this, we first introduce a Continuous Reliability Spectrum to unify missingness and quality degradation into a single framework. Building on this, we propose QA-MoE, a Quality-Aware Mixture-of-Experts framework that quantifies modality reliability via self-supervised aleatoric uncertainty. This mechanism explicitly guides expert routing, enabling the model to suppress error propagation from unreliable signals while preserving task-relevant information. Extensive experiments indicate that QA-MoE achieves competitive or state-of-the-art performance across diverse degradation scenarios and exhibits a promising One-Checkpoint-for-All property in practice.\n
\n\n\n\n \n\n \n \n \n \n \n \n Virtual Reality.\n \n \n \n \n\n\n \n Wang, Y.; and Chardonnet, J.\n\n\n \n\n\n\n In Hui, P.; Zhou, P. Y.; Lee, L.; and Braud, T., editor(s), Handbook of the Metaverse, pages 55–102. Springer Nature Switzerland, Cham, 2026.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n\n@incollection{hui_virtual_2026,\n\taddress = {Cham},\n\ttitle = {Virtual {Reality}},\n\tisbn = {978-3-032-03295-9 978-3-032-03296-6},\n\turl = {https://link.springer.com/10.1007/978-3-032-03296-6_2},\n\tdoi = {10.1007/978-3-032-03296-6_2},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {Handbook of the {Metaverse}},\n\tpublisher = {Springer Nature Switzerland},\n\tauthor = {Wang, Yuyang and Chardonnet, Jean-Rémy},\n\teditor = {Hui, Pan and Zhou, Peng Yuan and Lee, Lik-Hang and Braud, Tristan},\n\tyear = {2026},\n\tpages = {55--102},\n}\n\n\n\n\n\n \n\n \n \n \n \n \n \n GuideMe: A VLM-Based System Assisting Independent Smartphone Learning for Older Adults.\n \n \n \n \n\n\n \n Fang, K.; Zhang, J.; Ni, S.; Hui, P.; and Wang, Y.\n\n\n \n\n\n\n In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, pages 1–19, Barcelona Spain, April 2026. ACM\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n\n@inproceedings{fang_guideme:_2026,\n\taddress = {Barcelona Spain},\n\ttitle = {{GuideMe}: {A} {VLM}-{Based} {System} {Assisting} {Independent} {Smartphone} {Learning} for {Older} {Adults}},\n\tisbn = {979-8-4007-2278-3},\n\tshorttitle = {{GuideMe}},\n\turl = {https://dl.acm.org/doi/10.1145/3772318.3791448},\n\tdoi = {10.1145/3772318.3791448},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {Proceedings of the 2026 {CHI} {Conference} on {Human} {Factors} in {Computing} {Systems}},\n\tpublisher = {ACM},\n\tauthor = {Fang, Kairong and Zhang, Jiesi and Ni, Shi-Ting and Hui, Pan and Wang, Yuyang},\n\tmonth = apr,\n\tyear = {2026},\n\tpages = {1--19},\n}\n\n\n\n\n\n \n\n \n \n \n \n \n \n Aligning Gamification with Learner Motivation: Insights from VR-Based Learning Tasks.\n \n \n \n \n\n\n \n Bai, Y.; Wang, Y.; Hui, P.; and Wang, Y.\n\n\n \n\n\n\n IEEE Transactions on Visualization and Computer Graphics, 32(5): 3411–3421. May 2026.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{bai_aligning_2026,\n\ttitle = {Aligning {Gamification} with {Learner} {Motivation}: {Insights} from {VR}-{Based} {Learning} {Tasks}},\n\tvolume = {32},\n\tcopyright = {https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html},\n\tissn = {1077-2626, 1941-0506, 2160-9306},\n\tshorttitle = {Aligning {Gamification} with {Learner} {Motivation}},\n\turl = {https://ieeexplore.ieee.org/document/11479635/},\n\tdoi = {10.1109/TVCG.2026.3680716},\n\tabstract = {Virtual reality is increasingly adopted in education for its potential to create immersive, interactive learning experiences. Among various instructional approaches, gamification has emerged as a promising strategy to enhance learner engagement and motivation. While VR naturally provides a platform for game-based learning, current applications often overlook the underlying motivational mechanisms that influence learner behavior in these e nvironments. Building on Self-Determination Theory, we examined how gamification and motivational framing influence VR le arning. We designed a VR system featuring both gamified and non-gamified versions of two learning tasks—one culturally expressive (batik-based task) and one technically focused (code-based task)—to reflect different motivational framings. Our findings show that gamification selectively influenced intrinsic motivation components and played a dominant role in shaping learner satisfaction. A trend-level interaction suggested that combining extrinsic framing with gamification may increase satisfaction. Gamification improved overall experience and engagement, even though it elevated perceived workload. These results highlight the importance of aligning gamification strategies with learner motivation and underscore the need for more dynamic approaches to capture motivational processes in VR, offering design insights for more effective and psychologically attuned VR learning environments.},\n\tlanguage = {en},\n\tnumber = {5},\n\turldate = {2026-06-09},\n\tjournal = {IEEE Transactions on Visualization and Computer Graphics},\n\tauthor = {Bai, Yuxuan and Wang, Yuzhu and Hui, Pan and Wang, Yuyang},\n\tmonth = may,\n\tyear = {2026},\n\tpages = {3411--3421},\n}\n\n\n\n\n\n Virtual reality is increasingly adopted in education for its potential to create immersive, interactive learning experiences. Among various instructional approaches, gamification has emerged as a promising strategy to enhance learner engagement and motivation. While VR naturally provides a platform for game-based learning, current applications often overlook the underlying motivational mechanisms that influence learner behavior in these e nvironments. Building on Self-Determination Theory, we examined how gamification and motivational framing influence VR le arning. We designed a VR system featuring both gamified and non-gamified versions of two learning tasks—one culturally expressive (batik-based task) and one technically focused (code-based task)—to reflect different motivational framings. Our findings show that gamification selectively influenced intrinsic motivation components and played a dominant role in shaping learner satisfaction. A trend-level interaction suggested that combining extrinsic framing with gamification may increase satisfaction. Gamification improved overall experience and engagement, even though it elevated perceived workload. These results highlight the importance of aligning gamification strategies with learner motivation and underscore the need for more dynamic approaches to capture motivational processes in VR, offering design insights for more effective and psychologically attuned VR learning environments.\n
\n\n\n\n \n\n \n \n \n \n \n \n Multimodal colour modulation for cognitive enhancement in intelligent rehabilitation: a systematic review and translational guidance.\n \n \n \n \n\n\n \n Xu, L.; Wang, X.; Li, W.; Jiang, Y.; Cheng, C.; Li, Z.; Wang, Y.; and Yu, L.\n\n\n \n\n\n\n Journal of NeuroEngineering and Rehabilitation. May 2026.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{xu_multimodal_2026,\n\ttitle = {Multimodal colour modulation for cognitive enhancement in intelligent rehabilitation: a systematic review and translational guidance},\n\tissn = {1743-0003},\n\tshorttitle = {Multimodal colour modulation for cognitive enhancement in intelligent rehabilitation},\n\turl = {https://link.springer.com/10.1186/s12984-026-01991-y},\n\tdoi = {10.1186/s12984-026-01991-y},\n\tabstract = {Abstract\n \n Background\n Colour modulation has been investigated as a non-invasive means of supporting cognitive performance, yet translation to rehabilitation-oriented applications has been constrained by fragmented evidence, inconsistent parameterisation, and heterogeneous assessment strategies.\n \n \n Main body\n This systematic review synthesises 75 studies published between 2011 and 2025 through a Colour-Modality-Cognition framework that links stimulus design, measurement strategy, and cognitive goals. Across the evidence base, a graded and context-dependent pattern emerged. Contrast-related variables, particularly lightness and colour difference, showed more consistent support for baseline legibility and task reachability, whereas hue- and chroma-related effects were more conditional on task family, visual context, implementation locus, and the baseline contrast conditions already in place. Across several studies, efficiency-related changes, including shorter search times or reduced cortical load, were more readily captured by ocular and neurophysiological measures than by behavioural outcomes alone, especially where behavioural performance approached ceiling levels. However, the literature rarely assessed post-training retention, transfer, or other longer-term rehabilitation-relevant outcomes.\n \n \n Conclusion\n Current evidence supports a more explicit framework for the design and evaluation of rehabilitation-oriented colour interventions, particularly in relation to contrast-secured visual design and the use of multimodal assessment. However, implications for adaptive rehabilitation systems remain preliminary because most available evidence derives from controlled, predominantly non-clinical task settings rather than direct rehabilitation deployment.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tjournal = {Journal of NeuroEngineering and Rehabilitation},\n\tauthor = {Xu, Lina and Wang, Xingkai and Li, Wenan and Jiang, Yuyang and Cheng, Chen and Li, Zhenhong and Wang, Yuyang and Yu, Luwen},\n\tmonth = may,\n\tyear = {2026},\n}\n\n\n\n\n\n Abstract Background Colour modulation has been investigated as a non-invasive means of supporting cognitive performance, yet translation to rehabilitation-oriented applications has been constrained by fragmented evidence, inconsistent parameterisation, and heterogeneous assessment strategies. Main body This systematic review synthesises 75 studies published between 2011 and 2025 through a Colour-Modality-Cognition framework that links stimulus design, measurement strategy, and cognitive goals. Across the evidence base, a graded and context-dependent pattern emerged. Contrast-related variables, particularly lightness and colour difference, showed more consistent support for baseline legibility and task reachability, whereas hue- and chroma-related effects were more conditional on task family, visual context, implementation locus, and the baseline contrast conditions already in place. Across several studies, efficiency-related changes, including shorter search times or reduced cortical load, were more readily captured by ocular and neurophysiological measures than by behavioural outcomes alone, especially where behavioural performance approached ceiling levels. However, the literature rarely assessed post-training retention, transfer, or other longer-term rehabilitation-relevant outcomes. Conclusion Current evidence supports a more explicit framework for the design and evaluation of rehabilitation-oriented colour interventions, particularly in relation to contrast-secured visual design and the use of multimodal assessment. However, implications for adaptive rehabilitation systems remain preliminary because most available evidence derives from controlled, predominantly non-clinical task settings rather than direct rehabilitation deployment.\n
\n\n\n\n \n\n \n \n \n \n \n \n Flow-Aware Diffusion for Real-Time VR Restoration: Mitigating Cybersickness with Enhanced Spatiotemporal Coherence.\n \n \n \n \n\n\n \n Zhu, Y.; Jiang, G.; Liang, Z.; and Wang, Y.\n\n\n \n\n\n\n IEEE Transactions on Visualization and Computer Graphics,1–15. 2026.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{zhu_flow-aware_2026,\n\ttitle = {Flow-{Aware} {Diffusion} for {Real}-{Time} {VR} {Restoration}: {Mitigating} {Cybersickness} with {Enhanced} {Spatiotemporal} {Coherence}},\n\tcopyright = {https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html},\n\tissn = {1077-2626, 1941-0506, 2160-9306},\n\tshorttitle = {Flow-{Aware} {Diffusion} for {Real}-{Time} {VR} {Restoration}},\n\turl = {https://ieeexplore.ieee.org/document/11535293/},\n\tdoi = {10.1109/TVCG.2026.3697013},\n\tabstract = {Cybersickness remains a critical barrier to the widespread adoption of Virtual Reality (VR), particularly in scenarios involving intense or artificial motion cues. Among the key contributors is excessive optical flow—perceived visual motion that, when unmatched by vestibular input, leads to sensory conflict and discomfort. While previous efforts have explored geometric or hardware-based mitigation strategies, such methods often rely on predefined scene structures, manual tuning, or intrusive equipment. In this work, we propose U-MAD, a lightweight, real-time, AI-based solution that suppresses perceptually disruptive optical flow directly at the image level. Unlike prior handcrafted approaches, this method learns to attenuate high-intensity motion patterns from rendered frames without requiring mesh-level editing or scene-specific adaptation. Designed as a plug-and-play module, U-MAD integrates seamlessly into existing VR pipelines and generalizes well to procedurally generated environments. The experiments show that U-MAD consistently reduces average optical flow and enhances temporal stability across diverse scenes. A user study further supports the finding that reducing visual motion defects can improve perceptual comfort and alleviate cybersickness symptoms. These findings demonstrate that perceptually guided modulation of optical flow provides an effective and scalable approach to creating more user-friendly immersive experiences. The code will be released at https://github.com/XXXXX (upon publication).},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tjournal = {IEEE Transactions on Visualization and Computer Graphics},\n\tauthor = {Zhu, Yitong and Jiang, Guanxuan and Liang, Zhuowen and Wang, Yuyang},\n\tyear = {2026},\n\tpages = {1--15},\n}\n\n\n\n\n\n Cybersickness remains a critical barrier to the widespread adoption of Virtual Reality (VR), particularly in scenarios involving intense or artificial motion cues. Among the key contributors is excessive optical flow—perceived visual motion that, when unmatched by vestibular input, leads to sensory conflict and discomfort. While previous efforts have explored geometric or hardware-based mitigation strategies, such methods often rely on predefined scene structures, manual tuning, or intrusive equipment. In this work, we propose U-MAD, a lightweight, real-time, AI-based solution that suppresses perceptually disruptive optical flow directly at the image level. Unlike prior handcrafted approaches, this method learns to attenuate high-intensity motion patterns from rendered frames without requiring mesh-level editing or scene-specific adaptation. Designed as a plug-and-play module, U-MAD integrates seamlessly into existing VR pipelines and generalizes well to procedurally generated environments. The experiments show that U-MAD consistently reduces average optical flow and enhances temporal stability across diverse scenes. A user study further supports the finding that reducing visual motion defects can improve perceptual comfort and alleviate cybersickness symptoms. These findings demonstrate that perceptually guided modulation of optical flow provides an effective and scalable approach to creating more user-friendly immersive experiences. The code will be released at https://github.com/XXXXX (upon publication).\n
\n\n\n\n \n\n \n \n \n \n \n \n When trust collides: Exploring human-LLM cooperation intention through the prisoner’s dilemma.\n \n \n \n \n\n\n \n Jiang, G.; Yang, S.; Wang, Y.; and Hui, P.\n\n\n \n\n\n\n International Journal of Human-Computer Studies, 209: 103740. February 2026.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{jiang_when_2026,\n\ttitle = {When trust collides: {Exploring} human-{LLM} cooperation intention through the prisoner’s dilemma},\n\tvolume = {209},\n\tissn = {10715819},\n\tshorttitle = {When trust collides},\n\turl = {https://linkinghub.elsevier.com/retrieve/pii/S1071581926000157},\n\tdoi = {10.1016/j.ijhcs.2026.103740},\n\tabstract = {Large language models (LLMs) are advancing rapidly, equipping artificial intelligence (AI) agents with stronger reasoning and decision-making capacities. AI agents are moving from passive tools to more adaptive collaborators. However, the black-box nature and hallucinations of LLMs create uncertainties about their outputs, which may impact user trust in scenarios involving human-LLM collaboration and, in turn, lead to inconsistent outcomes in mixed-motive scenarios. To investigate how humans adjust their cooperation intentions in response to LLM unpredictability, we conducted repeated Prisoner’s Dilemma games with 30 participants (15 males, 15 females) interacting with LLM agents with different declared identities. Results revealed that an agent’s declared identity, the user’s gender, and their interaction influenced cooperation intentions. The semi-structured interviews further showed that these effects were mediated by gender differences in perceived agent identity and trustworthiness. By moving beyond the predominantly cooperative settings, this study uncovers robust interactions between agent identity and user gender in mixed-motive scenarios. These findings offer practical insights for developing more trustworthy AI systems for real-world problems.},\n\tlanguage = {en},\n\turldate = {2026-02-23},\n\tjournal = {International Journal of Human-Computer Studies},\n\tauthor = {Jiang, Guanxuan and Yang, Shirao and Wang, Yuyang and Hui, Pan},\n\tmonth = feb,\n\tyear = {2026},\n\tpages = {103740},\n}\n\n\n\n\n\n\n\n\n\n Large language models (LLMs) are advancing rapidly, equipping artificial intelligence (AI) agents with stronger reasoning and decision-making capacities. AI agents are moving from passive tools to more adaptive collaborators. However, the black-box nature and hallucinations of LLMs create uncertainties about their outputs, which may impact user trust in scenarios involving human-LLM collaboration and, in turn, lead to inconsistent outcomes in mixed-motive scenarios. To investigate how humans adjust their cooperation intentions in response to LLM unpredictability, we conducted repeated Prisoner’s Dilemma games with 30 participants (15 males, 15 females) interacting with LLM agents with different declared identities. Results revealed that an agent’s declared identity, the user’s gender, and their interaction influenced cooperation intentions. The semi-structured interviews further showed that these effects were mediated by gender differences in perceived agent identity and trustworthiness. By moving beyond the predominantly cooperative settings, this study uncovers robust interactions between agent identity and user gender in mixed-motive scenarios. These findings offer practical insights for developing more trustworthy AI systems for real-world problems.\n
\n\n\n\n
\n\n \n \n 2025\n \n \n (4)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n VRtalk: Real-Time Interactive Intelligent Anime Avatars in Virtual Reality.\n \n \n \n \n\n\n \n Yu, Y.; Xu, C.; Yang, S.; Cao, Y.; Wang, Y.; and Lee, B. G.\n\n\n \n\n\n\n In 2025 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pages 1191–1201, Daejeon, Korea, Republic of, October 2025. IEEE\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@inproceedings{yu_vrtalk:_2025,\n\taddress = {Daejeon, Korea, Republic of},\n\ttitle = {{VRtalk}: {Real}-{Time} {Interactive} {Intelligent} {Anime} {Avatars} in {Virtual} {Reality}},\n\tcopyright = {https://doi.org/10.15223/policy-029},\n\tisbn = {979-8-3315-8761-1},\n\tshorttitle = {{VRtalk}},\n\turl = {https://ieeexplore.ieee.org/document/11220364/},\n\tdoi = {10.1109/ISMAR67309.2025.00125},\n\tabstract = {The convergence of virtual reality live streaming and AI-driven avatars has emerged as a significant technological trend. However, current integration attempts remain in the proof-of-concept stage, with the primary challenge of automatic interaction system establishment. To build interactive intelligence anime avatars within VR frameworks, we have developed a multimodal interaction architecture centered on dialogue agents, realizing comprehensive understanding, reasoning, and response. Our approach 1).proposes high granularity explicit-implicit understanding and a dual-center switchable reasoning mechanism to support flexible responses. 2).innovates a dual-source animation mechanism for co-speech face-body visualization and a textual command module for supervising crossmodal animation, and 3).enhances expressiveness through mapping persona, content, voice, and motion to anime style. Experimental results demonstrate the state-of-the-art performance of VRtalk, highlighting its practical significance and future potential.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {2025 {IEEE} {International} {Symposium} on {Mixed} and {Augmented} {Reality} ({ISMAR})},\n\tpublisher = {IEEE},\n\tauthor = {Yu, Yuan and Xu, Chunlei and Yang, Shirao and Cao, Yu and Wang, Yuyang and Lee, Boon Giin},\n\tmonth = oct,\n\tyear = {2025},\n\tpages = {1191--1201},\n}\n\n\n\n\n\n The convergence of virtual reality live streaming and AI-driven avatars has emerged as a significant technological trend. However, current integration attempts remain in the proof-of-concept stage, with the primary challenge of automatic interaction system establishment. To build interactive intelligence anime avatars within VR frameworks, we have developed a multimodal interaction architecture centered on dialogue agents, realizing comprehensive understanding, reasoning, and response. Our approach 1).proposes high granularity explicit-implicit understanding and a dual-center switchable reasoning mechanism to support flexible responses. 2).innovates a dual-source animation mechanism for co-speech face-body visualization and a textual command module for supervising crossmodal animation, and 3).enhances expressiveness through mapping persona, content, voice, and motion to anime style. Experimental results demonstrate the state-of-the-art performance of VRtalk, highlighting its practical significance and future potential.\n
\n\n\n\n \n\n \n \n \n \n \n \n Identity, crimes, and law enforcement in the Metaverse.\n \n \n \n \n\n\n \n Qin, H. X.; Wang, Y.; and Hui, P.\n\n\n \n\n\n\n Humanities and Social Sciences Communications, 12(1): 194. February 2025.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n\n@article{qin_identity_2025,\n\ttitle = {Identity, crimes, and law enforcement in the {Metaverse}},\n\tvolume = {12},\n\tissn = {2662-9992},\n\turl = {https://www.nature.com/articles/s41599-024-04266-w},\n\tdoi = {10.1057/s41599-024-04266-w},\n\tlanguage = {en},\n\tnumber = {1},\n\turldate = {2026-06-09},\n\tjournal = {Humanities and Social Sciences Communications},\n\tauthor = {Qin, Hua Xuan and Wang, Yuyang and Hui, Pan},\n\tmonth = feb,\n\tyear = {2025},\n\tpages = {194},\n}\n\n\n\n\n\n \n\n \n \n \n \n \n \n Balancing Exploration and Cybersickness: Investigating Curiosity-Driven Behavior in Virtual Environments.\n \n \n \n \n\n\n \n Li, T.; and Wang, Y.\n\n\n \n\n\n\n IEEE Transactions on Human-Machine Systems, 55(6): 1043–1052. December 2025.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{li_balancing_2025,\n\ttitle = {Balancing {Exploration} and {Cybersickness}: {Investigating} {Curiosity}-{Driven} {Behavior} in {Virtual} {Environments}},\n\tvolume = {55},\n\tcopyright = {https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html},\n\tissn = {2168-2291, 2168-2305},\n\tshorttitle = {Balancing {Exploration} and {Cybersickness}},\n\turl = {https://ieeexplore.ieee.org/document/11151616/},\n\tdoi = {10.1109/THMS.2025.3602125},\n\tabstract = {Virtual reality offers the opportunity for immersive exploration, yet it is often undermined by cybersickness. However, how individuals strike a balance between exploration and discomfort remains unclear. Existing method (e.g., reinforcement learning (RL)) often fail to fully capture the complexities of navigation and decision-making patterns. This study investigates how curiosity influences users’ navigation behavior, particularly how users strike a balance between exploration and discomfort. We propose curiosity as a key factor driving irrational decision-making and apply the free energy principle to model the relationship between curiosity and user behavior quantitatively. Our findings indicate that users generally adopt conservative strategies when navigating. Also, curiosity levels tend to rise when the virtual environment changes. These results illustrate the dynamic interplay between exploration and discomfort. In addition, it offers a new perspective on how curiosity drives behavior in immersive environments, providing a foundation for designing adaptive VR environments. Future research will further refine this model by incorporating additional psychological and environmental factors to improve prediction accuracy.},\n\tlanguage = {en},\n\tnumber = {6},\n\turldate = {2026-02-23},\n\tjournal = {IEEE Transactions on Human-Machine Systems},\n\tauthor = {Li, Tangyao and Wang, Yuyang},\n\tmonth = dec,\n\tyear = {2025},\n\tpages = {1043--1052},\n}\n\n\n\n\n\n Virtual reality offers the opportunity for immersive exploration, yet it is often undermined by cybersickness. However, how individuals strike a balance between exploration and discomfort remains unclear. Existing method (e.g., reinforcement learning (RL)) often fail to fully capture the complexities of navigation and decision-making patterns. This study investigates how curiosity influences users’ navigation behavior, particularly how users strike a balance between exploration and discomfort. We propose curiosity as a key factor driving irrational decision-making and apply the free energy principle to model the relationship between curiosity and user behavior quantitatively. Our findings indicate that users generally adopt conservative strategies when navigating. Also, curiosity levels tend to rise when the virtual environment changes. These results illustrate the dynamic interplay between exploration and discomfort. In addition, it offers a new perspective on how curiosity drives behavior in immersive environments, providing a foundation for designing adaptive VR environments. Future research will further refine this model by incorporating additional psychological and environmental factors to improve prediction accuracy.\n
\n\n\n\n \n\n \n \n \n \n \n \n Towards Consumer-Grade Cybersickness Prediction: Multi-Model Alignment for Real-Time Vision-Only Inference.\n \n \n \n \n\n\n \n Zhu, Y.; Liang, Z.; Wu, Y.; Li, T.; and Wang, Y.\n\n\n \n\n\n\n In Proceedings of the 33rd ACM International Conference on Multimedia, pages 6859–6867, Dublin Ireland, October 2025. ACM\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@inproceedings{zhu_towards_2025,\n\taddress = {Dublin Ireland},\n\ttitle = {Towards {Consumer}-{Grade} {Cybersickness} {Prediction}: {Multi}-{Model} {Alignment} for {Real}-{Time} {Vision}-{Only} {Inference}},\n\tisbn = {979-8-4007-2035-2},\n\tshorttitle = {Towards {Consumer}-{Grade} {Cybersickness} {Prediction}},\n\turl = {https://dl.acm.org/doi/10.1145/3746027.3755115},\n\tdoi = {10.1145/3746027.3755115},\n\tabstract = {Cybersickness remains a major obstacle to the widespread adoption of immersive virtual reality (VR), particularly in consumer-grade environments. While prior methods rely on invasive signals such as electroencephalography (EEG) for high predictive accuracy, these approaches require specialized hardware and are impractical for real-world applications. In this work, we propose a scalable, deployable framework for personalized cybersickness prediction leveraging only non-invasive signals readily available from commercial VR headsets, including head motion, eye tracking, and physiological responses. Our model employs a modality-speci�c graph neural network enhanced with a Di�erence Attention Module to extract temporal-spatial embeddings capturing dynamic changes across modalities. A cross-modal alignment module jointly trains the video encoder to learn personalized traits by aligning video features with sensor-derived representations. Consequently, the model accurately predicts individual cybersickness using only video input during inference. Experimental results show our model achieves 88.4\\% accuracy, closely matching EEG-based approaches (89.16\\%), while reducing deployment complexity. With an average inference latency of 90ms, our framework supports real-time applications, ideal for integration into consumer-grade VR platforms without compromising personalization or performance. The code will be relesed at https://github.com/U235-Aurora/PTGNN.},\n\tlanguage = {en},\n\turldate = {2026-02-23},\n\tbooktitle = {Proceedings of the 33rd {ACM} {International} {Conference} on {Multimedia}},\n\tpublisher = {ACM},\n\tauthor = {Zhu, Yitong and Liang, Zhuowen and Wu, Yiming and Li, Tangyao and Wang, Yuyang},\n\tmonth = oct,\n\tyear = {2025},\n\tpages = {6859--6867},\n}\n\n\n\n\n\n Cybersickness remains a major obstacle to the widespread adoption of immersive virtual reality (VR), particularly in consumer-grade environments. While prior methods rely on invasive signals such as electroencephalography (EEG) for high predictive accuracy, these approaches require specialized hardware and are impractical for real-world applications. In this work, we propose a scalable, deployable framework for personalized cybersickness prediction leveraging only non-invasive signals readily available from commercial VR headsets, including head motion, eye tracking, and physiological responses. Our model employs a modality-speci�c graph neural network enhanced with a Di�erence Attention Module to extract temporal-spatial embeddings capturing dynamic changes across modalities. A cross-modal alignment module jointly trains the video encoder to learn personalized traits by aligning video features with sensor-derived representations. Consequently, the model accurately predicts individual cybersickness using only video input during inference. Experimental results show our model achieves 88.4% accuracy, closely matching EEG-based approaches (89.16%), while reducing deployment complexity. With an average inference latency of 90ms, our framework supports real-time applications, ideal for integration into consumer-grade VR platforms without compromising personalization or performance. The code will be relesed at https://github.com/U235-Aurora/PTGNN.\n
\n\n\n\n
\n\n \n \n 2024\n \n \n (7)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n Interoperability of the Metaverse: A Digital Ecosystem Perspective Review.\n \n \n \n \n\n\n \n Yang, L.; Ni, S.; Wang, Y.; Yu, A.; Lee, J.; and Hui, P.\n\n\n \n\n\n\n 2024.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@misc{yang_interoperability_2024,\n\ttitle = {Interoperability of the {Metaverse}: {A} {Digital} {Ecosystem} {Perspective} {Review}},\n\tshorttitle = {Interoperability of the {Metaverse}},\n\turl = {https://www.ssrn.com/abstract=4929167},\n\tdoi = {10.2139/ssrn.4929167},\n\tabstract = {The Metaverse, a pivotal element of the digital revolution, holds transformative potential for industries and lifestyles. Yet, skepticism persists, with concerns that enthusiasm may outstrip technological progress. Interoperability is a key obstacle, as highlighted by a CoinMarketCap report (February 2023) noting over 240 isolated Metaverse initiatives. Despite agreement on its importance, systematic research on interoperability remains scarce. This study bridges the gap through a systematic literature review, using content analysis on Web of Science and Scopus databases, identifying 74 relevant publications. Interoperability lacks a standardized definition, varying by context, while the Metaverse is broadly seen as a digital ecosystem. Urs Gasser’s framework for digital ecosystem interoperability—spanning technological, data, human, and institutional dimensions—guides our analysis. By applying this framework across three identified layers, we provide a comprehensive overview of Metaverse interoperability research, establishing benchmarks to advance scholarly exploration in this complex field.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tpublisher = {SSRN},\n\tauthor = {Yang, Liang and Ni, Shi-Ting and Wang, Yuyang and Yu, Ao and Lee, Jyn-An and Hui, Pan},\n\tyear = {2024},\n}\n\n\n\n\n\n The Metaverse, a pivotal element of the digital revolution, holds transformative potential for industries and lifestyles. Yet, skepticism persists, with concerns that enthusiasm may outstrip technological progress. Interoperability is a key obstacle, as highlighted by a CoinMarketCap report (February 2023) noting over 240 isolated Metaverse initiatives. Despite agreement on its importance, systematic research on interoperability remains scarce. This study bridges the gap through a systematic literature review, using content analysis on Web of Science and Scopus databases, identifying 74 relevant publications. Interoperability lacks a standardized definition, varying by context, while the Metaverse is broadly seen as a digital ecosystem. Urs Gasser’s framework for digital ecosystem interoperability—spanning technological, data, human, and institutional dimensions—guides our analysis. By applying this framework across three identified layers, we provide a comprehensive overview of Metaverse interoperability research, establishing benchmarks to advance scholarly exploration in this complex field.\n
\n\n\n\n \n\n \n \n \n \n \n \n Jump Cut Effects in Cinematic Virtual Reality: Editing with the 30-degree Rule and 180-degree Rule.\n \n \n \n \n\n\n \n Zhang, J.; Lee, L.; Wang, Y.; Jin, S.; Fei, D.; and Hui, P.\n\n\n \n\n\n\n In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), pages 51–60, Orlando, FL, USA, March 2024. IEEE\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@inproceedings{zhang_jump_2024,\n\taddress = {Orlando, FL, USA},\n\ttitle = {Jump {Cut} {Effects} in {Cinematic} {Virtual} {Reality}: {Editing} with the 30-degree {Rule} and 180-degree {Rule}},\n\tcopyright = {https://doi.org/10.15223/policy-029},\n\tisbn = {979-8-3503-7402-5},\n\tshorttitle = {Jump {Cut} {Effects} in {Cinematic} {Virtual} {Reality}},\n\turl = {https://ieeexplore.ieee.org/document/10494084/},\n\tdoi = {10.1109/VR58804.2024.00029},\n\tabstract = {Virtual reality (VR) is an immersive medium that offers users a unique opportunity to experience a digital environment realistically. As the demand for VR content continues to grow, the importance of effective VR editing techniques becomes increasingly apparent. This paper is a pioneering work investigating the effects of jump cuts on the viewer’s sense of presence, viewing experience, and edit quality in cinematic VR. Specifically, this work focuses on using the 30-degree and 180-degree rules in VR editing to minimize the adverse effects of jump cuts. We conducted a user study with thirteen participants, who watched nine different VR edits and completed a survey for each edited video. Our results indicate that employing the 30-degree and 180-degree rules in VR editing can significantly improve the sense of presence, viewing experience, and edit quality while mitigating the negative effects of jump cuts. We provide valuable insights for VR content creators and editors to achieve more effective and immersive VR experiences.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {2024 {IEEE} {Conference} {Virtual} {Reality} and {3D} {User} {Interfaces} ({VR})},\n\tpublisher = {IEEE},\n\tauthor = {Zhang, Junjie and Lee, Lik-Hang and Wang, Yuyang and Jin, Shan and Fei, Dan-Lu and Hui, Pan},\n\tmonth = mar,\n\tyear = {2024},\n\tpages = {51--60},\n}\n\n\n\n\n\n Virtual reality (VR) is an immersive medium that offers users a unique opportunity to experience a digital environment realistically. As the demand for VR content continues to grow, the importance of effective VR editing techniques becomes increasingly apparent. This paper is a pioneering work investigating the effects of jump cuts on the viewer’s sense of presence, viewing experience, and edit quality in cinematic VR. Specifically, this work focuses on using the 30-degree and 180-degree rules in VR editing to minimize the adverse effects of jump cuts. We conducted a user study with thirteen participants, who watched nine different VR edits and completed a survey for each edited video. Our results indicate that employing the 30-degree and 180-degree rules in VR editing can significantly improve the sense of presence, viewing experience, and edit quality while mitigating the negative effects of jump cuts. We provide valuable insights for VR content creators and editors to achieve more effective and immersive VR experiences.\n
\n\n\n\n \n\n \n \n \n \n \n \n OmniColor: A Global Camera Pose Optimization Approach of LiDAR-360Camera Fusion for Colorizing Point Clouds.\n \n \n \n \n\n\n \n Liu, B.; Zhao, G.; Jiao, J.; Cai, G.; Li, C.; Yin, H.; Wang, Y.; Liu, M.; and Hui, P.\n\n\n \n\n\n\n In 2024 IEEE International Conference on Robotics and Automation (ICRA), pages 6396–6402, Yokohama, Japan, May 2024. IEEE\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@inproceedings{liu_omnicolor:_2024,\n\taddress = {Yokohama, Japan},\n\ttitle = {{OmniColor}: {A} {Global} {Camera} {Pose} {Optimization} {Approach} of {LiDAR}-{360Camera} {Fusion} for {Colorizing} {Point} {Clouds}},\n\tcopyright = {https://doi.org/10.15223/policy-029},\n\tisbn = {979-8-3503-8457-4},\n\tshorttitle = {{OmniColor}},\n\turl = {https://ieeexplore.ieee.org/document/10610292/},\n\tdoi = {10.1109/ICRA57147.2024.10610292},\n\tabstract = {A Colored point cloud, as a simple and efficient 3D representation, has many advantages in various fields, including robotic navigation and scene reconstruction. This representation is now commonly used in 3D reconstruction tasks relying on cameras and LiDARs. However, fusing data from these two types of sensors is poorly performed in many existing frameworks, leading to unsatisfactory mapping results, mainly due to inaccurate camera poses. This paper presents OmniColor, a novel and efficient algorithm to colorize point clouds using an independent 360-degree camera. Given a LiDARbased point cloud and a sequence of panorama images with initial coarse camera poses, our objective is to jointly optimize the poses of all frames for mapping images onto geometric reconstructions. Our pipeline works in an off-the-shelf manner that does not require any feature extraction or matching process. Instead, we find optimal poses by directly maximizing the photometric consistency of LiDAR maps. In experiments, we show that our method can overcome the severe visual distortion of omnidirectional images and greatly benefit from the wide field of view (FOV) of 360-degree cameras to reconstruct various scenarios with accuracy and stability. The code will be released at https://github.com/liubonan123/OmniColor/.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {2024 {IEEE} {International} {Conference} on {Robotics} and {Automation} ({ICRA})},\n\tpublisher = {IEEE},\n\tauthor = {Liu, Bonan and Zhao, Guoyang and Jiao, Jianhao and Cai, Guang and Li, Chengyang and Yin, Handi and Wang, Yuyang and Liu, Ming and Hui, Pan},\n\tmonth = may,\n\tyear = {2024},\n\tpages = {6396--6402},\n}\n\n\n\n\n\n A Colored point cloud, as a simple and efficient 3D representation, has many advantages in various fields, including robotic navigation and scene reconstruction. This representation is now commonly used in 3D reconstruction tasks relying on cameras and LiDARs. However, fusing data from these two types of sensors is poorly performed in many existing frameworks, leading to unsatisfactory mapping results, mainly due to inaccurate camera poses. This paper presents OmniColor, a novel and efficient algorithm to colorize point clouds using an independent 360-degree camera. Given a LiDARbased point cloud and a sequence of panorama images with initial coarse camera poses, our objective is to jointly optimize the poses of all frames for mapping images onto geometric reconstructions. Our pipeline works in an off-the-shelf manner that does not require any feature extraction or matching process. Instead, we find optimal poses by directly maximizing the photometric consistency of LiDAR maps. In experiments, we show that our method can overcome the severe visual distortion of omnidirectional images and greatly benefit from the wide field of view (FOV) of 360-degree cameras to reconstruct various scenarios with accuracy and stability. The code will be released at https://github.com/liubonan123/OmniColor/.\n
\n\n\n\n \n\n \n \n \n \n \n \n A Study of Partisan News Sharing in the Russian Invasion of Ukraine.\n \n \n \n \n\n\n \n Zhu, Y.; Haq, E.; Tyson, G.; Lee, L.; Wang, Y.; and Hui, P.\n\n\n \n\n\n\n Proceedings of the International AAAI Conference on Web and Social Media, 18: 1847–1858. May 2024.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{zhu_study_2024,\n\ttitle = {A {Study} of {Partisan} {News} {Sharing} in the {Russian} {Invasion} of {Ukraine}},\n\tvolume = {18},\n\tissn = {2334-0770, 2162-3449},\n\turl = {https://ojs.aaai.org/index.php/ICWSM/article/view/31430},\n\tdoi = {10.1609/icwsm.v18i1.31430},\n\tabstract = {Since the Russian invasion of Ukraine, a large volume of biased and partisan news has been spread via social media platforms. As this may lead to wider societal issues, we argue that understanding how partisan news sharing impacts users’ communication is crucial for better governance of online communities. In this paper, we perform a measurement study of partisan news sharing. We aim to characterize the role of such sharing in influencing users’ communications. Our analysis covers an eight-month dataset across six Reddit communities related to the Russian invasion. We first perform an analysis of the temporal evolution of partisan news sharing. We confirm that the invasion stimulates discussion in the observed communities, accompanied by an increased volume of partisan news sharing. Next, we characterize users’ response to such sharing. We observe that partisan bias plays a role in narrowing its propagation. More biased media is less likely to be spread across multiple subreddits. However, we find that partisan news sharing attracts more users to engage in the discussion, by generating more comments. We then built a predictive model to identify users likely to spread partisan news. The prediction is challenging though, with 61.57\\% accuracy on average. Our centrality analysis on the commenting network further indicates that the users who disseminate partisan news possess lower network influence in comparison to those who propagate neutral news.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tjournal = {Proceedings of the International AAAI Conference on Web and Social Media},\n\tauthor = {Zhu, Yiming and Haq, Ehsan-Ul and Tyson, Gareth and Lee, Lik-Hang and Wang, Yuyang and Hui, Pan},\n\tmonth = may,\n\tyear = {2024},\n\tpages = {1847--1858},\n}\n\n\n\n\n\n Since the Russian invasion of Ukraine, a large volume of biased and partisan news has been spread via social media platforms. As this may lead to wider societal issues, we argue that understanding how partisan news sharing impacts users’ communication is crucial for better governance of online communities. In this paper, we perform a measurement study of partisan news sharing. We aim to characterize the role of such sharing in influencing users’ communications. Our analysis covers an eight-month dataset across six Reddit communities related to the Russian invasion. We first perform an analysis of the temporal evolution of partisan news sharing. We confirm that the invasion stimulates discussion in the observed communities, accompanied by an increased volume of partisan news sharing. Next, we characterize users’ response to such sharing. We observe that partisan bias plays a role in narrowing its propagation. More biased media is less likely to be spread across multiple subreddits. However, we find that partisan news sharing attracts more users to engage in the discussion, by generating more comments. We then built a predictive model to identify users likely to spread partisan news. The prediction is challenging though, with 61.57% accuracy on average. Our centrality analysis on the commenting network further indicates that the users who disseminate partisan news possess lower network influence in comparison to those who propagate neutral news.\n
\n\n\n\n \n\n \n \n \n \n \n \n Using a Virtual Reality Interview Simulator to Explore Factors Influencing People’s Behavior.\n \n \n \n \n\n\n \n Luo, X.; Wang, Y.; Lee, L.; Xing, Z.; Jin, S.; Dong, B.; Hu, Y.; Chen, Z.; Yan, J.; and Hui, P.\n\n\n \n\n\n\n Virtual Reality, 28(1): 56. March 2024.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{luo_using_2024,\n\ttitle = {Using a {Virtual} {Reality} {Interview} {Simulator} to {Explore} {Factors} {Influencing} {People}’s {Behavior}},\n\tvolume = {28},\n\tissn = {1359-4338, 1434-9957},\n\turl = {https://link.springer.com/10.1007/s10055-023-00934-5},\n\tdoi = {10.1007/s10055-023-00934-5},\n\tabstract = {Abstract\n \n Virtual reality interview simulator (VRIS) is an effective and valid tool that uses virtual reality technology to train people’s interview skills. Typically, it offers candidates prone to being very nervous during interviews the opportunity to practice interviews in a safe and manageable virtual environment and realistic settings, providing real-time feedback from a virtual interviewer on their performance. It helps interviewees improve their skills, reduce their fears, gain confidence, and minimize the cost and time associated with traditional interview preparation. Yet, the major anxiety-inducing elements remain unknown. During an interview, the anxiety levels, overall experience, and performance of interviewees might be affected by various circumstances. By analyzing electrodermal activity and questionnaire, we investigated the influence of five variables: (I)\n Realism\n ; (II)\n Question type\n ; (III)\n Interviewer attitude\n ; (IV)\n Timing\n ; and (V)\n Preparation\n . As such, an orthogonal design\n \n \n \\$\\$L\\_8(4{\\textasciicircum}1 {\\textbackslash}times 2{\\textasciicircum}4)\\$\\$\n \n \n \n L\n 8\n \n \n (\n \n 4\n 1\n \n ×\n \n 2\n 4\n \n )\n \n \n \n \n \n with eight experiments (\n \n \n \\$\\$O A\\_8\\$\\$\n \n \n O\n \n A\n 8\n \n \n \n \n \n matrix) was implemented, in which 19 college students took part in the experiments. Considering the anxiety, overall experience, and performance of the interviewees, we found that\n Question type\n plays a major role; secondly,\n Realism\n ,\n Preparation\n , and\n Interviewer attitude\n all have middle influence; lastly,\n Timing\n has little to no impact. Specifically, professional interview questions elicited a greater degree of anxiety than personal ones among the categories of interview questions. This work contributes to our understanding of anxiety-stimulating factors during job interviews in virtual reality and provides cues for designing future VRIS.},\n\tlanguage = {en},\n\tnumber = {1},\n\turldate = {2024-03-15},\n\tjournal = {Virtual Reality},\n\tauthor = {Luo, Xinyi and Wang, Yuyang and Lee, Lik-Hang and Xing, Zihan and Jin, Shan and Dong, Boya and Hu, Yuanyi and Chen, Zeming and Yan, Jing and Hui, Pan},\n\tmonth = mar,\n\tyear = {2024},\n\tpages = {56},\n}\n\n\n\n\n\n Abstract Virtual reality interview simulator (VRIS) is an effective and valid tool that uses virtual reality technology to train people’s interview skills. Typically, it offers candidates prone to being very nervous during interviews the opportunity to practice interviews in a safe and manageable virtual environment and realistic settings, providing real-time feedback from a virtual interviewer on their performance. It helps interviewees improve their skills, reduce their fears, gain confidence, and minimize the cost and time associated with traditional interview preparation. Yet, the major anxiety-inducing elements remain unknown. During an interview, the anxiety levels, overall experience, and performance of interviewees might be affected by various circumstances. By analyzing electrodermal activity and questionnaire, we investigated the influence of five variables: (I) Realism ; (II) Question type ; (III) Interviewer attitude ; (IV) Timing ; and (V) Preparation . As such, an orthogonal design $$L_8(4\\textasciicircum1 \\times 2\\textasciicircum4)$$ L 8 ( 4 1 × 2 4 ) with eight experiments ( $$O A_8$$ O A 8 matrix) was implemented, in which 19 college students took part in the experiments. Considering the anxiety, overall experience, and performance of the interviewees, we found that Question type plays a major role; secondly, Realism , Preparation , and Interviewer attitude all have middle influence; lastly, Timing has little to no impact. Specifically, professional interview questions elicited a greater degree of anxiety than personal ones among the categories of interview questions. This work contributes to our understanding of anxiety-stimulating factors during job interviews in virtual reality and provides cues for designing future VRIS.\n
\n\n\n\n \n\n \n \n \n \n \n \n Modeling Online Adaptive Navigation in Virtual Environments Based on PID Control.\n \n \n \n \n\n\n \n Wang, Y.; Chardonnet, J.; and Merienne, F.\n\n\n \n\n\n\n In Luo, B.; Cheng, L.; Wu, Z.; Li, H.; and Li, C., editor(s), Neural Information Processing, volume 1964, pages 325–346. Springer Nature Singapore, Singapore, 2024.\n Series Title: Communications in Computer and Information Science\n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n\n@incollection{luo_modeling_2024,\n\taddress = {Singapore},\n\ttitle = {Modeling {Online} {Adaptive} {Navigation} in {Virtual} {Environments} {Based} on {PID} {Control}},\n\tvolume = {1964},\n\tisbn = {978-981-99-8140-3 978-981-99-8141-0},\n\turl = {https://link.springer.com/10.1007/978-981-99-8141-0_25},\n\tdoi = {10.1007/978-981-99-8141-0_25},\n\tlanguage = {en},\n\turldate = {2024-03-10},\n\tbooktitle = {Neural {Information} {Processing}},\n\tpublisher = {Springer Nature Singapore},\n\tauthor = {Wang, Yuyang and Chardonnet, Jean-Rémy and Merienne, Frédéric},\n\teditor = {Luo, Biao and Cheng, Long and Wu, Zheng-Guang and Li, Hongyi and Li, Chaojie},\n\tyear = {2024},\n\tnote = {Series Title: Communications in Computer and Information Science},\n\tpages = {325--346},\n}\n\n\n\n\n\n \n\n \n \n \n \n \n Text2VRScene: Exploring the Paradigm of Automated Generation System for VR Experience From the Ground Up.\n \n \n \n\n\n \n Yin, Z.; Wang, Y.; Papatheodorou, T.; and Hui, P.\n\n\n \n\n\n\n In 2024 IEEE Virtual Reality and 3D User Interfaces (VR), Orlando, USA, March 2024. IEEE\n \n\n\n\n
\n\n\n\n \n\n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n\n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n
\n\n\n\n@inproceedings{yin_text2vrscene:_2024,\n\taddress = {Orlando, USA},\n\ttitle = {{Text2VRScene}: {Exploring} the {Paradigm} of {Automated} {Generation} {System} for {VR} {Experience} {From} the {Ground} {Up}},\n\tlanguage = {en},\n\tbooktitle = {2024 {IEEE} {Virtual} {Reality} and {3D} {User} {Interfaces} ({VR})},\n\tpublisher = {IEEE},\n\tauthor = {Yin, Zhizhuo and Wang, Yuyang and Papatheodorou, Theodoros and Hui, Pan},\n\tmonth = mar,\n\tyear = {2024},\n}\n\n\n\n\n\n
\n\n \n \n 2023\n \n \n (1)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n Dataset for predicting cybersickness from a virtual navigation task.\n \n \n \n \n\n\n \n Wang, Y.; Li, R.; Chardonnet, J.; and Hui, P.\n\n\n \n\n\n\n February 2023.\n arXiv:2303.13527 [cs]\n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@misc{wang_dataset_2023,\n\ttitle = {Dataset for predicting cybersickness from a virtual navigation task},\n\turl = {http://arxiv.org/abs/2303.13527},\n\tabstract = {This work presents a dataset collected to predict cybersickness in virtual reality environments. The data was collected from navigation tasks in a virtual environment designed to induce cybersickness. The dataset consists of many data points collected from diverse participants, including physiological responses (EDA and Heart Rate) and self-reported cybersickness symptoms. The paper will provide a detailed description of the dataset, including the arranged navigation task, the data collection procedures, and the data format. The dataset will serve as a valuable resource for researchers to develop and evaluate predictive models for cybersickness and will facilitate more research in cybersickness mitigation.},\n\turldate = {2023-04-13},\n\tpublisher = {arXiv},\n\tauthor = {Wang, Yuyang and Li, Ruichen and Chardonnet, Jean-Rémy and Hui, Pan},\n\tmonth = feb,\n\tyear = {2023},\n\tnote = {arXiv:2303.13527 [cs]},\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n This work presents a dataset collected to predict cybersickness in virtual reality environments. The data was collected from navigation tasks in a virtual environment designed to induce cybersickness. The dataset consists of many data points collected from diverse participants, including physiological responses (EDA and Heart Rate) and self-reported cybersickness symptoms. The paper will provide a detailed description of the dataset, including the arranged navigation task, the data collection procedures, and the data format. The dataset will serve as a valuable resource for researchers to develop and evaluate predictive models for cybersickness and will facilitate more research in cybersickness mitigation.\n
\n\n\n\n
\n\n \n \n 2022\n \n \n (2)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n Re-shaping Post-COVID-19 Teaching and Learning: A Blueprint of Virtual-Physical Blended Classrooms in the Metaverse Era.\n \n \n \n \n\n\n \n Wang, Y.; Lee, L.; Braud, T.; and Hui, P.\n\n\n \n\n\n\n In 2022 IEEE 42nd International Conference on Distributed Computing Systems Workshops (ICDCSW), pages 241–247, Bologna, Italy, July 2022. IEEE\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 4 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 4 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@inproceedings{wang_re-shaping_2022,\n\taddress = {Bologna, Italy},\n\ttitle = {Re-shaping {Post}-{COVID}-19 {Teaching} and {Learning}: {A} {Blueprint} of {Virtual}-{Physical} {Blended} {Classrooms} in the {Metaverse} {Era}},\n\tcopyright = {https://doi.org/10.15223/policy-029},\n\tisbn = {978-1-6654-8879-2},\n\tshorttitle = {Re-shaping {Post}-{COVID}-19 {Teaching} and {Learning}},\n\turl = {https://ieeexplore.ieee.org/document/9951355/},\n\tdoi = {10.1109/ICDCSW56584.2022.00053},\n\tabstract = {During the COVID-19 pandemic, most countries have experienced some form of remote education through video conferencing software platforms. However, these software platforms fail to reduce immersion and replicate the classroom experience. The currently emerging Metaverse addresses many of such limitations by offering blended physical-digital environments. This paper aims to assess how the Metaverse can support and improve e-learning. We first survey the latest applications of blended environments in education and highlight the primary challenges and opportunities. Accordingly, we derive our proposal for a virtual-physical blended classroom configuration that brings students and teachers into a shared educational Metaverse. We focus on the system architecture of the Metaverse classroom to achieve real-time synchronization of a large number of participants and activities across physical (mixed reality classrooms) and virtual (remote VR platform) learning spaces. Our proposal attempts to transform the traditional physical classroom into virtual-physical cyberspace as a new social network of learners and educators connected at an unprecedented scale.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {2022 {IEEE} 42nd {International} {Conference} on {Distributed} {Computing} {Systems} {Workshops} ({ICDCSW})},\n\tpublisher = {IEEE},\n\tauthor = {Wang, Yuyang and Lee, Lik-Hang and Braud, Tristan and Hui, Pan},\n\tmonth = jul,\n\tyear = {2022},\n\tpages = {241--247},\n}\n\n\n\n\n\n During the COVID-19 pandemic, most countries have experienced some form of remote education through video conferencing software platforms. However, these software platforms fail to reduce immersion and replicate the classroom experience. The currently emerging Metaverse addresses many of such limitations by offering blended physical-digital environments. This paper aims to assess how the Metaverse can support and improve e-learning. We first survey the latest applications of blended environments in education and highlight the primary challenges and opportunities. Accordingly, we derive our proposal for a virtual-physical blended classroom configuration that brings students and teachers into a shared educational Metaverse. We focus on the system architecture of the Metaverse classroom to achieve real-time synchronization of a large number of participants and activities across physical (mixed reality classrooms) and virtual (remote VR platform) learning spaces. Our proposal attempts to transform the traditional physical classroom into virtual-physical cyberspace as a new social network of learners and educators connected at an unprecedented scale.\n
\n\n\n\n \n\n \n \n \n \n \n \n Prediction of cybersickness in virtual environments using topological data analysis and machine learning.\n \n \n \n \n\n\n \n Hadadi, A.; Guillet, C.; Chardonnet, J.; Langovoy, M.; Wang, Y.; and Ovtcharova, J.\n\n\n \n\n\n\n Frontiers in Virtual Reality, 3: 973236. October 2022.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 4 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 4 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{hadadi_prediction_2022,\n\ttitle = {Prediction of cybersickness in virtual environments using topological data analysis and machine learning},\n\tvolume = {3},\n\tissn = {2673-4192},\n\turl = {https://www.frontiersin.org/articles/10.3389/frvir.2022.973236/full},\n\tdoi = {10.3389/frvir.2022.973236},\n\tabstract = {Recent significant progress in Virtual Reality (VR) applications and environments raised several challenges. They proved to have side effects on specific users, thus reducing the usability of the VR technology in some critical domains, such as flight and car simulators. One of the common side effects is cybersickness. Some significant commonly reported symptoms are nausea, oculomotor discomfort, and disorientation. To mitigate these symptoms and consequently improve the usability of VR systems, it is necessary to predict the incidence of cybersickness. This paper proposes a machine learning approach to VR’s cybersickness prediction based on physiological and subjective data. We investigated combinations of topological data analysis with a range of classifier algorithms and assessed classification performance. The highest performance of Topological Data Analysis (TDA) based methods was achieved in combination with SVMs with Gaussian RBF kernel, indicating that Gaussian RBF kernels provide embeddings of physiological time series data into spaces that are rich enough to capture the essential geometric features of this type of data. Comparing several combinations with feature descriptors for physiological time series, the performance of the TDA + SVM combination is in the top group, statistically being on par or outperforming more complex and less interpretable methods. Our results show that heart rate does not seem to correlate with cybersickness.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tjournal = {Frontiers in Virtual Reality},\n\tauthor = {Hadadi, Azadeh and Guillet, Christophe and Chardonnet, Jean-Rémy and Langovoy, Mikhail and Wang, Yuyang and Ovtcharova, Jivka},\n\tmonth = oct,\n\tyear = {2022},\n\tpages = {973236},\n}\n\n\n\n\n\n Recent significant progress in Virtual Reality (VR) applications and environments raised several challenges. They proved to have side effects on specific users, thus reducing the usability of the VR technology in some critical domains, such as flight and car simulators. One of the common side effects is cybersickness. Some significant commonly reported symptoms are nausea, oculomotor discomfort, and disorientation. To mitigate these symptoms and consequently improve the usability of VR systems, it is necessary to predict the incidence of cybersickness. This paper proposes a machine learning approach to VR’s cybersickness prediction based on physiological and subjective data. We investigated combinations of topological data analysis with a range of classifier algorithms and assessed classification performance. The highest performance of Topological Data Analysis (TDA) based methods was achieved in combination with SVMs with Gaussian RBF kernel, indicating that Gaussian RBF kernels provide embeddings of physiological time series data into spaces that are rich enough to capture the essential geometric features of this type of data. Comparing several combinations with feature descriptors for physiological time series, the performance of the TDA + SVM combination is in the top group, statistically being on par or outperforming more complex and less interpretable methods. Our results show that heart rate does not seem to correlate with cybersickness.\n
\n\n\n\n
\n\n \n \n 2021\n \n \n (3)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n Development of a speed protector to optimize user experience in 3D virtual environments.\n \n \n \n \n\n\n \n Wang, Y.; Chardonnet, J.; and Merienne, F.\n\n\n \n\n\n\n International Journal of Human-Computer Studies, 147: 102578. March 2021.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 10 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 10 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@article{wang_development_2021,\n\ttitle = {Development of a speed protector to optimize user experience in {3D} virtual environments},\n\tvolume = {147},\n\tissn = {10715819},\n\turl = {https://linkinghub.elsevier.com/retrieve/pii/S1071581920301804},\n\tdoi = {10.1016/j.ijhcs.2020.102578},\n\tabstract = {Virtual walking in virtual environments (VEs) requires locomotion interfaces, especially when the available physical environment is smaller than the virtual space due to virtual reality facilities limitations; many navigation approaches have been proposed according to different input conditions, target selection and speed selection. With current technologies, the virtual locomotion speed for most VR systems relies primarily on ratecontrol devices (e.g., joystick). The user has to manage manual adaptation of the speed, based on the size of the VE and personal preferences. However, this method cannot provide optimal speeds for locomotion as the user tends to change the speed involuntarily due to non-desired issues including collisions or simulator sickness; in this case, the user may have to adjust the speed frequently and unsmoothly, worsening the situation. Therefore, we designed a motion protector that can be embedded into the locomotion system to provide optimal speed profiles. The optimization process aims at minimizing the total jerk when the user translates from an initial position to a target, which is a common rule of the human motion model. In addition to minimization, we put constraints on speed, acceleration and jerk so that they do not exceed specific thresholds. The speed protector is formulated mathematically and solved analytically in order to provide a smooth navigation experience with a minimum jerk of trajectory. The assessment of the speed protector was conducted in a user study measuring user experience with a simulator sickness questionnaire, event-related skin conductance responses (ER-SCR), and a NASA-TLX questionnaire, showing that the designed speed protector can provide more natural and comfortable user experience with appropriate acceleration and jerk as it avoids abrupt speed profiles.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tjournal = {International Journal of Human-Computer Studies},\n\tauthor = {Wang, Yuyang and Chardonnet, Jean-Rémy and Merienne, Frédéric},\n\tmonth = mar,\n\tyear = {2021},\n\tpages = {102578},\n}\n\n\n\n\n\n Virtual walking in virtual environments (VEs) requires locomotion interfaces, especially when the available physical environment is smaller than the virtual space due to virtual reality facilities limitations; many navigation approaches have been proposed according to different input conditions, target selection and speed selection. With current technologies, the virtual locomotion speed for most VR systems relies primarily on ratecontrol devices (e.g., joystick). The user has to manage manual adaptation of the speed, based on the size of the VE and personal preferences. However, this method cannot provide optimal speeds for locomotion as the user tends to change the speed involuntarily due to non-desired issues including collisions or simulator sickness; in this case, the user may have to adjust the speed frequently and unsmoothly, worsening the situation. Therefore, we designed a motion protector that can be embedded into the locomotion system to provide optimal speed profiles. The optimization process aims at minimizing the total jerk when the user translates from an initial position to a target, which is a common rule of the human motion model. In addition to minimization, we put constraints on speed, acceleration and jerk so that they do not exceed specific thresholds. The speed protector is formulated mathematically and solved analytically in order to provide a smooth navigation experience with a minimum jerk of trajectory. The assessment of the speed protector was conducted in a user study measuring user experience with a simulator sickness questionnaire, event-related skin conductance responses (ER-SCR), and a NASA-TLX questionnaire, showing that the designed speed protector can provide more natural and comfortable user experience with appropriate acceleration and jerk as it avoids abrupt speed profiles.\n
\n\n\n\n \n\n \n \n \n \n \n \n Using Fuzzy Logic to Involve Individual Differences for Predicting Cybersickness during VR Navigation.\n \n \n \n \n\n\n \n Wang, Y.; Chardonnet, J.; Merienne, F.; and Ovtcharova, J.\n\n\n \n\n\n\n In 2021 IEEE Virtual Reality and 3D User Interfaces (VR), pages 373–381, Lisboa, Portugal, March 2021. IEEE\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 5 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 5 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@inproceedings{wang_using_2021,\n\taddress = {Lisboa, Portugal},\n\ttitle = {Using {Fuzzy} {Logic} to {Involve} {Individual} {Differences} for {Predicting} {Cybersickness} during {VR} {Navigation}},\n\tcopyright = {https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html},\n\tisbn = {978-1-6654-1838-6},\n\turl = {https://ieeexplore.ieee.org/document/9417785/},\n\tdoi = {10.1109/VR50410.2021.00060},\n\tabstract = {Many studies have explored how individual differences can affect users’ susceptibility to cybersickness in a VR application. However, the lack of strategy to integrate the influence of each factor on cybersickness makes it difficult to utilize the results of existing research. Based on the fuzzy logic theory that can represent the effect of different factors as a single value containing integrated information, we developed two approaches including the knowledgebased Mamdani-type fuzzy inference system and the data-driven Adaptive neuro-fuzzy inference system (ANFIS) to involve three individual differences (Age, Gaming experience and Ethnicity). We correlated the corresponding outputs with the simulator sickness questionnaire (SSQ) scores in a simple navigation scenario. The correlation coefficients obtained through a 4-fold cross validation were found statistically significant with both fuzzy logic approaches, indicating their effectiveness to influence the occurrence and the level of cybersickness. Our work provides insights to establish customized experiences for VR navigation by involving individual differences.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {2021 {IEEE} {Virtual} {Reality} and {3D} {User} {Interfaces} ({VR})},\n\tpublisher = {IEEE},\n\tauthor = {Wang, Yuyang and Chardonnet, Jean-Remy and Merienne, Frederic and Ovtcharova, Jivka},\n\tmonth = mar,\n\tyear = {2021},\n\tpages = {373--381},\n}\n\n\n\n\n\n Many studies have explored how individual differences can affect users’ susceptibility to cybersickness in a VR application. However, the lack of strategy to integrate the influence of each factor on cybersickness makes it difficult to utilize the results of existing research. Based on the fuzzy logic theory that can represent the effect of different factors as a single value containing integrated information, we developed two approaches including the knowledgebased Mamdani-type fuzzy inference system and the data-driven Adaptive neuro-fuzzy inference system (ANFIS) to involve three individual differences (Age, Gaming experience and Ethnicity). We correlated the corresponding outputs with the simulator sickness questionnaire (SSQ) scores in a simple navigation scenario. The correlation coefficients obtained through a 4-fold cross validation were found statistically significant with both fuzzy logic approaches, indicating their effectiveness to influence the occurrence and the level of cybersickness. Our work provides insights to establish customized experiences for VR navigation by involving individual differences.\n
\n\n\n\n \n\n \n \n \n \n \n \n Enhanced Cognitive Workload Evaluation in 3D Immersive Environments with TOPSIS Model.\n \n \n \n \n\n\n \n Wang, Y.; Chardonnet, J.; and Merienne, F.\n\n\n \n\n\n\n International Journal of Human-Computer Studies, 147: 102572. March 2021.\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n \n \n 21 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n \n \n 21 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n\n@article{wang_enhanced_2021,\n\ttitle = {Enhanced {Cognitive} {Workload} {Evaluation} in {3D} {Immersive} {Environments} with {TOPSIS} {Model}},\n\tvolume = {147},\n\tissn = {10715819},\n\turl = {https://linkinghub.elsevier.com/retrieve/pii/S1071581920301749},\n\tdoi = {10.1016/j.ijhcs.2020.102572},\n\tlanguage = {en},\n\turldate = {2024-03-10},\n\tjournal = {International Journal of Human-Computer Studies},\n\tauthor = {Wang, Yuyang and Chardonnet, Jean-Rémy and Merienne, Frédéric},\n\tmonth = mar,\n\tyear = {2021},\n\tpages = {102572},\n}\n\n\n\n\n\n
\n\n \n \n 2019\n \n \n (1)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n VR Sickness Prediction for Navigation in Immersive Virtual Environments using a Deep Long Short Term Memory Model.\n \n \n \n \n\n\n \n Wang, Y.; Chardonnet, J.; and Merienne, F.\n\n\n \n\n\n\n In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 1874–1881, Osaka, Japan, March 2019. IEEE\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n \n \n 4 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n\n \n \n \n 4 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n\n@inproceedings{wang_vr_2019,\n\taddress = {Osaka, Japan},\n\ttitle = {{VR} {Sickness} {Prediction} for {Navigation} in {Immersive} {Virtual} {Environments} using a {Deep} {Long} {Short} {Term} {Memory} {Model}},\n\tisbn = {978-1-7281-1377-7},\n\turl = {https://ieeexplore.ieee.org/document/8798213/},\n\tdoi = {10.1109/VR.2019.8798213},\n\tlanguage = {en},\n\turldate = {2024-03-10},\n\tbooktitle = {2019 {IEEE} {Conference} on {Virtual} {Reality} and {3D} {User} {Interfaces} ({VR})},\n\tpublisher = {IEEE},\n\tauthor = {Wang, Yuyang and Chardonnet, Jean-Remy and Merienne, Frederic},\n\tmonth = mar,\n\tyear = {2019},\n\tpages = {1874--1881},\n}\n\n\n\n\n\n
\n\n\n\n\n \n \n 2018\n \n \n (1)\n \n \n
\n \n \n \n
\n \n \n\n \n \n \n \n \n \n Speed Profile Optimization for Enhanced Passenger Comfort: An Optimal Control Approach.\n \n \n \n \n\n\n \n Wang, Y.; Chardonnet, J.; and Merienne, F.\n\n\n \n\n\n\n In 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pages 723–728, Maui, HI, November 2018. IEEE\n \n\n\n\n
\n\n\n\n \n \nPaper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 1 download\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n
\n\n\n\n\n\n \n\n\n\n \n \n
Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 1 download\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n\n\n\n\n
\n\n\n@inproceedings{wang_speed_2018,\n\taddress = {Maui, HI},\n\ttitle = {Speed {Profile} {Optimization} for {Enhanced} {Passenger} {Comfort}: {An} {Optimal} {Control} {Approach}},\n\tisbn = {978-1-7281-0321-1 978-1-7281-0323-5},\n\tshorttitle = {Speed {Profile} {Optimization} for {Enhanced} {Passenger} {Comfort}},\n\turl = {https://ieeexplore.ieee.org/document/8569420/},\n\tdoi = {10.1109/ITSC.2018.8569420},\n\tabstract = {Autonomous vehicles are expected to start reaching the market within the next years. However in practical applications, navigation inside dynamic environments has to take many factors such as speed control, safety and comfort into consideration, which is more paramount for both passengers and pedestrians. In this paper, a novel speed profile planner based on an optimal control approach considering passenger comfort is proposed. The approach is accomplished by minimizing jerk under certain comfort constraints, which inherently gives a speed profile for the central nervous system to follow naturally. Imposed with the same conditions, the widely used Jerk Limitation method is interpreted as an equivalent of the minimum time control method, the latter being used to verify that our method can ensure better continuity and smoothness of the speed profiles. A validation test was specifically designed and performed in order to show the feasibility of our method.},\n\tlanguage = {en},\n\turldate = {2026-06-09},\n\tbooktitle = {2018 21st {International} {Conference} on {Intelligent} {Transportation} {Systems} ({ITSC})},\n\tpublisher = {IEEE},\n\tauthor = {Wang, Yuyang and Chardonnet, Jean-Remy and Merienne, Frederic},\n\tmonth = nov,\n\tyear = {2018},\n\tpages = {723--728},\n}\n\n\n\n\n\n Autonomous vehicles are expected to start reaching the market within the next years. However in practical applications, navigation inside dynamic environments has to take many factors such as speed control, safety and comfort into consideration, which is more paramount for both passengers and pedestrians. In this paper, a novel speed profile planner based on an optimal control approach considering passenger comfort is proposed. The approach is accomplished by minimizing jerk under certain comfort constraints, which inherently gives a speed profile for the central nervous system to follow naturally. Imposed with the same conditions, the widely used Jerk Limitation method is interpreted as an equivalent of the minimum time control method, the latter being used to verify that our method can ensure better continuity and smoothness of the speed profiles. A validation test was specifically designed and performed in order to show the feasibility of our method.\n
\n\n\n