Human-Computer Interaction
New submissions
[ showing up to 2000 entries per page: fewer | more ]
New submissions for Fri, 10 May 24
- [1] arXiv:2405.05284 [pdf, other]
-
Title: A Study on Cognitive Effects of Canvas Size for Augmenting Drawing SkillAuthors: Jize Wang, Kazuhisa Nakano, Daiyannan Chen, Zhengyu Huang, Tsukasa Fukusato, Kazunori Miyata, Haoran XieComments: 5 pages, 6 figures, accepted in NICOGRAPH International 2024Subjects: Human-Computer Interaction (cs.HC); Graphics (cs.GR)
In recent years, the field of generative artificial intelligence, particularly in the domain of image generation, has exerted a profound influence on society. Despite the capability of AI to produce images of high quality, the augmentation of users' drawing abilities through the provision of drawing support systems emerges as a challenging issue. In this study, we propose that a cognitive factor, specifically, the size of the canvas, may exert a considerable influence on the outcomes of imitative drawing sketches when utilizing reference images. To investigate this hypothesis, a web based drawing interface was utilized, designed specifically to evaluate the effect of the canvas size's proportionality to the reference image on the fidelity of the drawings produced. The findings from our research lend credence to the hypothesis that a drawing interface, featuring a canvas whose dimensions closely match those of the reference image, markedly improves the precision of user-generated sketches.
- [2] arXiv:2405.05285 [pdf, ps, other]
-
Title: Generative AI as a metacognitive agent: A comparative mixed-method study with human participants on ICF-mimicking exam performanceAuthors: Jelena Pavlovic (University of Belgrade, Faculty of Philosophy and Koucing centar Resarch Lab), Jugoslav Krstic, Luka Mitrovic, Djordje Babic, Adrijana Milosavljevic, Milena Nikolic, Tijana Karaklic, Tijana Mitrovic (Koucing centar Research Lab)Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)
This study investigates the metacognitive capabilities of Large Language Models relative to human metacognition in the context of the International Coaching Federation ICF mimicking exam, a situational judgment test related to coaching competencies. Using a mixed method approach, we assessed the metacognitive performance, including sensitivity, accuracy in probabilistic predictions, and bias, of human participants and five advanced LLMs (GPT-4, Claude-3-Opus 3, Mistral Large, Llama 3, and Gemini 1.5 Pro). The results indicate that LLMs outperformed humans across all metacognitive metrics, particularly in terms of reduced overconfidence, compared to humans. However, both LLMs and humans showed less adaptability in ambiguous scenarios, adhering closely to predefined decision frameworks. The study suggests that Generative AI can effectively engage in human-like metacognitive processing without conscious awareness. Implications of the study are discussed in relation to development of AI simulators that scaffold cognitive and metacognitive aspects of mastering coaching competencies. More broadly, implications of these results are discussed in relation to development of metacognitive modules that lead towards more autonomous and intuitive AI systems.
- [3] arXiv:2405.05292 [pdf, other]
-
Title: Smart Portable ComputerAuthors: Niladri DasComments: 34 pagesSubjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Robotics (cs.RO)
Amidst the COVID-19 pandemic, with many organizations, schools, colleges, and universities transitioning to virtual platforms, students encountered difficulties in acquiring PCs such as desktops or laptops. The starting prices, around 15,000 INR, often failed to offer adequate system specifications, posing a challenge for consumers. Additionally, those reliant on laptops for work found the conventional approach cumbersome. Enter the "Portable Smart Computer," a leap into the future of computing. This innovative device boasts speed and performance comparable to traditional desktops but in a compact, energy-efficient, and cost-effective package. It delivers a seamless desktop experience, whether one is editing documents, browsing multiple tabs, managing spreadsheets, or creating presentations. Moreover, it supports programming languages like Python, C, C++, as well as compilers such as Keil and Xilinx, catering to the needs of programmers.
- [4] arXiv:2405.05294 [pdf, other]
-
Title: Harmonizing Program Induction with Rate-Distortion TheoryComments: CogSci 2024Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Information Theory (cs.IT); Machine Learning (cs.LG); Symbolic Computation (cs.SC); Machine Learning (stat.ML)
Many aspects of human learning have been proposed as a process of constructing mental programs: from acquiring symbolic number representations to intuitive theories about the world. In parallel, there is a long-tradition of using information processing to model human cognition through Rate Distortion Theory (RDT). Yet, it is still poorly understood how to apply RDT when mental representations take the form of programs. In this work, we adapt RDT by proposing a three way trade-off among rate (description length), distortion (error), and computational costs (search budget). We use simulations on a melody task to study the implications of this trade-off, and show that constructing a shared program library across tasks provides global benefits. However, this comes at the cost of sensitivity to curricula, which is also characteristic of human learners. Finally, we use methods from partial information decomposition to generate training curricula that induce more effective libraries and better generalization.
- [5] arXiv:2405.05299 [pdf, other]
-
Title: Challenges for Responsible AI Design and Workflow Integration in Healthcare: A Case Study of Automatic Feeding Tube Qualification in RadiologyAuthors: Anja Thieme, Abhijith Rajamohan, Benjamin Cooper, Heather Groombridge, Robert Simister, Barney Wong, Nicholas Woznitza, Mark Ames Pinnock, Maria Teodora Wetscherek, Cecily Morrison, Hannah Richardson, Fernando Pérez-García, Stephanie L. Hyland, Shruthi Bannur, Daniel C. Castro, Kenza Bouzid, Anton Schwaighofer, Mercy Ranjit, Harshita Sharma, Matthew P. Lungren, Ozan Oktay, Javier Alvarez-Valle, Aditya Nori, Stephen Harris, Joseph JacobSubjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)
Nasogastric tubes (NGTs) are feeding tubes that are inserted through the nose into the stomach to deliver nutrition or medication. If not placed correctly, they can cause serious harm, even death to patients. Recent AI developments demonstrate the feasibility of robustly detecting NGT placement from Chest X-ray images to reduce risks of sub-optimally or critically placed NGTs being missed or delayed in their detection, but gaps remain in clinical practice integration. In this study, we present a human-centered approach to the problem and describe insights derived following contextual inquiry and in-depth interviews with 15 clinical stakeholders. The interviews helped understand challenges in existing workflows, and how best to align technical capabilities with user needs and expectations. We discovered the trade-offs and complexities that need consideration when choosing suitable workflow stages, target users, and design configurations for different AI proposals. We explored how to balance AI benefits and risks for healthcare staff and patients within broader organizational and medical-legal constraints. We also identified data issues related to edge cases and data biases that affect model training and evaluation; how data documentation practices influence data preparation and labelling; and how to measure relevant AI outcomes reliably in future evaluations. We discuss how our work informs design and development of AI applications that are clinically useful, ethical, and acceptable in real-world healthcare services.
- [6] arXiv:2405.05411 [pdf, ps, other]
-
Title: Permalife Of The Archive: Archaeogaming As QueergamingAuthors: Florence Smith NichollsComments: 9 pagesSubjects: Human-Computer Interaction (cs.HC)
Archaeogaming and queer games studies have both grown as paradigms in the last decade. The former broadly refers to the archaeological study of games, while the later concerns the application of queer theory to the medium. To date, there has been limited engagement of archaeogamers with queer games scholarship, and vice versa. This article argues that there are epistomological parallels between the two; as they are both concerned with the limits and ethics of representation, the personal and political contexts of game development and engagement with video games through transgressive play.
The paper is structured around an extended literature review and three vignettes that reflect on the author's personal experience of conducting archaeogaming research, an ethnographic study of Wurm Online, an archaeological survey of Elden Ring and a player study of the generative archaeology game Nothing Beside Remains. While archaeogaming can learn from the centring of subjective lived experience and labour in the queer games sphere, archaeogaming as a form of game preservation can also benefit queer games studies. - [7] arXiv:2405.05458 [pdf, ps, other]
-
Title: Studying Self-Care with Generative AI Tools: Lessons for DesignAuthors: Tara Capel, Bernd Ploderer, Filip Bircanin, Simon Hanmer, Jamie Yates, Jiaxuan Wang, Kai Ling Khor, Tuck Wah Leong, Greg Wadley, Michelle NewcombComments: 28 pages, 4 figures, to be published in the proceedings of the ACM Designing Interactive Systems Conference (DIS '24)Subjects: Human-Computer Interaction (cs.HC)
The rise of generative AI presents new opportunities for the understanding and practice of self-care through its capability to generate varied content, including self-care suggestions via text and images, and engage in dialogue with users over time. However, there are also concerns about accuracy and trustworthiness of self-care advice provided via AI. This paper reports our findings from workshops, diaries, and interviews with five researchers and 24 participants to explore their experiences and use of generative AI for self-care. We analyze our findings to present a framework for the use of generative AI to support five types of self-care, - advice seeking, mentorship, resource creation, social simulation, and therapeutic self-expression - mapped across two dimensions - expertise and modality. We discuss how these practices shift the role of technologies for self-care from merely offering information to offering personalized advice and supporting creativity for reflection, and we offer suggestions for using the framework to investigate new self-care designs.
- [8] arXiv:2405.05474 [pdf, ps, other]
-
Title: (Dis)placed Contributions: Uncovering Hidden Hurdles to Collaborative Writing Involving Non-Native Speakers, Native Speakers, and AI-Powered Editing ToolsSubjects: Human-Computer Interaction (cs.HC)
Content creation today often takes place via collaborative writing. A longstanding interest of CSCW research lies in understanding and promoting the coordination between co-writers. However, little attention has been paid to individuals who write in their non-native language and to co-writer groups involving them. We present a mixed-method study that fills the above gap. Our participants included 32 co-writer groups, each consisting of one native speaker (NS) of English and one non-native speaker (NNS) with limited proficiency. They performed collaborative writing adopting two different workflows: half of the groups began with NNSs taking the first editing turn and half had NNSs act after NSs. Our data revealed a "late-mover disadvantage" exclusively experienced by NNSs: an NNS's ideational contributions to the joint document were suppressed when their editing turn was placed after an NS's turn, as opposed to ahead of it. Surprisingly, editing help provided by AI-powered tools did not exempt NNSs from being disadvantaged. Instead, it triggered NSs' overestimation of NNSs' English proficiency and agency displayed in the writing, introducing unintended tensions into the collaboration. These findings shed light on the fair assessment and effective promotion of a co-writer's contributions in language diverse settings. In particular, they underscore the necessity of disentangling contributions made to the ideational, expressional, and lexical aspects of the joint writing.
- [9] arXiv:2405.05543 [pdf, ps, other]
-
Title: Predicting Cognitive Load Using Sensor Data in a Literacy GameComments: This work has been accepted by the 17th International Conference on Educational Data MiningSubjects: Human-Computer Interaction (cs.HC)
Educational games are being increasingly used to support self-paced learning. However, educators and system designers often face challenges in monitoring student affect and cognitive load. Existing assessments in game-based learning environments (GBLEs) tend to focus more on outcomes rather than processes, potentially overlooking key aspects of the learning journey that include learner affect and cognitive load. To address this issue, we collected data and trained a model to track learner cognitive load while they used an online literacy game for English. We collected affect-related physiological data and pupil data during gameplay to enable the development of models that identify these latent characteristics of learner processes. Our model indicates the feasibility of using these data to track cognitive load in GBLEs. Our multimodal model distinguished different levels of cognitive load, achieving the highest Kappa (.417) and accuracy (70%). Our model reveals the importance of including affect-related features (i.e., EDA and heart rate) when predicting cognitive load and extends recent findings suggesting the benefit of using multiple channels when modeling latent aspects of learner processes. Findings also suggest that cognitive load tracking could now be used to facilitate the creation of personalized learning experiences.
- [10] arXiv:2405.05548 [pdf, other]
-
Title: Investigating Interaction Modes and User Agency in Human-LLM Collaboration for Domain-Specific Data AnalysisComments: CHI'24 Late-Breaking WorkSubjects: Human-Computer Interaction (cs.HC)
Despite demonstrating robust capabilities in performing tasks related to general-domain data-operation tasks, Large Language Models (LLMs) may exhibit shortcomings when applied to domain-specific tasks. We consider the design of domain-specific AI-powered data analysis tools from two dimensions: interaction and user agency. We implemented two design probes that fall on the two ends of the two dimensions: an open-ended high agency (OHA) prototype and a structured low agency (SLA) prototype. We conducted an interview study with nine data scientists to investigate (1) how users perceived the LLM outputs for data analysis assistance, and (2) how the two test design probes, OHA and SLA, affected user behavior, performance, and perceptions. Our study revealed insights regarding participants' interactions with LLMs, how they perceived the results, and their desire for explainability concerning LLM outputs, along with a noted need for collaboration with other users, and how they envisioned the utility of LLMs in their workflow.
- [11] arXiv:2405.05579 [pdf, ps, other]
-
Title: Intelligent EC Rearview Mirror: Enhancing Driver Safety with Dynamic Glare Mitigation via Cloud Edge CollaborationSubjects: Human-Computer Interaction (cs.HC); Systems and Control (eess.SY)
Sudden glare from trailing vehicles significantly increases driving safety risks. Existing anti-glare technologies such as electronic, manually-adjusted, and electrochromic rearview mirrors, are expensive and lack effective adaptability in different lighting conditions. To address these issues, our research introduces an intelligent rearview mirror system utilizing novel all-liquid electrochromic technology. This system integrates IoT with ensemble and federated learning within a cloud edge collaboration framework, dynamically controlling voltage to effectively eliminate glare and maintain clear visibility. Utilizing an ensemble learning model, it automatically adjusts mirror transmittance based on light intensity, achieving a low RMSE of 0.109 on the test set. Furthermore, the system leverages federated learning for distributed data training across devices, which enhances privacy and updates the cloud model continuously. Distinct from conventional methods, our experiment utilizes the Schmidt-Clausen and Bindels de Boer 9-point scale with TOPSIS for comprehensive evaluation of rearview mirror glare. Designed to be convenient and costeffective, this system demonstrates how IoT and AI can significantly enhance rearview mirror anti-glare performance.
- [12] arXiv:2405.05581 [pdf, other]
-
Title: One vs. Many: Comprehending Accurate Information from Multiple Erroneous and Inconsistent AI GenerationsAuthors: Yoonjoo Lee, Kihoon Son, Tae Soo Kim, Jisu Kim, John Joon Young Chung, Eytan Adar, Juho KimComments: Accepted to FAccT 2024Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
As Large Language Models (LLMs) are nondeterministic, the same input can generate different outputs, some of which may be incorrect or hallucinated. If run again, the LLM may correct itself and produce the correct answer. Unfortunately, most LLM-powered systems resort to single results which, correct or not, users accept. Having the LLM produce multiple outputs may help identify disagreements or alternatives. However, it is not obvious how the user will interpret conflicts or inconsistencies. To this end, we investigate how users perceive the AI model and comprehend the generated information when they receive multiple, potentially inconsistent, outputs. Through a preliminary study, we identified five types of output inconsistencies. Based on these categories, we conducted a study (N=252) in which participants were given one or more LLM-generated passages to an information-seeking question. We found that inconsistency within multiple LLM-generated outputs lowered the participants' perceived AI capacity, while also increasing their comprehension of the given information. Specifically, we observed that this positive effect of inconsistencies was most significant for participants who read two passages, compared to those who read three. Based on these findings, we present design implications that, instead of regarding LLM output inconsistencies as a drawback, we can reveal the potential inconsistencies to transparently indicate the limitations of these models and promote critical LLM usage.
- [13] arXiv:2405.05627 [pdf, other]
-
Title: AI in Your Toolbox: A Plugin for Generating Renderings from 3D ModelsAuthors: Mingming WangComments: Submitted to SA24 as a posterSubjects: Human-Computer Interaction (cs.HC)
With the rapid development of LLMs and AIGC technology, we present a Rhino platform plugin utilizing stable diffusion technology. This plugin enables real-time application deployment from 3D modeling software, integrating stable diffusion models with Rhino's features. It offers intelligent design functions, real-time feedback, and cross-platform linkage, enhancing design efficiency and quality. Our ongoing efforts focus on optimizing the plugin to further advance AI applications in CAD, empowering designers with smarter and more efficient design tools. Our goal is to provide designers with enhanced capabilities for creating exceptional designs in an increasingly AI-driven CAD environment.
- [14] arXiv:2405.05678 [pdf, ps, other]
-
Title: Beyond Prompts: Learning from Human Communication for Enhanced AI Intent AlignmentSubjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
AI intent alignment, ensuring that AI produces outcomes as intended by users, is a critical challenge in human-AI interaction. The emergence of generative AI, including LLMs, has intensified the significance of this problem, as interactions increasingly involve users specifying desired results for AI systems. In order to support better AI intent alignment, we aim to explore human strategies for intent specification in human-human communication. By studying and comparing human-human and human-LLM communication, we identify key strategies that can be applied to the design of AI systems that are more effective at understanding and aligning with user intent. This study aims to advance toward a human-centered AI system by bringing together human communication strategies for the design of AI systems.
- [15] arXiv:2405.05758 [pdf, other]
-
Title: Exploring the Potential of Human-LLM Synergy in Advancing Qualitative Analysis: A Case Study on Mental-Illness StigmaComments: 55 pagesSubjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)
Qualitative analysis is a challenging, yet crucial aspect of advancing research in the field of Human-Computer Interaction (HCI). Recent studies show that large language models (LLMs) can perform qualitative coding within existing schemes, but their potential for collaborative human-LLM discovery and new insight generation in qualitative analysis is still underexplored. To bridge this gap and advance qualitative analysis by harnessing the power of LLMs, we propose CHALET, a novel methodology that leverages the human-LLM collaboration paradigm to facilitate conceptualization and empower qualitative research. The CHALET approach involves LLM-supported data collection, performing both human and LLM deductive coding to identify disagreements, and performing collaborative inductive coding on these disagreement cases to derive new conceptual insights. We validated the effectiveness of CHALET through its application to the attribution model of mental-illness stigma, uncovering implicit stigmatization themes on cognitive, emotional and behavioral dimensions. We discuss the implications for future research, methodology, and the transdisciplinary opportunities CHALET presents for the HCI community and beyond.
- [16] arXiv:2405.05910 [pdf, ps, other]
-
Title: Expanding Accessibility in Immersive Virtual Spaces: A Comprehensive Approach for All DisabilitiesAuthors: Cecilia Aragon, Melissa Vosen Callens, Stacy M. Branham, Cali Anicha, Brianna Blaser, Canan Bilen-GreenComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
In the early stages of the COVID-19 pandemic, many events and conferences hastily converted to a virtual format, and many commercial ventures promptly developed tools promising seamless transitions to virtual spaces. In particular, efforts to expand and monetize augmented and virtual reality environments increased. While these spaces increased accessibility for some, others were left behind. In 2024, many events returned to on-site venues, yet virtual spaces remain central in academic and research communities, particularly for disabled scholars. As such, in this paper, we advocate for continued virtual access and improved virtual spaces; we also identify some potentially overlooked harms in immersive and embodied virtual spaces.
- [17] arXiv:2405.05914 [pdf, ps, other]
-
Title: Risk of Harm in VR Dating from the Perspective of Women and LGBTQIA+ StakeholdersComments: First three listed authors had equal contributions. This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
Virtual reality (VR) dating introduces novel opportunities for romantic interactions, but it also raises concerns about new harms that typically occur separately in traditional dating apps and general-purpose social VR environments. Given the subjectivity in which VR dating experiences can be considered harmful it is imperative to involve user stakeholders in anticipating harms and formulating preventative designs. Towards this goal with conducted participatory design workshops with 17 stakeholders identified as women and/or LGBTQIA+; demographics that are at elevated risk of harm in online dating and social VR. Findings reveal that participants are concerned with two categories of harm in VR dating: those that occur through the transition of interaction across virtual and physical modalities, and harms stemming from expectations of sexual interaction in VR.
- [18] arXiv:2405.05915 [pdf, ps, other]
-
Title: From Virtual Gains to Real Pains: Potential Harms of Immersive ExergamesComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
Digitalization and virtualization are parts of our everyday lives in almost all aspects ranging from work, education, and communication to entertainment. A novel step in this direction is the widespread interest in extended reality (XR) [2]. The newest consumer-ready head-mounted displays (HMD) such as Meta Quest 3 or Apple Vision Pro, have reached unprecedented levels of visual fidelity, interaction capabilities, and computational power. The built-in pass-through features of these headsets enable both virtual reality (VR) and augmented reality (AR) with the same devices. However, the immersive nature of these experiences is not the only groundbreaking difference from established forms of media.
- [19] arXiv:2405.05916 [pdf, ps, other]
-
Title: Leveraging Artificial Intelligence to Promote Awareness in Augmented Reality SystemsAuthors: Wangfan Li, Rohit Mallick, Carlos Toxtli-Hernandez, Christopher Flathmann, Nathan J. McNeeseComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
Recent developments in artificial intelligence (AI) have permeated through an array of different immersive environments, including virtual, augmented, and mixed realities. AI brings a wealth of potential that centers on its ability to critically analyze environments, identify relevant artifacts to a goal or action, and then autonomously execute decision-making strategies to optimize the reward-to-risk ratio. However, the inherent benefits of AI are not without disadvantages as the autonomy and communication methodology can interfere with the human's awareness of their environment. More specifically in the case of autonomy, the relevant human-computer interaction literature cites that high autonomy results in an "out-of-the-loop" experience for the human such that they are not aware of critical artifacts or situational changes that require their attention. At the same time, low autonomy of an AI system can limit the human's own autonomy with repeated requests to approve its decisions. In these circumstances, humans enter into supervisor roles, which tend to increase their workload and, therefore, decrease their awareness in a multitude of ways. In this position statement, we call for the development of human-centered AI in immersive environments to sustain and promote awareness. It is our position then that we believe with the inherent risk presented in both AI and AR/VR systems, we need to examine the interaction between them when we integrate the two to create a new system for any unforeseen risks, and that it is crucial to do so because of its practical application in many high-risk environments.
- [20] arXiv:2405.05917 [pdf, ps, other]
-
Title: Fostering Inclusive Virtual Reality Environments: Discussing Strategies for Promoting Group Dynamics and Mitigating HarassmentComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
The rapid evolution of social Virtual Reality (VR) platforms has significantly enhanced the way users interact and socialize in digital spaces, offering immersive experiences that closely mimic real-world interactions [1]. However, this technological advancement has brought new challenges, particularly in ensuring safety and preventing harassment [11]. Unlike traditional social media platforms, the immersive nature of social VR applications can intensify the impact of harassment, affecting users' emotions, experiences, and reactions at both mental and physical levels [2, 9].
Group dynamics can play a pivotal role in both preventing and mitigating harassment [9]. Literature in group dynamics has provided insights into fostering and nurturing communities, with special emphasis on how enabling leadership, coordination, and cohesion among individuals can enable inclusive and safer social spaces [4]. For this workshop, we propose to discuss group-centric approaches to address harassment in social VR. We will discuss group strategies such as matching, interactions, and reporting mechanisms aimed at promoting safer and more supportive social VR spaces. By leveraging the social structures among users, we aim to empower users and communities to collectively counteract harassment and ensure a positive social experience for all users. - [21] arXiv:2405.05918 [pdf, ps, other]
-
Title: Safeguarding People's Financial Health in Metaverse with Emotionally Intelligent Virtual BuddyComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
The Metaverse, an immersive virtual world, has emerged as a shared space where people engage in various activities ranging from social interactions to commerce. Cryptocurrencies [3] and Non-Fungible Tokens (NFTs) [6] play pivotal roles within this virtual realm, reshaping interactions and transactions. Cryptocurrencies, utilizing cryptographic techniques for security, enable decentralized and secure transactions, and NFTs represent ownership or proof of authenticity of unique digital assets through the blockchain technology. While NFTs and cryptocurrencies offer innovative opportunities for ownership, trading, and monetization within the metaverse, their use also introduces potential risks and negative consequences, such as financial scams and fraud, highlighting the need for users to exercise caution and diligence in their virtual transactions.
- [22] arXiv:2405.05919 [pdf, ps, other]
-
Title: Protecting Human Users Against Cognitive Attacks in Immersive EnvironmentsComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
Integrating mixed reality (MR) with artificial intelligence (AI) technologies, including vision, language, audio, reasoning, and planning, enables the AI-powered MR assistant [1] to substantially elevate human efficiency. This enhancement comes from situational awareness, quick access to essential information, and support in learning new skills in the right context throughout everyday tasks. This blend transforms interactions with both the virtual and physical environments, catering to a range of skill levels and personal preferences. For instance, computer vision enables the understanding of the user's environment, allowing for the provision of timely and relevant digital overlays in MR systems. At the same time, language models enhance comprehension of contextual information and support voice-activated dialogue to answer user questions. However, as AI-driven MR systems advance, they also unveil new vulnerabilities, posing a threat to user safety by potentially exposing them to grave dangers [5, 6].
- [23] arXiv:2405.05920 [pdf, ps, other]
-
Title: Exploring Proactive Interventions toward Harmful Behavior in Embodied Virtual SpacesAuthors: Ruchi PanchanadikarComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
Technological advancements have undoubtedly revolutionized various aspects of human life, altering the ways we perceive the world, engage with others, build relationships, and conduct our daily work routines. Among the recent advancements, the proliferation of virtual and mixed reality technologies stands out as a significant leap forward, promising to elevate our experiences and interactions to unprecedented levels. However, alongside the benefits, these emerging technologies also introduce novel avenues for harm and misuse, particularly in virtual and embodied spaces such as Zoom and virtual reality (VR) environments.
The immersive nature of virtual reality environments raises unique challenges regarding psychological and emotional well-being. While VR can offer captivating and immersive experiences, prolonged exposure to virtual environments may lead to phenomena like cybersickness, disorientation, and even psychological distress in susceptible individuals. Additionally, the blurring of boundaries between virtual and real-world interactions in VR raises ethical concerns regarding consent, harassment, and the potential for virtual experiences to influence real-life behavior. Additionally, the increasing integration of artificial intelligence (AI) and machine learning algorithms in virtual spaces introduces risks related to algorithmic bias, discrimination, and manipulation. In VR environments, AI-driven systems may inadvertently perpetuate stereotypes, amplify inequalities, or manipulate user behavior through personalized content recommendations and targeted advertising, posing ethical dilemmas and societal risks. - [24] arXiv:2405.05922 [pdf, ps, other]
-
Title: Understanding and Mitigating Harmful Design in User-Generated Virtual WorldsComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
Virtual space offers innovative ways for individuals to engage with one another in a digital setting. Prominent virtual social platforms, such as Facebook Spaces, VR Chat, and AltspaceVR, facilitate social connections, allowing users to interact seamlessly. Additionally, certain video games, like Second Life and World of Warcraft, are set within these virtual spaces as well, providing immersive player experiences. As the popularity of virtual space grows, various companies have begun to democratize the process of creating these spaces, shifting the development from skilled professionals to hobbyist creators. Platforms like Minecraft, Roblox, and RecRoom enable users to create and publish their own virtual environments, hosting a wide range of interactions and narratives. This shift echoes the rise of user-generated content, where content creators create and publish content on platforms, such as social media platforms [6]. For example, YouTubers upload videos on YouTube and Reddit users post text-based content on Reddit. For a long time, user-generated content has predominantly contained text, videos, and images. However, with the emergence of virtual spaces, some platforms now allow creators to create and publish their own virtual spaces, leading to the emergence of user-generated virtual worlds.
- [25] arXiv:2405.05923 [pdf, ps, other]
-
Title: Darkverse -- A New DarkWeb?Comments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
The "Darkverse" could be the negative harmful area of the Metaverse; a new virtual immersive environment for the facilitation of illicit activity such as misinformation, fraud, harassment, and illegal marketplaces. This paper explores the potential for inappropriate activities within the Metaverse, and the similarities between the Darkverse and the Dark Web. Challenges and future directions for investigation are also discussed, including user identification, creation of privacy-preserving frameworks and other data monitoring methods.
- [26] arXiv:2405.05924 [pdf, ps, other]
-
Title: Privacy Protection and Video Manipulation in Immersive MediaComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
In comparison to traditional footage, 360{\deg} videos can convey engaging, immersive experiences and even be utilized to create interactive virtual environments. Like regular recordings, these videos need to consider the privacy of recorded people and could be targets for video manipulations. However, due to their properties like enhanced presence, the effects on users might differ from traditional, non-immersive content. Therefore, we are interested in how changes of real-world footage like adding privacy protection or applying video manipulations could mitigate or introduce harm in the resulting immersive media.
- [27] arXiv:2405.05926 [pdf, ps, other]
-
Title: New Harms Moderated by Immersive Experiences and Breaks in ThemAuthors: Eugene KukshinovComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
This proposal highlights the potential real-world consequences of harmful experiences in immersive and embodied spaces due to presence, which moderates experiences, intensifying positive or negative content. While positive experiences enhance social interactions, negative content can lead to harm. Also, presence is not continuous and may break. Understanding the threshold between harmful experiences and breaks in presence is essential. This proposal underscores the need to explore whether the level of immersion or the nature of harm defines the boundary, emphasizing key discussion points for the workshop.
- [28] arXiv:2405.05928 [pdf, ps, other]
-
Title: Moderating Embodied Cyber Threats Using Generative AIComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
The advancement in computing and hardware, like spatial computing and VR headsets (e.g., Apple's Vision Pro) [1], has boosted the popularity of social VR platforms (VRChat, Rec Room, Meta HorizonWorlds) [2, 3, 4]. Unlike traditional digital interactions, social VR allows for more immersive experiences, with avatars that mimic users' real-time movements and enable physical-like interactions. However, the immersive nature of social VR may introduce intensified and more physicalized cyber threats-we define as "embodied cyber threats", including trash-talking, virtual "groping", and such virtual harassment and assault. These new cyber threats are more realistic and invasive due to direct, virtual interactions, underscoring the urgent need for comprehensive understanding and practical strategies to enhance safety and security in virtual environments.
- [29] arXiv:2405.05929 [pdf, ps, other]
-
Title: Understanding Emotional Hijacking in MetaverseComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
Emotions are an integral part of being human, and experiencing a range of emotions is what makes life rich and vibrant. From basic emotions like anger, fear, happiness, and sadness to more complex ones like excitement and grief, emotions help us express ourselves and connect with the world around us. In recent years, researchers have begun adopting virtual reality (VR) technology to evoke emotions as realistically as possible and quantify the strength of emotions from the electroencephalogram (EEG) signals measured from the brain to understand human emotions in realistic situations better. This is achieved by creating a sense of presence in the virtual environment, the feeling that the user is there. For instance, [6] studied the excitement of a rollercoaster ride in VR, and [5] studied the fear of navigating in a VR cave.
- [30] arXiv:2405.05931 [pdf, ps, other]
-
Title: Harms in Repurposing Real-World Sensory Cues for Mixed Reality: A Causal PerspectiveComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
The rise of Mixed Reality (MR) stimulates new interactive techniques that seamlessly blend the virtual and physical environments. Just as virtual content could be overlayed onto the physical world for providing adaptive user interfaces [5, 8], emergent techniques "repurpose" everyday environments and sensory cues to support the virtual content [7, 9, 13-15]. For instance, a strong wind gust in the real world, rather than being distracting to the virtual experience, can be mapped with trees swaying in MR to achieve a unifying experience [15], as shown in Figure 1. Such techniques introduce stronger immersion, but they also expose users to overlooked perceptual manipulations, where safety risks arise from misperception of real-world events. In this work, we apply a causal inference perspective to understand the harms of repurposing real-world sensory cues for MR. We argue that by viewing the MR experience as a causal inference process of interpreting cues arising from both the virtual and physical world, MR designers and researchers can gain a new lens to understand potential perceptual manipulation harms.
- [31] arXiv:2405.05933 [pdf, ps, other]
-
Title: Considering Avatar Crossing as Harm or Help for Adolescents in Social VRComments: This is an accepted position statement of CHI 2024 Workshop (Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024)Subjects: Human-Computer Interaction (cs.HC)
People leverage avatars to communicate nonverbal behaviors in immersive virtual reality (VR), like interpersonal distance [2, 6] and virtual touch [5]. However, violations of appropriate physical distancing and unsolicited intimate touching behavior in social virtual worlds represent potential social and psychological virtual harm to older adolescent users [4, 8]. Obtaining peer acceptance and social rewards, while avoiding social rejection can drive older adolescent behavior even in simulated virtual spaces [1, 3], and while "the beginning of adolescence is largely defined by a biological event, [...] the end of adolescence is often defined socially" [3] (p.912). Avatar crossing, the phenomenon of avatars walking through each other in virtual environments, is a unique capability of virtual embodiment, and others intriguing possibilities and ethical concerns for older adolescents experiencing social virtual spaces. For example, the ability to cross through and share positions with other avatars in a virtual classroom helps students concentrate on accessing and comprehending information without concerns about blocking others when navigating for better viewpoints [10]. However, the ability to cross through others in virtual spaces has been associated with a reduction in perceived presence and avatar realism, coupled with a greater level of discomfort and intimidation in comparison to avatar collisions [12]. In this article, we consider the potential benefits and harms of utilizing avatar crossing with adolescent users.
- [32] arXiv:2405.05947 [pdf, other]
-
Title: A Survey on Visualization Approaches in Political Science for Social and Political Factors: Progress to Date and Future OpportunitiesAuthors: Dongyun Han, Abdullah-Al-Raihan Nayeem, Jason Windett, Yaoyao Dai, Benjamin Radford, Isaac ChoSubjects: Human-Computer Interaction (cs.HC)
Politics is the set of activities related to strategic decision-making in groups. Political scientists study the strategic interactions between states, institutions, politicians, and citizens; they seek to understand the causes and consequences of those decisions and interactions. While some decisions might alleviate social problems, others might lead to disasters such as war and conflict. Data visualization approaches have the potential to assist political scientists in their studies by providing visual contexts. However, political researchers' perspectives on data visualization are unclear. This paper examines political scientists' perspectives on visualization and how they apply data visualization in their research. We discovered a growing trend in the use of graphs in political science journals. However, we also found a knowledge gap between the political science and visualization domains, such as effective visualization techniques for tasks and the use of color studied by visualization researchers. To reduce this gap, we survey visualization techniques applicable to the political scientists' research and report the visual analytics systems implemented for and evaluated by political scientists. At the end of this paper, we present an outline of future opportunities, including research topics and methodologies, for multidisciplinary research in political science and data analytics. Through this paper, we expect visualization researchers to get a better grasp of the political science domain, as well as broaden the possibility of future visualization approaches from a multidisciplinary perspective.
Cross-lists for Fri, 10 May 24
- [33] arXiv:2405.05345 (cross-list from cs.CL) [pdf, other]
-
Title: QuaLLM: An LLM-based Framework to Extract Quantitative Insights from Online ForumsComments: Accepted to CHI LLM as Research Tools Workshop (2024)Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
Online discussion forums provide crucial data to understand the concerns of a wide range of real-world communities. However, the typical qualitative and quantitative methods used to analyze those data, such as thematic analysis and topic modeling, are infeasible to scale or require significant human effort to translate outputs to human readable forms. This study introduces QuaLLM, a novel LLM-based framework to analyze and extract quantitative insights from text data on online forums. The framework consists of a novel prompting methodology and evaluation strategy. We applied this framework to analyze over one million comments from two Reddit's rideshare worker communities, marking the largest study of its type. We uncover significant worker concerns regarding AI and algorithmic platform decisions, responding to regulatory calls about worker insights. In short, our work sets a new precedent for AI-assisted quantitative data analysis to surface concerns from online forums.
- [34] arXiv:2405.05378 (cross-list from cs.CL) [pdf, other]
-
Title: "They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated ConversationsAuthors: Preetam Prabhu Srikar Dammu, Hayoung Jung, Anjali Singh, Monojit Choudhury, Tanushree MitraSubjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
Large language models (LLMs) have emerged as an integral part of modern societies, powering user-facing applications such as personal assistants and enterprise applications like recruitment tools. Despite their utility, research indicates that LLMs perpetuate systemic biases. Yet, prior works on LLM harms predominantly focus on Western concepts like race and gender, often overlooking cultural concepts from other parts of the world. Additionally, these studies typically investigate "harm" as a singular dimension, ignoring the various and subtle forms in which harms manifest. To address this gap, we introduce the Covert Harms and Social Threats (CHAST), a set of seven metrics grounded in social science literature. We utilize evaluation models aligned with human assessments to examine the presence of covert harms in LLM-generated conversations, particularly in the context of recruitment. Our experiments reveal that seven out of the eight LLMs included in this study generated conversations riddled with CHAST, characterized by malign views expressed in seemingly neutral language unlikely to be detected by existing methods. Notably, these LLMs manifested more extreme views and opinions when dealing with non-Western concepts like caste, compared to Western ones such as race.
- [35] arXiv:2405.05420 (cross-list from cs.CY) [pdf, ps, other]
-
Title: The Power of Absence: Thinking with Archival Theory in Algorithmic DesignComments: 16 pages, to be published in the 2024 ACM Conference on Designing Interactive Systems (DIS '24)Subjects: Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
This paper explores the value of archival theory as a means of grappling with bias in algorithmic design. Rather than seek to mitigate biases perpetuated by datasets and algorithmic systems, archival theory offers a reframing of bias itself. Drawing on a range of archival theory from the fields of history, literary and cultural studies, Black studies, and feminist STS, we propose absence-as power, presence, and productive-as a concept that might more securely anchor investigations into the causes of algorithmic bias, and that can prompt more capacious, creative, and joyful future work. This essay, in turn, can intervene into the technical as well as the social, historical, and political structures that serve as sources of bias.
- [36] arXiv:2405.05792 (cross-list from cs.RO) [pdf, other]
-
Title: RoboHop: Segment-based Topological Map Representation for Open-World Visual NavigationAuthors: Sourav Garg, Krishan Rana, Mehdi Hosseinzadeh, Lachlan Mares, Niko Sünderhauf, Feras Dayoub, Ian ReidComments: Published at ICRA 2024; 9 pages, 8 figuresSubjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
Mapping is crucial for spatial reasoning, planning and robot navigation. Existing approaches range from metric, which require precise geometry-based optimization, to purely topological, where image-as-node based graphs lack explicit object-level reasoning and interconnectivity. In this paper, we propose a novel topological representation of an environment based on "image segments", which are semantically meaningful and open-vocabulary queryable, conferring several advantages over previous works based on pixel-level features. Unlike 3D scene graphs, we create a purely topological graph with segments as nodes, where edges are formed by a) associating segment-level descriptors between pairs of consecutive images and b) connecting neighboring segments within an image using their pixel centroids. This unveils a "continuous sense of a place", defined by inter-image persistence of segments along with their intra-image neighbours. It further enables us to represent and update segment-level descriptors through neighborhood aggregation using graph convolution layers, which improves robot localization based on segment-level retrieval. Using real-world data, we show how our proposed map representation can be used to i) generate navigation plans in the form of "hops over segments" and ii) search for target objects using natural language queries describing spatial relations of objects. Furthermore, we quantitatively analyze data association at the segment level, which underpins inter-image connectivity during mapping and segment-level localization when revisiting the same place. Finally, we show preliminary trials on segment-level `hopping' based zero-shot real-world navigation. Project page with supplementary details: oravus.github.io/RoboHop/
Replacements for Fri, 10 May 24
- [37] arXiv:2201.13448 (replaced) [pdf, other]
-
Title: Warmth and competence in human-agent cooperationComments: Accepted at Autonomous Agents and Multi-Agent SystemsSubjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY); Machine Learning (cs.LG)
- [38] arXiv:2311.05867 (replaced) [pdf, other]
-
Title: PodReels: Human-AI Co-Creation of Video Podcast TeasersSubjects: Human-Computer Interaction (cs.HC)
- [39] arXiv:2312.07454 (replaced) [pdf, other]
-
Title: "You Might Like It": How People Respond to Small Talk During Human-Robot CollaborationComments: 25 pages, 6 figures, 7 tables,Subjects: Human-Computer Interaction (cs.HC); Robotics (cs.RO)
- [40] arXiv:2405.01795 (replaced) [pdf, ps, other]
-
Title: Human Factors in the LastPass BreachAuthors: Niroop SugunarajSubjects: Human-Computer Interaction (cs.HC); Cryptography and Security (cs.CR)
- [41] arXiv:2308.04588 (replaced) [pdf, other]
-
Title: ScatterUQ: Interactive Uncertainty Visualizations for Multiclass Deep Learning ProblemsComments: 5 pages, 4 figures, accepted to IEEE VIS 2023Journal-ref: 2023 IEEE Visualization and Visual Analytics (VIS)Subjects: Machine Learning (cs.LG); Human-Computer Interaction (cs.HC)
- [42] arXiv:2312.07077 (replaced) [pdf, other]
-
Title: On the Potential of an Independent Avatar to Augment Metaverse Social NetworksComments: Supported by the projects: Piano Nazionale di Ripresa e Resilienza IR0000013 - "SoBigData.it", Partenariato Esteso PE00000013 - "FAIR", Centro Nazionale CN00000013 - "ICSC"Journal-ref: IEEE ICCCN 2024Subjects: Social and Information Networks (cs.SI); Human-Computer Interaction (cs.HC)
- [43] arXiv:2401.15356 (replaced) [pdf, other]
-
Title: A Decision Theoretic Framework for Measuring AI RelianceSubjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
- [44] arXiv:2403.02939 (replaced) [pdf, other]
-
Title: PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected PapersAuthors: Yoonjoo Lee, Hyeonsu B. Kang, Matt Latzke, Juho Kim, Jonathan Bragg, Joseph Chee Chang, Pao SiangliulueComments: Accepted to CHI 2024Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
- [45] arXiv:2405.00099 (replaced) [pdf, other]
-
Title: Creative Beam Search: LLM-as-a-Judge For Improving Response GenerationSubjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
[ showing up to 2000 entries per page: fewer | more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, cs, recent, 2405, contact, help (Access key information)