EdTech Discovery
Argus

Named after the hundred-eyed watchman of Greek myth, Argus watches the education landscape: spotting new opportunities, pressure-testing the ventures we're building, and tracing every read back to the real-world signals behind it.

Updated Aug 31, 2026 · 36 ideas · 18349 signals

Signals

The evidence library: the raw signals the pipeline is watching across the education ecosystem. Every idea is built from these.

technology Mon, 24 Aug 2026 00:00:00 -0400
arXiv cs.HC

Pneumatic Units for Logic-based Sequential Excitation (PULSE) in Wearable Haptic Devices

arXiv:2608.20626v1 Announce Type: new Abstract: Soft, wearable robotic devices can deliver haptic feedback to support a wide range of tasks, such as extended reality, training various skills, and rehabilitation. Pneumatic actuation can deliver complex haptic feedback, is lightweight and compliant, and can be incorporated into textiles, making it promising for wearable applications. These soft pneumatic devices, however, typically require a valve and input for each pneumatic actuator, making it challenging to develop fully portable devices for at-home use. In this work we present a pneumatic unit for logic-based sequential excitation (PULSE). The PULSE is a flat, textile-based pneumatic actuator with embedded fluidic logic. By combining these actuators into a fluidic ring oscillator, we decreased the typical amount of required pneumatic inputs for a haptic forearm sleeve by 60%, with the ability to scale. We built the ring oscillator by optimizing design variables to reach desired perio

Source ↗
technology Mon, 24 Aug 2026 00:00:00 -0400
arXiv cs.HC

Disentangling Threads: Exploring the Potential of LLM-Supported Discussion Forum Analysis for Community Insight

arXiv:2608.20591v1 Announce Type: new Abstract: Online discussion forums enable people from diverse backgrounds to share ideas, feedback, and perspectives. These organic discussions can help researchers understand communities' collective viewpoints, but insights are often difficult to uncover given their freeform reply structure. Large language models (LLMs) support qualitative text analysis but can misalign with researchers' analytical intent and miss key insights. To inform design considerations for forum sensemaking tools, we manually analyzed a forum discussion, synthesized an exploratory analysis framework from relevant literature, built a design probe, and interviewed 21 researchers to uncover perceived opportunities and barriers with LLM representations of collective discussions. We provide recommendations for community sensemaking tools to support flexible analytical goals grounded in raw user data and enable follow-up research processes, while balancing anonymous free expressi

Source ↗
technology Mon, 24 Aug 2026 00:00:00 -0400
arXiv cs.HC

Me Among Us: Affective Framing in Data Donation

arXiv:2608.20523v1 Announce Type: new Abstract: This study investigates how different framing approaches influence the affective aspects of data donation decision-making. Although framing effects are well studied in charitable giving, how affective framing shapes data donation, especially through data visualization, remains poorly understood. Using a theoretical framework based on the functions of affect in decision-making, we examine how three distinct framing approaches, an individual-donor lens (Group A), an individual-collective lens (Group B), and a collective-institutional lens (Group C), shape participants' affective experiences and subsequent donation decisions. Through a real-world data donation study (N=24), we found that framing designs substantially influenced donation outcomes, with the individual-collective lens generating the most favorable responses. Our analysis illustrates how affect can functions as information, motivation, and as a spotlight during the decision-maki

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Attention-Guided Saliency Maps for Interpreting Visualization Literacy in VLMs

arXiv:2607.16105v1 Announce Type: cross Abstract: Understanding how vision-language models (VLMs) interpret data visualizations remains an open problem, and is increasingly important as these models are used for analytical tasks where reliable reasoning is essential. We introduce a lightweight, diagnostic saliency map method tailored for text generation over images using transformer models, the current state-of-the-art models in visualization interpretation. Our approach aggregates the language model's attention over the visual tokens across all heads and layers, then maps this attention back onto the vision encoder's patch grid to localise it over the image, producing a direct correspondence between each generated answer token and the image regions it attended to. This yields fast, gradient-free saliency maps that expose how VLMs allocate focus across visual elements during answer generation, enabling inspection of whether model attention aligns with semantically relevant components.

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

EgoExoMoCap: Distributed Ego-Exo Human Motion Capture

arXiv:2607.15868v1 Announce Type: cross Abstract: Human motion capture from head-mounted devices (HMDs) offers a scalable way to acquire real-world human motion and interaction data, which is crucial for applications in embodied AI and VR/AR. Existing approaches focus on either egocentric body tracking, estimating the motion of the subject wearing the device, or exocentric tracking, capturing the movements of people in the wearer's surroundings. So far, these two paradigms have largely been explored in isolation. In this paper, we propose a novel distributed framework that jointly leverages ego- and exocentric multi-modal signals for human motion estimation from HMDs. Unlike traditional motion capture systems requiring bulky multi-camera setups or obtrusive mocap suits, our approach, EgoExoMoCap, is as simple as two (or more) people, each wearing a pair of smart glasses. The method leverages head (plus potentially wrist) tracking signals for accurate estimation of global motion in the

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

On the Structure of Address in Multi-Party Dialogue: From Discrete Labels to Continuous Levels

arXiv:2607.15648v1 Announce Type: cross Abstract: In multi-party dialogues between a dialogue system and multiple users, identifying to whom an utterance is addressed is a key challenge. Prior work has typically treated addressee detection as a multi-class classification task, selecting a single label representing an individual participant or the group. This formulation assumes that address is inherently discrete and has primarily been used for predicting turn-taking. In this paper, we revisit this assumption by analyzing address as a continuous phenomenon. Using a multi-party human dialogue corpus annotated by multiple annotators, we construct both binary address labels derived from majority-vote addressee labels and continuous address levels inferred from annotator judgments using a latent-variable model. We then examine how these representations relate to turn-taking as well as listener behaviors, including gaze and backchannels. Our results show that, in addition to turn-taking, bo

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

PACE: Persona Adaptation through Conversational Elicitation in Human-Robot Interaction

arXiv:2607.15579v1 Announce Type: cross Abstract: Equipping humanoid robots with coherent and adaptable personas is crucial for fostering natural, engaging, and trustworthy human-robot interaction (HRI). However, existing approaches often rely on static, hard-coded identities that lack the flexibility to adapt to individual user contexts. In this paper, we present PACE (Persona Adaptation through Conversational Elicitation), a novel framework for the interactive generation and deployment of structured personas on the Ameca humanoid robot. Our system introduces an Interactive Persona Elicitation Pipeline, enabling the robot to dynamically synthesize a tailored, psychologically grounded identity through user Q&A. This elicitation process feeds into a persona prompt compilation phase, generating a structured persona prompt built upon multi-perspective dimensions. We detail the Embodied System Integration required to translate this structured specification into expressive, multimodal human

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

A Human-Centric Evaluation of a Retrieval-Augmented Generation System for Explaining Quebec Insurance Contracts

arXiv:2607.15963v1 Announce Type: new Abstract: With the rise of online insurance sales, consumers face a significant \enquote{advice gap}, requiring them to navigate complex legal contracts without expert guidance. This paper presents a human-centric, extrinsic evaluation of a state-of-the-art Retrieval-Augmented Generation system, designed to make Quebec automobile insurance contracts more understandable. Through a user study with 154 participants from Laval University, we assess the agent's real-world utility by measuring system satisfaction, cognitive effort, perceived autonomy, and risk. Our results show the system is perceived as a \enquote{cognitive equalizer}, receiving high ratings for satisfaction, trust, and clarity. Crucially, users value the sense of autonomy the system provides even more than the knowledge itself, with this effect being most pronounced among participants with lower financial literacy, demonstrating how such an agent can directly empower individuals. Howev

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Perceived AGI: Believability as Dimensional Completeness, Not Capability

arXiv:2607.15883v1 Announce Type: new Abstract: Large language models are broadly capable, yet in sustained one-to-one conversation they still read as flat: competent, responsive, and somehow not quite the presence of a mind. We hypothesize that a central missing ingredient is not more capability but dimensional completeness. We propose that the believability of an artificial interlocutor -- the degree to which a user attributes an inner life to it, which we call perceived mind -- is governed by whether the agent expresses a small set of first-person stances that humans use as evidence of mind, and that this is separable from task intelligence. We name four such dimensions -- time, truth, entropy, and love -- each defined as a behavioral stance rather than a benchmark competency, each with a human analog and a concrete emulation path; the time dimension already has an author-reported prototype. We identify an observable behavior layer -- initiative (unprompted action) and cadence (the

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Breakdowns for Human-Machine Creative Reflexivity

arXiv:2607.15866v1 Announce Type: new Abstract: Generative AI (GenAI) works via goal-directed computation, which differs fundamentally from human creative processes. This poses challenges for the intelligent support of creative experiences. We propose ``breakdowns'' as opportunities for the exchange of perspectives between human and machine. Breakdowns disrupt a flow and force us to consciously evaluate our ``being-in-the-world''. Between human and machine, breakdowns can function as openings for collaborative creative reflection. We are currently studying human-human creative interactions, to identify the markers of these inter-subjective openings, and to understand how they are used in a co-creative process. We present preliminary findings on breakdowns as a design principle for creativity support, prioritising human creative agency and meaningful reflection over automated content generation.

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Can't Stop: How Context and Individual Traits Influence Effectiveness of Different Gradual Interventions for Infinite Scrolling on Short-Form Video Platforms

arXiv:2607.15818v1 Announce Type: new Abstract: Infinite scrolling on short-form video platforms like TikTok encourages prolonged engagement and post-usage regret. Interventions aim to mitigate such behavior, but their effectiveness may depend on the interplay between intervention type, contextual factors, and individual traits. In a 7-day within-subject randomized field study (N=104), we compared a baseline pop-up and two gradually intensifying design frictions (visual and haptic). We evaluated behavioral changes and user experience using objective and subjective measures. Results showed that the pop-up was initially effective but quickly lost impact, whereas the visual gradual intervention sustained subjective ratings the longest. Bayesian modeling revealed that self-regulation traits moderate how participants responded to the three intervention types. For participants with low impulsivity, the type of intervention had little influence on its subjective effectiveness. For participant

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Understanding Fortunetelling with Large Language Models in China: User Practices, Perceptions, and Impacts on Beliefs and Decisions

arXiv:2607.15626v1 Announce Type: new Abstract: Fortunetelling is a cultural practice for navigating uncertainty, often associated with people's beliefs and decisions. Fortunetelling with recent large language models (LLMs) introduces new opportunities and risks. This paper conducts qualitative studies to understand users' practices, perceptions, and impacts of LLM fortunetelling in China. We first analyze 1,045 posts on Chinese social media, yielding a comprehensive taxonomy of the diverse foretold topics (e.g., career, romance), emotion reactions (e.g., surprise, worry), and perceived credibility (e.g., doubt, trust) of LLM fortunetelling. Then, we conduct interviews with 20 users of LLM fortunetelling. The findings indicate that users treat LLM fortunetelling as a tool less for accurate prediction but more for emotional support. While the fortunetelling results rarely change users' initial beliefs or decisions, they are associated with subtle mindset shifts, with some users reportin

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Visualization Autocomplete: Visualization Authoring via Stepwise Design Recommendations

arXiv:2607.15608v1 Announce Type: new Abstract: When domain experts create charts, the bottleneck is rarely the data, but knowing the optimal next step in chart design. The visualization design space is vast, and while domain experts can recognize a good design when they see it, it is often challenging to determine the exact path to get there. To address this, we present VISAUTOCOMPLETE, a system inspired by text autocompletion that reconceptualizes visualization design as a sequential process, recommending concrete next steps at each stage of the authoring process based on common practices. Users can intervene at any step, or delegate multiple steps to the system and select one from the design recommendations. To support responsive interaction, we distill the translation logic of a large language model (LLM) into a single function that receives the current chart state and recommended transition as input and returns the updated chart specification as output. We evaluate the system agai

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Physiological Prior-Driven Label Enhancement for Cross-Subject EEG Emotion Recognition

arXiv:2607.15566v1 Announce Type: new Abstract: Electroencephalography (EEG)-based emotion recognition captures affective neural signals with high temporal precision, but cross-subject variability and label noise remain critical challenges to its practical healthcare deployment. Existing label-denoising methods lack physiological grounding, while physiology-informed approaches rely on hand-crafted hyperparameters. To bridge these two paradigms, we propose PhyDA, a plug-and-play, tuning-free framework that unifies neurophysiological priors with data-driven label refinement. PhyDA comprises two modules. Since cross-subject variability renders global thresholds suboptimal, the Physiological Noise Quantifier (PhyNQ) exploits a spectral slope} to produce a subject-specific noise score, providing a neurophysiologically interpretable quality assessment {that naturally adapts to each individual. The Data-Adaptive Label Refiner (DALR) directly adopts this noise score as the contamination ratio

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

CASAband: Easy-to-Wear Textile Wristband using Shape Memory Alloy Actuators for Spatial and Temporal Haptic Feedback

arXiv:2607.15533v1 Announce Type: new Abstract: Haptic interfaces for the wrist and forearm offer an attractive alternative to hand-worn devices as they are simple to wear, leave the hands free for interaction with the real world, and interfere minimally with natural arm motions. To be useful in real-world settings, however, such devices must balance functionality, wearability and comfort, all while being fully untethered with minimal mass and volume. In this work, we present CASAband, a haptic wristband that integrates compliant amplified shape memory alloy actuators (CASA) into a multi-layered textile wristband to deliver spatial and temporal haptic feedback. CASAband operates completely untethered, generates no noise, and has a total mass of 63 g. The device incorporates four actuators that can generate up to 1.7 N of blocked force and 3.2 mm of free displacement with an operating bandwidth ranging from 1.34-6.59 Hz depending on the applied voltage. We conducted a perceptual study a

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Interactive Mascot: A Scene-Centric Interaction Grammar for Data Visualizations

arXiv:2607.15523v1 Announce Type: new Abstract: Scene-centric visualization systems expose semantic components, such as marks, encodings, layouts, and axes, as first-class objects that can be directly manipulated. Existing interaction abstractions, however, are largely based on event streams, signals, and data selections rather than semantic scene components. This mismatch makes interactions involving scene components less natural to specify and limits the expressive power of scene-centric visualization systems. We present Interactive Mascot, a scene-centric interaction grammar for data visualizations. Interactive Mascot extends scene-centric representations for static visualizations by modeling interactive behavior as information flow among four interaction components (trigger, responder, evaluator, and updater) and two forms of context (event context and state context). To realize these semantics, we introduce a dependency-graph execution model that systematically transforms interact

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Assessing Learning Processes with Multimodal Data in Virtual Reality Learning Environments

arXiv:2607.15403v1 Announce Type: new Abstract: Assessing learning in virtual reality (VR) environments typically relied on traditional pre-post content retention tests, revealing little about the process of learnng within such immersive environments. Multimodal data from player activity in VR is promising to better measure learning processes and higher-order skills, but little research in the learning sciences has explored how such data can be combined to provide meaningful measures. To address this, we explored multimodal sources of data from a VR escape room containing hands-on logic puzzles that require problem-solving strategies and engagement in verbal metacognitive reflections. We leverage VR's affordances to immerse users in sustained dialog and promote multimodal interactions in a digital environment to understand how logfile and verbal data reveal participants' reasoning skills versus guesswork.

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Interactive 3D Tangible Display with a High-Speed Stiffness-Variable Jamming Module

arXiv:2607.15325v1 Announce Type: new Abstract: Multisensory integration, particularly through visual and tactile feedback, plays a crucial role in enhancing audience engagement with artworks. Although recent research has increasingly explored tactile experiences in art, existing systems often lack real-time variable stiffness modulation and depend on bulky mechanical infrastructures. In this work, we propose a novel tangible display based on a magnetic jamming mechanism, enabling real-time, low-noise, and low-voltage stiffness modulation integrated into traditional sculptural artworks. Our system combines visual motion and dynamic tactile feedback within a compact standalone module, allowing audiences to interactively experience variations in the rigidity and form of features such as those found in the traditional Korean mask Hahoetal. This approach offers a new paradigm for interactive art, enabling more immersive, multisensory engagement through the fusion of cultural artifacts and

Source ↗
technology Mon, 20 Jul 2026 00:00:00 -0400
arXiv cs.HC

Empathy as Predictive Misalignment Tolerance: A Co-Regulation Framework and the Regime Structure of Dialogue Repair

arXiv:2607.15282v1 Announce Type: new Abstract: Empathy is most often theorized as resonance: a mirroring of another's present emotional or cognitive state. This synchronic framing has shaped artificial systems, where empathic behavior is defined as affect recognition and response alignment. We argue this is the wrong target for extended dialogue, where understanding unfolds over time through prediction, divergence, and repair. We reframe empathy as predictive misalignment tolerance: the capacity to anticipate and regulate divergence across time rather than collapse it. We formalize this as Interpretive Error Tolerance (IET), a dynamic-threshold heuristic that models empathy as maintaining a viable band of divergence between agents. We evaluate this framework with two computational probes under controlled noise. The IET update rule does not outperform fixed baselines. Instead, we find a robust regime-dependent structure: repair trades discriminative fidelity for gist preservation. At l

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Musical Agent Systems: MACAT and MACataRT

arXiv:2502.00023v2 Announce Type: replace-cross Abstract: Our research explores the development and application of musical agents, human-in-the-loop generative AI systems designed to support music performance and improvisation within co-creative spaces. We introduce MACAT and MACataRT, two distinct musical agent systems crafted to enhance interactive music-making between human musicians and AI. MACAT is optimized for agent-led performance, employing real-time synthesis and self-listening to shape its output autonomously, while MACataRT provides a flexible environment for collaborative improvisation through audio mosaicing and sequence-based learning. Both systems emphasize training on personalized, small datasets, fostering ethical and transparent AI engagement that respects artistic integrity. This research highlights how interactive, artist-centred generative AI can expand creative possibilities, empowering musicians to explore new forms of artistic expression in real-time, performan

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Experiencing Apple's Lockdown Mode -- The Challenges of Providing Technology for At-Risk Users

arXiv:2411.13249v2 Announce Type: replace-cross Abstract: Lockdown Mode, introduced in 2022 as an optional security hardening setting for Apple's operating systems, aims to protect users from "some of the most sophisticated digital threats". We present the first academic analysis of Lockdown Mode based on a three-month autoethnographic study of its everyday use. Our findings show that Lockdown Mode does not adhere to most principles proposed by Matthews et al. (2025) for technologies supporting prevention and monitoring of digital threats for at-risk users. Apple provides limited information about the underlying threat model and affected functionality, making it difficult for at-risk users to understand and evaluate the tool. Usability challenges further highlight the need for more granular controls, while the high volume of notifications offers little support for attack detection and instead contributes to user annoyance. Although we consider Lockdown Mode an important step toward imp

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Envisioning Mobile Data Visualization Libraries for Digital Health

arXiv:2604.24448v2 Announce Type: replace Abstract: Mobile health (mHealth) applications support health management through the collection and visualization of rich data, yet the quality of the visualizations varies widely. A key limitation lies in the challenge of effectively visualizing temporally dense, irregular, and context-dependent health data within the constrained mobile interfaces. We argue that this gap is partly driven by a lack of specialized developer tools. Existing libraries primarily target desktop or general-purpose mobile use, providing limited support for health-specific semantics such as normal ranges, thresholds, and goals. As a result, developers often resort to custom solutions that are inconsistent or hard to interpret. We therefore advocate for dedicated mobile visualization libraries tailored to personal health data and mobile contexts, and discuss key design considerations including intelligent defaults, built-in health annotations, and fluid interaction. Suc

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Ten simple rules for non-visual, reproducible and accessible bioinformatics

arXiv:2608.14400v1 Announce Type: cross Abstract: Bioinformatics workflows rely heavily on visual representations. Quality-control plots, cell embeddings, heatmaps, genome-browser tracks, and interactive dashboards are not merely illustrations, but instruments for making analytical decisions. For blind and low-vision researchers who use screen readers, braille displays, or audio-based interfaces, these create a barrier: the evidence used to justify an analysis is often encoded in visual form, while the underlying decision remains undocumented. We argue that non-visual accessibility and computational reproducibility are closely aligned, as they both require analyses to be transparent and to record why decisions were made. We present ten simple rules for non-visual bioinformatics, covering plots as decision records, cautious use of AI-generated figure descriptions, accessible computing environments, text-first literate programming, structured data and metadata, compact object summaries,

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Intelligent Detection of Mechanical, Electrical, and Plumbing (MEP) Metrics Based on 2D Floor Plans

arXiv:2608.14317v1 Announce Type: cross Abstract: This research developed a neural network-based model to extract various information from 2D floor plans. We detect lighting symbols, identify the appropriate type of light, and extract the associated texts with lights. The study aims to enable efficient floor designing and determining the number and type of lights needed per floor, i.e., allow efficient design and estimate the power requirement of the floor plan. The model was developed using Mask RCNN as the base. The images were annotated and converted into a Coco data format for training the model. The model achieved bbox\_mAP and segm\_mAP values of 0.7596 and 0.7111, respectively. It also performed well at different IoU thresholds, i.e., with bbox\_mAP 50 and segm\_mAP 75 values of 0.9850 and 0.9219, respectively. The developed model will help various industries, such as architecture and construction, to improve design time and create efficient workflows by automatically detecting

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

AlignFace: Human-Aligned Face Similarity Metric with Interpretable Concept Relations

arXiv:2608.14130v1 Announce Type: cross Abstract: Computer vision models for generated facial content, such as face editing and privacy protection, increasingly affect people, requiring similarity metrics that serve as faithful proxies for human perception. While perceptual evaluation has progressed from signal-based heuristics to representation-based metrics, current approaches are limited to behavioral modeling without cognitive alignment. They rely on implicit and spurious relations while assuming a universal observer, failing to account for inherent variations across diverse human populations. This leads to inaccurate evaluative models of stakeholders and misleading guidance for generative model debugging. Rather than treating perception as a black box, we leverage scientific findings from cognitive psychology of human face similarity perception: dependence on facial featural and configural attributes, nonlinear psychophysical response scaling, and own-group biases. We introduce th

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Engineering Signals of Human-AI Collaboration in the Agentic Coding Era: A Longitudinal Analysis of 33,228 Pull Requests from vLLM and SGLang with Implications for Biomedical AI Agents and Bioinformatics Pipeline Developmen

arXiv:2608.13884v1 Announce Type: cross Abstract: The rapid adoption of AI coding assistants and autonomous agentic development systems has coincided with major changes in the pace and structure of open-source software engineering. Yet empirical longitudinal evidence of these changes at the team level remains limited. We present a descriptive longitudinal analysis of seven engineering metrics: pull request (PR) throughput, cycle time, contributor diversity, PR comment density, merge rate, new-author participation, and PR size. Metrics were computed from all merged PRs in two high-velocity AI infrastructure repositories, vLLM (February 2023-June 2026; 18,290 PRs) and SGLang (January 2024-June 2026; 14,938 PRs). We segment development into four eras aligned with major changes in AI-assisted software development and examine human- and bot-authored activities. Both projects show substantial increases in development velocity and AI-developer collaboration signals. PR throughput increased 21

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Architecture and Affordances of PLAUD: Performative Latents and Unsupervised DDSP

arXiv:2608.13724v1 Announce Type: cross Abstract: PLAUD (Performative Latents and Unsupervised DDSP) is a neural synthesizer and Max for Live instrument for live electronic music, built on NoiseBandNet and trained on small personal sound corpora. We present its architecture, combining a variational DDSP synthesis model, latent smoothing, multi-scale spectral and adversarial losses, and an optional transformer prior, alongside a set of bending operations that intervene directly in the synthesis chain: component limiting, waveshaping, and prior feedback. The Max for Live interface exposes control generation, trajectory sampling, and modulation as primary modes of interaction. Throughout, we thread an affordance analysis arguing that the system's performative character follows from architectural decisions rather than being designed on top of them. The paper contributes both a technical account of the system and a situated affordance analysis of its role in live electronic music performanc

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Cross-Disciplinary Taxonomy and Modeling of Misunderstanding Generation, Amplification, and Detection, from Pragmatics to AI Agents

arXiv:2608.13604v1 Announce Type: cross Abstract: Detection of misunderstanding is an urgent problem to solve because communication has moved away from real-time, in-person interaction and is increasingly handled by AI-mediated channels. This shift cuts communicators off from the resources repair depends on faster than new means of detection are being built. In this paper we analyse misunderstanding as a layered process in which a divergence is generated, may then be amplified, and is either detected and repaired or left to persist unnoticed. Consolidating accounts from nine fields of research that do not ordinarily cite one another, we identify eleven exact failure modes and show that each operates at a specific point in a communicative process rather than anywhere within it. Those points give eight analytical layers, derived from the literature rather than adopted from an existing model. Eight of the mechanisms primarily generate a divergence, two primarily amplify one already presen

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Towards Scaling Qualitative Analysis of Video Data

arXiv:2608.13594v1 Announce Type: cross Abstract: Scaling qualitative video analysis is difficult as studies grow. This paper presents QualiVision, a design probe examining how an interactive, spreadsheet-backed workspace can support video-based qualitative analysis. By integrating video, transcripts, coding streams, preliminary reports, heuristic visualization and AI support, QualiVision aims to help researchers preserve evidence, compare interpretations, and conduct iterative, reflexive sensemaking as their analysis evolves.

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Visualizing Uncertainty in Non-linear Projections with Ensembles

arXiv:2608.14513v1 Announce Type: new Abstract: Widely used non-linear dimensionality reduction (NLDR) methods such as UMAP and t-SNE are stochastic--repeated runs on the same data can produce different low-dimensional projections. In this paper, we explore two problems related to projection variability: on some datasets clusters, structure, and outliers may change run-to-run, and on others projections can be extremely stable when overfitting noise. To address the first problem, we propose visualizing the median of multiple NLDR outputs rather than relying on individual projections. To address the second, we perturb input data before creating consensus embeddings. We find that taking the median of multiple projections performs comparably to individual runs on multiple quality metrics, while increasing perturbation emphasizes global over local structure. We show through a set of exploratory visualizations that even relatively simple ensemble presentations can be used to better communica

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework

arXiv:2608.14405v1 Announce Type: new Abstract: Art style is a signature of professional digital artists that develops through repeated experimentation, reflection, and adaptation. While generative AI (GenAI) can reproduce styles with high fidelity, current tools provide limited support for exploring new stylistic directions and may encourage style replication over exploration. To address this gap, we propose Analyze-Experiment-Resituate (AER), a framework for AI-assisted style exploration derived from interviews with 10 professional digital artists. Rather than prioritizing visually appealing outputs alone, AER supports three core practices of style exploration, including interpreting references, trying out stylistic possibilities, and reflecting on how emerging styles may be received. Specifically, AER enabled artists to (1) analyze artworks into interpretable stylistic elements, (2) have controllable experimentation guided by their own choices, and (3) resituate emerging styles thro

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Human and Artificial Intelligence - Promoting Trustworthy and Understandable Collaboration

arXiv:2608.14291v1 Announce Type: new Abstract: Methods of Artificial Intelligence (AI) enable the personalization of information for individual user experiences in many domains; however, they can also conflict with established design principles, e.g., due to uncertainties regarding the real world. Building trust and understanding can serve as an approach to create a more balanced relationship between humans and AI. Building upon a pilot study, an online survey was conducted to investigate 12 individual aspects related to the topics of explainability and controllability. The results indicate that both topics, despite their different and numerous facets, are generally perceived as important by respondents; simultaneously, however, a wide dispersion of opinions is frequently observed. This could be an indication that, alongside a fundamental consensus, individual perspectives, technical knowledge and understanding, context-specific factors, or personal experiences play a role in the perc

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Designing Mobile and Wearable Sensor-Fused Conversational Agents for Health and Wellbeing

arXiv:2608.14273v1 Announce Type: new Abstract: Mobile and wearable devices increasingly collect continuous wellbeing data, including sleep, activity, heart rate, stress, blood glucose, and blood pressure. Yet access to such data does not automatically help people interpret their condition or change behavior. Many health applications remain dashboard-first, presenting charts, thresholds, goals, and alerts while leaving users to decide what a change means and what action should follow. Conversely, generic LLM-based conversational agents (CAs) can provide fluent advice, but without personal sensor grounding, they cannot detect individualized patterns or provide contextual guidance. This three-hour tutorial teaches participants how to move from passive monitoring to actionable wellbeing dialogue. Participants examine a dashboard that combines wearable health-data visualization with conversational-agent feedback, then use Wearable Sensor-Dialogue Wellbeing Agent Studio (WSDWAS) to simulate

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Physics-Bounded mmWave Sensing for Schedulable, Privacy-Preserving Human Pose Estimation

arXiv:2608.14176v1 Announce Type: new Abstract: Millimeter-wave (mmWave) is a promising modality for human pose estimation (HPE) in mobile deployments with strong privacy requirements and limited resources, such as fall detection in bathrooms or activity monitoring in bedrooms, where cameras are inadmissible and computationally demanding processing is infeasible. Although mmWave signals naturally confine human reflections to compact, physically bounded regions, the algorithmic foundations of existing systems fail to provide deterministic execution and accuracy guarantees. They either process the full spectrum uniformly, resulting in unpredictable latency that varies across different scenes, or apply lossy compression that discards vital pose structures. To address this, we present PRISM, a framework that exploits the spatial concentration of RF reflections to achieve schedulable edge HPE. PRISM introduces three core components: 1) Physics-Bounded Integral Processing (PBIP), which restr

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Act2Intention: A Benchmark For Developing Active Mobile Agents Through Inferring User Intention from GUI Actions

arXiv:2608.14132v1 Announce Type: new Abstract: Mobile GUI Agents powered by multimodal large language models (MLLMs) show promise in human-computer intelligence. However, current research primarily focuses on reactive task execution while lacking a comprehensive understanding-prediction-execution process for user intentions, which are the core requirements of active agents. In this paper, we propose the Act2Intention framework that builds an active mobile agent by integrating understanding, predicting user intentions, and executing decisions. First, we construct the Act2Intention Bench through data collection and validated generation, comprising 72,511 intentions and over 700,000 actions across 52 apps, thereby establishing the first benchmark for evaluating proactive agents via continuous intention-action trajectories. We further develop the Act2Intention Agent, achieving proactive services through Proactive-oriented Intention Understanding, Personalized Proactive Intention Predictio

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Search or Chat? Comparing How We Learn About Debated Topics

arXiv:2608.14113v1 Announce Type: new Abstract: As large language models (LLMs) become more integrated into everyday information platforms, chat-based systems are emerging as a popular alternative to traditional web searches, especially for informational search and informal learning tasks. Despite this shift, little is known about how different tools affect learning outcomes. Our work aims to improve the understanding of how chat-based information access supports and impacts learning performance in informal learning settings. In this paper, we present the results of a crowdsourcing user study (N = 194) that compares learning about debated topics using a traditional search interface versus an LLM-powered chat interface. Through our analysis of learning outcomes, user characteristics, and interaction patterns, we found no significant differences in user learning gain or critical reflection on our study tasks. Our observations from the analysis of further exploratory variables suggest tha

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

AppLooper: An Agentic Application Engineering Loop for Accountable Release with Virtual-User Feedback

arXiv:2608.14093v1 Announce Type: new Abstract: Much existing research on coding agents organizes application development as an iterative loop of requirement interpretation, implementation, tool execution, evaluation, and repair. As these loops run longer, requirements may drift; users may lose awareness of the current state and rationale for changes; and generated applications may remain insufficiently grounded in target users' contexts and needs. Application engineering therefore requires a mechanism connecting owner intent, target-user experience, development changes, and responsibility for release. We present AppLooper, a human--coding-agent--virtual-user application engineering loop for accountable release. An application owner confirms frozen requirements, supplies feedback, inspects candidates, and retains final release authority. A development agent produces and revises versioned candidates. A virtual-user agent cohort executes interface scenarios grounded in target users and c

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Musical Mirrors: The LLM as Sounding Board in Songwriting

arXiv:2608.13944v1 Announce Type: new Abstract: This paper examines a use of AI in creative practice as an interpretive sounding board for human-generated material, rather than the more familiar pattern of AI generation followed by human curation. Through the lens of resonance as theorized by Hartmut Rosa, I present a first-person case study of songwriting from July 2025 to March 2026, drawing on 16 original pieces in English, French, and other languages along with piano solos. I describe a configuration in which resonance is not located between user and model, but in the author's deepening contact with their own material, mediated through the model. This kind of resonance was supported rather than inhibited by AI when sounding-board behavior was cultivated through sustained calibration by the user. Two failure modes appeared when calibration was absent: sycophantic drift and magical overinterpretation. This account suggests both the potential and the risks of AI as an interpretive par

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

DepressionAgent: Reading, Listening, Seeing, and Deliberating Multimodal Evidence for Depression Risk Assessment

arXiv:2608.13891v1 Announce Type: new Abstract: Multimodal depression risk assessment requires jointly interpreting textual, acoustic, and visual cues that are often subtle, non-specific, context-dependent, and potentially inconsistent across modalities. Existing multimodal approaches predominantly learn latent representations through feature fusion, leaving the evidence underlying a prediction and the treatment of cross-modal disagreement largely implicit. We propose DepressionAgent, an evidence-centric agentic framework that transforms multimodal depression assessment from implicit feature fusion into explicit evidence deliberation. DepressionAgent first converts textual, acoustic, and visual inputs into modality-specific evidence, and then organizes self-report and behavioral evidence into parallel support--challenge deliberation branches. Cross-modal arbitration explicitly examines agreement and disagreement between the two branches, with conflict reflection revisiting inconsistent

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

The Capturing and Logging Ecological Virtual Experiences and Reality (CLEVER) - Job Simulator Dataset

arXiv:2608.13715v1 Announce Type: new Abstract: Virtual reality (VR) motion tracking and interaction data has become increasingly recognized as valuable for machine learning experiments for a variety of purposes, including predicting user identities, predicting user attributes like gender and age, predicting retention and learning, and more. However, there exist a limited number of publicly accessible VR motion datasets. In this paper, we present a new open-source dataset of 95 participants playing the SteamVR game Job Simulator. Additionally, we review existing datasets, detail our study procedure, describe our data collection process, list attributes of our dataset, and suggest future work, impact, and applications.

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

FabDreamer: Exploring the Image-to-Physical Workflow Through AI-Assisted Layered Fabrication

arXiv:2608.13665v1 Announce Type: new Abstract: Generative AI lets anyone create rich visual content in seconds, yet translating that content into a physically fabricable artifact still demands manual decomposition, occlusion repair, and structural verification that most tools leave entirely to the user. We present FabDreamer, an image-to-physical system that carries an image to fabrication-ready SVGs through three stages with deliberately staged AI initiative: (1) AI leads decomposition into depth-ordered layers, (2) assists on demand during creative editing with realtime 3D preview, and (3) advises on structural integrity before export. We instantiate this workflow for layered laser-cut art and evaluate it through three rounds including a formative analysis, an early prototype user evaluation (N=13), and a cross-domain practitioner study with specialists from 6 fabrication domains (N=6). Our findings show that physical awareness during design opens creative opportunities beyond error

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Context Aware AI Assistant and AR Interface for Lunar Extravehicular Activity (EVA) Procedural Guidance

arXiv:2608.13589v1 Announce Type: new Abstract: As human space exploration returns to the Moon, astronauts need rapid access to procedural information during extravehicular activities (EVAs), where attention is divided across navigation, repair tasks, tool handling, and environmental risk. The challenge is not the absence of information, but surfacing the right information at the right moment. We present GAIN-AI (Guided Assistant for Intelligent Navigation), a context-aware AI assistant and minimal heads-up interface for procedural guidance in simulated lunar EVA. The system operates in two layers. The first grounds a large language model with structured context: EVA procedure documents, live telemetry data, and error-handling protocols encoded as JSON. The second restructures that output into three compact units for AR display: Goal, Task, and Verification. Evaluated on 111 synthetic EVA scenarios, the system scores 10.0/10 on nominal conditions and 8.15/10 on single-fault scenarios,

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Student-ChatGPT Interaction Visible: Designing a Teacher Dashboard for EFL Writing Education

arXiv:2608.13587v1 Announce Type: new Abstract: We present a Prompt Analytics Dashboard (PAD) for teachers that can traces student-LLM interactions from EFL writing classes. PAD can show student prompt-response exchanges with LLM chatbot and English essay writing revision histories to support data-informed instruction and visibility in classes. Through two iterative co-design sessions with six EFL instructors, we distilled a compact trace taxonomy (misuse signals, goal-alignment cues, revision effort) and instantiated three interface views (overview, week/outcome filter, drill-down with evidence snippets). This pipeline summarizes potential misuse and alignment at class/cohort levels and attaches micro-explanations to reduce over-surveillance. Instructors reported reduced scanning burden and clearer timing for interventions.

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

FactorFlow: A Visual Analytics Workspace with Large Language Model-Assisted Interpretation for Factor Analysis

arXiv:2608.13585v1 Announce Type: new Abstract: In exploratory factor analysis (EFA), one typically aims to extract and describe a small number of factors (i.e., latent variables) based on the relationships among numerous manifest variables (i.e., directly observable variables). In practice, performing EFA entails examining different factor models (and rotations) to identify the underlying latent structure. Now, the primary criterion for evaluating a factor model is interpretability. That is, the preferred model is the one that yields a meaningful, coherent, and theoretically defensible factor structure. However, gauging a model's interpretability is not a trivial task, as it is subjective and often requires keeping track of large amounts of information simultaneously. Because of this, researchers typically employ various visualizations to interpret models and determine the "best" one. Hence, we introduce FactorFlow, a visual analytics workspace for performing EFA end-to-end. Using Fac

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

UltraArUco: A Lightweight Multilingual Library And Framework With Low-Latency Real-Time Marker-Based Tracking System For Mobile AR Interaction

arXiv:2608.13584v1 Announce Type: new Abstract: UltraArUco - a lightweight multilingual library and framework for low-latency, real-time marker-based tracking in mobile augmented reality. Unlike standard OpenCV-based implementations, UltraArUco introduces an optimized multilingual wrapper that reduces per-frame latency by five times, while maintaining high accuracy. Distributed Wi-Fi architecture provides portability, connects a mobile device (camera input) with a PC-based visual application, enabling responsive interactions. The framework is validated through an interactive piano simulation, where static ArUco markers on keys enable occlusion-based note triggering, and hand-mounted markers provide spatial gesture recognition. UltraArUco's system requirements make it perfect for resource-constrained mobile AR applications, demonstrating a viable AR music application without specialized equipment.

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Beyond Simplification: DFT-GEN for Fidelity-Preserving Visual Accessibility in Dyslexia-Friendly Educational Texts

arXiv:2608.13583v1 Announce Type: new Abstract: Dense educational texts impose avoidable reading friction on people with dyslexia, yet generic simplification can delete terminology, task constraints, or source evidence that readers still need. Stakeholder interviews with dyslexic adults and specialists reveal a core tension: reduced burden must not compromise information fidelity. We present DFT-GEN, a stakeholder-informed text transformation framework for content-heavy educational materials. Its central contribution is not a generic LLM refinement loop, but a dyslexia-specific accessibility layer that combines protected-span preservation with a deterministic Dyslexia Accessibility Controller (DAC) for rendered visual organization. DAC converts stakeholder and expert preferences into reproducible controls for visual-unit length, chunk spacing, source/task separation, highlighting budget, and reviewable risk flags. We therefore separate evaluation into DCFI, a fidelity-safety diagnostic

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

From Prediction to Intervention: Personalized Meal-Level Glucose Regulation via an LLM Agent

arXiv:2608.13581v1 Announce Type: new Abstract: Personalized glucose regulation remains a central yet unresolved challenge in precision nutrition, as postprandial glucose response varies substantially across individuals. Existing approaches based on glycemic indices fail to adequately account for such heterogeneity and lack the mechanism to dynamically adjust meals based on personal physiological feedback. In this context, recent advances in LLM-based agents offer a promising direction, as they enable context-aware reasoning and iterative refinement. Inspired by this, we propose a physio-feedback agentic loop, a unified system that integrates individualized absorption modeling with dietary intervention to regulate glucose response. Specifically, we develop a Physiology-Aware Glucose Predictor to model individualized absorption dynamics through a learnable Temporal Physiological Absorption Decay Module. We then construct a Prediction-Driven Two-Stage Meal Optimization Agent that iterati

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

BCIJelly: An integrated ecosystem for brain-computer interface research

arXiv:2608.13576v1 Announce Type: new Abstract: Brain-computer interface (BCI) research relies on multistage computational pipelines, yet progress remains constrained by fragmented data formats, heterogeneous decoder implementations and hardware-specific deployment toolchains, and researchers lack an integrated workflow. Here, we fill this gap with BCIJelly, a unified computational ecosystem that integrates 18 curated BCI datasets, 15 benchmark decoders and an algorithmic library of 80 reusable modules, an automated architecture search (AAS) procedure, and hardware-aware deployment through the toChip pipeline within a single Python framework. AAS constructs task-specific decoders without manual architecture design. It is further extended into a closed-loop mode guided by a large language model (LLM), which uses task specifications, module descriptions and search history to support multitask and cross-species decoding. The toChip pipeline compiles trained decoders for execution on neuro

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

Interactive Analysis of Global Explanations using Aggregated Class Activation Maps for Network Data

arXiv:2608.13575v1 Announce Type: new Abstract: Recent machine learning (ML) advances have demonstrated that deep learning (DL) achieves impressive results in different application domains, including the classification of computer network traffic to corresponding applications. However, the data frequently contains diverging patterns within a single predicted class. This presents a significant challenge to the ability to provide a clear and comprehensive explanation and emphasizes the necessity for tools capable of detecting and analyzing these patterns. Furthermore, the capacity to extract descriptive rules for classes is a crucial requirement in network traffic analysis and intrusion detection, particularly when leveraging advanced tools like next-generation firewalls. We provide a visual-interactive system that explains predictions of classes for network traffic. Global explanations derived from multiple samples of a given class contribute to understanding model predictions. Visualiz

Source ↗
technology Mon, 17 Aug 2026 00:00:00 -0400
arXiv cs.HC

The Architect: Interactive Visualization of Deep Learning Mathematics Directly in Microsoft Excel

arXiv:2608.13572v1 Announce Type: new Abstract: We present The Architect, a system that turns Microsoft Excel into an interactive view of deep learning mathematics. A user describes a neural network in a compact table. The system then generates a workbook that shows the full forward pass and, when requested, the backward pass and parameter updates. Computed values appear as live spreadsheet formulas, while user-controlled values such as inputs, weights, labels, and hyperparameters remain editable. Excel reactively updates the dependent computations through its recalculation engine. Most deep learning tools hide the numerical details behind library calls. Many visualization tools show architecture diagrams or training summaries, but they do not expose the full arithmetic of the model. The Architect focuses on that missing middle layer. It makes matrices, activations, losses, gradients, and updates visible as inspectable spreadsheet regions, with editable controls for values users natura

Source ↗
Showing 1201–1250 of 1631 signals
← Prev Page 25 of 33 Next →