Now showing 1 - 4 of 4
  • Publication
    MR Object Identification and Interaction: Fusing Object Situation Information from Heterogeneous Sources
    (ACM, 2023-09-28) ;
    Khakim Akhunov
    ;
    Federico Carbone
    ;
    ; ; ; ;
    Kasim Sinan Yildirim
    The increasing number of objects in ubiquitous computing environments creates a need for effective object detection and identification mechanisms that permit users to intuitively initiate interactions with these objects. While multiple approaches to such object detection-including through visual object detection, fiducial markers, relative localization, or absolute spatial referencing-are available, each of these suffers from drawbacks that limit their applicability. In this paper, we propose ODIF, an architecture that permits the fusion of object situation information from such heterogeneous sources and that remains vertically and horizontally modular to allow extending and upgrading systems that are constructed accordingly. We furthermore present BLEARVIS, a prototype system that builds on the proposed architecture and integrates computer-vision (CV) based object detection with radio-frequency (RF) angle of arrival (AoA) estimation to identify BLE-tagged objects. In our system, the front camera of a Mixed Reality (MR) head-mounted display (HMD) provides a live image stream to a vision-based object detection module, while an antenna array that is mounted on the HMD collects AoA information from ambient devices. In this way, BLEARVIS is able to differentiate between visually identical objects in the same environment and can provide an MR overlay of information (data and controls) that relates to them. We include experimental evaluations of both, the CV-based object detection and the RF-based AoA estimation, and discuss the applicability of the combined RF and CV pipelines in different ubiquitous computing scenarios. This research can form a starting point to spawn the integration of diverse object detection, identification, and interaction approaches that function across the electromagnetic spectrum, and beyond.
    Type:
    Journal:
    Volume:
    Issue:
    Scopus© Citations 2
  • Publication
    Embedding Autonomous Agents into Low-Power Wireless Sensor Networks
    ( 2023) ;
    Jannik William
    ;
    Matuzalem Muller Dos Santos
    ;
    Maiquel De Brito
    ;
    Jomi Fred Hubner
    ;
    ;
    Low-power sensors are increasingly becoming available, equipped with more energy-efficient processing and networking capabilities. Still, in order to accommodate the independent deployment and intermittent availability of such constrained devices, engineers often manually reconfigure system behavior for integrating sensors and actuators into complex and context-aware systems. The Multi-Agent Systems paradigm enables engineering systems where components can be deployed more independently and operate towards achieving their design objectives. In this process, they act autonomously and interact with others to perform context-aware decision-making without human intervention at run time. In this paper, we present autonomous agents implemented as low-power nodes that perceive and act in a shared environment through sensors and actuators. The autonomous agents on these constrained devices locally reason and act on the environment, and wirelessly interact with each other to share knowledge and enable more context-aware system behavior. The capabilities of our low-power autonomous nodes are demonstrated in a light-control scenario with two Belief-Desire-Intention agents. Our experiments demonstrate that running autonomous and social agents in low-power platforms incurs little overhead, indicating their feasibility.
  • Publication
    Increasing the Intelligence of low-power Sensors with Autonomous Agents
    ( 2022)
    William, Jannik
    ;
    Muller dos Santos, Matuzalém
    ;
    de Brito, Maiquel
    ;
    Hübner, Jomi Fred
    ;
    ;
  • Publication
    Secure Communication with Batteryless Sensors
    ( 2022-06-07)
    Stricker, Naomi
    ;
    Liam, Jan Albert
    ;
    Rabbani, Md Masoon
    ;
    ;