SOCRAR: Semantic OCR through Augmented Reality
Journal
Proceedings of the 12th International Conference on the Internet of Things
ISBN
9781450396653
Type
conference paper
Date Issued
2022-11-11
Author(s)
Abstract
To enable people to interact more efficiently with virtual and physical services in their surroundings, it would be beneficial if information could more fluently be passed across digital and non-digital spaces. To this end, we propose to combine semantic technologies with Optical Character Recognition on an Augmented Reality (AR) interface to enable the semantic integration of (written) information located in our everyday environments with Internet of Things devices. We hence present SOCRAR, a system that is able to detect written information from a user’s physical environment while contextualizing this data through a semantic backend. The SOCRAR system enables in-band semantic translation on an AR interface, permits semantic filtering and selection of appropriate device interfaces, and provides cognitive offloading by enabling users to store information for later use. We demonstrate the feasibility of SOCRAR through the implementation of three concrete scenarios.
Language
English
Keywords
Knowledge Graph
Web of Things
Ubiquitous Computing
Augmented Reality
Optical Character Recognition
HSG Classification
contribution to scientific community
Refereed
Yes
Publisher
ACM
Publisher place
New York, NY, USA
Start page
25
End page
32
Event Title
12th International Conference on the Internet of Things (IoT ’22)
Event Location
Delft, Netherlands
Event Date
November 7-10, 2022
Official URL
Subject(s)
Division(s)
Contact Email Address
jannisrene.strecker@unisg.ch
Eprints ID
267988
File(s)![Thumbnail Image]()
Name
Strecker2022-SOCRAR.pdf
Size
1.79 MB
Format
Adobe PDF
Checksum (MD5)
ec38f08a8bcae2ee66fbe7d68f041ee9