A common problem with spatial immersive applications is the placement of UI elements in the space. On the one hand, a menu needs to be accessible and on the other hand, it must not be in the way of the user when it is not needed. Moreover, the menus need to adapt to the room’s characteristics, e.g. to avoid problems where menus clip through walls and become unreachable. For mixed reality applications, the environment can vary from small rooms to large lecture halls. UI systems must account for this. For instance, UI elements cannot be placed in a fixed position in space without respecting the spatial mapping of the real environment. Instead, a more intelligent solution is required for positioning UI elements in space.
Thesis Type |
|
Student |
Yanxi Liu |
Status |
Finished |
Submitted in |
2021 |
Proposal on |
25/05/2021 1:00 pm |
Proposal room |
|
Presentation on |
05/10/2021 1:30 pm |
Supervisor(s) |
Ralf Klamma |
Advisor(s) |
Benedikt Hensen |
Contact |
hensen@dbis.rwth-aachen.de |
The goal of this thesis is to conceptualize and develop a system that intelligently places menus and UI elements in reachable locations. The system should automatically choose or suggest the placement of the menus in the environment. In combination with the placement, the scale of the menus should be considered so that they stay legible and usable. Moreover, it should recognize and resolve situations in which UI elements become occluded by real-world objects or walls. To solve this task, the Mixed Reality Toolkit already provides the technical foundation in the form of modular solvers which can e.g. stick objects to walls. However, the ideated system should go beyond that by combining different solvers, e.g. deciding which one should be used at a given time or by adding own solvers.
Must: Good knowledge of C#
Beneficial: Experience with Unity 3D engine, Knowledge in Computer Graphics and Human-Computer Interaction