Skip to content. | Skip to navigation

Sections
Personal tools
You are here: Home Theses An Intelligent Menu Placement System for Mixed Reality Applications

Contact

Prof. Dr. S. Decker
RWTH Aachen
Informatik 5
Ahornstr. 55
D-52056 Aachen
Tel +49/241/8021501
Fax +49/241/8022321

How to find us

Annual Reports

Disclaimer

Webmaster

 

 

An Intelligent Menu Placement System for Mixed Reality Applications

Thesis type
  • Bachelor
Student Yanxi Liu
Status Finished
Submitted in 2021
Supervisor(s)
Advisor(s)

A common problem with spatial immersive applications is the placement of UI elements in the space. On the one hand, a menu needs to be accessible and on the other hand, it must not be in the way of the user when it is not needed. Moreover, the menus need to adapt to the room’s characteristics, e.g. to avoid problems where menus clip through walls and become unreachable. For mixed reality applications, the environment can vary from small rooms to large lecture halls. UI systems must account for this. For instance, UI elements cannot be placed in a fixed position in space without respecting the spatial mapping of the real environment. Instead, a more intelligent solution is required for positioning UI elements in space.

 

The goal of this thesis is to conceptualize and develop a system that intelligently places menus and UI elements in reachable locations. The system should automatically choose or suggest the placement of the menus in the environment. In combination with the placement, the scale of the menus should be considered so that they stay legible and usable. Moreover, it should recognize and resolve situations in which UI elements become occluded by real-world objects or walls. To solve this task, the Mixed Reality Toolkit already provides the technical foundation in the form of modular solvers which can e.g. stick objects to walls. However, the ideated system should go beyond that by combining different solvers, e.g. deciding which one should be used at a given time or by adding own solvers.

Prerequisites

Must: Good knowledge of C#
Beneficial: Experience with Unity 3D engine, Knowledge in Computer Graphics and Human-Computer Interaction

Related projects

Document Actions