Skip to content. | Skip to navigation

Sections
Personal tools
You are here: Home Publications RUITE: Refining UI Layout Aesthetics Using Transformer Encoder

Contact

Prof. Dr. S. Decker
RWTH Aachen
Informatik 5
Ahornstr. 55
D-52056 Aachen
Tel +49/241/8021501
Fax +49/241/8022321

How to find us

Annual Reports

Disclaimer

Webmaster

 

 

RUITE: Refining UI Layout Aesthetics Using Transformer Encoder

Year 2021
Abstract URL view
ISBN-13 9781450380188

In the User Interface (UI) design process, designers sketch the UI design (low fidelity prototype) with minimal focus on visual appearances before converting them to higher fidelities. Contrary to low-fidelity, higher fidelity prototypes require better layout and aesthetic quality, during which designers adhere to design laws and conventions. Numerous research studies attempt to automate this transformation of low fidelity sketches to higher fidelities using Deep Neural Networks. However, these studies seldom focus on the layout quality and aesthetics of the generated higher fidelity prototype. As a solution, this paper proposes RUITE, a UI layout refinement engine that optimizes layouts using a Transformer Encoder. We trained RUITE by adding noise to misalign 35,369 UI layouts from the RICO dataset as input and the original aligned layout annotation as ground-truth. Upon evaluation with 4,421 misaligned UI layouts, RUITE provides 77% accuracy in aligning them. RUITE improves the existing research on transforming low-fidelity sketches to higher fidelities by beautifying generated UI layouts.

Details

IUI '21: 26th International Conference on Intelligent User Interfaces, College Station, TX, USA, April 13-17, 2021, Companion.

Authors

Presented at

26th International Conference on Intelligent User Interfaces, 2021 , College Station, Texas , US.

Published in

26th International Conference on Intelligent User Interfaces , by Tracy Hammond, Katrien Verbert, Dennis Parra , p. 81-83 ; ACM .

Document Actions