BrickPal - DeeCamp 2021
Build something different with you. Say goodbye to stupid manuals and redefine a novel instruction with AR and AI.
User Analysis
After brainstorming, we interviewed 6 LEGO users and then conducted a questionnaire survey on 106 users. We divide the target users into three main groups. They are junior Mocer, novice players, and potential customers. As they have different experiences in assembling bricks, their needs are also different. We extracted three keywords from these groups: personalization, reshaping, and novel.
Case Study
| Web Manual | AR guided assembly | Paper manual plus AR |
| + Able to rotate and zoom in | + Track the progress in real-time with AR | + Multi-dimensional display |
| + Stadardized parts, fixed access position | ||
| - fixed sequences according to the recoded videos | - Lack of checking right items | - Paper-based and Fixed sequences |
Idea
How might we help customers who are eager to express themselves to gain the novel experience of building bricks?
Use Flow
Technology Map
NLP: Assembly as Language
AR：Immersive and gamification
Editing: in-situ creation
Demo Video
Team Member
ZHANG Xiaofeng @ BUAA: NLP Engineer
SHI Yao @ UESTC: Computer Vision & AR Engineer
YANG Zhou @ Xidian University: Computer Vision & AR Engineer
TANG Xiao @ CUHK: AR Engineer
YE Hongni @ Politecnico di Milano: Unity Developer & UX Designer
WU Yi @ University of Michigan—Ann Arbor: UX Designer
ZHANG Ran @ Hasso Plattner Institute: Advisor & Tech Support
Coauthor for Fengru Cup:
ZHANG Haoxing @ BUAA & CentraleSupélec
YAN Lingyao @ BUAA & Centrale Nantes