Music, Movement & Make-believe in the Pandemic Era

在疫情中，借助音乐、动作、自由想象培养儿童表达能力

/why

Music, Movement & Make-believe as an Expression

儿童能在音乐中借助动作自由想象、培养孩子表达能力

COVID-19 has amplified the role of digital contexts for living, working, and playing. While the pandemic fueled an already active DIY culture, it also accelerated an unspoken digital addiction which impede children's development. Pulling these trends together, this project investigates Augmented Reality (AR) interfaces in children play. With music, movement, and make-believe, children can build on their natural curiosities, spark imagination, and better self-express.

2019 冠状病毒病更加显示数字技术在人们的生活、工作、休闲娱乐方式占据了核心地位。虽然疫情促进了 DIY 文化，却加快了数字依赖，导致儿童的社交及情感能力发展严重被影响到。了解了各个社会趋势后，设计过程通过以制作为中心来研究增强现实 (AR) 界面，来创造新的儿童游戏体验。音乐、律动、想象力紧密结合以即兴音乐创作的形式呈现出来培养儿童的情感、社交、创造力和认知能力。音乐可以引导儿童天生的好奇心，促进想象力，也能启发儿童的创造性思维，借由此表达思想感情。

/how

Challenging the use of ARuCo markers to make musical beats

挑战怎么将ArUco 标记应用到音乐教育领域

/how

Challenging the use of ARuCo markers to make musical beats

挑战怎么将ArUco 标记应用到音乐教育领域

Stickibeats explore the potential of ArUco markers (an example of a marker is QR code; a synthetic square marker composed by a wide black border and an inner binary matrix which determines its identifier (id).)

ArUco 标记类似于二维码，是一个由黑色边框组成的二进制矩阵。这是一种合成标记，用于在图像或视频中立即定位。

KEY CHALLENGES / 关键挑战

/KEY CHALLENGES 关键挑战

✽

Build a format for open-ended, unstructured play

提供开放式及非结构化游戏方式由儿童主导

✽

Create an inexpensive & tangible AR experience with a smartphone

利用智能手机让增强现实体验低成本“有形”

✽

Integrate ArUco markers in a manner familiar to children

以儿童熟悉的方式融合 ArUco 标记

Project Goals / 设计目标

/Project Goals 设计目标

01

Hands-on play should be guiding, not directive.

游戏应该是指导方式，而不是直接指挥

02

Make it accessible through DIY and open-source format

以 DIY 和开源软件为主

03

Play instructions should be intuitive and engaging

游戏说明应该容易了解有趣

Stickibeats is a DIY AR kit to make a musical toy as a cardboard interface is transformed for tangible music composition in the form of a robot, a ship or even a plane. Children choose coloured stickers (ArUCO markers loaded with music samples) to stick on a toy wheel. As computer vision detects the unique markers, physical play is translated into musical beats and visual effects on the mobile screen.

Stickibeats 是一个 DIY AR 套装，用于制作音乐的纸板玩具。纸板套装更具互动性，能制作出一个机器人、一艘船、一架飞机。儿童将选择彩色贴纸（装有音乐样本的 ArUCO 标记）贴在玩具轮上。当儿童可以操控纸板移动，纸板玩具上的手机将扫描的二维码被转化为音乐节拍和手机荧幕的视觉效果。