01 → Crescendo

CONTEXT:

Academic Product Development Project with Darren Chin and Joyce Lee, MFA
Spring 2024

This project was developed as a part of a core studio class in fulfillmnet of the Master’s in Design Engineering Degree at Harvard. As a group, we were propmpted to build a product to shape the future of leisure in 2040, with a target demographic of after career individuals.

SKILLS DEVELOPED:

UX Design, Computer Vision, User Research, Product Development

ABOUT:

As people age, maintaining physical activity and cognitive engagement becomes a challenge. Over 70% of adults over 65 will need long-term care due to mobility decline, yet 50-65% of individuals do not adhere to their physical therapy regimens. Traditional rehabilitation methods often feel clinical, repetitive, and disengaging, leading to poor adherence and suboptimal outcomes.

Moreover, social isolation is a growing concern among retirees, with limited opportunities to exercise in a way that is enjoyable, rewarding, and socially connected. Studies have shown that music has a powerful effect on movement, mood, and cognition, yet it is rarely leveraged in rehabilitation.

Crescendo was developed to bridge the gap between physical rehabilitation and music therapy, making movement a more engaging, habit-forming, and effective process for aging adults.

FUNCTIONALITY + TECHNOLOGY:

The technology behind Crescendo combines biometric sensing and compuer vision to create a personalized and adaptive rehabilitation experience. The proposed system includes smart wearables such as wristbands and sensor-equipped weights that track movement, intensity, and muscle engagement. Future iterations would integrate EEG headbands to monitor cognitive engagement and track users’ focus levels during exercise.

Crescendo’s biofeedback system along with utilizing computer vision to map movements, generates adaptive music and sound cues that guide movement, allowing users to intuitively correct their form while reinforcing positive exercise habits. The platform also uses data analysis to adjust exercises based on user progress, ensuring that each session is tailored to the individual’s needs. The system offers both a free-form play mode, in which users generate music through their movements, and a guided exercise mode that pairs structured physical therapy routines with music-driven cues for pacing and encouragement.

INTERFACE DESIGN:

The design of Crescendo prioritizes accessibility, engagement, and nostalgia. A significant consideration in its aesthetic choices was the recognition that the older adults of 2040 will have grown up in the 1980s, a cultural era characterized by vibrant arcade visuals, bold color palettes, and early digital interfaces. By incorporating retro-futuristic 8-bit and neon-inspired UI elements, Crescendo taps into a deep well of familiarity and positive association, making the platform more inviting and emotionally resonant for its users.

The home dashboard provides users with an overview of their progress, movement history, and cognitive engagement scores, while the workout section offers both guided therapy sessions and creative play experiences. To enhance motivation, the interface integrates game-like progression systems, rewarding users with achievements and allowing them to compose increasingly complex musical pieces through their movement. Social elements are embedded into the platform, giving users opportunities to collaborate in musical exercises with other users.

By designing an interface that is both intuitive and nostalgic, Crescendo fosters a sense of connection not just to exercise, but to personal history, cultural memory, and community.

COMBINING MUSIC THERAPY AND PHYSICAL THERAPY:

By integrating music-driven feedback into physical therapy, Crescendo transforms what is often seen as a monotonous or frustrating process into an engaging, interactive, and rewarding experience. In addition to conducting expert interviews with music therapists, physical therapists, and physical therapy patients, we also conducted a brief user study on the impact of integrating music making into a physical therapy routine with 8 PT patients.

Projects: 01 Crescendo

02 Predicting Crop Damages03 Youtopia04 Sagwa 05 Saffron06 Thesis in Mathematics 07 Personal Projects

Projects:

01 Crescendo

02 Predicting Crop Damages
03 Youtopia
04 Sagwa
05 Saffron
06 Thesis in Mathematics
07 Personal Projects