Index
02/14
Year
2025
Role
Developer & Designer
Read
1 min
176 wordsMedia
9 items
Stack
Audio · Visualization · Real-Time · Interactive · Performance · Multi-Device
A real-time visualized music performance platform combining a keyboard synthesizer, drum machine, MIDI player, and GPU-accelerated particle visualization — with multi-device remote control via Socket.IO.
Live Experience
Launch the Sonic performance platform directly below — play the synthesizer, trigger drum patterns, and watch GPU-accelerated particles react to your music in real time.
Concept
Sonic is built on the idea that music creation should be visual, tactile, and social. The platform merges audio synthesis with GPU-accelerated particle systems — every note you play triggers a visual response rendered in Three.js. A relay server architecture allows multiple mobile devices to connect as remote controllers, turning any room into a collaborative performance space.
Architecture
The system operates across three components: a Desktop Host that handles all audio synthesis and visual rendering locally using Three.js, Web Audio API, and GPGPU computing; a Relay Server built on Express.js and Socket.IO that forwards JSON control messages between devices; and Mobile Terminals that provide up to 5 control slots with live comments and emoji reactions — all without processing audio on the server.









Tools Used

Creative Technology · 2025