🎵 Sync
GitHubbuilt for HackIllinois (Modal + Solana tracks):
basically the backstory is that we wanted to build something fun since most of my team had never done a hackathon before but we also wanted to compete for tracks and try to win with technical complexity. on my bucket list of things to build, i wanted to build a machine learning model to generate music based on a user's top song's MIDI (music data file) but i thought that was too boring and basic for a hackathon so when i was brainstorming i remembered how enraged my friends would be my geometry dash and then i thought to how slither.io/agar.io have versions where you can bet crypto to gamble. we knew this idea didn't solve any problem (and lowkey endorsed gambling) but it sounded so fun that we went all in on it.
Highlights
Music Generation
we trained a LSTM (Recurrent Neural Network) on modal's GPU for modal track that generates tracks based on the user's top song's MIDI file. then deployed it as an RESTFUL API on Modal
TypeScript Game Engine
Full game built in TypeScript with custom gravity/physics (jump arcs + collisions) and terrain generation synced to the music beat.
Verifiable random function
ORAO VRF is a crypto concept that we used to ensure terrain generation that's actually proven random and not just a pseudo-random number generator.
Auth + Data
Privy handles seamless wallet auth (no extension required), Firebase stores scores and match state for duel mode, and wallet connection is only required for staking or duels.
Stack
Next.js + React (TypeScript), custom TS game engine, Tone.js, Solana/Anchor smart contracts, ORAO VRF, Privy auth, Firebase, and Modal-hosted LSTM inference.