Machine Learning 6 min read

Scaling Laws for Language Models on Symbolic Music Data

Investigating neural scaling behavior with Transformers and LSTMs on ABC notation music

NYU Machine Learning project comparing scaling laws of Transformers vs LSTMs on symbolic music. Trained models from 1M to 100M parameters on Irish folk tunes.

Read Article GitHub

Articles

Scaling Laws for Language Models on Symbolic Music Data

NYU Machine Learning project comparing scaling laws of Transformers vs LSTMs on symbolic music. Trained models from 1M to 100M parameters on Irish folk tunes.

27 Jan 25, 2026

Machine Learning 4 min

MixMatch: Exploring Semi-Supervised Learning for Limited Data

Semi-supervised learning is crucial when labeled data is scarce. This post explores my implementation of MixMatch, a state-of-the-art semi-supervised learning algorithm that combines consistency regularization with pseudo-labeling.

27 Nov 06, 2025

Scaling Laws for Language Models on Symbolic Music Data

Scaling Laws for Language Models on Symbolic Music Data

MixMatch: Exploring Semi-Supervised Learning for Limited Data

Get In Touch