Llama 3.1 Lyrical Fine-Tune

I’m a recording artist type of musicina. You won’t have heard of me, but I have a studio in my home office and I’ve amassed a back catalog of over 660 songs.

I decided to take all those lyrics I’ve written and turn them into a dataset and fine-tune an LLM to write lyrics like me.

First, we curated a collection of over 150 song lyrics. Then we chunked and assembled that data into training prompts. We trained using the Tinker APIs and Hugging Face Transformers, and created “Llama 3.1 8b Lyrical AF.”

An LLM that naturally writes in the my style!

Here’s an example of us collaborating together to create a new song - “The Night It Exploded”:

(Verse 1)
She said boy why you broke
Your voice ain’t gold no more
You sing like a prophet with no message left to deliver
And He said
Ma’am I’m not singing for conversions
I’m just letting the sound rip through my lungs,
maybe someday It’ll find someone who believes in something

(Chorus)
The night it exploded
Was a beautiful sound
From a distance you could hear it rumble around
A myth with no body,
just consequence
and echo without a crowd
The night it exploded
Was a beautiful sound
From a distance you could hear it rumble around
A myth with no body,
just consequence
and echo without a crowd

(Verse 2)
He walked like static
down Lover’s Lane
Rain like syrup
mixed with regret and fame
No umbrella,
no phone signal,
he got no name to claim
She said
Why you ain’t got no voice no more?
You used to sound like signal
Now your chords sound unsure

(Chorus)
The night it exploded
Was a beautiful sound
From a distance you could hear it rumble around
A myth with no body,
just consequence
and echo without a crowd
The night it exploded
Was a beautiful sound
From a distance you could hear it rumble around
A myth with no body,
just consequence
and echo without a crowd

(Bridge)
Maybe the city’s listening now
Or maybe it’s just the wind
through broken antennae
somehow
Maybe he found a new melody to sing
Or maybe, just maybe, he doesn’t need words no more

(Chorus)
The night it exploded
Was a beautiful sound
From a distance you could hear it rumble around
A myth with no body,
just consequence
and echo without a crowd
The night it exploded
Was a beautiful sound
From a distance you could hear it rumble around
A myth with no body,
just consequence
and echo looking for a crowd

Pretty neat stuff.