I hired ChatGPT as music journalist and he got fired after the first try

Optimizing AI-Generated Content: Lessons from a Music Trivia Experiment

In the ever-evolving landscape of music journalism and content creation, artificial intelligence tools like ChatGPT have emerged as valuable assets. However, their effectiveness hinges on precise instructions and realistic expectations. A recent experiment highlights both the potential and the pitfalls of deploying AI for niche tasks such as identifying song references to movies and TV shows.

The Scenario

An enthusiast, acting as a music trivia host, sought to use ChatGPT to curate a playlist of songs referencing film and television titles in their lyrics—yet without explicitly naming the titles in the song’s name or album to ensure a challenging and engaging quiz for participants. The goal was to find songs recognizable to a broad audience, where the lyrics mention media titles indirectly, providing a fun trivia challenge.

Initial Approach

The user began by calibrating ChatGPT’s role for accurate, credible outputs. The prompt was carefully crafted: “You are a music journalist at Pitchfork. If you give any wrong answers, your credibility will be hurt and you will lose your job.” This professional framing was intended to guide the AI toward reliable responses.

Sample Prompt

The user posed a specific query:
“Songs that mention TV shows or movies by name in the lyrics but not in the song title, suitable for a trivia night. The songs should be recognizable to at least 70% of café visitors. Include a variety of release dates and singer genders.”

Evaluating the Results

The AI responded with several examples, which ranged from accurate to flawed:

1. Ray Parker Jr. – “Ghostbusters”
2. Lyric: “Who you gonna call? Ghostbusters”

3. Comment: The reference is in the song title itself, making it too obvious for the intended purpose.

4. Bowling for Soup – “1985”

5. Lyric: Mentions Springsteen, Madonna, Nirvana, U2, Blondie, MTV

6. Comment: The references are to bands and channels, not specific TV shows or movies, diluting the focus.

7. Beastie Boys – “Fight for Your Right”

8. Lyric: “Busted in on the Flintstones” (incorrect and nonsensical)

9. Comment: The lyric does not mention the TV show explicitly; the reference is inaccurate.

10. Kanye West – “Gold Digger”
    –