A History of Stealing Music From Record Club Memberships By Em Perper Highlight Stealing music didn’t originate with the internet. In the era of subscription vinyl, Columbia House records club ruled—until the recording artists revolted and the medium evolved.