After 21 years with his label Columbia Records, John Mayer has decided to leave to "pursue new avenues of making music".