Robbie Williams and Ayda Field have confirmed they will not return to 'The X Factor' judging panel this year, because they are too busy.