James Corden has insisted he hasn't "done anything wrong" after being banned from a restaurant over his "abusive" behaviour earlier this week.