Larry King filed for divorce due to irreconcilable differences and there are allegations of infidelity