Germany's Social Democrats have voted to hold formal coalition talks with Chancellor Angela Merkel's conservative bloc.