The Victorian government is under growing pressure to explain why it didn't cancel the Commonwealth Games sooner, in a bid to avoid a $380 million compensation deal to organisers.