Residents of Victoria’s La Trobe Valley have rallied against the Federal Opposition's nuclear proposal.