Three people have been injured and thousands left without power after gale-force winds brought down trees and damaged homes in Victoria.