Wallabies fans were left eating their words after being downed by rivals England in their Rugby World Cup quarter-final.