Floods and landslides in Sri Lanka kill several, including a 10-month-old baby, and have forced tens of thousands more to flee their homes, officials say.