If your character is below level 10 or you wish to find the Dawnguard on your own, you can seek out the Dawnguard headquarters roughly east/southeast of Riften. It can be reached by a small cave through the mountains.
