Don't wear your boots out by walking everywhere in the early stages of the Elder Scrolls V: Skyrim - read our guide to fast travel instead. It's safer than stealing horses.
