A young Palestinian stabbed an ultra-Orthodox Jew in Jerusalem on Sunday before being apprehended by the city's mayor and his bodyguard.