Prime Minister Narendra Modi called up West Bengal Governor Jagdeep Dhankhar on Tuesday and expressed his concern over the post-poll violence in the state.