India has formally regretted the recent two incidents of border killings by the Indian Border Security Force (BSF), Home Minister Mohiuddin Khan Alamgir said on Thursday.