Finance Minister P Chidambaram has asked public sector banks to set up ATMs in all branches by March, 2014 to enable customers in rural pockets to do banking round-the-clock.