The Port Hudson State Historic Site is located on the Mississippi River north of Baton Rouge in East Feliciana Parish, Louisiana