I have not been to Havre de Grace but there is thin ice covering the creeks off the Severn River near Annapolis. Even the main channel has a glassy look to it and I believe has ice coverage. I imagine it would be the same near Havre de Grace. If I was going there I would look to the Jean S. Roberts launch as it is on the main channel and tucked not too far off the main flow of the river. Should be better by the end of next week.
Here is picture of the ice on the Bay as of Thursday 01/14 at Annapolis