Hmm.. OK. I looked at the World and noticed the swamps had hills in them, and the US is definitely better, but still I can see that things don't exactly line up.
It could be error in the topo map, or it could be the 3d data. How does GPS data you collect in the area line up with either?
I noticed that Terraserver for some reason isn't serving up a few topo tiles in that area. That doesn't make me trust the topo alignment completely.
I don't think the elevation data is down to 0.1 meters. The resolution is, at best, 30 meter -- but that's the grid spacing. But in general the difference between possible elevation data is much higher resolution for the elevation data than for the topo lines -- which are often at intervals of 20 ft, 40 ft, etc.
The answer might just be that they are from different sources and there isn't a definitive answer on what the topography looks like in that area. Maybe it changes over time? It isn't the case that the elevation data was made FROM the topo maps, so I wouldn't expect an exact correspondence. In mountianous regions they seem to agree fairly closely.
You might try downloading a 30 meter or 10 meter resolution DEM file for that area to compare to the auto-downloaded one.
Good luck.