I like the ability to  drag the 3D view with the mouse and am getting more adept with it, but I too think it would be great to also be able to use the keyboard arrows.
I just got the NGS Topo! Streets & 3D Views Expansion Pack, and I'm really enjoying the 3D features which allow you to quite easily 'fly' over the terrain, looking in any direction as you do it.
The controls are as follows:
up arrow; go forward
down arrow; go backwards
left arrow; turn left
right arrow; turn right
Ctrl; pans left (moves the view point perpindicular to the direction viewed)
0 / Ins; pans right
Page Up; look up
Page Down; look down
Home: increase elevation (as measured from the terrain directly below, allowing you to fly maintaining a constant elv. from the ground)
End: decrease elevation
There is a slider bar to contol the speed at which you move.
It's all quite intuitive and I find easy to use with just a bit of practice.
It would be super if TopoFusion could use the same system!
I'm not sure, but I think that this would also let you use a joystick for control.
Larry