Yeah, this is a really annoying one, especially for those times when I don't really know what fields I want (or in what order) until after I see what data's in all of them (i.e. most of the time). I wouldn't even mind so much if we could just scroll manually AND IT WOULD STAY PUT (move a field up a bunch of times, scroll the list up, move the field up some more...), but as it is, you have to move the field up/down without even seeing it because the view will just jump down to what seems like an arbitrary position every time you move the field, so you have to try to get it in the ballpark blindly, scroll to where it is and count how many places to move it, then count as you click the button, then scroll & double check to make sure you got it right...
This is a WISH that seems more like a BUG report...