Select the first or last file in finder with the keyboard, or disable filename sort in finder
In column view and list view you can use ⌥↑ and ⌥↓.

You could also set arrange by to none (⌃⌘0) and sort by to size (⌃⌥⌘6).