lavc: limit maximum number of channels to 63

This is the most that can be represented with the current channel layout
system. This limit should be raised/removed when a better system is
implemented.
