1. A matrix transposition accelerator comprising: a plurality of N input memory banks; a plurality of N input address registers, each input address register corresponding to one of said input memory banks; a plurality of N multiply and add units, each multiply and add unit corresponding to one of said input memory banks; a plurality of N output memory banks, each output memory bank corresponding to one of said multiply and add units; a plurality of N output address registers, each output address unit corresponding to one of said output memory banks' an input memory controller connected to said plurality of input address registers; and an output memory controller connected to said plurality of output address registers; said matrix transformation accelerator operating said input memory controller in cooperation with said output memory controller whereby said input memory controller supplies addresses to corresponding input address registers for recalling plural matrix elements from plural separate input memory banks and said output memory controller supplies addresses to corresponding output address register writing plural matrix elements into corresponding locations plural separate output memory banks.