Is CHARSET important for tables with INT only?
The character set and collation of a table affects the newly created columns in that table. It also affects char/text columns without a specified character set/collation.
So your int only tables don't have any specific difference because of character set, until you add a column that uses it.