Automatically partition a table in mysql (pymysql) everyday for new data
Yes REORGANIZE of a "future" partition is the right way.  See http://mysql.rjweb.org/doc.php/partitionmaint for a discussion of why, plus sample Perl code.

Do not create more partitions that you need immediately; it leads to inefficiencies.  Instead, check to see if you need a new partition more often than simply "just in time".