How do I specify the debug_mail_directory for the devel maillog?
You should use 

$config['devel.settings']['debug_mail_directory'] = 'private://mydirectory';
$config['devel.settings']['debug_mail_file_format'] = 'mypattern-%to-%subject-%datetime.mail.txt';