instead of training on cobol if the dataset is limited, wouldn't you just start with an ai that knows coding practices generally, hand it a manual it can keep in context, and begin constructing new synthetic datasets? model collapse could be avoided by supplementing with anything we do have and with real life feedback on the efficacy of this or that solution.
Pirate