Ask HN: Best Language for Programmatically Transforming Large Datasets?
As part of my job I often find myself creating tools to transform large datasets. Some examples include restructuring GTFS feeds for structured consumption, or CRM migration. I come from web development so my tools of choice generally revolve around PHP and MySQL in a Drupal wrapper (for security, utilities, &amp;c). As you might expect this approach seems slow and I know those tools aren’t well suited to the task. What languages, frameworks, or apps do you use for similar tasks?