ES Modules in Node Today
ES Modules in Node Today! - Web Dev @ Microsoft - Medium
👉 Update: The “@std/esm” loader is now “esm”. Read more here.I’m excited to announce the release of @std/esm (standard/esm), an opt-in, spec-compliant, ECMAScript (ES) module loader that enables a smooth transition between Node and ES module formats with near built-in performance! This fast, small, zero-dependency package is all you need to enable ES modules in Node today 🎉🎉🎉@std/esm used in the Node REPL after `npm --save @std/esm`A tale of two module formatsWith ESM landing in browsers, attention is turning to Node’s future ESM support. Unlike browsers, which have an out-of-band parse goal signal and no prior module format, support for ESM in Node is a bit more…prickly. Node’s legacy module format, a CommonJS (CJS) variant, is a big reason for Node’s popularity, but CJS also complicates Node’s future ESM support. As a refresher, let’s look at an example of both module syntaxes.CJS:const a = require("./a")module.exports = { a, b: 2 }ESM:import a from "./a"export default { a, b: 2 }Note: For more in-depth comparisons see Nicolás Bevacqua’s excellent post.Because CJS is not compatible with ESM, a distinction must be made. After much discussion, Node has settled on using the “.mjs” (modular JavaScript) file extension to signal the “module” parse goal. Node has a history of processing resources by file extension. For example, if you require a .json file, Node will happily load and JSON.parse the result.ESM support is tentatively slated to land, unflagged, in Node 10 anytime between October 2018 and April 2020. This puts developers, esp. package authors, in a tough spot. They could choose to:Go all in, shipping only ESM, and alienate users of older Node versionsWait until 2020, after Node 8 support ends, to go all inShip ESM and transpiled CJS sources, inflating package size and shouldering the responsibility of ensuring 1:1 behaviorNone of those choices seem super appealing. The ecosystem needs something, that meets it where it is, to span the CJS to ESM gap.Bridge buildingEnter the @std/esm loader, a user-land package designed to bridge the module gap. Since Node supports most ES2015 features, @std/esm is free to focus solely on enabling ESM.The loader stays out of your way and tries to be a good neighbor by:Not polluting stack tracesWorking with your existing tools like Babel and webpack.Playing well with other loaders like babel-register(using .babelrc "modules":false)Only processing files of packages that opt-in with a @std/esm configuration object or @std/esm as a dependency, dev dependency, or peer dependency in their package.jsonSupporting versioning(i.e. package “A” can depend on one version of @std/esm and package “B” on another)Unlike existing ESM solutions which require shipping transpiled CJS, @std/esm performs minimal, inline source transformations on demand, processing and caching files at runtime. Processing files at runtime has a number of advantages.Only process what is used, when it’s usedThe same code is executed in all Node versionsFeatures are configurable by module consumers(e.g. module “A” consumes module “C” with the default@std/esm config while module “B” consumes module “C” with cjs compat rules enabled)More compliance opportunities(i.e. @std/esm can enforce Node’s ESM rules for environment variables, error codes, path protocol and resolution, etc.)Standard featuresDefaults are important. The @std/esm loader strives to be as spec-compliant as possible while following Node’s ESM rules.Out of the box @std/esm just works, no configuration necessary, and supports:import / exportDynamic importImproved errorsLive bindingsLoading .mjs files as ESMThe file URI schemeUnlockablesDevelopers have strong opinions on just about everything. To accommodate, @std/esm allows unlocking extra features with the "@std/esm" package.json field. Options include:Enabling unambiguous module support (i.e. files with at least an import, export, or "use module" pragma are treated as ESM)Supporting named exports of CJS modulesTop-level await in main modulesPerformanceBefore I continue let me qualify the following section:It’s still super early, mileage may vary, results are hand wavey, etc. 👋Testing was done using Node 9 compiled from PR #14369, which enables built-in ESM support. I measured the time taken to load the 643 modules of lodash-es, converted to .mjs, against a baseline run loading nothing. Keep in mind the @std/esm cache is good for the lifetime of the unmodified file. Ideally, that means you’ll only have a single non-cached load in production.Loading CJS equivs was ~0.28 milliseconds per moduleLoading built-in ESM was ~0.51 milliseconds per moduleFirst @std/esm no cache run was ~1.56 milliseconds per moduleSecondary @std/esm cached runs were ~0.54 milliseconds per moduleInitial results look very promising, with cached @std/esm loads achieving near built-in performance! I’m sure, with your help, parse and runtime performance will continue to improve.Getting startedRun npm i esm in your app or package directory.There are two ways to enable ESM with esm.Enable esm for packages:Use esm to load the main ES module and export it as CommonJS.index.js// Set options as a parameter, environment variable, or rc file.require = require("esm")(module/*, options*/)module.exports = require("./main.js")main.js// ESM syntax is supported.export {}2. Enable esm for local runs:node -r esm main.jsMeteor’s mightThe @std/esm loader wouldn’t exist without Ben Newman, creator of the Reify compiler from which @std/esm is forked. He’s proven the loader implementation in production at Meteor, since May 2016, in tens of thousands of Meteor apps!All green thumbsEven though @std/esm has just been released it’s already had a positive impact on several related projects by:Fixing Acorn’s strict mode pragma detection and aligning parser APIsImproving dynamic import support of Babel and related Acorn plugin ( acorn-dynamic-import is used by webpack for code splitting)Improving property iteration order in ChakraImproving the parse/load time and spec compliance of Reify(Reify is used by Meteor for ESM support)Improving JS engine performance for webpack 3(Chakra, SpiderMonkey, V8)Inspiring a fast top-level parser proof of conceptSpurring champions of export * as ns from "mod" and export default from "mod" proposalsWhat’s nextLike many developers, I want ES modules yesterday. I plan to use @std/esm in Lodash 5 to not only transition to ESM but also leverage features like gzip module support to greatly reduce its package size.The @std/esm loader is available on GitHub. It’s my hope that others are as excited and as energized as I am. ES modules are here! This is just the start. What’s next is up to you. I look forward to seeing where you take it.Final ThoughtWhile this is not a Microsoft release, we’re proud to have a growing number of core contributors to fundamental JavaScript frameworks, libraries, and utilities at Microsoft. Contributors like Maggie Pint of Moment.js, Matthew Podwysocki of ReactiveX, Nolan Lawson of PouchDB, Patrick Kettner of Modernizr, Rob Eisenberg of Aurelia, Sean Larkin of webpack, and Tom Dale of Ember, to name a few, who in addition to their roles at Microsoft, are helping shape the future of JavaScript and the web at large through standards engagement and ecosystem outreach. I’m happy to guest post this news on the Microsoft Edge blog to share our enthusiasm with the community!