ETL: Transform Data with Node.js
The goal of the transform step in a Node ETL (Extract, Transform, Load) pipeline is to take the data from the data source and make it fit into the format we want it to be in for the destination. We can rename fields, add new fields, and filter out unnecessary data. Transforming the data in Node is simple once it’s been extracted.
In this example, we’ll be transforming planet records from the NASA Exoplanet API into a different, easier-to-use format. We can do this by renaming keys, removing data points we aren't interested in, and computing new values from existing values.
In this tutorial we'll:
- Understand the benefits of transforming the service payload
- List ways we can transform a payload in Node
By the end of the tutorial you'll know how to transform data with Node.js as part of an ETL pipeline.
Sign in with your Osio Labs account
to gain instant access to our entire library.