Nick Drane

  • Hire Me
  • About Me
Thu Oct 18 2018

Using Shell Commands to Effortlessly Ingest Line-Delimited JSON into PostgreSQL

I recently wanted to ingest a line-delimited JSON file into Postgres for some quick data exploration. I was surprised when I couldn't find a simple CLI solution that parsed the JSON and loaded each field into its own column. Every approach I found instead inserted the entire JSON object in a JSONB field. Here is my solution.

Most Popular Posts

  • Scraping the Web with Puppeteer: Lessons Learned
  • Build Your Own Nested Query String Encoder/Decoder
  • Build Your Own Regex in Less Than 40 Lines of Code
  • Write Your Own React-Redux Connect
  • The Hidden Costs of PostgreSQL's JSONB Datatype

Most Recent Posts

  • Manipulating Raw HTML in Node with the Visitor Pattern
  • Optimizing Gatsby Build Times for Large Websites Using pageContext
  • One Simple Performance Tip to Optimize GatsbyJS Static Sites
  • A Deep Dive into JavaScript Static Site Generators: Gatsby vs. Hexo
  • Using Shell Commands to Effortlessly Ingest Line-Delimited JSON into PostgreSQL

categories

  • Architecture (1)
  • Build Your Own (3)
  • Functional Programming (1)
  • Gatsby (3)
  • Immutability (1)
  • JavaScript (3)
  • Javascript (2)
  • Postgres (2)
  • React (2)
  • Redux (1)
  • Regular Expressions (2)
  • Shell (1)
  • Software Ethics (1)
  • Technical Hiring (1)
  • Testing (1)
  • Web Scraping (1)