Nick Drane

  • Hire Me
  • About Me
Sat Dec 09 2017

Scraping the Web with Puppeteer: Lessons Learned

I'm currently contracted to create a web service using some data from a third party Angular application. I worked off a proof of concept codebase that used Chrome's new Puppeteer API to scrape this site. I strongly regret not starting from scratch.

Most Popular Posts

  • Scraping the Web with Puppeteer: Lessons Learned
  • Build Your Own Nested Query String Encoder/Decoder
  • Build Your Own Regex in Less Than 40 Lines of Code
  • Write Your Own React-Redux Connect
  • The Hidden Costs of PostgreSQL's JSONB Datatype

Most Recent Posts

  • Manipulating Raw HTML in Node with the Visitor Pattern
  • Optimizing Gatsby Build Times for Large Websites Using pageContext
  • One Simple Performance Tip to Optimize GatsbyJS Static Sites
  • A Deep Dive into JavaScript Static Site Generators: Gatsby vs. Hexo
  • Using Shell Commands to Effortlessly Ingest Line-Delimited JSON into PostgreSQL

categories

  • Architecture (1)
  • Build Your Own (3)
  • Functional Programming (1)
  • Gatsby (3)
  • Immutability (1)
  • JavaScript (3)
  • Javascript (2)
  • Postgres (2)
  • React (2)
  • Redux (1)
  • Regular Expressions (2)
  • Shell (1)
  • Software Ethics (1)
  • Technical Hiring (1)
  • Testing (1)
  • Web Scraping (1)