Sometimes data cannot be scraped as efficient and automated as something like a websocket would give you. While we love websockets this is a story about how we used a linux “crontab” to create an auto-initiated script on a script to scrape external data from an API.

When you begin to understand the power this tool gives you, the possibilities become endless. Do you have external data you’d like to be acquiring from an API or have a hypothesis about a condition that you’d like to gather data about? Let’s talk about how we can set up automatic data collecting pipelines for your business today!