Recently we discussed how to design a serverless batch process that notifies data consumers using S3 bucket notifications. However, when using Terraform to deploy notifications there are a few things we must take into account. How Terraform deploys S3 bucket notifications Who else is using the same S3 bucket How Terraform deploys S3 bucket notifications When using Terraform...Continue Reading

Previously we designed a simple serverless batch process to extract data from a data warehouse. This design lacked an intuitive way for data consumers to be notified when new data is available. Requiring consumers to do one of the following: Consume data regardless of when it was last updated Create logic to identify when new...Continue Reading

In this post, we will discuss a solution for extracting data from a warehouse and saving to a remote location. In a typical corporate IT environment, multiple applications read and manipulate the same data. With this in mind, transactional applications may need their own copy of the data. So today we will design a serverless...Continue Reading