Writings.
-
Enhancing DBT Workflows with Dynamic Tag-Based Macros
In the world of modern data analytics and transformation, the Data Build Tool (DBT) has emerged as a cornerstone for managing SQL-based workflows within data warehouses. A powerful feature of DBT lies in its ability to leverage Jinja, a templating engine for Python, enabling developers to create dynamic and reusable…
-
Subscription Analytics: the little things
Originally that article was posted at my blog on Medium. I have spent 5+ years in the subscription business. Mainly, I was building in-house analytics from scratch. Now I found more and more projects that try to fulfill empty areas of services for the subscription business. Some people ask me…
-
What we are missing in data CI/CD pipelines?
Originally that article was posted at my blog on Medium. I told the story of how we set up our CI/CD with a data pipeline using classical CI/CD tools — Gitlab previously. As a final idea, I just put a note that Gitlab is not a great tool for…
-
Scentbird Analytics 2.0. Migrate from Redshift to Snowflake. Redesign ETL process.
As some of you may know I'm building analytics in Scentbird and my intial steps in building ETLs and choosing a data warehouse engine was not perfect. Initially, I'm a Java developer and I start that journey having zero experience in building data stack, I hope it gives me an…
-
Timestamp to string conversion (Redshift vs Snowflake) issue
Everyone faces some strange behavior in software products from time to time. Any software has bugs, so it does not surprise us much. However, in some case you facing not a clear but some kind of strange implementation that surprise you. I have such one from our Redshift to Snowflake…