Writings.

  1. How do we build analytics system in Scentbird

    Couple month ago Scentbird have celebrated 2 years of building internal analytics system. I considered it is a time to start sharing our expirence with community and it was a theme of my HighLoad 2019 (the biggest conference in Russia regarding high load systems) speach. Here it is (in Russian)…

    Analytics Looker AWS Glue redshift DBT architecture

  2. Jenkins: How to start Jenkins build using commit id of last successful build on test enviroment?

    Last week I faced with a quite not trivial case in CI practice. There is production build running once a day by schedule and it is using master branch as a source. The main challenge here that the development team is not using branches in everyday practice (why? it is…

    jenkins CI groovy continuous-integration

  3. Generating series in Redshift

    Redshift in 99% of cases means data warehouse, where generating series (especially date series) is quite a common case. You will be disappointed to find out no information about series in official documentation (the only thing that you will be able to find - "generate_series function is not…

    redshift AWS Analytics sql

  4. Running static Iglu repository on AWS S3

    During setuping Snowplow analytics systems I have to setup a private Iglu repository. The main idea behind this is described on (https://github.com/snowplow/iglu/wiki/Setting-up-an-Iglu-repository). That manual missed several steps that are really important for building Iglu repository on AWS infrastructure. I had spent a lot of…

    Snowplow AWS S3 Iglu Repository Analytics

  5. build-test-data plugin: how to generate IDs for domain entities in a batch

    I have faced an inssue on grails project: domain entities has assigned id, so in tests I have to manually set up id for every created entity: new Entity(id: id_value, ...).save() It is very verbose and creates additional task to create and maintain id variable. In addition, there…

    grails groovy build-test-plugin ID batch