May 18A short performance story: Scala Native and CArgsRecently, I got intrigued about Scala Native, essentially a compiler+runtime which allows a native performance for Scala — in particular, no JVM. However, my initial experiments were giving abysmal performance, worse than that of naive python or bash. …Scala3 min read
May 3On Data Lakes and Stream IngestionCloud architectures often contain some kind of generic event ingestion service and a data lake or data warehouse for storage of these. The events in question may be trackings of UI actions and impressions, monitorings of IoT devices, business logic actions reported by other components. I would like to list…Data Lake11 min read
Published in Inside Amp X·Mar 28Practical Tips for Dask, vol3: Limited-fan RepartitionsPractical Tips for Dask is a series of short blog posts accompanied with code snippets or notebooks, each focusing on a particular data engineering problem and its solution in Dask. Throughout the series, a common example of aggregating sensor measurements data will be used. Schema transforms and parquet engines. Mapping…Dask4 min read
Published in Inside Amp X·Mar 14Practical Tips for Dask, vol2: Partition MapsPractical Tips for Dask is a series of short blog posts accompanied with code snippets or notebooks, each focusing on a particular data engineering problem and its solution in Dask. Throughout the series, a common example of aggregating sensor measurements data will be used. Schema transforms and parquet engines. Mapping…Dask4 min read
Published in Inside Amp X·Mar 7Practical Tips for Dask, vol1Practical Tips for Dask is a series of short blog posts accompanied with code snippets or notebooks, each focusing on a particular data engineering problem and its solution in Dask. Throughout the series, a common example of aggregating sensor measurements data will be used. Expected volumes (names not final): Schema…Data Science4 min read
Feb 13Job Spotlight: Machine Learning Product ManagerI would like to argue that a certain Job or Role is more important than today’s size of its ranks suggests, and that its importance will even grow. There already exists a confusing plethora of Jobs related to Data and Machine Learning, so the first question is why having another…Machine Learning6 min read
Dec 1, 2021Consolation in Covid TimesThe pandemic of Covid has brought plenty of woes. Numbers of people have died, some of them being fairly old and losing winters of their lives, some of them quite young, with productive lives ahead, leaving behind families torn and incomplete. Social activities have been curbed, education and work forcefully…Stoicism8 min read
Sep 21, 2021Delayed GratificationRight after finishing the Hobbit book, I was very keen on continuing with the Lord of the Rings. It was the previous millennium, the movie nowhere in sight, and the bookstores in my hometown were not well supplied. They had just the second volume. Undaunted, I had it bought, and…Literature3 min read
Mar 4, 2021Rule Of Thumb for determining whether Data is PersonalThe coming of GDPR and similar regulations caused a lot of software engineers and data scientists ask a question whether some particular data is personal, and thus subject to GDPR measures. I have a Rule of Thumb for this — not a fully reliable one, but giving a good starting…Gdpr3 min read
Feb 6, 2021Reflection on Values for WorkIntroduction As my 5-year-long anabasis at Avast is nearing an end, I’ve chosen to write a short reflection on personal values that matter during a career. The point is not to provide a directly followable recipe, but rather serve as an inspiration or guide for a similar reflection by the reader…Philosophy8 min read
