I recently went through the process of recertifying as an AWS Solution Architect, and I wanted to share my experience with anyone who is preparing for the exam. Also, check out my post if ChatGPT can pass the AWS exam. Overall, it took me about 3 weeks of dedicated study…

ChatGPT is one of the hot topics today, and everyone is talking about it. ChatGPT can do a lot of things: answering questions, language translation, and even code generation. It even passed a Google-level coding interview. So, I’m in the process to re-certify my AWS Solution Architect exam and I…

Sampling is a very popular technique in machine learning. When the data is big, you can do sampling to learn about the data or train a test model first. Or when the data is small or imbalance, you can do sampling to rebalance the data. …

This post is a follow-up post to my previous post on Cache component design. Previously, I mainly focused on deciding which data to cache and monitoring cache components. In this post, I will dive into more about other aspects of the caching system. Cache serialization & compressions Most of the…

Caching is one of the most basic System Design techniques, and every software engineer needs to know about Cache. There are so many great articles about Cache already, so I will mainly focus on sharing my opinion and experience on improving and monitoring your cache component. Do you need Cache? When you introduce Caching…

I have finally passed my Certified Kubernetes Application Developer, or CKAD, last week. CKAD is certification by Cloud Native Computing Foundation (CNCF) to test your experience and knowledge about Kubernetes. The test was a way to validate my knowledge and experience with Kubernetes. I wrote this post to share my…

Before we begin, let’s start with a definition of unknown value in a machine learning system. It’s basically a categorical value that your model has not seen in both training and evaluation datasets. For example, your loan default prediction has five income categories, but it receives something else. You may…

Spark 3.0 is out, and there are ton of improvements! But there are a nice improvement that is not yet highlighted in the announcement post: Push down filter for CSV file. Prior to Spark 3.0, when you load a CSV file, the CSV file is read to memory then apply…

Docker allows you to set the limit of memory, CPU, and also recently GPU on your container. It is not as simple as it sounds. Let’s go ahead and try this docker run --rm --memory 50mb busybox free -m The above command creates a container with 50mb of memory and…