Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : The shortest and comprehensive System Design Template for any new service - link here Kafka is one of the most efficiently built transient datastore. This article explains the compute and storage layers of kafka – link here Consistent Hashing has helped solve Distributed System with: even shard distribution across nodes in cluster ...

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : AI-Powered Search and Chat for AWS Docs. The best way of consuming AWS docs. – link here A Framework for Thinking About Systems Change - link here BookWyrm - Yet another attempt on building a social media based on book. link here git repo for the same - bookwyrm​ Built by Mouse Reeve - https://github.com/mouse-reeve ...

[Self Notes and Review]: This is a new series of publications where I am publishing my self notes/extracts from reading the very famous book - DDIA (Designing Data-Intensive Applications) by Martin Kleppmann. This particular article is from the first chapter of the book. Again, these are just my self notes/extracts and treat this more like an overview/summary. Best way is to read the book in itself. Side note: I am a terribly slow and repetitive reader. The update between chapters might take weeks. ...

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : Don’t turn that Swap off yet. In defense of swap - common misconceptions. - link here Why histogram and how are they useful. link here If you have used any of the monitoring or APM tools, you would have come across Histogram form of metric being emitter. This writeup give a brief on why Histogram. S3 isn’t getting cheaper - link here ...

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : A new book released on the hot eBPF - “Learning eBPF” by Liz Rice. This a summary form and a quick introduction to eBPF capabilities when compared to “BPF Performance tools” by Brendan Gregg. To understand latency in detail - “Everything You Know About Latency Is Wrong” - link here ...

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : [Video-57mins] : What is Continuous Profiling in Performance monitoring and What is Pyroscope - with Ryan Perry - link Go 1.20 is here(link). A thread on all the changes - here “What’s the best lecture series you’ve seen?” - Thread link Some great side project idea on the thread - here. My fav is PlainTextSports ...

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : It is December and Advent of code is here. What is Advent of code ? - link here. An old podcast on Spotify’s Engineering team geeking out every December on AOC - link here [A talk - 31mins ] - Concurrency is not Parallelism - “Concurrency is about dealing with lots of things at once. Parallelism is about doing lots of things at once.” - YouTube ...

This writeup is more of a demo to showcase the power of “proc” (process information pseudo-filesystem) interface in linux to get the memory details of process, and also a quick brief on the power of “proc interface”. In the current trend of building abstraction over abstractions in software/tooling, very few tend to care about the source of truth of a metrics. There are various APM / Monitoring tools to get the memory details of a process for a linux system, but when the need arises, I believe, one must know the ways of going closer to the source of truth on a linux system and verify things. ...

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : [Book-Recommendations]: Cloud-Native Observability with OpenTelemetry by Alex and Charity. (Side note: Half way through the book and learning a lot. ) Take away : Effective ways of adding metrics/traces in cloud native apps without marrying to any APM tools A list of possible developer questions to consider asking a prospective employer. - github link [Video]: Disk latency being directly proportional to vibrations (in other words, lets try shouting in data center!!) – 2min Video link What is Redis explained - link here Best Practices for Fixing your alerts in your service? (so that you can sleep well?) – link from newrelic here The disproportionate influence of early tech decisions (debatable but interesting!) - link here Non-Technical : Second-order thinking: How to NOT create new problems while solving existing problems. - Link [90mins] Podcast recommendation – The Knowledge Project : Insights for making better Decision – Spotify link What’s the strangest thing you ever found in a book ? (heartwarming!)– link 10 mental concepts for thinking better - Twitter thread A quote that struck the right chords: “So much advantage in life comes from being willing to look foolish in the short term.” ...

This writeup is a dump of my study notes on most frequently used docker commands for reference. This is just a self reference page and will get updated on the go To run a container from an image docker run <image name> To run a docker image with a specific tag. Example below of pulling redis image with tag4.0. You will get these tag details on the dockerhub page for the image docker run redis:4.0 To run a docker image in detached mode docker run -d <image_name> To run a docker image and login to the container directly docker run -it <image_name> To list all the docker images docker images To pull a docker image from dockerhub but not run it. docker pull <image_name> To list all the docker containers docker ps -a To stop a docker container docker stop <container_name> To remove a docker container form the disk. Note: This will remove the container permanently. It will not list anymore in docker ps -a. However, the image still exists. The exited/stopped containers do not consume any CPU or memory, but they still use the machine’s disk space. docker rm <container_name> To remove a docker image docker rmi image To execute a command in a running docker container docker exec <container_name> <command> To get the ip of a docker container docker inspect <container_id/container_name> | grep IPAddress To map the internal port of a docker container to a host port docker run -p 80:5000 <image_name> To get the logs of a container docker logs <container_name> To build a docker file docker build . #from being in the dir which has Dockerfile To map an external directory at the bootup to a docker container docker run -v /myCustomdir:/defaultDir -u root imageName