Scaling Kubernetes to 7,500 nodes
At this point no one doesn’t know OpenAI and their ChatGPT. They run a massive K8S cluster with 7,500 nodes. Needless to say that come with many challenges they share with us here.
Things DBs Don't Do - But Should
Writing or talking about things databases don’t do may sound a bit silly. There are obviously many things databases don’t do. Example, automatic backup, version control of row…
Tinkering with Unix domain sockets
A most normal way for client <-> server communication is to open a port, and listen to traffic to that port. To secure sometine we use localhost, but there is also other way call Unix socket. The most famous one use it is docker with its
/var/run/docker.sock which sometime we can mount into a container and interact with docker on host. In this post, we explore this socket concept.
Generate diagrams programmatically
Drawing Diagram by hand can be very tedious. To connect relationship we have to constantly move thing around to make room and space. D2 is a modern text-to-diagram language. It is built with extensibility in mind.
This post show an example of how we can use SQL to generate the diagram of table relationship.
Inside logical replication in PostgreSQL: How it work
Logical replication uses a publish and subscribe model with one or more subscribers subscribing to one or more publications on a publisher node. Subscribers pull data from the publications they subscribe to and may subsequently re-publish data to allow cascading replication or more complex configurations.
The Wonders of Postgres Logical Decoding Messages
Did you know there’s a function in Postgres that lets you write data which you can’t query? A function that lets you persist data in all kinds and shapes but which will never show up in any table? Let me tell you about pg_logical_emit_message()! It’s a Postgres function that allows you to write messages to the write-ahead log (WAL) of the database.
Introduction to Postgres Backups
There’s a variety of ways to back up your data and this post aims to explain the basic tools involved in backups and what options you have, from just getting started to more sophisticated production systems.
A collection of awesome CRDT resources. Useful when you want to learn about collaborative editing
Code to read
an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
A collection of script depicting the strange quirks of programming languages.
a command-line program that finds secrets and sensitive information in textual data and Git history.
Have you ever see code like
\u001b[1;31;40mHello World\033[0m in your log because color code get send to text log? How can we parse them?
~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint
🎹🎸A music theory library with a command-line interface. Super cool as a guitar beginner to look up chord I must say
an open source software supply chain control plane, a single source of truth for artifacts plus a declarative attestation process. SecOps teams can declaratively state the attestation and artifacts expectations for their organization’s CI/CD workflows, while also resting assured that latest standards and best practices are put in place.
A SQLite extension which loads a Google Sheet as a virtual table.
Use SQL to instantly query your cloud services (AWS, Azure, GCP and more). Open source CLI. No DB required
Ready, Beautiful UI Components for building analytical interfaces. Feed data and they show nice chart.
Have you ever want to dig through a huge JSON object? filter out a certain array. Nested it etc.
jq is great if you know the shape of object ahead of time. But if you’re looking for a needle in a huge JSON, a visual tool might be better
modern font stacks
Use system font avoid many gotcha such as layout shift, flashing. istant render because the font is pre-installed. But which font stack offer the best on all the OS, how does they looks like. Use this site to choose
a lightweight SQL caching engine written in Rust that helps developers enhance the performance and scalability of existing applications.
Schedule job in Postgrs by using Postgres table itself. Using a cron you always have to deal with lock to ensure there are no 2 instances run at same time. Putting this in the db itself make operating simpler. You can schedule SQL query, system command, or built-in function. Refresh materialize view is a perfect match.
An open-source, cloud-native, distributed time-series database with PromQL/SQL/Python supported.
That's it for this round, have a great day! If you like this newsletter, please tell the world, or
tweet about this