Distributed systems and Unique IDs: Snowflake
Most of us who deal with traditional databases take auto-increments for granted. While auto-increments are simple on consistent clusters, it can become a challenge in a cluster of independent nodes...
View ArticleClik here to view.
Cfmap: Publishing, discovering and dashboarding infrastructure state
Dynamic infrastructure can be a challenging if apps and scripts can’t keep up with them. At Ingenuity we observed this problem when we started moving towards virtualization and SOA (service oriented...
View ArticleClik here to view.
OpenTSDB – Distributed time series database
Ever since I saw a demo of this tool, I’ve been on the edge, waiting for it to be opensourced so that I could use it. The problem its trying to solve is a real pain-point which most webops folks...
View ArticleClik here to view.
Kafka : A high-throughput distributed messaging system.
Found an interesting new open source project which I hadn’t heard about before. Kafka is a messaging system used by linkedin to serve as the foundation of their activity stream processing. Kafka is a...
View ArticleClik here to view.
S4: Distributed Stream Computing Platform
A few weeks ago I mentioned Yahoo! Labs was working on something called S4 for real-time data analysis. Yesterday they released an 8 page paper with detailed description of how and why they built this....
View Article
