Distributed systems and Unique IDs: Snowflake
Most of us who deal with traditional databases take auto-increments for granted. While auto-increments are simple on consistent clusters, it can become a challenge in a cluster of independent nodes...
View ArticleCfmap: Publishing, discovering and dashboarding infrastructure state
Dynamic infrastructure can be a challenging if apps and scripts can’t keep up with them. At Ingenuity we observed this problem when we started moving towards virtualization and SOA (service oriented...
View ArticleOpenTSDB – Distributed time series database
Ever since I saw a demo of this tool, I’ve been on the edge, waiting for it to be opensourced so that I could use it. The problem its trying to solve is a real pain-point which most webops folks...
View ArticleKafka : A high-throughput distributed messaging system.
Found an interesting new open source project which I hadn’t heard about before. Kafka is a messaging system used by linkedin to serve as the foundation of their activity stream processing. Kafka is a...
View ArticleS4: Distributed Stream Computing Platform
A few weeks ago I mentioned Yahoo! Labs was working on something called S4 for real-time data analysis. Yesterday they released an 8 page paper with detailed description of how and why they built this....
View Article
More Pages to Explore .....