When Should You Spin Up Your Next Apache Kafka Cluster?

 This post is published on the Confluent blog: https://www.confluent.io/blog/kafka-clusters-and-cluster-management/

Comments

Post a Comment

Popular posts from this blog

A framework for generating Payment(SWIFT) messages

Image
It was late 2007, world was on the brink of credit crisis. I was a lead architect on a project for a large American bank on a consulting assignment. The project required generating and consuming SWIFT messages and I was thinking hard on how to make it easy for my team to exchange SWIFT messages as part of the system that was being developed. After searching around I could not find a good software or a framework that would do the job and so I set out to design one myself. I soon realized that composing SWIFT messages element by element was going to be hard as it required the developers to understand the rules and grammar of SWIFT. If I were to ask my developers to learn SWIFT and then work on the module of the system that would be responsible for exchanging SWIFT messages, I know I would be on a suicidal mission. Most of the developers in my team were novices, let alone understanding SWIFT they didn't even know enough programming. You know how the offshoring companies work, its all...
Read more

Technology Scorecard for Application Portfolio Rationalization (Application Portfolio Management)

1.      Introduction To understand Application Portfolio Rationalization (APR), we need to understand what is Application Portfolio Management (APM)? APM is akin to Financial Portfolio Management but it is applied to inventory of IT applications / systems present in an enterprise or segment of business within the enterprise. “In many organizations, applications are deployed and then run forever leading to an endless proliferation of IT systems that is not sustainable. The practice of adding new software applications without retiring old ones will eventually cause the entire IT budget to be consumed by the maintenance and operations burden of legacy applications.” – Burton Group To avoid the condition described above, Application Portfolio Management function is required. Application Portfolio Rationalization (APR) is a means of APM.  APR needs to be undertaken periodically for a sound APM. APM is performed in two ways as suggested by Wikipedia, “There...
Read more

RCA Algorithm / Process

Last few weeks I have been working with a large client engagement where we have several projects in development. The teams keep on adding major & minor releases almost every month as the projects are on a tight schedule to beat competition in introducing new features to their apps. This has become an issue for the support teams with multiple issues cropping up across many applications around the same time and the teams running after me (I being a Technology Leader - Principal Architect for SBU consisting of 8 - 10 large client accounts.) to help them with the Root Cause Analysis - RCA . I being a mere mortal have only 1 processor (brain) and can focus at most at only one issue at a time. Focusing here means looking at the code, understanding the design, deployment etc in depth. Growing frustrated with people running after me simultaneously to borrow an extra pair of eyes i.e. outsider perspective to look at their problem, I designed a simple process for RCA as I found out that many...
Read more