Integration / Apache Pulsar Interview questions
How do you troubleshoot unbalanced load across brokers?
Check the cluster's current bundle-to-broker assignment and per-broker resource metrics (CPU, throughput, connection count) via pulsar-admin or a monitoring dashboard to confirm the imbalance is real and see which brokers are over- or under-loaded.
A common cause is a small number of very hot bundles sitting on the same broker; check whether automatic bundle splitting is enabled and whether its thresholds are appropriately tuned for the actual traffic pattern - overly conservative thresholds delay splitting hot bundles.
Confirm the load manager's shedding configuration is active - Pulsar's load manager can actively unload bundles from overloaded brokers onto less-loaded ones, and if this is disabled or too conservative, imbalance can persist even after hot bundles are correctly split.
Check for "sticky" traffic from non-partitioned topics: a single very high-traffic non-partitioned topic is inherently confined to one broker, since it can't be split across brokers the way a partitioned topic can - if that's the imbalance source, converting it to a partitioned topic is the actual fix, not load-manager tuning.
Finally, verify client-side connection distribution isn't itself skewed, for example a proxy or DNS layer routing disproportionately to a subset of brokers, since load imbalance can sometimes originate outside Pulsar's own load manager entirely.
Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!
Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.
Invest now!!! Get Free equity stock (US, UK only)!
Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.
The Robinhood app makes it easy to trade stocks, crypto and more.
Webull! Receive free stock by signing up using the link: Webull signup.
More Related questions...
