Storm Wars Episode 7: when the Data Stream shrinks
In a galaxy far, far away…. We use Apache Storm to process our data stream in real time. In general, we add more stream partitions/shards to increase throughput and things work fine. But, when the stream shrinks i.e. a stream partition/shard gets deleted? things fall apart. In this storm wars episode, we discuss a solution to handle this scenario. PS: May the force be with you!
Seniour Software Engineer, PocketMath
MySQL Enthusiast, Doodle Maker & fellow Programmer @ http://www.pocketmath.com - worlds largest self-serve mobile DSP. i am a surgeon at M*A*S*H (MySQL Army Surgical Hospital) http://mash213.wordpress.com & i doodle at www.doodle-vishnu.blogspot.in