Storm: Real-Time Data Processing at a Massive Scale

Using the stream processing and Hadoop ecosystem, Sears and MetaScale is developing a platform to collect, process and publish data in real-time. By integrating Storm into the enterprise data flow and deploying scalable topologies that source from multiple data sources, this platform makes it possible to process hundreds of thousands of messages per second.

This processing is essential for many Sears real-time initiatives, including gamification, individualized customer offers, inventory management, sales metrics and fraud detection. This presentation provides an overview of real-time computation, identifies components and operational features of Storm, and outlines a real-time processing platform and its use cases.