Part 4/11:

The Core Innovation: Persisting Raw Data Forever

Why Persistent Raw Data?

The driving motivation for Redbus's innovation stems from need:

• Troubleshooting: When users report booking failures or anomalies, having access to the exact raw event data sent by APIs is crucial.

• Data Science and Modeling: Building retrospective models or capturing new use cases often require raw event data, which can't always be reconstructed from summarized or transformed datasets.

• Operational Monitoring: For example, in food delivery services, tracking delivery times and driver performance also relies heavily on raw event streams.

Challenges in Raw Data Storage

Handling raw event streams at such scales presents challenges: