Part 3/11:

Redbus ingests data from diverse sources: mobile applications, web browsers, backend servers, and more. Data flows through multiple channels such as Kafka, RabbitMQ, HTTPS, and file uploads, depending on the nature of the data.

Depending on the data type, different processing tools are employed:

• Streaming Data: Processed via Apache Kafka and Apache Flink.

• Batch Data: Managed through Fargate, Lambda, and AWS Glue.

• Data Storage and Warehousing: Raw and processed data are stored across platforms like Redshift, Apache Druid, and data lakes in S3.

Furthermore, Redbus leverages proprietary tools such as Superset for visualization and a custom-built data catalog for democratizing and accessing metadata about data assets.