Data Engineer – Real-time Analytics

Paytm's data platform team processes over 50 billion events per day across payments, commerce, financial services, and advertising products. As a Data Engineer focused on real-time analytics, you will build and operate the streaming data infrastructure that powers Paytm's live dashboards, fraud detection pipelines, and personalisation engines. Your responsibilities include building Apache Flink and Kafka Streams jobs for real-time event processing, designing Delta Lake and Apache Iceberg table architectures on AWS S3, managing Apache Spark batch processing workflows for historical analytics, building self-serve data cataloguing using Apache Atlas and DataHub, implementing data quality checks using Great Expectations, and collaborating with ML engineers to productionise feature pipelines. The role requires strong distributed systems thinking, proficiency in Scala or Python, and hands-on experience with cloud-native big data tooling.