Secure and scalable observability for a national digital identity program
Client
The client runs one of the world’s largest digital identity programs — a government initiative that verifies and manages digital IDs for millions of residents across India.
Project Context
The team needed a secure on-premise observability solution with capacity for 1.5 TB/day of ingestion, while meeting strict compliance and data privacy requirements.
Project Objectives
Deploy Elasticsearch for observability, APM, and SIEM.
Plan for 1.5 TB/day ingestion and 270 TB retention.
Implement HA across two geographically separate data centers.
Challenges
Legacy tools lacked scale and security.
In-house team required expert engineering support for capacity planning and deployment.
Sensitive nature of data required on-site delivery.
Solution
Deployed Elasticsearch with APM, ML, and SIEM features.
Set up Kafka MirrorMaker for geo-redundant ingestion.
Performed HA configuration and stress testing for performance validation.
