Elasticsearch Migration to Elastic Cloud for a Leading Canadian Energy Company
Client
The client is one of Canada’s largest energy producers, specializing in oil and natural gas exploration and operations. With mission-critical ingestion pipelines and real-time data requirements, the company sought to modernize its infrastructure for improved performance, availability, and cloud scalability.
Project Context
The client’s 3-node on-prem Elasticsearch cluster (v8.6.1) hosted 465 indices and 1.3 TB of search-critical data. To improve maintainability, scalability, and operational overhead, they initiated a structured migration to Elastic Cloud with minimal downtime.
Challenges
- Snapshot failures due to security validations
- Subscription fragmentation on Azure
- ILM and SLM policy inconsistencies
- Role and user recreation post-migration
Solution
- Resolved snapshot issues through early testing
- Rebuilt deployment on Elastic v8.13.2
- Merged Azure billing under a single subscription
- Recreated security roles and ILM policies in the cloud
Project Objectives
- Migrate Elasticsearch from on-prem to Elastic Cloud
- Preserve data integrity using snapshot-based migration
- Limit total downtime to under 3 hours
- Streamline Azure subscription and billing
- Recreate roles, access, and ILM configurations
Solution Delivery
SquareShift delivered a 3-phase migration plan: prep, testing, and final cutover. They validated snapshot integrity, tested on a non-prod Elastic Cloud cluster, and completed the live restoration in under 3 hours while preserving all indices, roles, and configurations.
Testimonial
SquareShift’s structured approach helped us modernize our search infrastructure with zero data loss and minimal downtime.