OpenSearch Engineer – AWS & Data Pipelines

About the role

Ruby Labs is building a high‑scale payment orchestration platform that handles millions of transactions each month. We are looking for an experienced OpenSearch Engineer to own and scale our AWS OpenSearch Service and the data pipelines that keep it in sync with PostgreSQL.

Key responsibilities

• Operate AWS OpenSearch Service in production, designing indices, mappings, analyzers, templates, shards and retention policies.
• Optimize search queries, aggregations, filtering, pagination and bulk indexing; troubleshoot slow queries and indexing bottlenecks.
• Plan and execute safe upgrades, migrations, re‑indexing and capacity scaling.
• Build and maintain reliable PostgreSQL‑to‑OpenSearch pipelines using AWS DMS, OpenSearch Ingestion, Lambda, SQS, S3, ECS or EKS.
• Implement retries, idempotency, deduplication, dead‑letter handling and recovery mechanisms.
• Monitor cluster health, search and indexing latency, storage, CPU, JVM pressure and shard distribution; create CloudWatch dashboards and alerts.
• Design backup, snapshot, restore and disaster‑recovery procedures and participate in incident response.
• Collaborate with backend, database, infrastructure and product teams to define document models and schema standards.

Required profile

• Strong production experience with OpenSearch or Elasticsearch, preferably on AWS OpenSearch Service.
• Hands‑on experience building data pipelines between PostgreSQL and OpenSearch.
• Solid understanding of search architecture, indexing performance and reliability.
• Experience with AWS services such as DMS, Lambda, SQS, S3, ECS/EKS and CloudWatch.
• Ability to design secure access controls using IAM, encryption and least‑privilege principles.

Required skills

• OpenSearch / Elasticsearch
• AWS OpenSearch Service
• PostgreSQL
• AWS DMS
• AWS Lambda
• AWS SQS
• AWS S3
• AWS ECS or EKS
• CloudWatch monitoring and alerting
• IAM role‑based access control
• Data pipeline design and implementation