DevOps Consultant

Job Summary

We are looking for an experienced AWS Observability Engineer specializing in the Elasticsearch (ELS) Stack to design, implement, and optimize observability solutions across our cloud infrastructure. The ideal candidate will have expertise in AWS services, log management, metric monitoring, and dashboards to ensure system performance, availability, and security.

Key Responsibilities

Observability & Monitoring

• Design and implement centralized logging solutions using the ELS stack (Elasticsearch, Logstash, Kibana) in AWS environments.
• Develop scalable log pipelines using Logstash or other log shipper tools (e.g., Fluentd, Beats).
• Set up and manage Kibana dashboards for system metrics, application logs, and performance monitoring.
• Integrate and align logging and monitoring with AWS services such as CloudWatch, CloudTrail, and S3.

AWS Infrastructure

• Architect and deploy observability components in AWS using best practices for scalability and reliability.
• Leverage AWS-native services like CloudFormation, AWS Lambda, and ECS/EKS to enhance monitoring capabilities.
• Optimize the observability stack to manage large-scale log ingestion, storage, and querying.

Performance Analysis

• Monitor and analyze system performance, application health, and infrastructure logs for anomalies or incidents.
• Implement alerts and notifications for critical events using Kibana or third-party alerting tools like PagerDuty or Slack.
• Work with engineering teams to debug performance issues and provide insights for improvement.

Automation & Optimization

• Automate observability workflows using scripting languages (Python, Bash) or infrastructure-as-code tools (Terraform, Ansible).
• Tune Elasticsearch clusters for performance and cost efficiency, including indexing, shard allocation, and retention policies.
• Stay up-to-date with the latest developments in the ELK stack and AWS observability tools.

Required Skills and Experience

• 5+ years of experience in IT infrastructure monitoring, observability, or related fields.
• 3+ years of experience with the ELS/ELK stack (Elasticsearch, Logstash, Kibana) in production environments.
• Strong hands-on experience with AWS services, including:
• CloudWatch, CloudTrail, S3, Lambda, ECS/EKS, and VPC Flow Logs.
• IAM policies and security best practices for observability tools.
• Proficiency in scripting/programming languages (Python, Bash, or PowerShell).
• Experience with CI/CD tools and DevOps methodologies.
• Familiarity with containerized environments (Docker, Kubernetes) and their observability challenges.
• Solid understanding of log management, distributed tracing, and metrics monitoring.
• Knowledge of Elasticsearch tuning, including shard management and query optimization.

Preferred Qualifications

• AWS Certification (Solutions Architect, DevOps Engineer, or SysOps Administrator).
• Experience with other monitoring tools like Datadog, Dynatrace, or Prometheus.
• Knowledge of event-driven architectures and AWS Step Functions.
• Understanding of compliance frameworks (PCI DSS, GDPR) and log retention policies.

About Us:

Ascendion is a global, leading provider of AI-first software engineering services, delivering transformative solutions across North America, APAC, and Europe. We are headquartered in New Jersey. We combine technology and talent to deliver tech debt relief, improve engineering productivity solutions, and accelerate time to value, driving our clients’ digital journeys with efficiency and velocity. Guided by our “Engineering to the power of AI” [EngineeringAI] methodology, we integrate AI into software engineering, enterprise operations, and talent orchestration, to address critical challenges of trust, speed, and capital. For more information, please go to www.ascendion.com

With Ascendion (www.ascendion.com), you:

• Will get to work on numerous challenging and exciting projects on our various offerings including Salesforce, AI/Data Science, Generative AI/ML, Automation, Cloud Enterprise and Product/Platform Engineering.
• At Ascendion you have high chances of project extension or redeployment to other clients.
• Additionally, you can also share CV of anyone you know. We have a referral policy in place.