-
Orki

Principal AI Platform Architect

Orki
Oman · Full-time · Mid-Senior

About Orki

Orki is an AI-native SaaS company on a mission to revolutionize operations for online businesses in the MENA region. We provide a powerful platform that allows businesses to deploy and orchestrate a team of specialized AI agents across their entire operation. From AI Personal Account Executives (PAEs) that supercharge sales and customer service to agents that manage marketing campaigns , competitor monitoring , and back-office tasks , Orki digitizes the "dream team" for any online business. Our core goal is to transform fragmented outreach into a continuous, personalized relationship, enabling true 1:1 relationship marketing at scale.



The Opportunity

We are seeking a visionary Principal AI Platform Architect to be the mastermind behind the entire cloud and AI infrastructure that powers Orki. This is not a role for maintaining legacy systems; you will be building the highly scalable, resilient, and multi-cloud foundation for our next generation of AI agents from the ground up. You will architect the core platform that will handle millions of customer interactions, power our AI/LLM serving capabilities, and enable us to scale to tens of thousands of businesses across the MENA region.


What You'll Drive:


  • Core AI Cloud Platform Architecture: Design and implement our primary cloud platform as a distributed, event-driven system capable of processing millions of real-time transactions. This platform is the backbone of our AI Agents.


  • LLM & Agentic Systems Infrastructure: Lead the architecture for our AI/LLM serving stack (e.g., vLLM, TGI), RAG pipelines, and agent orchestration frameworks. You will build the environment where our hyper-specialized and voice-based agents will operate.


  • Hybrid & Multi-Cloud Strategy: Architect a multi-region, multi-cloud (GCP, AWS, on-prem, etc.) strategy with seamless failover and data consistency to ensure 24/7 availability for our e-commerce clients. Design deployment models that support both cloud-native and on-premises Kubernetes.


  • Scalable Developer Platforms: Champion GitOps and DevOps best practices to create a self-service developer platform with "golden paths," enabling our teams to build, deploy, and scale new features and AI capabilities rapidly and securely.


  • Observability and Performance Excellence: Engineer a world-class observability framework using OpenTelemetry, distributed tracing, and advanced monitoring to ensure our platform meets stringent SLIs/SLOs for latency and reliability. Implement chaos engineering and automated performance optimization.


  • FinOps & Cost Optimization: Build and automate sophisticated cost optimization systems for both cloud infrastructure and AI/LLM inference workloads, ensuring operational efficiency as we scale.


Core Technical Requirements

  • Must-Have Expertise:
  • 8+ years in distributed systems architecture with proven, enterprise-scale implementations.
  • Deep, hands-on expertise in cloud platforms (e.g. GCP and AWS) with multi-cloud experience.
  • Production mastery of Kubernetes at scale (GKE/EKS, operators, CRDs, multi-tenancy).
  • Expert-level knowledge of event-driven architectures (Kafka, Pub/Sub, EventBridge, NATS).
  • Proven experience implementing service mesh technologies (Istio, Linkerd, Consul).
  • Deep understanding of distributed databases (e.g., Spanner, DynamoDB, CockroachDB).
  • Excellence in Infrastructure as Code (Terraform/Pulumi) and GitOps (ArgoCD/Flux).
  • Strong programming skills in Python or C# (expertise in both is highly valued).


  • Essential AI/LLM Infrastructure Experience:
  • Experience building and scaling RAG pipelines with vector databases.
  • Familiarity with agent orchestration frameworks and MLOps principles.
  • Experience managing GPU clusters and optimizing inference workloads is a significant advantage.


  • Proven Experience:
  • Architecting systems handling 100K+ RPS with sub-second latency.
  • Implementing zero-trust security architectures.
  • Building scalable developer platforms that accelerate engineering velocity.


Why Join Orki?

  • Build from the Ground Up: This is a rare greenfield opportunity to architect a cutting-edge AI platform without the constraints of technical debt.


  • Massive Impact: Your work will be the foundation of our entire company and will directly empower thousands of businesses.


  • Lead the Market: We are hyper-focused on the MENA region with a unique, culturally-aware AI, giving us a powerful competitive advantage.


  • Elite Partnerships & Traction: We are partnered with global tech leaders, have secured our initial funding round, and have a rapidly growing list of businesses signed up.


  • Experienced Leadership: You will work alongside a proven leadership team with deep expertise in AI, management, and software architecture.


If you are a visionary architect passionate about building from the ground up and this role excites you, we encourage you to apply, even if your experience doesn't perfectly match every requirement on our list. We value a builder's mindset and a passion for innovation above all else.


To Apply:

Please click the "Apply" button on this post to begin the application process.

  • Ensure your resume is submitted in PDF format only. Applications with resumes in other formats may not be reviewed.
  • While not mandatory, we highly recommend including a brief cover letter (as a PDF) that highlights your specific experience architecting large-scale cloud and AI/ML infrastructure.

Orki is a proud equal opportunity employer. We are committed to building a diverse and inclusive team that will redefine e-commerce in the MENA region. With the support of key partners like Omantel, NVIDIA, and Huawei, we are on a rapid growth trajectory and look forward to reviewing your application.

Key Skills

Ranked by relevance

ai cloud dynamodb outreach devops kafka istio mlops saas aws gcp
Login to Apply
Posted
Jul 31, 2025
Type
Full-time
Level
Mid-Senior
Location
Muscat
Company
Orki

Industries

Technology Information Internet

Categories

Engineering Information Technology

Related Jobs

3 roles aligned with this opportunity

View all jobs
View Job Details
Block Labs
Related

Senior Frontend Engineer

2026-05-28

Full-time
Not Applicable
Ireland
Technology
Engineering
View Job Details
Air Apps
Related

Software Architect - Mobile

2026-05-29

Full-time
Not Applicable
Italy
Technology
Engineering
View Job Details
Orki
Related

Senior GenAI Engineer

2025-10-19

Full-time
Mid-Senior
Oman
Technology
Engineering