Senior Automation Engineer – AI Quality Architecture

About the role

The Senior Automation Engineer will lead the design and delivery of production‑grade automation frameworks for an AI platform that powers real‑time, LLM‑driven conversations. Based in Bahrain and open to Bahraini nationals only, this role treats automation as a core engineering discipline that safeguards user trust, platform reliability, and enterprise compliance.

Key responsibilities

• Own the architecture and delivery of scalable functional, integration, regression, and end‑to‑end test frameworks across Next.js/React front‑ends and Node.js back‑ends.
• Build advanced API and micro‑service automation for RESTful and event‑driven systems, including deterministic and semantic validation of non‑deterministic LLM responses.
• Lead automation of Slack and Microsoft Teams integrations, covering bot logic, webhooks, interactive components, and multi‑turn dialogues.
• Architect validation suites for WebSocket‑based communication and low‑latency AI response pipelines.
• Integrate LLM evaluation automation (hallucination detection, faithfulness scoring, semantic similarity checks) in partnership with ML teams.
• Embed automation into CI/CD pipelines on AWS infrastructure with strong observability and performance tracking.
• Drive high standards for test architecture, code quality, security, and automation reliability.
• Collaborate cross‑functionally to translate product and AI requirements into high‑confidence automation solutions.

Required profile

• Senior‑level, hands‑on automation architect with full accountability for quality outcomes.
• Strong communication, ownership, and professional maturity in a fast‑moving, collaborative environment.
• Comfortable owning high‑stakes systems end‑to‑end and treating automation as engineering, not just testing.

Required skills

• Next.js
• React
• Node.js
• AWS
• CI/CD pipelines
• WebSocket
• RESTful APIs
• Slack integration
• Microsoft Teams integration
• LLM evaluation automation

What we offer

• Opportunity to shape automation strategy for a global AI platform.
• Collaborative environment with engineering, product, ML, and leadership teams.
• Competitive compensation and benefits aligned with senior expertise.