AI Platform Operations Engineer

AI Platform Operations Engineer

Join our dynamic team as an **AI Platform Operations Engineer**, where you will play a pivotal role in ensuring the seamless, secure, and scalable deployment of cutting-edge AI workloads on Microsoft Azure. In this full-time position, you will oversee the operational management, governance, and support of enterprise-grade AI platforms, including Generative AI and Agentic AI solutions, while driving efficiency, compliance, and innovation across the organization.

As an AI Platform Operations Engineer, you will be responsible for maintaining the integrity and performance of Azure AI services, such as Azure AI Foundry and Azure OpenAI, while collaborating with cross-functional teams to streamline onboarding processes, enforce governance policies, and optimize AI-driven workflows. Your expertise will be instrumental in bridging the gap between technical execution and strategic AI initiatives, ensuring that every deployment aligns with enterprise standards, security protocols, and cost-efficiency best practices.

Key Responsibilities

Your role will encompass a broad spectrum of operational and technical duties, including but not limited to:

• Platform Operations and Governance: Manage and optimize Azure AI platform services, ensuring seamless integration of Generative AI and Agentic AI workloads while adhering to approved landing-zone patterns, blueprints, and governance frameworks.
• AI Workload Onboarding: Lead the onboarding of Nexus AI, GenAI, and agentic applications using standardized processes, including identity/access management, network/API connectivity, and deployment validation checks.
• API and Gateway Management: Support the exposure of AI gateways and LLM gateways via Azure API Management (APIM), ensuring robust API connectivity, registration, and production-readiness assessments.
• Environment Readiness and Compliance: Collaborate with use-case teams to prepare environments for AI deployments, enforce guardrails, content-safety controls, and observability measures, while ensuring cost attribution and governance alignment.
• Monitoring and Observability: Implement and validate AI observability solutions, including prompt/model monitoring, evaluation frameworks, and operational health indicators, to ensure optimal performance and reliability.
• Integration and Data Flow Management: Facilitate integrations with MCP/agent interfaces, data products, event streams, and operational data stores, ensuring seamless data flow and system interoperability.
• Incident and Risk Management: Track and resolve incidents, onboarding issues, and dependencies in coordination with Microsoft, Client IT, CIS, Architecture, Data & AI, and use-case teams, while maintaining comprehensive documentation and knowledge-transfer materials.
• Documentation and Process Improvement: Develop and maintain onboarding checklists, operational procedures, troubleshooting guides, and governance evidence to foster continuous improvement and knowledge sharing.

Must-Have Skills and Experience

To excel in this role, you must possess:

• 3+ Years of Hands-On Azure Experience: Deep expertise in Azure administration and operations, with a focus on supporting production cloud environments.
• Azure AI Platform Mastery: Extensive experience with Azure AI Foundry, Azure OpenAI, and Azure AI Services, including their operational intricacies and scalability challenges.
• API Management and Exposure: Proficiency in Azure API Management (APIM) and API exposure patterns, ensuring secure and efficient API integrations.
• Generative AI and Agentic AI Knowledge: A strong understanding of Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI architectures.
• AI Governance and Guardrails: Experience implementing AI guardrails, content filtering, and Responsible AI controls to mitigate risks and ensure ethical AI deployment.
• Observability and Monitoring: Familiarity with AI observability tools, including Azure Monitor, Application Insights, Log Analytics, and performance tracking frameworks.
• Security and Identity Management: Working knowledge of Azure security best practices, RBAC, Managed Identities, Key Vault, and networking concepts to safeguard AI workloads.
• Troubleshooting and Stakeholder Collaboration: Strong troubleshooting skills and the ability to manage stakeholders effectively, ensuring alignment and resolution of operational challenges.

Good-to-Have Skills

While not mandatory, the following skills will further enhance your impact in this role:

• AI Gateway Solutions: Experience with Azure APIM AI Gateway or similar solutions for advanced API exposure and management.
• Prompt Engineering and Evaluation: Knowledge of Prompt Flow, AI evaluations, and model benchmarking frameworks to optimize AI performance.
• AI Frameworks and Tools: Familiarity with LangChain, LangGraph, Semantic Kernel, or AutoGen for building and managing agentic AI systems.
• MLOps and CI/CD: Experience with MLOps practices, CI/CD pipelines, GitHub Actions, and Azure DevOps for streamlined AI development and deployment.
• Data Governance and Compliance: Understanding of Microsoft Purview, AI governance, and compliance frameworks to ensure regulatory adherence.
• Vector Databases and RAG: Knowledge of vector databases, Azure AI Search, and RAG architectures for advanced AI applications.
• Containerization and Scalability: Familiarity with Kubernetes, Container Apps, or Azure OpenAI at enterprise scale for high-performance AI deployments.
• FinOps and Cost Management: Experience with quota planning, token consumption analysis, and FinOps practices to optimize AI workload costs.

This is an opportunity to shape the future of AI operations within a forward-thinking organization. If you are passionate about leveraging Azure’s AI capabilities to drive innovation while ensuring operational excellence, we invite you to apply and contribute to our mission of transforming AI into a scalable, secure, and impactful enterprise solution.