AI Architect

Job Purpose

Designs and architect end-to-end AI Cloud platforms with a focus on security, cost-efficiency, and performance. This position involves direct client engagement to translate requirements into technical Solution, encompassing GPU infrastructure rightsizing and optimal model selection. We are looking for a cloud expert with a demonstrated ability to transition complex AI models from concept to large-scale production. The ideal candidate brings extensive experience in AI/Cloud ecosystems and a successful track record of architecting and managing production-grade, large-scale AI platforms.

Role Summary

Key Responsibilities

• Translate business requirements into scalable, high-performance AI/GenAI architectures featuring NVIDIA GPU clusters
• Design end-to-end AI Cloud and next-generation platforms optimized for deep learning workloads and distributed training.
• Architect HPC cluster topologies utilizing high-speed InfiniBand (NDR/HDR) and RoCE v2 interconnects for low-latency communication.
• Right-size platform components, including GPUs, CPUs, memory and NVMe storage for comprehensive client proposals.
• Architect distributed training and inference environments optimized for MPI frameworks and workload scheduling via Slurm.
• Desing scalable container orchestration platforms using Kubernetes and Kubeflow to manage AI workloads.
• Propose optimized inference strategies using vLLM, Triton, and TensorRT-LLM to meet specific latency and throughput KPIs.
• Should have experience on RAG systems and multi-agent orchestration frameworks like LangGraph and agentic ecosystems.
• Develop private AI cloud environments focused on data sovereignty and regulatory compliance, such as the India DPDP Act.
• Define integration strategies for LLMs and open-source models within existing enterprise data systems, APIs, and knowledge graphs.
• Establish reference architectures for CI/CD/CT pipelines and automated model retraining workflows to ensure reproducibility.
• Implement automation and observability frameworks for monitoring GPU utilization, performance tuning, and failure handling.
• Drive technical validation through Proof of Concept (PoC) engagements, focusing on scalability and performance benchmarks for LLM training.
• Establish Infrastructure-as-Code (IaC) practices to ensure reproducible and reliable cluster deployments.
• Collaborate with C-suite stakeholders and cross-functional teams to drive technical decision-making, innovation, and roadmap alignment.

Experience & Educational Requirements

Qualifications and Experience

EDUCATIONAL QUALIFICATIONS: (degree, training, or certification required)

BE/B-Tech or equivalent with Computer Science or Electronics & Communication

RELEVANT EXPERIENCE: 15 - 20 years of IT Experience with minimum 5 years in AI platform

Required Technical Skills

Core AI/ML Expertise

• Strong experience in Nvidia, Intel, Google GPU Architecture, InfiniBand
• Strong expertise in Kubernetes, Slurm and OpenShift
• Good experience in Python, PyTorch and TensorFlow
• Good knowledge on LangChain, LangGraph
• Deep understanding of Transformers, Attention mechanisms, Diffusion, MoE
• Knowledge of RLHF, Pinecone, FAISS, Chroma, OpenAI, VLLM
• Expertise in RAG and agentic AI workflows
• Knowledge of high-performance storage (Lustre, PFS, Object NVMe)
• Good Knowledge with NVIDIA architectures (Hopper, Blackwell)

Soft Skills

• Strong problem-solving and analytical thinking
• Excellent communication and stakeholder management
• Ability to influence leadership and drive strategic decisions
• Innovation mindset with focus on enterprise impact

Preferred Experience

• Currently in AI / Cloud Presales team
• Should be able to right size infra and choose right GPU model as per client requirement
• Hands-on with Python, vector DBs (Pinecone, FAISS, Chroma), and LLM APIs (OpenAI, Anthropic).
• Solid understanding of cloud-native architecture OpenStack, KVM, (Azure/AWS/GCP), microservices, Kubernetes, serverless, API gateways.
• Good knowledge on deep learning experience: CNNs, RNNs/LSTMs, Transformers, and attention mechanisms.
• Proficiency in Python for ML: NumPy, pandas, scikit-learn, and frameworks such as PyTorch or TensorFlow.
• Experience in integrating LLMs (GPT, Claude, Gemini, LLaMA, Mistral) into applications.
• Prompt engineering skills: zero-shot, few-shot, chain-of-thought, ReAct, and structured output patterns.
• Experience building RAG systems: document chunking, embedding models, vector search, and retrieval optimization.
• Understanding of AI agent patterns, tool use, and agentic workflows.
• Familiarity with Docker, CI/CD pipelines, and Git-based workflows.
• Strong communication, stakeholder management, and solution design skills.