Test Automation Engineer

Introduction

At IBM Infrastructure & Technology, we design and operate the systems that keep the world running. From high-resiliency mainframes and hybrid cloud platforms to networking, automation, and site reliability. Our teams ensure the performance, security, and scalability that clients and industries depend on every day. Working in Infrastructure & Technology means tackling complex challenges with curiosity and collaboration. You'll work with diverse technologies and colleagues worldwide to deliver resilient, future-ready solutions that power innovation. With continuous learning, career growth, and a supportive culture, IBM provides the opportunities to build expertise and shape the infrastructure that drives progress.

Your role and responsibilities

Role and Responsibilities

. Design, develop, and maintain white box test automation frameworks for cloud native applications and micro services.

. Develop automated unit, API, integration, and end to end tests with strong focus on code quality and code coverage.

. Build and validate AI/LLM based agentic workflows, including multi agent orchestration, prompt execution, tool usage, and reasoning validation.

. Collaborate with development teams to review architecture, source code, and APIs to create effective white-box test strategies.

. Develop automated validation for AI model outputs, prompt quality, guardrails, hallucination detection, and response consistency.

. Build test utilities, mocks, simulators, and synthetic datasets for cloud services and AI applications.

. Create performance, scalability, reliability, and resiliency tests for cloud hosted applications and AI services.

. Contribute to test framework design, coding standards, and engineering best practices.

Required education
Bachelor's Degree

Preferred education
Bachelor's Degree

Required technical and professional expertise

Required Technical and Professional Expertise

. 3-5 yearsof experience in software development or test automation for enterprise cloud applications.

. Strong programming skills in Java or Python.

. Hands on experience with test automation frameworks such as JUnit, Python

. Experience testing REST APIs using REST Assured and Postman

. Good understanding of white box testing techniques, code coverage, unit testing, integration testing, and debugging.

. Experience with cloud platforms such as IBM Cloud, AWS, Azure, or Google Cloud Platform (GCP).

. Experience with cloud platforms and of container technologies including Docker and orchestration using Kubernetes and OpenShift.

. Experience with CI/CD tools such as Jenkins, GitHub Actions etc.

. Working knowledge of AI/LLM technologies, including prompt engineering, Retrieval Augmented Generation (RAG), AI agents, MCP, and agent orchestration frameworks.

. Familiarity with LLM APIs such as OpenAI, IBMwatsonx.ai, or open source models.

. Experience working with Git and Agile/Scrum development methodologies.

. Strong analytical, debugging, and problem solving skills.

. Excellent communication and collaboration skills.

Preferred technical and professional experience

Preferred Professional and Technical Expertise :

. Experience in Storage, Infrastructure, or Cloud Management products.

. Good understanding of Microservices and REST APIs

. Experience with IBM watsonx, Granite models, or Agentic AI platforms.

. Experience with performance testing tools such as JMeter

. Familiarity with vector databases, embeddings, and RAG evaluation.

. Exposure to security testing and DevSecOps practices.

Years of Experience:
3-6