AI Solution Engineer – Foundation Models & LLMs | IBM Client Engineering
Use watsonx and GenAI to co-create innovative, scalable AI solutions in real-time with enterprise clients.

Company: IBM
Location: Not specified (assumed hybrid or flexible)
Job Type: Full-time
Preferred Education: Master’s Degree

About the Role

As an AI Solution Engineer in IBM’s Client Engineering team, you'll work on fast-paced, 4–6 week AI pilots using IBM’s watsonx platform. You'll directly partner with clients and technical leaders to design, build, and deploy AI-powered proof-of-concepts grounded in foundation models, LLMs, and scalable architecture. This role is a blend of innovation, hands-on engineering, and client interaction.

You’ll be a core part of IBM’s co-creation strategy—turning complex business problems into real, scalable solutions in record time.

Responsibilities

• Build AI Proof-of-Concepts (POCs) to demonstrate technical feasibility and business value using watsonx and other technologies
• Architect custom AI solutions focused on foundation models, LLMs, and scalable deployment patterns
• Engage with clients during the pilot and deployment phases to guide, support, and educate on best practices
• Document architecture decisions, designs, and lessons learned; contribute to white papers, internal documentation, and mentoring
• Stay current on industry trends in AI, ML, foundation models, vector databases, and automation frameworks
• Collaborate with cross-functional IBM teams to turn client pilots into production-ready innovations

Required Skills & Experience

• Experience with full AI project lifecycle – from R&D to production deployment
• Hands-on development with foundation models and large language models
• Familiarity with Agile methodologies
• Experience in AI/Data governance, digital assistants, or business automation solutions
• Strong understanding of cloud-native tooling:
  • Red Hat OpenShift, Kubernetes, Ansible
  • Vector DBs, open file formats (Parquet, Avro, ORC)
  • Apache Iceberg, Redis or similar key-value stores
• Cognos BI experience: design, build, and deployment of dashboards and multi-dimensional reports

You’ll Succeed If You:

• Are hands-on with GenAI and cloud-native architecture
• Have experience building repeatable, scalable AI solutions
• Thrive in client-facing, agile environments
• Are comfortable iterating quickly on real-time pilots
• Combine deep technical expertise with strong communication and consultative skills

Join IBM and shape how enterprise clients experience the power of AI today.