Job Description

Software Developer - Job Description ← Go Back To Jobs

Software Developer

APPLY FOR THIS JOB

Adyar , Chennai, Tamil Nadu, India (ST01)

Department
Technology Solutions Group
Job Posted On
27-05-2026 16:17:13
Employee Type
FTE
Experience range (Years)
5 - 10

About Us  

Straive is a global leader in data analytics and AI operationalization, helping enterprises embed advanced AI and data capabilities into core business workflows to deliver measurable business outcomes and ROI. With a workforce of ~20,000 professionals serving 350+ clients across 30+ markets, Straive combines technical scale with deep domain expertise. A key differentiator is its network of over 6,000 subject matter experts who specialize in managing and enriching complex, unstructured data enabling organizations to build AI systems grounded in accuracy, context, and business relevance.

The company continues to earn recognition from leading industry analysts and was recently named a Leader in AIM’s 2026 Generative AI and Data Engineering PeMa Quadrants. Backed by EQT  a purpose-driven global investment organization which was ranked among the world’s leading private equity firms by PEI in 2025 Straive is positioned as a high-value alternative to traditional IT services providers, combining domain-led intelligence with AI execution at scale.

Job Description 

As a GenAI Test Lead, you will define and operationalize quality for AI systems, bridging traditional QA with AI engineering. You will design scalable evaluation frameworks (EvalOps) to measure groundedness, factual accuracy, coherence, and RAG performance, ensuring our AI systems are reliable, aligned, and production-ready. This role requires treating LLM outputs as measurable signals—building data-driven validation systems that continuously improve model performance and user experience.

Key responsibilities and duties –

    • Define evaluation metrics for LLM systems (groundedness, hallucination rate, task success RAG accuracy)
    • Design and implement automated EvalOps pipelines for continuous model validation
    • Establish acceptance criteria and quality benchmarks for AI releases
    • Build scalable test frameworks for LLM-based systems using tools like DeepEval, pytest, or custom pipelines
    • Automate validation of prompts, responses, and agent workflows
    • Integrate AI testing into CI/CD pipelines
    • Analyze LLM outputs as structured data to identify failure patterns
    • Validate data quality, retrieval accuracy, and grounding in RAG systems
    • Design synthetic and real-world test datasets
    • Collaborate with AI engineers, product teams, and clients to define quality standards
    • Drive alignment across distributed/onshore-offshore teams
    • Provide insights on model performance and improvement areas
    • Evaluate prompt strategies, agent behaviors, and user interaction flows
    • Ensure outputs align with business context and user expectations
    • Rapidly adapt to domain-specific requirements
    • Experience with Rational Tool Suite, JIRA, or similar test management tools.
    • Experience in using/setting up continuous integration testing and experience with any DevOps tools
    • Develop automation tests as part of the Eval Framework using frameworks like DeepEval, pytest etc
    • Strong understanding of Agile principles; experience in SAFe Agile environments.
    • Experience testing APIs and data integrations.
    • Experience working in an onshore/offshore model.
    • Experience in test automation design and execution.
    • Strong understanding of different software testing methodologies.

Required Qualifications and Experience –

  • Minimum 6+ years of overall experience in software QA.
  • Education: Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related quantitative field.
  • Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot complex, distributed AI systems.
  • Communication: Excellent communication skills to articulate technical findings and development progress effectively.

Recognition & Achievements

  • We have been recognized as a Star Performer in Data & AI Services Specialists - Everest’s North America PEAK Matrix 2025, and as a Leader in AIM’s Pema Quadrant of Agentic AI Service Providers - 2025.

  • In Nov 2023, Straive acquired Gramener, an award-winning, design-led data science company, enhancing our data, analytics, and AI capabilities. In June 2025, we acquired SG Analytics, a leading provider of AI-powered insights and contextual analytics services.


For more information, please visit our 🌐Website https://www.straive.com/


Skip to content