Software Test Lead

5 days ago

Istanbul, Istanbul, Turkey Huawei Telekomünikasyon Dış Ticaret Ltd Full time ₺700,000 - ₺1,000,000 per year

Key Responsibilities

 Software Testing & QA Leadership

  • Design, review, and lead the implementation of test plans, test cases, and test strategies for various software components (APIs, services, UI).
  • Oversee test automation script development using tools such as PyTest, Selenium, Playwright, or Postman.
  • Maintain and optimize test automation pipelines, integrating with CI/CD tools (e.g., Jenkins, GitLab CI, Azure DevOps).
  • Lead functional, regression, smoke, and performance testing efforts to validate system readiness.
  • Ensure traceability from requirements to test cases and bug reports.

 LLM Evaluation & Benchmarking

  • Lead a team responsible for the evaluation of Large Language Model (LLM) outputs.
  • Design capability-based evaluation benchmarks (e.g., summarization, reasoning, math, code generation).
  • Guide the development and execution of auto-evaluation scripts, using LLM-as-a-judge, rule-based, and metric-based methods.
  • Build and maintain evaluation pipelines to track model accuracy, hallucination rates, robustness, and more.
  • Collaborate closely with AI Engineers and Data Scientists to align evaluations with development priorities.

Team Leadership & Technical Coaching

  • Mentor and support a team of QA engineers and model evaluators.
  • Allocate tasks, define sprint goals, and ensure timely and high-quality delivery of testing and evaluation artifacts.
  • Foster a culture of test-first thinking, technical quality, and continuous improvement.
  • Communicate evaluation insights and quality reports to product managers and stakeholders.

Required Qualifications

  • Bachelor's or Master's degree in Computer Science, Software Engineering, AI, or a related field.
  • Minimum 5+ years in software testing, including experience as a Senior QA Engineer or Test Lead.
  • Strong experience in test case writing, test scenario design, and test automation scripting.
  • Proficiency in scripting languages like Python, JavaScript, or Java for test automation.
  • Experience with tools such as PyTest, Selenium, JUnit, Playwright, Postman, etc.
  • Familiarity with LLMs (e.g., DeepSeek, Mistral, LLaMA) and AI evaluation metrics (BLEU, ROUGE, Accuracy, etc.).
  • Experience in building or maintaining benchmark datasets for AI evaluation.
  • Understanding of prompt engineering, response validation, and error case analysis.

Preferred Skills

  • Experience with LLM evaluation libraries/tools like OpenAI Evals, TruLens, LangChain Eval, or custom scripts.
  • Experience working with MLOps or AI pipelines and integrating tests within them.
  • Familiarity with dataset labeling platforms or human-in-the-loop evaluation systems.
  • Strong data analysis and reporting skills using Excel, Python (Pandas/Matplotlib), or dashboards.
  • Ability to define and customize evaluation logic per customer or business domain.

  • Software Test Engineers

    7 days ago

    Istanbul, Istanbul, Turkey Reset HR Consulting Full time ₺60,000 - ₺120,000 per year

    For our leading technology client, we are seeking Software Test Engineers (All levels) to join their growing team. The role involves contributing to both automation and performance testing within an enterprise-scale environment.Job Description:Design, execute, and maintain manual and automated test cases across different stages of the SDLC (Software...

  • Software Testing Engineer

    5 days ago

    Istanbul, Istanbul, Turkey Transsion Full time ₺80,000 - ₺120,000 per year

    Company DescriptionTranssion is a leading provider of smart terminal products and mobile internet services in emerging markets. With a diverse brand portfolio, including TECNO, itel, and Infinix, Transsion has established a significant presence in markets such as Africa, India, and Bangladesh. Recognized globally, Transsion has achieved high rankings for...

  • Software Test Engineer

    7 days ago

    Istanbul, Istanbul, Turkey Transsion Full time ₺35,000 - ₺50,000 per year

    Company DescriptionTranssion is a leading provider of smart terminal products and mobile internet services in emerging markets. With a diverse brand portfolio, including TECNO, itel, and Infinix, Transsion has established a significant presence in markets such as Africa, India, and Bangladesh. Recognized globally, Transsion has achieved high rankings for...

  • Software Test Engineer

    5 days ago

    Istanbul, Istanbul, Turkey obilet Full time €40,000 - €80,000 per year

    Founded in 2012, is a leading travel and tourism platform offering comprehensive services, including bus, flight, and ferry ticketing, along with hotel bookings and car rentals.As the undisputed market leader in Turkey across both B2B and B2C segments, the platform supports bus carriers with its best-in-class SaaS Inventory Management System (IMS), attracts...

  • Software Testing Specialist

    7 days ago

    Istanbul, Istanbul, Turkey Machinarium Full time ₺40,000 - ₺80,000 per year

    Join the journey of building world-class digital experiences at Machinarium.At Machinarium, we're a forward-thinking technology company delivering strategy, design, and engineering services to clients worldwide. Our focus is on building AI-driven, transformative digital solutions that address today's needs while unlocking tomorrow's opportunities.We are...

  • Software Test Engineer

    5 days ago

    Istanbul, Istanbul, Turkey NGSS Full time ₺60,000 - ₺120,000 per year

    About the RoleWe're a growing tech company building mission-critical software for Telecom and Finance players. Our teams work on two major stacks — C# and Java.We're looking for a Software Test Engineer who will help us ensure product quality, reliability and continuity in critical systems. If you care about quality, clarity, ownership and collaboration,...

  • Software Test Engineer

    5 days ago

    Istanbul, Istanbul, Turkey StartupHeroes Full time ₺30,000 - ₺60,000 per year

    StartupHeroes  is seeking a qualified professional to fill the position of Software Test Engineers based in Istanbul. To identify, analyse, and document problems with program function, output, online screen, and content. Develop and execute testing programs that address areas such as database impacts, software scenarios, regression testing, negative...

  • Software Test Engineer

    3 days ago

    Istanbul, Istanbul, Turkey Segmentify Full time ₺50,000 - ₺100,000 per year

    Segmentify is an eCommerce Customer Engagement Platform (CEP) helping online retailers to optimise their conversion rates by enabling them to deliver a unique and personalised shopping experience.We have a dynamic and passionate compact team dedicated to creating a SaaS solution to boost eCommerce revenue. We are selected as one of the 25 Machine Learning...

  • Software Test Engineer

    5 days ago

    Istanbul, Istanbul, Turkey Huawei Telekomünikasyon Dış Ticaret Ltd Full time ₺40,000 - ₺80,000 per year

    Qualifications:• The candidate should possess a strong interest in testing techniques and methodologies.• A minimum of 2 years of experience as a Software Test Engineer is required.• A willingness and enthusiasm to learn and work with new open-source technologies is essential.• The candidate must have extensive knowledge of Linux operating system...

  • CBDC Test Engineer

    5 days ago

    Istanbul, Istanbul, Turkey Huawei Telekomünikasyon Dış Ticaret Ltd Full time ₺500,000 - ₺800,000 per year

    · Proactively join testing activities and support the team members to solve the technical difficulties,· Define test strategy and provide technical guidance in driving quality in new feature development,· Work with cross-functional teams to ensure quality throughout the software development life cycle,· Analyse the business requirements and estimate,...