freelance agent evaluation engineer

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Turkey. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably,...

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Turkey. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably,...

Design and deliver AI agent systems that remain reliable beyond a successful demonstration. In this role, you will own technical decisions and delivery for a defined system or substantial component, from requirements and design through production operation. You will combine strong software engineering with practical agent development, make trade-offs...

Purpose of the RoleDefine, drive, and govern the technical strategy for enterprise Agentic AI platforms and solutions, ensuring scalable, secure, compliant, and business‑aligned AI capabilities across the organization.Work ModelAt ING Hubs Türkiye, flexibility is more than a benefit — it's part of how we work. Our hybrid working model is designed to...

ZettaMine Labs Pvt. Ltd. is seeking LLM–Engineering Experts to support an AI-focused evaluation project with global partners.This remote freelance engagement requires deep engineering design and simulation skills, strong Python scripting, and hands-on experience with modern LLMs and coding agents. Eligible candidates have 10+ years of engineering design...

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI...

We are seeking a Senior MLOps Engineer to take ownership of the agentic versioning model, promotion workflow, and rollback patterns across the agent estate, contributing to an Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that empowers engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The...

Overview:Are you a web-savvy, search expert with a talent for finding things online by using just a few words? Do you want to influence the future of global AI search? If so, we want you on board!Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from everyday people.Using your search...

Arfitect in Izmir, Turkey, invites an engineer to join its AI R&D track. You will own experiments, evaluations, prompts and agent designs, collaborating with the current AI R&D and applied AI engineers.This hands-on role focuses on making AI systems smarter, cheaper and more reliable, rather than client delivery deadlines. You will design benchmarks, tune...

Grid Dynamics is hiring a Senior Machine Learning Engineer specializing in LLM systems and evaluation. You will own ML projects from problem definition to deployment, design evaluation methodologies, and build benchmarks to measure model and product performance.You will evaluate and improve LLM-based systems, including RAG applications, agents, safety...

Overview:Are you a web-savvy, search expert with a talent for finding things online by using just a few words? Do you want to influence the future of global AI search? If so, we want you on board!Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from everyday people.Using your search...

About The Role What if your everyday internet skills could directly influence how AI finds and presents information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations — helping ensure that the AI systems people rely on every day are accurate, relevant, and...

EPAM Systems, Inc. is seeking a Python AI Evaluation Engineer to design evaluation frameworks for LLM-based apps and agents. You will build deterministic evaluators and Python-based tools to measure quality across responses, tool calls, and complete workflows.You will integrate these checks into CI/CD pipelines, work with OpenTelemetry traces, and...

We are looking for an experienced Senior DevOps Engineer to help build an Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The platform standardizes agent development across the organization using LangGraph and Strands Agents on...

We are seeking a Senior AI Engineer specialized in Agentic SDKs and Workflows to join a strategic initiative building an Agentic intelligence platform for data insights and planning decisions related to charging site planning, utilization, and optimization. This role will focus on delivering a Proof of Value for Self-Service Charging Site Utilization...

Hilbert’s AI is seeking an AI Engineer to build production-grade AI systems end-to-end—from prototype to pipeline to product—with startup-pace ownership. You will design agent architectures, implement evaluation systems, and balance accuracy, latency, and cost in production.You’ll lead evaluation of agents, build regression gates, and ensure...

Lead the technical design and delivery of production AI agent solutions. This is a hands-on technical leadership role combining architecture, engineering, and team delivery. You will work with customers and stakeholders to define the right solution, guide engineers through implementation, and take responsibility for technical quality and operational...

Overview: Are you a web-savvy, search expert with a talent for finding things online by using just a few words? Do you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from everyday people. Using your search...

Define, drive, and govern the technical strategy for enterprise Agentic AI platforms and solutions, ensuring scalable, secure, compliant, and business-aligned AI capabilities across the organization. Work Model At ING Hubs Türkiye, flexibility is more than a benefit — it's part of how we work. Our hybrid working model is designed to balance collaboration,...

Insiderone is hiring a Machine Learning Engineer to design, prototype, and maintain AI systems powered by LLMs and foundation models. You will work on agentic AI applications, complex workflows, and evaluation pipelines, collaborating with cross‑functional teams to deliver end‑to‑end features and scalable infrastructure.You will lead efforts around...