Find your dream job now!

Click on Location links to filter by Job Title & Location.
Click on Company links to filter by Company & Location.
For exact match, enclose search terms in "double quotes".

Keywords: Software Engineer - LLM evaluation, Location: San Francisco, CA

Page: 1

Software Engineer - LLM evaluation

About the Role Join an exciting project that pushes the boundaries of AI technology. As a Software Engineer focused..., or the UK. Have 2+ years of software engineering experience. Have exceptional attention to detail. Excel in written...

Company: OpenJobs
Location: San Francisco, CA
Posted Date: 27 Mar 2025

Machine Learning Systems Engineer - Data & Evaluation, Horizons

Role As a Data & Evaluation Engineer on the Horizons team, you will build the software infrastructure that enables.... This engineering-focused role combines software development with empirical analysis to drive advances in model performance...

Posted Date: 02 Apr 2025

Software Engineer, ML Infrastructure - Training Platform

Scale is looking for an AI/ML Infrastructure Engineer to join our Machine Learning Infrastructure team to build out...: Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching...

Posted Date: 03 Apr 2025

Senior Machine Learning Engineer

our best-in-class technology. In 2022, GoFundMe , a leading nonprofit fundraising software company that enables nonprofits to connect... for our next Senior ML Engineer to help design and implement our next generation of machine learning and generative AI-based services...

Company: GoFundMe
Location: San Francisco, CA
Posted Date: 03 Apr 2025
Salary: $128500 - 192500 per year

Machine Learning, Research Engineer (Horizons)

Role As a Research Engineer on the Horizons team, you will collaborate with a diverse group of researchers and engineers... in reinforcement learning, creating 'agentic' models via tool use for open-ended tasks such as computer use and autonomous software...

Posted Date: 03 Apr 2025

Forward Deployed Engineer - GenAI Quality

how humanity interacts with AI. You will build the products that handle LLM-based data evaluation, benchmarking, data quality... evaluation of all applicants. About Us: At Scale, we believe that the transition from traditional software...

Posted Date: 03 Apr 2025

Research Engineer / Scientist, Safeguards

evaluate the effectiveness of novel LLM-generated jailbreaks. Write scripts and prompts to efficiently produce evaluation... of human-level capabilities. You could describe yourself as both a scientist and an engineer. You'll both focus on risks...

Posted Date: 22 Mar 2025

Senior/Lead AI Engineer (Backend) - AI Integration

Evaluation and Deployment: Deploy LLM prompts into production systems, ensuring scalability, security, and efficiency... you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce We’re Salesforce, the Customer Company...

Company: Salesforce
Location: San Francisco, CA
Posted Date: 22 Mar 2025

Sr AI Engineer

to reimagine software development without being constrained by historical conventions. Deep understanding of LLM technologies... to "make software development more joyful, creative, and impactful through AI." Our goal is to revolutionize how developers...

Company: Adobe
Location: San Francisco, CA
Posted Date: 18 Mar 2025

AI Infrastructure Engineer, Model Serving Platform

As a software engineer on the ML Infrastructure team, you will work on developing the platform for orchestrating post...-training and model evaluation jobs. At Scale, we are constantly developing new data sources and running experiments...

Posted Date: 30 Jan 2025

Distinguished ML Engineer - Cisco ThousandEyes (AppliedML / Model Tuning)

and evaluating LLMs. You will lead the team in building evaluation frameworks and metrics while evaluating traditional... direction, user experiences, and ML/LLM lifecycle infrastructures. You will have experience in translating ambiguous product...

Company: Cisco Systems
Location: San Francisco, CA
Posted Date: 01 Apr 2025

Machine Learning Engineer, Fraud

evaluation of all applicants. About Us: At Scale, we believe that the transition from traditional software... the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise...

Posted Date: 21 Mar 2025

Forward Deployed Engineer

largest scale. A day’s work may include building LLM workflows on a large scale, interacting with customers to understand... Gen AI landscape. Strong foundation in Machine Learning basics (Evaluation, Training, Problem Decomposition...

Posted Date: 16 Feb 2025
Salary: $135000 - 150000 per year

Prompt Engineer - New Grad

to serve some novel purpose Familiarity with LLM evaluation metrics (BLUE, ROUGE, MAUVE, etc.) and statistics Strong written... of LLM applications for commercial purposes, improvement of training data sets via model capabilities, and discovery of new...

Company: Scale AI
Location: San Francisco, CA
Posted Date: 23 Jan 2025
Salary: $120000 - 145000 per year