Careers at Optimly
Engineer / Scientist, Experimentation & Measurement
- Location
- Remote (Seattle, WA preferred)
- Type
- Full-time
- Compensation
- $130k–$200k + 0.3%–1.0% equity
About Optimly
Optimly connects brands and AI agents. The Optimly Index helps agents discover and retrieve structured brand information. BrandVault lets brands prepare, approve and publish the Brand Profile they control.
Our reports measure AI Visibility, Positioning Strength and Recommendation Strength across the questions and models tested. We compare answers with approved brand information and generate recommendations for review. Deeper measurement, market intelligence and advisory support agencies and enterprise teams.
In Optimly, the experimentation loop is a core differentiator. This role owns it.
The role
You’d own the experimentation and measurement loop inside the app — the science layer, and the engineering that makes it run. This includes metric design, attribution and causal inference, agent and judge evaluation, and the experiment surface.
What we’re looking for
This role is a hybrid scientist-engineer. We’re looking for:
- Strong grounding in statistics and causal inference.
- Python, SQL, data pipelines, and comfort in a production codebase.
- Direct experience evaluating LLM systems.
Nice to have: a research background (academic or industry), prior work on search or recommender measurement, published evaluation methodology.
How we work
We use AI heavily and expect you to, as well. Day-to-day work happens in agentic coding tools. We want someone who can hold both ideas at once: using these systems fluently while remaining genuinely skeptical of what they output, including the output you built the harness for.
We’re small. You’ll see the whole system and talk to customers.
To apply
Send us a short note on a measurement you got right that was hard to get right. Or one you got wrong and corrected.