Senior Data Scientist (GenAI)
Please mention DailyRemote when applying
AI Summary
Drive RAG retrieval relevance and LLM answer quality by defining evaluation datasets and tuning hybrid search and embedding models. Collaborate with cross-functional teams to translate user feedback into actionable metrics and improve model performance.
The data-driven mind behind every breakthrough. Put your skills to the test to build AI solutions that shape the way businesses operate and innovate.
About Us
Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.
About the role
Join the AI Platform team to drive RAG retrieval relevance and LLM answer quality across emails and attachments.
Define evaluation datasets, labelling pipelines, metrics, and experiments to tune chunking, embeddings (Flamingo API), hybrid search, filtering, and citation grounding.
Your insights will directly improve model quality, retrieval performance, and end-user impact
About you
What you’ll do
Required skills
About Us
Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.
About the role
Join the AI Platform team to drive RAG retrieval relevance and LLM answer quality across emails and attachments.
Define evaluation datasets, labelling pipelines, metrics, and experiments to tune chunking, embeddings (Flamingo API), hybrid search, filtering, and citation grounding.
Your insights will directly improve model quality, retrieval performance, and end-user impact
About you
- Detail-oriented, hands-on, and metric-driven.
- Curious about LLMs, vector search, and retrieval systems.
- Collaborative with engineers, ETL teams, and business users.
- Comfortable designing evaluation pipelines and experiments.
- Strong communicator: turns feedback into actionable insights
What you’ll do
- Define evaluation sets across clients, content types, and languages.
- Build labelling pipelines and dashboards for manual or UI-based feedback.
- Measure and tune hybrid retrieval (semantic + keyword), top-k, rerankers, and filters.
- Evaluate embedding models and chunking strategies for accuracy and coverage.
- Assess LLM answer quality: grounded factuality, hallucination rate, completeness.
- Analyze failure patterns across queries, long contexts, attachments vs. emails.
- Collaborate with backend, ETL, and frontend teams to align telemetry, schema, and feedback capture.
- Translate user feedback into actionable metrics and backlog items.
- Evaluate cost/performance trade-offs for summarization, spillover, and indexing.
Required skills
- Applied ML/Data Science with strong evaluation discipline.
- Python (pandas, Jupyter/Notebooks) + SQL.
- Information retrieval / RAG evaluation: Recall@K, MRR, nDCG, citation grounding.
- Experience with LLMs: prompting, grounding, long-context handling, cost/latency awareness.
- Building reproducible pipelines and dashboards.
- Strong communicator: translating business questions into metrics and experiments.
- Hands-on with Azure AI Search vector/hybrid tuning, index schema.
- Experience designing human-in-the-loop annotation pipelines.
- Knowledge of enterprise access-control / security trimming.
- Experience tracking embedding drift and retrieval failures.
- Working with large-scale document/email datasets.
Why Join Us
People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details. Why Join Us
If you have any questions contact our Talent Acquisition team on ta.admin@acuityanalytics.
For more details about Acuity Analytics please see here: Read here.
Automatically Apply to the Best Remote Jobs
Stop the endless job search. Our AI finds and applies to the best jobs for you.
