For Employers

Avra

Member of Technical Staff | Inference Platform

Posted 2 months ago
5-10 years experience
Apply Now

Please mention DailyRemote when applying

?Not checked yet0100
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Tailor your resume to this job

One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.

  • Job match score for this posting
  • Edits you accept or skip, no invented facts
  • Download it when it reads right: TXT free, PDF with Premium

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

You will own and evolve the inference platform, managing model execution for both real-time APIs and large-scale batch processing. This involves optimizing performance, cost, and reliability across cloud and customer-hosted Kubernetes environments.

About the role

At Avra, every technical IC is a Member of Technical Staff (MTS). The title doesn't put anyone in a silo: you own systems and outcomes, not steps in a function, and you keep building depth in your area. Seniority shows up in your scope, level, and compensation, not in titles.

In this role, you'll join the Platform team to own where our models execute. Customers consume our models through large batches of millions of records and through real-time APIs, and they make business decisions on every response. You'll run governed model releases reliably and efficiently — in our cloud and on customer-hosted Kubernetes — and make inference fast, predictable, and cheap enough to serve both enterprise and mid-market customers.

What you'll do

  • Evolve Sophos, our online and batch inference runtime, built on Kubernetes.

  • Run large batch inference on ephemeral jobs, with multi-dimensional admission control (CPU, memory, GPU) through Kueue.

  • Build and extend the Sophos controller and its Kubernetes custom resources.

  • Optimize each model's inference engine and feature processing, using vectorized, columnar operations.

  • Serve graphs and data efficiently from Lance-based storage.

  • Own execution of training, post-training, and fine-tuning jobs, in our cloud and in customer dataplanes.

  • Drive autoscaling, GPU serving, performance, and cost optimization, with telemetry for every model we run.

  • Solve open problems such as deterministic job sizing, checkpointing and recovery for batch runs, per-customer encryption and isolation, resilience to difficult input files, and automatic profiling when a new model is accepted.

How we measure success

  • 99.9% serving availability.

  • p95/p99 latency for online inference and throughput for batch.

  • Cost per prediction and per training job.

  • GPU utilization: paid capacity versus capacity actually used.

  • Training and batch jobs that finish on time and succeed without manual retries.

What we're looking for

  • Experience running model serving or large-scale batch compute on Kubernetes.

  • Experience building Kubernetes controllers or operators.

  • Skill at profiling and optimizing data-heavy Python pipelines.

  • A clear sense of cost: you treat compute efficiency as a product feature.

  • Production-quality code and reviews, and a willingness to operate what you build.

Nice to have

  • Ray, Ray Serve, or KubeRay in production.

  • Kueue or other batch scheduling and admission-control systems.

  • GPU serving and performance optimization.

  • Arrow, Parquet, Lance, or other columnar formats.

  • Shipping software to customer-hosted Kubernetes.

  • GCP/AWS and GKE/EKS, and financial services or regulated environments.

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Others jobs →

Brand Reputation Manager

Full Time Europe Others

Senior Residential Hazard Mitigation Subject Matter Expert (California)

Full Time United States $98187 - $166K per year Others

Nuclear Engineer 4

Full Time United States $125K - $200K per year Others

Supply Chain Associate, Demand Planning

Full Time Poland Others

Conseiller senior en opérations TI – Transition et gestion des services

Freelance Canada Others

Senior Director, Programs and Impact

Full Time United States $125K - $135K per year Others
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 221,512+ Jobs in Others

Answer easy questions

Answer easy questions

221,512+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified