Design and implement a scalable observability platform for metrics, logs, and traces to monitor system performance and GPU utilization. Develop automated monitoring, alerting systems, and custom infrastructure-as-code tools to enhance distributed tracing and incident response.
Together AI
11 Remote Job Openings at Together AI
Provide analytical support for infrastructure strategy, focusing on capacity planning, compute sourcing, and site selection. Build dashboards and frameworks to monitor deployments and streamline operational workflows across Engineering and Finance.
Design and build infrastructure for model customization and evaluation, including backend services and job orchestration platforms. Collaborate cross-functionally to improve platform reliability, observability, and deployment tooling.
Staff Engineer, Distributed Storage and HPC & AI Infrastructure
Together AI
·
Full Time
·
a month ago
Together AI
Design and deliver multi-petabyte storage systems and high-performance parallel filesystems optimized for AI training and inference workloads. Build Kubernetes-native storage operators and optimize end-to-end data paths to achieve high throughput and low latency.
Act as the primary technical contact for customers building AI training, fine-tuning, and inference solutions. Collaborate with Engineering and Product teams to resolve complex GPU cluster issues and influence the product roadmap based on customer insights.
Develop and execute a global data center strategy, focusing on site selection, vendor relationships, and infrastructure scaling. Lead technical diligence and commercial negotiations for power, cooling, and connectivity to support AI cloud growth.
Partner with AI research and engineering leadership to define and execute hiring strategies for world-class research teams. Lead full-cycle recruiting for specialized AI talent across academia and industry while refining technical interview processes.
Own the design, planning, and technical execution of whitespace environments for large-scale AI GPU clusters across a data center portfolio. Collaborate with MEP consultants and network engineers to optimize power, cooling, and physical layer requirements for high-density deployments.
You will serve as a primary technical contact for customers, resolving complex issues related to GPU clusters and AI infrastructure. Additionally, you will collaborate with engineering and product teams to drive roadmap improvements based on customer insights.
You will optimize and fine-tune GPU code for better performance and scalability while collaborating with cross-functional teams to integrate GPU-accelerated solutions. Staying up-to-date with advancements in GPU programming techniques is also a key responsibility.
The role involves designing and iterating on novel speculator algorithms and being the critical link between raw data and production-ready models. You will collaborate with customers and internal teams to ensure models meet their specific needs and performance standards.
