Skip to content
Genesis AI

Inference

San CarlosLocation unclear
FullTime · Engineering & Research
POSTED 30 APRVERIFIED 43M AGO
Apply Ask
Role
195 days opentrue age
Posted 30 Apr
CompanyGenesis AI →
69open roles
Opened · 30d
+4
Closed · 30d
−9
10d of snapshots · 30d window
Market
37,669open · Software engineering
Opened · 7d
+3,2139% of open
All software engineering
75,375open
All tracked boards · live 12 Nov · n=37,669
PythonRustC++Distributed systems

What You’ll Do

Build low-latency inference pipelines for on-device deployment, enabling real-time next-token and diffusion-based control loops in robotics

Design and optimize distributed inference systems on GPU clusters, pushing throughput with large-batch serving and efficient resource utilization

Implement efficient low-level code (CUDA, Triton, custom kernels) and integrate it seamlessly into high-level frameworks

Optimize workloads for both throughput (batching, scheduling, quantization) and latency (caching, memory management, graph compilation)

Develop monitoring and debugging tools to guarantee reliability, determinism, and rapid diagnosis of regressions across both stacks

What You’ll Bring

Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years)

Production-grade expertise in Python, with strong background in systems languages (C++/Rust/Go)

Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory and compute scheduling

Proven track record scaling inference workloads in both throughput-oriented cluster environments and latency-critical on-device deployments

System-level mindset with a history of tuning hardware–software interactions for maximum efficiency, throughput, and responsiveness

Source · Genesis AIFirst seen 2 Nov1 editsOriginal ↗