AI Performance Software Engineer Job at Signify Technology, San Francisco, CA

bTIvcGZRcWpQbHprenlNbXNFT09lNjJuaVE9PQ==
  • Signify Technology
  • San Francisco, CA

Job Description

AI Inference Software Engineer — Stealth AI Systems Startup

Base Salary Range: $200,000-$300,000

Location: San Fransisco (Onsite)

A stealth-stage AI systems company is redefining the performance boundaries of inference at scale. As generative AI models become larger and more complex, inference is emerging as the core bottleneck in production environments. This team is building a vertically integrated stack—from low-level GPU kernels to developer-friendly APIs—that dramatically improves inference speed, efficiency, and scalability.

Spun out of cutting-edge academic research and backed by deep industry experience across distributed systems, machine learning infrastructure, and hardware design, they are focused on enabling production-grade AI with minimal latency and maximal throughput. Their platform integrates seamlessly with modern ML frameworks like PyTorch and LangChain, allowing teams to deploy and monitor workloads in seconds.

They are looking for a Software Engineer focused on AI inference performance to help build and optimize the core runtime infrastructure powering these systems. This role sits at the intersection of deep learning, systems engineering, and GPU performance.

What You’ll Do

  • Implement and evaluate advanced inference optimization techniques, including quantization, KV caching, and FlashAttention
  • Design and build systems for distributing inference workloads efficiently across multiple GPUs and nodes
  • Profile and benchmark large-scale models to identify bottlenecks across the software and hardware stack
  • Optimize CUDA kernels and GPU memory usage to improve performance across a wide variety of AI models
  • Collaborate closely with research and systems engineers to push the limits of model serving infrastructure

What They’re Looking For

  • Proficiency with CUDA and experience writing or optimizing GPU kernels
  • Strong background in Python and C++ development
  • Hands-on experience with PyTorch, TensorFlow, or similar deep learning frameworks
  • Knowledge of distributed systems or model-serving platforms at scale
  • Familiarity with performance tuning, benchmarking tools, and profiling techniques

Nice to Have

  • Graduate degree in computer science, engineering, or a related field
  • Experience with compiler frameworks such as MLIR or Triton
  • Exposure to vLLM, ONNX, or custom model runtimes

This is a rare opportunity to work on core infrastructure for AI systems at a team solving some of the hardest performance challenges in the field.

Job Tags

Similar Jobs

Neiman Marcus Group Careers

External Stylist Job at Neiman Marcus Group Careers

 ...around the world. BG.com expands on Bergdorf Goodmans heritage, showcasing coveted collections for men and women in an unparalleled online shopping experience. Bergdorf Goodman is part of Neiman Marcus Group.Your RoleCreates a welcoming environment by greeting and... 

Propel Recruitment LLC

Personal Assistant Job at Propel Recruitment LLC

 ...Our client, a highly-regarded tech company, is looking for a Personal Assistant/House Manager to provide comprehensive support to the Principal. You would be joining a positive, genuine team and working closely with the company's President. This role is fully in-person... 

Randstad USA

Fashion Designer Job at Randstad USA

The purpose of this position is to be responsible for designing and creating innovative, commercially viable products that deliver value and style as well as sustain the development, evolution and communication of looks that supports and deepens the brand value and identity...

Express Trucking Group

CDL A DRIVER - REGIONAL Job at Express Trucking Group

 ...rest timeDrive modern, well-equipped Freightliner Cascadias (2019 or newer)Enjoy comfort on the road: APU, inverter, fridge, TV, DirecTV & SiriusXMNo-touch freight: 85% dry van, 15% hazmat (with extra pay + endorsement cost covered)Mostly drop & hook -minimal... 

Aerotek

Outside Sales Account Manager Job at Aerotek

 ...Why Aerotek? Aerotek, a part of Allegis Group, is the #1 Staffing Agency in the United States . We are a privately held organization with over 250+ offices nationwide. We work with 95% of Fortune 500 companies and specialize in recruiting for industrial skillsets such...