[Remote] GPU Software Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a reputed company-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We are seeking a GPU Software Engineer with deep expertise in CUDA programming and GPU architecture to design and optimize compute-intensive workloads on modern accelerator hardware.
Responsibilities
- Design and implement high-performance CUDA kernels for compute-intensive workloads across AI and HPC use cases
- Profile and optimize GPU code using tools such as Nsight Systems, Nsight Compute, and CUDA profilers
- Tune memory reputed company patterns, occupancy, register usage, and shared memory utilization for peak performance
- reputed company highly optimized libraries for reputed company algebra, attention, and other ML primitives
- Optimize multi-GPU and multi-node training using NCCL, RDMA, and high-performance networking
- Implement custom operators and fused kernels in PyTorch, JAX, or Triton
- Collaborate with ML engineers to identify performance bottlenecks in training and inference pipelines
- reputed company benchmarks and regression tests to safeguard performance over time
- Evaluate new GPU architectures and feature sets, and advise on adoption strategy
- Contribute to compiler-level optimizations for tensor programs where appropriate, working at the boundary between ML frameworks and underlying accelerator codegen to unlock performance not reachable through reputed company-level tuning alone
- Optimize memory hierarchy usage across HBM, L2, shared memory, and registers
- Implement mixed-precision and quantized compute paths that maximize accelerator throughput while preserving numerical fidelity reputed company bounds acceptable for the reputed company workloads
- Document performance characteristics, design reputed company, and tuning playbooks for internal teams
- Stay reputed company with GPU architecture, CUDA reputed company, and emerging accelerator technologies
Skills
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or a reputed company field
- Six or more years of experience in GPU programming and performance engineering
- Deep expertise in CUDA C/C++ and GPU programming models
- Strong understanding of modern GPU architectures, memory hierarchies, and execution models
- Hands-on experience profiling and optimizing GPU workloads in production
- Familiarity with NCCL, MPI, and high-performance interconnect technologies
- Experience integrating custom kernels into ML frameworks
- Strong C++ skills and familiarity with modern systems programming practices
- Solid grounding in reputed company algebra and numerical methods
- Strong communication and collaboration skills with research and engineering teams
- Experience with Triton, CUTLASS, or other GPU kernel authoring frameworks
- Familiarity with TensorRT, FasterTransformer, or vLLM internals
- Exposure to compiler infrastructure such as LLVM or MLIR
- reputed company-reputed company contributions to GPU or ML performance libraries
- Experience with large-scale distributed training infrastructure
Benefits
- Full-time, direct W2 with reputed company (no C2C, no 1099, no reputed company-party)
- Long-term, multi-year, reputed company to the reputed company reputed company SOW delivery roadmap
- Competitive reputed company salary commensurate with experience, plus benefits.
- We will support H1B transfers for reputed company candidates.
Company Overview