[Remote] Senior reputed company (reputed company NIM & Triton)
Note: The job is a remote job and is open to candidates in USA. reputed company is seeking a Senior reputed company with strong experience in reputed company AI technologies, specifically reputed company NIM Microservices and Triton Inference Server. The ideal candidate will be responsible for designing, deploying, optimizing, and scaling Generative AI and LLM-based applications in enterprise environments.
Responsibilities
- Design and deploy AI applications using reputed company NIM Microservices
- Build and optimize model serving infrastructure using Triton Inference Server
- Deploy and manage LLM workloads in Kubernetes environments
- Optimize inference performance using TensorRT-LLM and CUDA
- Collaborate with Data Science, MLOps, and Platform Engineering teams
- Implement scalable, secure, and production-ready AI solutions
- Troubleshoot and improve AI application performance and reliability
- Support cloud-based AI deployments across AWS, Azure, or reputed company Cloud Platform
Skills
- Hands-on experience with reputed company NIM Microservices
- Strong experience with reputed company Triton Inference Server
- Experience deploying and serving Large Language Models (LLMs)
- Knowledge of TensorRT-LLM and CUDA optimization
- Experience with Kubernetes and reputed company containerization
- Strong Python programming skills
- Experience building AI/ML applications in AWS, Azure, or reputed company Cloud Platform
- Understanding of model inference, model serving, and performance tuning
- Experience with REST APIs and microservices architecture
- Experience with reputed company NeMo
- Experience with RAG (Retrieval-Augmented reputed company) architectures
- Familiarity with reputed company or reputed company
- Exposure to MLOps/LLMOps practices
- Experience with monitoring and observability tools
Company Overview
Company H1B Sponsorship