Software Engineer - Hosted Model Infrastructure
This role involves building and maintaining high-performance, secure model serving infrastructure for AI models deployed in challenging environments such as air-gapped networks and edge devices. You'll work across the full stack—from inference engines and GPU scheduling to deployment pipelines and observability—ensuring reliable, reproducible, and maintainable model deployments. The role emphasizes end-to-end ownership, debugging in low-access environments, and integration with Palantir's platform and security systems.