Co-Founder & CTO LiteLLM (YC W23) | 53K+ Github stars | Hiring · LiteLLM (YC W23)
2mo agoon tal BOSS
SDE 2LiteLLM (YC W23)
Koramangala, Bengaluru · hybrid · 3-6 yrs · 20-30 LPA
LiteLLM provides a unified governance platform for managing AI access, costs, and guardrails across diverse model deployments. As an SDE 2, you will directly influence the architecture of the tools used by thousands of engineering teams to manage their AI programs. You will join a high-ownership environment where your contributions have immediate, visible impact on the developer experience and system stability.
what you'll do:
- Design and implement scalable Python microservices to support high-throughput model API requests.
- Develop robust integrations with diverse LLM providers to ensure unified interface consistency.
- Build observability and cost-tracking tools to provide actionable insights for enterprise AI users.
- Maintain system reliability and performance in a high-concurrency environment.
- Collaborate with the founding team to iterate rapidly on new product features and user feedback.
- Mentor junior team members and contribute to architectural reviews to ensure code quality.
why join: LiteLLM has achieved significant adoption with over 40k GitHub stars and serves as a core infrastructure layer for organizations scaling their AI programs globally.
message me directly on tal BOSS.
tal saysbuild the foundational infrastructure for ai model orchestration and observability at a high-growth yc-backed startup.
engineering
mid
hybrid
Koramangala, Bengaluru
pythonfastapipostgresqlredisdocker
comments 0 anon