Head of Software Engineering

Job Title: Principal Software Engineer - Platform & Architecture (10+ Years Experience)

Company Overview:

We are a fast-growing enterprise AI platform company delivering secure, private AI solutions. Our vision is to deliver one answer unifying siloed data across enterprise with our industry specific pre-built agentic applications. We are now looking for a hands-on Principal Software Engineer – Platform & Architecture to drive the design and development of scalable systems that power our next-generation platforms.

Who Should Apply:

We are looking strictly for candidates with 10-15 years of total experience, at least 3–4 years in platform engineering, a minimum of 4 years in startups / product companies and a B.Tech/M.Tech in Computer Science Engineering. The ideal candidate must have built and scaled products to atleast a couple of millions of users and bring a combination of hands-on coding, architecture depth, and platform thinking. Please do not apply if you do not meet these essential criteria.

Role Summary:

As a Principal Software Engineer, you will be responsible for designing and building scalable, high-performance, and resilient platforms. You will be deeply involved in core system design, software architecture, and development. This is a highly technical role requiring deep engineering capability, a product mindset, and ownership over delivery in a fast-paced, innovation-first environment.

Key Responsibilities:
• Design end-to-end architecture for enterprise-grade AI platforms, ensuring scalability, security, and resilience.
• Build and own core infrastructure powering large-scale applications with millions of users.
• Integrate AI/ML models into enterprise workflows, collaborating closely with data science and ML engineering teams.
• Contribute to the design and deployment of production-grade agentic AI systems.
• Lead LLM orchestration, fine-tuning, and prompt engineering workflows across multi-model environments.
• Design and implement intelligent context memory systems for enhanced interaction continuity.
• Collaborate with cross-functional teams across engineering, product, and design.
• Define and implement technical standards, code quality, and architecture governance.
• Provide mentorship to engineering teams and lead critical design/code reviews.
• Drive technology roadmap planning and long-term platform evolution with a strong innovation focus.

Must-Have Qualifications:
• Minimum 10 years of experience in software engineering and large-scale product development.
• Strong hands-on coding background in modern programming languages (e.g., Java, Python, Go, Node.js).
• Proven experience building and scaling products to millions of users.
• At least 3–4 years in architecture and platform-level design roles.
• Hands-on experience building or deploying AI/ML platforms, LLM-based applications, or intelligent assistants.
• Expertise in LLMs (Public & Opern source), LLM orchestration, fine-tuning strategies, prompt engineering, and context memory systems.
• Strong foundation in distributed systems, microservices, CI/CD, and containerization (Docker/Kubernetes).
• Familiarity with AI/ML frameworks and tools (e.g., TensorFlow, PyTorch, Hugging Face, LangChain).
• Knowledge of data engineering, system security, and event-driven architecture.
• Demonstrated contributions to open-source projects or active engagement in developer communities.
• Demonstrated interest in cutting-edge technologies (e.g., LCMs, SLMs, edge AI, autonomous agents).
• Strong GitHub profile or portfolio showcasing production-grade contributions.
• Excellent collaboration and communication skills.
• B.Tech or M.Tech in Computer Science Engineering is mandatory.

Key Attributes:
• A builder’s mindset with an eye for quality, performance, and scalability.
• A problem-solver’s mentality with a deep intellectual curiosity and a drive to address complex technical challenges.
• Passion for continuous learning and staying ahead of emerging technology trends.
• Demonstrated recognition through professional awards, patents, or noteworthy contributions to the industry is highly valued.
• High integrity, humility, and a sense of ownership.

Why Join Us?
• Shape the core AI technology of a company delivering the future of private AI.
• Join a high-caliber team solving real-world, enterprise-scale challenges.
• Competitive compensation, leadership visibility, and growth opportunities.
• Culture of innovation, trust, and purpose.

Location: Chennai / Bangalore

How to Apply: If you meet the experience criteria and are excited to architect cutting-edge enterprise AI systems, we want to hear from you. Please send your resume and a brief note explaining your most impactful architecture initiative to careers@yavar.ai.