Senior AI Software Engineer - LLM & RAG Development

Accenture Mumbai, Maharashtra
Permanent Job Not disclosed
Rust .NET PostgreSQL

Accenture is seeking a Senior AI Software Engineer to join our team in Mumbai, Maharashtra. In this role, you will be instrumental in developing custom software solutions, with a strong focus on building agentic AI applications. You will design, code, and enhance components across systems, leveraging modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.

Key responsibilities include hands-on development of agents, prompts/templates, planners, and memory systems, alongside writing clean, testable code and CI/CD pipelines. You will also stand up RAG services, including ingestion, chunking, embeddings, indexing, and integrating vector databases, while implementing observability and guardrails. Integration with enterprise APIs, event streams, and data sources, ensuring robust error handling, will be crucial. Quality and safety will be paramount, involving writing unit/integration tests, implementing evaluations, and establishing content/action safety boundaries. You will prototype quickly, demo frequently, and communicate trade-offs and results clearly to stakeholders.

This role requires strong CS and software engineering fundamentals, with hands-on experience in LLMs, RAG, vector databases, and AI APIs. A visible portfolio of AI projects demonstrating experimentation and speed is essential. You should be a fast learner with a bias for rapid prototyping and iteration, capable of translating business problems into practical AI solutions.

Core build proficiency is expected in Python (agent frameworks, data/RAG services, evaluation), TypeScript/Node.js (service wrappers, tool servers, API integration), or Java (enterprise services, Spring Boot). Familiarity with frameworks and tooling such as LangChain, LlamaIndex, Semantic Kernel, vector databases (pgvector, Pinecone, etc.), test frameworks (PyTest, JUnit, Jest), containers, serverless, and cloud SDKs is highly beneficial.

Minimum 7.5 years of experience in Java Full Stack Development and 15 years of full-time education are required.

Similar Jobs

View all

Software Engineer III, Google Cloud

Google India

Pune, Maharashtra 2-5 Years
Permanent Job Not disclosed

Software Engineer, AVP

NatWest Group

Bengaluru / Bangalore, Karnataka 0-0 Years
Permanent Job Not disclosed

Custom Software Engineer

Accenture

Pune, Maharashtra 6-8 Years
Permanent Job Not disclosed

Custom Software Engineer

Accenture

Hyderabad / Secunderabad, Telangana, Telangana 7-9 Years
Permanent Job Not disclosed

Software Dev Engineer IV

Swiggy

India 8-10 Years
Permanent Job Not disclosed
Apply Now