Ravi Singhal
Principal Engineer (Executive Director) — Agentic AI Systems & LLM Infrastructure
Agentic AI architect and systems engineer, 20+ years hands-on, still writing production Go, Python and Java. Derives sustainable value from Generative AI solutions. Multi-agent orchestration, vLLM serving, and the evaluation harnesses that gate release — now across treasury and payments at Wells Fargo. Core team of Oracle Verrazzano: built the Go control plane, took it to GA. Enterprise AI solutions at ServiceNow.
Agent platform across three banking programmes
Agent identity · Evaluation gates @ Wells Fargo
Oracle Verrazzano
Built the Go control plane, took it to GA, closed its first enterprise deal.
Gurugram, India · Hybrid
20+
Years Experience
20M+
Users Served
10×
Pipeline Improvement
Ravi Singhal
Principal Engineer (Executive Director)
Building transformative software solutions through innovative thinking and technical excellence.
© 2026 Ravi Singhal. All rights reserved.
Experience
Building transformative solutions across enterprise platforms and emerging technologies
Principal Engineer (Executive Director)
Wells Fargo
2026 - Present
Three concurrent programmes — Commercial Banking AI, API monetization and consumer Open Banking. Owning the agent platform, tool plane, identity and evaluation across all three; architecture set jointly with engineering, model risk and product.
Shaping the target architecture and multi-year direction for a commercial banking AI assistant platform — how agent capability scales without outpacing auditability, oversight and the bank's risk appetite.
Researching and prototyping the agent identity model for the tool plane — SPIFFE workload identity, OAuth 2.1 delegated token exchange so an agent acts on behalf of a named user, and an effect ceiling of min(agent, human) at the gateway.
Architecture for API monetization and the Open Banking Gateway: metering and entitlement for paid API products; consent and authorisation lifecycle under Section 1033 and FDX.

Sr. Staff Software Engineer
ServiceNow
12/2025 - 07/2026
Enterprise AI Platform team, directly working on ServiceNow's AI-native product roadmap.
Building the platform that powers ServiceNow's AI-native product roadmap, cloud-native, hosted on AWS EKS and Bedrock

Consulting Member Technical Staff (IC5) / Developer Advocate
Oracle
05/2016 - 12/2025
Hands-on technology leader across Oracle's WebLogic, Wercker, Verrazzano, OCI CloudShell, and Database organisations, spanning enterprise middleware, CI/CD, container-native platforms, and production GenAI systems.
GenAI / LLM platform on Kubernetes. Built an Ollama-based model serving layer, LangChain-powered RAG pipelines grounded in Oracle DB, and a full observability stack covering trace collection, automated evaluation pipelines, drift detection, and model reliability monitoring.
Oracle Verrazzano (GA August 2021), Oracle's open-source enterprise multi-cluster Kubernetes platform. Designed multi-cluster container deployment capabilities, built the Go operator-driven control plane, and engineered the full observability stack (Prometheus, Grafana, Jaeger, Kiali, OpenSearch, Istio, Rancher) automated via declarative CRDs. Delivered the ReactJS management console.
Helped secure Verrazzano's first enterprise paying customer, a major Japanese enterprise, by owning the coordination across their teams and ours. It was the platform's first revenue, and it shaped the product roadmap.
India engineering team for OCI CloudShell, Oracle Cloud's in-browser developer terminal, bringing secure, browser-native CLI access to Oracle Cloud users globally. Earlier roles included Wercker container-native CI/CD and WebLogic Server platform engineering.

Technical Specialist — Digital & Retail Banking (India & UK)
Royal Bank of Scotland (RBS/NatWest)
02/2015 - 05/2016
Dual-geography technical leadership spanning RBS Digital (Gurugram) and UK Banking HQ — driving systems architecture, real-time ML platform innovation, and digital transformation across retail and global banking divisions.
Owned the prototype and evaluation of the bank's first streaming ML pipeline for the Digital Frontline team, social data ingestion via Kafka and Storm, LingPipe model inference — and the recommendation that came out of it on what was worth productionising.
Owned the systems architecture for a zero-downtime omnichannel platform serving 20+ million retail banking users across mobile, web, and ATM, designing for continuous availability, cross-channel consistency, and the latency requirements of transactional banking at UK scale.
Built the platform on Java Spring Boot microservices hosted on Azure, with Flume and Solr behind them for log analytics, sub-second search across high-throughput production workloads in global banking infrastructure.
Served as the technical translation layer between senior UK and India leadership, converting executive strategy into detailed engineering roadmaps, driving cross-functional alignment, and representing platform architecture in executive reviews spanning two geographies.

Senior Associate Platform L2 — UBS & Wellington Management
Publicis Sapient
10/2010 - 02/2015
Global digital transformation consultancy; Ravi delivered quantitative data engineering and high-performance trading systems for UBS, Wellington Management, and other top-tier financial institutions.
Built distributed Hadoop/MapReduce/Sqoop data processing pipelines inside Wellington Management, enabling investment research teams to run quantitative parameter computations across massive financial datasets that were previously too slow or too large to process interactively.
Engineered a high-performance real-time quantitative pricing engine using Thrift-based distributed RPC: live market data streams in, options pricing model execution, and sub-millisecond results published to a Memcached caching layer consumed by downstream analytical models. Designed for the throughput and latency demands of active trading environments.
Rearchitected a Java and PL/SQL data extraction pipeline that had become a bottleneck, reducing the time to generate 16+ million record Tableau-ready extracts from a full working day to under 2 hours, giving near-real-time business intelligence to investment decision-makers.

Software Designer — Global Trade Division
Royal Bank of Scotland
06/2009 - 10/2010
Took on a full rewrite of RBS Global Trade's legacy Visual Basic BI and charting platform, migrating it to a modern GWT, Java, JPA, Hibernate, JPivot, and Mondrian stack. The result: eliminated brittle legacy dependencies, gave the Global Trade division a maintainable analytics foundation, and made it possible to extend reporting that the old technology had frozen.

Senior Subject-Matter Expert / Software Designer
Amdocs
04/2007 - 11/2007, 05/2008 - 04/2009
Delivered OSS integrations for AT&T BusinessDirect, including Cramer SSO and EJB portal metrics, enabling faster, more reliable telecom service activation workflows across AT&T's enterprise carrier infrastructure.
Built Telecom BSS integrations (JAX-WS web services, CORBA/JMS) for digital ad space contract billing, connecting disparate BSS systems to automate billing workflows that had previously required manual reconciliation.

Software Engineer / Software Intern
OpenText
07/2006 - 04/2007
Built Java/XForms tooling for the Open Text self-service BPM platform — reducing development time for key application workflows by 80% and enabling teams to ship BPM applications in a fraction of the previous effort.

Software Intern
HCL Enterprise
01/2006 - 07/2006
Developed a Struts/MySQL bug tracking system that improved defect tracking efficiency by 70%, bringing structure and visibility to a previously ad-hoc process in a large global engineering environment.
Projects
Innovative solutions that demonstrate strategic thinking and technical excellence
llm-inference-platform — Kubernetes Control Plane for vLLM
Open source. A Go operator reconciles a declarative InferenceService CRD into a running vLLM deployment, autoscaled on queue depth rather than on what the GPU reports about itself.
Scales on queue depth and p95 time-to-first-token, because decode is memory-bound, so utilisation lies
CEL admission enforces data classification before a pod is scheduled
GPUs claimed through DRA (resource.k8s.io/v1), not the device plugin
Gateway routes on classification first, cost last
agentic-adjudication-platform — Agents Under Regulatory Constraint
Open source. Adjudicates applications against published criteria. It can recommend a grant; it can never issue a refusal — an unmet criterion becomes a referral to a human officer.
Supervisor topology, so one component owns routing and the audit record
Four guardrail layers; hash-chained audit log replays a case in order
Release gate scores 8 runs a case and gates on the worst, not the mean
Mutation tests prove the gate can actually fail
Open Banking Billing & API Metering
Usage metering and billing for paid Open Banking APIs. Every call becomes an event on Kafka, aggregated into billable usage that reconciles against entitlement.
Event-sourced metering, so a billing dispute is answered by replaying events, not by trusting a running total
S3 holds the immutable event record behind Kafka retention
Entitlement and billing resolve from the same events, so they cannot drift
Metering path isolated from the request path on OpenShift
AI Platform — ServiceNow (AWS EKS + Bedrock + LangGraph)
Architecting a cloud-native, production-grade AI platform on AWS EKS and Bedrock.
AWS EKS + Bedrock with LangGraph
Context engineering: memory, tool-use, HITL evaluation
Autonomous AI Incident Management Agent
Built a Kubernetes-native AI agent that autonomously detects cluster failures, correlates root causes across pods and nodes using an in-cluster Ollama LLM, and files structured ServiceNow incidents — completely self-contained, zero API keys, one command to run locally.
Zero-config autonomous incident filing, no API keys or thresholds needed
In-cluster Ollama LLM for air-gapped enterprise environments
Root-cause correlation across pods, nodes, and events
Full ServiceNow CMDB integration with structured incident payload
Oracle Verrazzano — Enterprise Container Platform
Oracle Verrazzano — open-source enterprise-grade multi-cluster Kubernetes platform (GA 2021). Designed container-native deployment capabilities, built the Go operator-driven control plane, engineered production Kubernetes operators automating the full observability stack, and delivered the ReactJS management console. Led commercial adoption, securing the platform's first enterprise paying customer, a major Japanese enterprise.
Oracle's flagship open-source container platform
Go operator-driven control plane for full lifecycle automation via CRDs
Unified observability stack: Prometheus, Grafana, Jaeger, Kiali, OpenSearch
Helped secure the platform's first enterprise paying customer — major Japanese enterprise
Multi-cluster hybrid cloud support for WebLogic, Coherence, Helidon workloads
GenAI / LLM Platform on Kubernetes
Developed a production-grade GenAI / LLM platform on Kubernetes at Oracle — serving multiple LLMs via Ollama, building LangChain-powered RAG pipelines over Oracle Database, and integrating end-to-end LLM observability to measurably improve retrieval accuracy and model reliability at enterprise scale.
LLM serving with Ollama on Kubernetes
LangChain RAG pipelines over Oracle DB with measurable retrieval improvement
End-to-end LLM observability: tracing, automated evals, drift detection
OCI CloudShell — In-Browser Cloud Terminal
Led India team in developing OCI CloudShell, Oracle Cloud Infrastructure's in-browser terminal, using Xterm.js, Java backend, and Docker containerization. Enables engineers to manage OCI resources from any browser without local CLI setup.
Full web-based terminal emulation via Xterm.js
Secure OCI IAM integration with real-time command execution
Cross-browser compatibility across all major environments
Omnichannel Platform for 20M+ Users — RBS
Defined and architected end-to-end omnichannel platform supporting 20 million+ users across mobile apps, web browsers, and ATMs for Royal Bank of Scotland — with a streaming sentiment-analysis pilot behind it and a zero-downtime Java Spring Boot microservices architecture on Azure.
Zero-downtime architecture serving 20M+ users across mobile, web, ATM
ML-powered real-time NLP sentiment analysis for Digital Frontline
Real-time event processing pipeline: Kafka → Storm → LingPipe
Skills & Expertise
Comprehensive technical mastery across modern software development
Agentic Systems
Inference & Serving
Evaluation, Safety & Model Risk
Retrieval & Data
Security & Identity
Cloud & Platform
Languages
Architecture & Leadership
Education & Certifications
Continuous learning and professional development
Education
Bachelor of Technology (Honours) in Computer Engineering
Maharishi Dayanand University
2006
Certifications & Achievements
Blog
Thoughts on engineering, architecture, and building at scale