AI / Systems / Product Engineering

I build systems that work in the real world.

I've spent the last 9 years designing and shipping production software across AI, distributed systems, data platforms, observability, and developer infrastructure. I take ambiguous problems from problem definition → architecture → implementation → production, and stay close to the people actually using what I build.

Varun Deshpande
Product + infrastructure
from architecture to production
Experience
9 years
Production software
AI impact
$2M ARR
From AI-powered product work
Bulk operations
100K rows
Average per API call
Product performance
95%
Survey load-time reduction

Systems, not demos.

A selection of systems I've designed and shipped. The common thread is taking a messy real-world workflow and turning it into software that people can actually depend on.

01

Alfie

AI-powered review operations — turning incoming customer reviews into validated, context-aware responses and business actions.

$2M ARR AI-powered product impact

The problem. Restaurants receive reviews continuously across Google, Yelp, Zomato and other platforms. Responding well means understanding the review, the brand, the location, available offers or loyalty actions, business rules, language, and what should happen next. Doing that manually does not scale.

What I built. I led the architecture and end-to-end development of Alfie, a production AI workflow that turns each incoming review into a response-ready business event. Reviews are pulled from multiple platforms through scheduled jobs, normalized, and placed onto a message queue for asynchronous processing.

Each consumer retrieves the appropriate brand context from cache. This context includes the information needed to make the response relevant to that brand, including offers, loyalty actions, business rules, calculations and other operational context.

When a review arrives in another language, Alfie can invoke a translation tool before passing the enriched review and context into the AI workflow. The foundation model generates the candidate response, but the model is not the final authority.

The generated response goes through a deep validation and guardrail layer before it can continue. This allows the AI to operate inside a controlled software system rather than simply generating free-form text.

Once validated, the response is ready for the customer's chosen workflow: it can be automated, or it can be presented to an operator who can review, edit and send it manually.

Alfie / End-to-end architecture
Production workflow
Google review source
Yelp / Zomato review sources
Other platforms review sources
→
Scheduled ingestion cron / fetch / normalize
Review event normalized representation
→
Message queue async processing boundary
→
Alfie consumer workflow orchestration
→
Validated response automation or human review
Inside the Alfie consumer
Context → AI → validation → action
01 / Review
Incoming review, platform information and restaurant / brand context.
02 / Brand context
Context retrieved from cache, including brand information, offers, loyalty actions, rules, calculations and relevant operational information.
03 / Translation
When required, a translation tool converts the review into the language needed by the downstream workflow.
04 / Foundation model
The model receives the review together with the relevant business context and produces a candidate response.
05 / Validation
Deep validation and guardrails determine whether the generated result is acceptable before execution.
06 / Execution
Validated output becomes either an automated response / configured action or a response ready for human review.
Automation The validated response proceeds automatically when the customer's workflow allows automation.
OR
Human review The response is ready for an operator to inspect, edit, approve and send manually.

AI inside a software system

The LLM is one component. Context, tools, business rules, calculations, validation and execution surround it.

Event-driven processing

External review ingestion is separated from AI processing through a queue, creating an independent processing boundary.

Context is brand-specific

The workflow can serve different brands while retrieving the context and rules appropriate to each one.

Automation without removing control

Customers can automate the workflow or keep a human in the loop depending on how they want the system operated.

OpenAI Gemini AI Agents AWS Queues Caching LLM Guardrails Translation Distributed Systems
02

AI E2E Test Engineering

Verification for software increasingly written by AI.

Requirement → executable test AI-assisted verification workflow

As AI makes it dramatically easier to generate application code, verification becomes an increasingly important engineering step. Writing a test is not enough: the system needs to understand the requirement, the codebase, the application and the state required to actually execute the test.

I built an AI-assisted E2E testing workflow around Playwright. A Jira or Notion ticket becomes the starting point. The system understands the requirement and codebase, uses a Playwright MCP server to explore the application, determines what state and test data are required, and identifies missing prerequisites.

If required data does not exist, the workflow guides the developer through creating the prerequisite data. Once the environment is ready, the system generates the Playwright test specification. Tests can then run daily or inside a CI/CD pipeline.

Verification pipeline
Requirement → executable test
Jira / Notion requirement
→
Understand requirement what should be verified?
Understand codebase how does the feature work?
→
Playwright MCP explore application
Determine test state data + prerequisites
→
Missing data? guide developer
Generate spec Playwright test
→
Daily / CI continuous verification
AI Playwright MCP Codebase Understanding E2E Testing CI/CD
03

Bulk Resolution

Making large customer-facing operations feel like a normal product action.

100K rows average per API call

Customers needed to resolve or unresolve around 100,000 rows on average in a single API operation, directly from the product. The operation happens in front of the customer, so making the workflow feel like a hanging system was not acceptable.

The existing implementation had grown into a collection of filters and separate ticket-type implementations. The key architectural decision was to separate selection from execution.

Once filters have been evaluated and the ticket IDs are known, the IDs are materialized in Redis under a deterministic key representing the relevant account, user and filter combination.

The frontend receives that key. When the customer triggers the operation, the backend retrieves the materialized IDs and performs the resolve or unresolve operation without repeating the expensive selection work.

Selection / execution split
Materialize once → execute
Customer filters account / user / criteria
→
Compute ticket IDs expensive selection
→
Redis materialized IDs + key
→
Frontend operation key
→
Backend resolve / unresolve
Redis Node.js PostgreSQL Distributed Systems Caching Performance
04

Restaurant Intelligence

Multi-platform analytics infrastructure built from scratch.

Multiple queries optimized to sub-100ms performance

Restaurant feedback lived across multiple platforms including Google, Yelp, Zomato and others. I designed and built the analytics infrastructure from scratch to provide unified insights across brands, locations and individual outlets.

The system handled hundreds of restaurants, thousands of outlets and millions of records per week. I worked across ingestion, processing, storage and the application layer rather than treating analytics as a reporting-only problem.

A major part of the work was database performance. I optimized multiple analytical queries through SQL changes, indexing strategy and query planning. Queries that previously took tens of seconds or around a minute were brought down to sub-100ms execution for key workloads.

The result was an analytics system where users could explore restaurant, brand and outlet-level insights without waiting on long-running queries.

PostgreSQL Redis AWS Python TypeScript Data Engineering SQL Optimization
05

Cluster Manager

Production deployment infrastructure for Walmart's data science team.

~80% deployment-time reduction

Data scientists at Walmart needed a reliable way to run and schedule production-grade Jupyter notebooks without depending on DevOps teams for every deployment.

I designed and built a deployment platform around Jupyter Notebooks, Papermill and Airflow that turned notebook execution into a self-service production workflow.

The platform was adopted across Walmart's data science team. I also trained the client team directly, helping move the system from software delivery into actual organizational adoption.

Python Airflow Papermill Jupyter Data Platforms DevOps
06

Rakuten Sixth Sense

Observability infrastructure across global engineering teams.

100+ engineering teams supported

Sixth Sense was an internal observability platform spanning infrastructure, applications and databases across global teams. I worked on synthetic monitoring, database monitoring and the telemetry infrastructure behind the platform.

I built and scaled programmable synthetic monitoring in Python, owning high-level and low-level designs for user journeys and checks. Airflow orchestrated monitoring suites while the platform surfaced live pass/fail results.

I also built custom database monitoring agents that collected query-level metrics, latency patterns and failure events, pushing telemetry into Elasticsearch for visualization and investigation.

The work included collaborating with SRE, platform and application teams to define SLIs and SLOs and integrate observability into the engineering lifecycle.

Python Airflow Elasticsearch Synthetic Monitoring Observability SLI / SLO

How I work.

I care about the entire path from a problem someone has to a system people can rely on. Architecture matters, but so do adoption, operations and what happens after launch.

01

Start with the real problem

Understand who is affected, what they are doing today and where the actual bottleneck is before designing the system.

02

Separate expensive work

Move computation to the right boundary. Materialize expensive work when appropriate instead of repeatedly making the user wait.

03

AI is part of the system

Models need context, tools, constraints, validation and clear execution boundaries to become dependable production software.

04

Measure what happens

Usage analytics, RUM sessions, system metrics and customer behavior tell you whether the thing you built actually works.

05

Own the whole path

Architecture, implementation, deployment, customer interaction, debugging and adoption are all part of shipping software.

06

Design for adoption

A technically correct system has limited value if people cannot understand it, trust it or fit it into how they already work.

Where I've built.

Across product engineering, data platforms, enterprise systems, observability and AI.

Merchant Management Solutions

Production AI systems, distributed workflows, analytics platforms, customer-facing product infrastructure and developer tooling. Architecture, implementation, deployment and customer-facing delivery.

Rakuten

Observability infrastructure, synthetic monitoring, database monitoring and telemetry systems supporting global engineering teams.

The Math Company

Built production data and deployment systems for enterprise clients, including Walmart, with a focus on self-service platforms and operational automation.

Oracle

Core settlement systems in the banking domain, KYC workflows, React applications and sensitive database migrations.

Tools follow the problem.

A practical stack built through production systems rather than technology collecting.

AI

OpenAI · Gemini · LLM applications · AI agents · context systems · guardrails · evaluation · MCP

Backend

Python · Node.js · TypeScript · Flask · APIs · asynchronous processing · distributed systems

Cloud

AWS · Lambda · SQS · SNS · EventBridge · Step Functions · Batch

Data

PostgreSQL · Redis · Elasticsearch · Snowflake · Databricks · data pipelines · SQL optimization

Infrastructure

Airflow · observability · synthetic monitoring · CI/CD · queues · caching · production operations

Frontend & Testing

React · Playwright · E2E testing · MCP · product analytics · RUM

I’m available for engineering work.

Full-time roles, contracts, consulting or project work. If you need someone who can take a problem from architecture through production, get in touch.

varun.vd51@gmail.com