Technical Lead, Gurugram, India

Open to opportunities

Arpit Gupta

I build distributed systems and platform infrastructure that hold up at scale.

8+ years across startups and enterprises. Currently leading a 12+ engineer team at SYMX.AI. Previously at Thales and LambdaTest.

I specialize in IoT observability, Go microservices, and cost-aware platform engineering. Based in Gurugram, working with global teams.

8+
Years Experience
12+
Engineers Led
1,500+
IoT Devices (Symbots)
89%
Fewer Escalations

Experience

8+ years of engineering across distributed systems, platform infrastructure, and security.

SYMX.AI

Technical Lead

Jan 2025 - Present

Leading a 12+ engineer team building X-Radar, a real-time IoT observability platform reading data from 1,500+ Symbots on mining trucks, and Control Room for live fleet tracking.

  • X-Radar built from scratch
  • 89% fewer customer escalations
  • 12+ engineer team
PythonStreamlitAWS KinesisAirflowReactDistributed Systems

Thales Group

Senior Software Engineer

Jun 2021 - Jan 2025

Architected 5 Go microservices for CipherTrust Secrets Management on Kubernetes; integrated CipherTrust with Akeyless. Won the global Thales CPL Award.

  • Global Thales CPL Award
  • 400+ test suite, 135 critical bugs caught
  • SSO setup in under 30 seconds
GoKubernetesMicroservicesSecurity

TurnKey Solutions

Software Engineer

Nov 2020 - May 2021

Built Node.js backend services for RainierAEV, an ML-driven autonomous testing platform for enterprise ERP systems including Workday, SAP, and Oracle.

  • Caterpillar Workday deployment
  • ML-driven test platform
Node.jsBackend

TestMu, formerly LambdaTest

Member of Technical Staff

Nov 2019 - Oct 2020

One of the first 30 employees. Built integrations with 15+ Selenium, Playwright, and Cypress frameworks; published a Java Maven plugin to Maven Central.

  • First 30 employees
  • Maven Central plugin
  • GEB contributor
JavaTest AutomationIntegrations

CGI Group

Associate Software Engineer

Jan 2018 - Oct 2019

Java feature development and bug fixes for Bell Canada's telecom systems.

  • Bell Canada telecom systems
Java

Selected Work

Platforms, tools and open source, built to solve real problems.

CostReveal

Cost attribution for AI, cloud, and API spend

Independent research project that reads the bills of AI, cloud, and API providers and attributes every dollar of spend to the team, feature, or customer behind it. No SDK, no code changes.

Node.jsNestJSPostgreSQLRedisReactDocker

SecretStack

VS Code extension for exposed secrets

Open-source VS Code extension that scans codebases for exposed secrets (API keys, passwords, tokens) and raises real-time alerts with customisable detection rules.

TypeScriptVS Code Extension API

CipherTrust Secrets Manager SSO Plugin

Enterprise SSO automation · ThalesGroup

Open-source Chromium extension published under the ThalesGroup GitHub org. Automates SSO configuration between CipherTrust Manager and Akeyless, cutting enterprise setup time from 30 minutes to under 30 seconds.

GoJavaScriptChrome Extensions APIOAuthSSO

About

Senior Technical Lead with 8+ years building distributed systems and platform infrastructure. Currently leading a 12+ engineer team at SYMX.AI.

I specialize in engineering distributed systems, platform infrastructure, and developer tooling. At SYMX.AI I built X-Radar from scratch: a real-time IoT observability platform reading data from 1,500+ Symbots on mining trucks, cutting customer escalations by 89 percent.

At Thales I architected Go microservices for CipherTrust Secrets Management and won the global CPL Award. I also build open-source tools like SecretStack and the CipherTrust SSO plugin. Based in Gurugram, India, working with global teams.

Education

B.Tech, Computer Science

GL Bajaj Group of Institutions, AKTU (2014–2018) · 85.2% · College Topper · Top 30 in UP

Recognition

  • Global CPL Award, Thales (2024)
  • Extra Miler Awards, Thales (2021, 2023)
  • 2,800+ GitHub contributions across open-source, private, and org repos
  • Publication: “Formal Modeling of Generalized Sliding Window Protocol”, IJCA (2018)
  • Blogathon 1.0 and 2.0 winner

Technical Skills

Languages

PythonJavaGoTypeScriptNode.js

Systems and Architecture

System DesignDistributed SystemsPlatform EngineeringMicroservicesSoftware Observability

Cloud and DevOps

AWSKubernetesDockerCloud Infrastructure

Data and Streaming

PostgreSQLRedisApache KafkaApache Airflow

Web and AI

ReactNestJSLarge Language Models (LLM)

Cost Engineering

Cloud Cost OptimizationCost Attribution

Writing

Engineering deep-dives, architectural patterns, and notes from building systems in production.

11 min read

Zero-Downtime Deployments on Kubernetes: Rolling, Blue-Green, Canary

Deployment strategies compared: rolling updates, blue-green, and canary. Traffic shifting, rollback, and readiness gates.

KubernetesDevOpsDeployments
Read article
15 min read

Cutting Customer Escalations 89% with IoT Anomaly Detection

Inside X-Radar: the real architecture of a Streamlit observability platform processing data from 1,500+ mining truck devices across Athena, DynamoDB, and PostgreSQL.

IoTAnomaly DetectionPython
Read article
13 min read

Designing Webhook Delivery Systems That Survive Failures

How to build webhook delivery that works: at-least-once semantics, retry with backoff, signature verification, and ordering guarantees.

WebhooksSystem DesignReliability
Read article
16 min read

Unit Economics for AI Products: Cost Per Request Done Right

Model costs, infrastructure overhead, and margin math. How to calculate whether your AI feature is actually profitable.

AICost AttributionProduct
Read article
15 min read

Time-Series Databases Compared: InfluxDB, TimescaleDB, and S3

InfluxDB, TimescaleDB, or plain S3 for time-series data? A practical comparison of write throughput, query patterns, retention, and cost at scale, with a decision framework.

DatabasesTime-SeriesIoT
Read article
10 min read

From Senior Engineer to Tech Lead: Skills That Transfer

Technical leadership, delegation, architecture ownership, and stakeholder management. What actually changes when you move from senior engineer to tech lead.

LeadershipCareerEngineering Management
Read article
10 min read

System Design Interviews: What Senior Interviewers Look For

Evaluation rubrics, common mistakes, and how to structure answers. What separates a strong senior system design interview from an average one.

InterviewsSystem DesignCareer
Read article
13 min read

How to Structure a Large Go Codebase: Lessons from Production

Package layout, dependency direction, interface design, and the monorepo question, drawn from running multiple Go microservices in production.

GoArchitectureBackend
Read article
14 min read

Structured Logging for Microservices: What to Log and What to Skip

JSON logging, correlation IDs, log levels, cardinality control, and cost management for production microservice logging.

ObservabilityMicroservicesBackend
Read article
11 min read

Secrets Management in Production: Vault, AWS Secrets Manager, and Rotation

Secret injection patterns, rotation without restarts, and audit trails: production secrets management compared.

SecurityDevOpsAWS
Read article
12 min read

Saga Pattern for Distributed Transactions: Choreography vs Orchestration

How to handle transactions across microservices: saga pattern HLD, choreography vs orchestration, compensation logic, and isolation challenges.

MicroservicesDistributed SystemsArchitecture
Read article
14 min read

Beyond Copilot: Why Repo-Specific AI Workflows Beat Generic Assistants

Generic AI assistants write plausible code that ignores your conventions. Repo-specific context files and mandatory human review are what make AI output shippable.

AIDeveloper ToolsCode Review
Read article
9 min read

Platform Engineering: Reducing Developer Toil

Measuring toil, building self-service, and paving roads without becoming the team everyone waits on.

Platform EngineeringDevOpsDeveloper Experience
Read article
13 min read

From Sensor to Alert in Seconds: LLD of a Real-Time Pipeline

Low-level design of a real-time alerting pipeline: stream processing, windowing, alert deduplication, and latency budgets from sensor to notification.

StreamingIoTArchitecture
Read article
14 min read

Python to Go: What Changes When You Switch Backend Languages

Type systems, error handling, deployment, and performance characteristics compared from experience running both in production.

PythonGoBackend
Read article
13 min read

Python Asyncio in Production: What Tutorials Miss

Event loop blocking, connection pool sizing, structured concurrency, and debugging techniques for Python asyncio services that actually ship.

PythonAsyncioBackend
Read article
10 min read

Internal Developer Platforms: What to Abstract and What Not To

Platform HLD, golden paths, escape hatches, and the line between helpful abstraction and harmful magic.

Platform EngineeringDevOpsDeveloper Experience
Read article
16 min read

OpenTelemetry in Practice: Distributed Systems Guide

HLD of an OpenTelemetry pipeline: instrumentation, collectors, backends. Traces vs metrics vs logs, sampling strategies, context propagation, and the real tradeoffs nobody warns you about.

ObservabilityOpenTelemetryDistributed Systems
Read article
18 min read

Multi-Tenant SaaS at Scale: Isolation and Data Design

A complete HLD for multi-tenant SaaS: isolation models, noisy neighbor handling, and what to do when one tenant is 100x larger than the rest.

Multi-TenancySaaSSystem Design
Read article
9 min read

Multi-Cluster Kubernetes: Architectures and Tradeoffs

Cluster per environment vs per team vs per region: multi-cluster patterns, federation, and GitOps approaches.

KubernetesArchitectureDevOps
Read article
14 min read

MCP Servers in Production: Architecture, Security, and Failure Modes

Model Context Protocol servers in production: HLD, auth, sandboxing tool execution, input validation, failure modes, scaling, and observability. An engineer's guide.

MCPAI AgentsSystem Design
Read article
13 min read

Attributing LLM API Costs to Features, Users, and Requests

Token metering, per-request tagging, cost allocation models, and budget guardrails. How to know exactly which feature is burning your OpenAI budget.

AILLMsCost Attribution
Read article
15 min read

Kubernetes GPU Scheduling: ML and Microservices Together

Running inference and microservices on shared Kubernetes clusters is becoming normal. GPU scheduling, tenant isolation, and idle-cost control decide whether it works.

KubernetesGPUInfrastructure
Read article
15 min read

Kubernetes Cost Optimization That Actually Works

A practical guide to cutting Kubernetes spend: right-sizing workloads, autoscaling that responds to real demand, spot instances without the pain, and placement strategies that bin-pack efficiently.

KubernetesCost OptimizationDevOps
Read article
12 min read

Kinesis vs Kafka for Streaming: A Decision Framework

Throughput, ordering, retention, operational burden, and cost: a practical framework for choosing between Kinesis and Kafka.

StreamingAWSKafka
Read article
11 min read

Kubernetes Autoscaling: HPA, KEDA, and Custom Metrics Compared

HPA vs KEDA vs custom metrics: scaling signals, cooldown behavior, and when each approach makes sense.

KubernetesAutoscalingDevOps
Read article
13 min read

Designing IoT Systems for Intermittent Connectivity

Mining sites lose connectivity. Your IoT architecture needs offline buffering, store-and-forward, conflict resolution, and the right MQTT QoS levels to survive it.

IoTDistributed SystemsMQTT
Read article
13 min read

Designing Idempotent APIs: Handling Retries Without Duplication

How to design APIs that safely handle retries: idempotency keys, exactly-once myths, and implementation patterns that work.

APIsSystem DesignReliability
Read article
13 min read

gRPC vs REST for Microservices: Performance Compared

Latency benchmarks, schema evolution, tooling tradeoffs, and a practical framework for choosing between gRPC and REST for service-to-service communication.

gRPCRESTMicroservices
Read article
12 min read

Graceful Shutdown in Go: Handling SIGTERM Properly

Signal handling, draining in-flight requests, shutdown ordering, and Kubernetes termination lifecycle for Go services.

GoKubernetesDevOps
Read article
15 min read

Go Concurrency Patterns for Backend Engineers: Beyond Goroutines 101

Worker pools, fan-in/fan-out, context cancellation, errgroup, and pipeline patterns you will actually use in production Go services.

GoConcurrencyBackend
Read article
10 min read

EKS Networking Explained: VPC CNI and Pod Communication

How pod networking actually works on EKS: VPC CNI modes, security groups for pods, network policies, and DNS.

KubernetesAWSNetworking
Read article
12 min read

Distributed Locking: Redis Redlock, Zookeeper, and When You Need Them

When distributed locks are necessary, how Redlock and Zookeeper work, fencing tokens, and the alternatives you should consider first.

Distributed SystemsRedisConcurrency
Read article
12 min read

Designing Event-Driven Microservices in Go: HLD of a Production System

High-level design of an event-driven microservices platform in Go: event bus architecture, schema evolution, dead letter queues, and ordering guarantees.

GoMicroservicesEvent-Driven
Read article
15 min read

AI Agent Infrastructure for Production: Full Architecture

A production-grade HLD for AI agent platforms: orchestrator, tool router, per-session sandboxes, memory stores, and observability. Isolation tiers, secrets, egress, and cost controls included.

AI AgentsSystem DesignPlatform Engineering
Read article
13 min read

Writing Design Docs That Get Approved

Doc structure, tradeoff analysis, alternatives considered, and decision records. How to write technical design documents that actually drive decisions.

ArchitectureDocumentationEngineering Practices
Read article
10 min read

Database Sharding vs Read Replicas: When to Use Which

A practical decision framework for database scaling: sharding strategies, shard key selection, read replica lag, and when each approach makes sense.

DatabasesSystem DesignScalability
Read article
13 min read

Batch vs Streaming Data Pipelines: Architecture and Tradeoffs

Lambda vs kappa architecture, exactly-once semantics, late data handling, and backfill strategies. A practical guide to choosing between batch and streaming pipelines.

Data EngineeringStreamingArchitecture
Read article
13 min read

Database Connection Pooling: Sizing, Timeouts, and Failure Modes

Pool sizing math, timeout tuning, exhaustion handling, and when to reach for PgBouncer in production backend services.

PostgreSQLDatabasesBackend
Read article
13 min read

Reviewing AI-Generated Code: A Checklist for Real Bugs

What AI gets wrong: edge cases, error paths, hidden assumptions. A practical review checklist for AI-assisted pull requests.

AICode ReviewEngineering Practices
Read article
12 min read

Why Your AWS Bill Cannot Tell You What Each Feature Costs

AWS bills show services and accounts, not features or teams. Here is why the bill structure makes attribution hard, and how to build a pipeline that fixes it.

AWSCost AttributionCloud
Read article
12 min read

Circuit Breakers and Retries: Resilient Services

How to prevent cascading failures: circuit breaker states, retry budgets, timeout design, bulkheads, and hedging.

MicroservicesResilienceGo
Read article
9 min read

Designing CI/CD Pipelines for Microservices: Speed Without Chaos

Pipeline HLD for microservices: trunk-based development, progressive delivery, and DORA metrics that matter.

DevOpsCI/CDMicroservices
Read article
11 min read

Cache Invalidation for Distributed Systems: Strategies That Work

Practical cache invalidation strategies for distributed systems: write-through, TTL, event-driven invalidation, and stampede protection.

CachingDistributed SystemsRedis
Read article
15 min read

Background Job Architecture: Queues, Workers, and Retry Strategies

Job queue HLD, at-least-once delivery, dead letter handling, scheduling, and priority queues for reliable background processing.

ArchitectureDistributed SystemsBackend
Read article
10 min read

Lambda Cold Starts: Causes, Mitigations, and When to Avoid Serverless

What causes Lambda cold starts, how to mitigate them, and when serverless is the wrong choice.

AWSServerlessLambda
Read article
14 min read

API Versioning That Does Not Break Clients

URL vs header versioning, deprecation policies, additive changes, and contract testing for evolving APIs without breaking consumers.

APIBackendArchitecture
Read article
11 min read

API Gateway Design: Routing, Rate Limiting, and Auth at Scale

High-level design of an API gateway: request routing, rate limiting algorithms, auth termination, and request transformation at scale.

API GatewaySystem DesignMicroservices
Read article
13 min read

Don't Trust Your AI Agents: Sandboxing Strategies for Production

Agents that execute code are remote execution services with a natural language interface. Isolation, identity, and audit trails are infrastructure problems, not model problems.

AI AgentsSecurityAWS
Read article
15 min read

AI Agent Cost Observability: Metering Tokens in Production

Coding agents burn tokens the way servers burn CPU, but most teams still cannot say where the tokens go. Token metering, budget guardrails, and per-team attribution are how you fix that.

AI AgentsCost ObservabilityDevOps
Read article

Let's talk.

Open to high-impact technical leadership roles. I usually reply within a day.

arpitstack@gmail.com