Shaswat PandaSchedule Review

Available for Fractional AI Advisory & Architecture Sprints (Q4 2026)

AI Systems Architect & Fractional Founding Engineer

I'm an ML engineer who has done the use case, a founding engineer who takes it from ideation to POC to MVP, and the person who runs the experiments, talks to stakeholders in terms of burn, ARR, and the user, and designs the system and the infra from top to bottom.

The work is the path from a rough model to something a user will trust: broadcast vision under 15 ms, FinOps agents that took the manual work out, document pipelines that only bother a person on the uncertain fields, cited answers, bounded agents, voice, code, video, fine-tunes, and support that knows when to stop. I run the experiment, choose the architecture and the infra, and say what it does to burn, the quote, or the ticket.

Modeling · Experiments · Ideation to MVP · Architecture and infra · Stakeholders, burn, and the user

Small upstream fixes in PyTorch and YOLO-World.

Shaswat Panda

New Delhi · AI/ML

About

I'm Shaswat, based in New Delhi. Founders get one person in the room: the modeling, the experiment loop, the path from a rough idea to an MVP a user will trust, the architecture and infra, and a straight answer on burn, the market, and what the user actually does.

I have shipped the systems on the projects page. Live sports vision that had to stay under the broadcast ceiling. FinOps agents and a retrieval gateway where a wrong answer or an open loop showed up as review time and GPU spend. Document extraction that only queued the uncertain fields. Then the later work: cited answers, agents with a step cap, voice that will not write a field early, a coding agent that cannot merge itself, video that does not send every hour to a cloud GPU, fine-tunes that have to beat the base model, and support that counts a reopen as a failure.

Each of those started as an experiment, became a POC, and only shipped once the architecture was decided: what the model may emit, where it runs, and what a wrong output costs the user. I set that expectation with the people paying for it. Inference cost and token burn are part of the design, not a finance note after launch. BTech in Computer Science (AI/ML). A few small upstream fixes in PyTorch and YOLO-World.

Where I've shipped

  1. 2024 — Present

    Senior ML Engineer & Architect · Independent

    End-to-end product ownership, FinOps agents (90%+ less manual handling), org-wide LiteLLM, stakeholder-facing roadmaps.

  2. 2023 — 2024

    Computer Vision Engineer · Document intelligence · B2B

    Supply-chain vision platform, enterprise RAG on Bedrock/Qdrant, production MLOps and team mentoring.

  3. 2022 — 2023

    AI Engineer · Sports broadcast · Startup

    First real-time AI broadcast product in production—TensorRT pipelines at 200 FPS and sub-15 ms delivery.

What I bring

Product judgment, technical depth, and leadership—on the same engagement.

Founders hire me when they need a fractional co-founder/CTO for AI: someone who can shape the use case, ship the system, and keep stakeholders aligned while burn stays honest.

01 · Product

Ideation through production at scale

From problem framing and MVP scope to MLOps, observability, and the launch checklist. I own the thread so you are not juggling three vendors and an internal team that never met.

Use-case selection · Roadmap · POC → pilot → GA · SLOs & on-call

02 · Stakeholders

Expectations you can defend

Clear narratives for founders, investors, and customers—what the model will and will not do, when humans stay in the loop, and how success is measured before spend ramps.

Executive readouts · Demo vs production gaps · Risk registers

03 · Business

Co-founder / CTO judgment

Burn-aware sequencing: which features earn their GPU bill, which automations replace headcount, and which experiments should die in week two. I optimize for runway and defensibility, not vanity benchmarks.

Unit economics · Build vs buy · Compliance as a ship gate

04 · ML depth

Agentic AI, RAG, and inference

Multi-agent orchestration with bounded steps, hybrid retrieval, fine-tuning and evals, and serving on Triton or vLLM with cost-per-query tracing. Plus vision and multimodal when the product demands it.

Agents · RAG · SFT/RLHF · LiteLLM · Qdrant · vLLM · TensorRT · CV

05 · Leadership

Teams that can run it without you

Hiring bar, code review culture, and hands-on mentoring so your engineers inherit patterns—not dependency. I have led pods through production incidents and compliance reviews.

Tech lead · Hiring loops · Runbooks · Junior → mid growth

Production benchmarks

Latency

<15 ms

End-to-end real-time edge CV inference for global live sports broadcast feeds.

Hallucination cut

30%

Achieved across enterprise RAG and agentic workflows via hybrid BM25 + dense vector routing.

OCR accuracy

+25%

Layout-aware document extraction pipelines using LayoutLMv3 and deep learning inpainting.

FinOps automation

90%+

Manual invoice and payment handling removed via autonomous agents on a regulated B2B FinOps platform.

ML & platform depth

The stacks teams actually run in production—not demo notebooks.

Agentic workflows, retrieval, inference serving, and vision—architected with cost, compliance, and operating metrics from day one.

  1. 01

    Agentic & multi-agent workflows

    Customer support copilots, internal ops agents, and document-to-action pipelines—built with step limits, tool routing, and eval harnesses so loops cannot silently burn budget or bypass policy.

    LangGraph · CrewAI · Smolagents · LiteLLM · guardrails

  2. 02

    Enterprise RAG & knowledge products

    Hybrid BM25 + dense retrieval, reranking, and citation-aware answers over PDFs, tickets, APIs, and SQL. The patterns enterprises ask for: access control, freshness, and hallucination metrics in CI.

    Qdrant · Chroma · Pinecone · LlamaIndex · Bedrock · RAGAS

  3. 03

    LLM inference, routing, and cost control

    Org-wide gateways, model routing by task, TTFT and latency SLAs, and Prometheus/Grafana dashboards that tie every feature flag to dollars per query.

    vLLM · Triton · LiteLLM · Ollama · LoRA/QLoRA · SFT

  4. 04

    Vision, OCR, and multimodal extraction

    Layout-aware document AI, real-time edge inference, and redaction at scale—when the product is pixels and milliseconds, not chat alone.

    PyTorch · TensorRT · LayoutLM · OpenCV · SageMaker · ECS

Advisory models

Two engagements. Both scoped before the work starts.

Two modes: a fixed sprint to decide what to build and how, and a monthly retainer when you want a fractional co-founder/CTO for AI—product, architecture, and team in one seat.

2-week fixed scope

Architecture & Evaluation Sprint

$6,000 – $8,000

Fixed fee · 2 weeks

Best for

Seed and Series A teams deciding what to build, what to defer, and whether the current stack will survive first real users.

Scope

  • Use-case and ROI framing with founders and stakeholders
  • Architecture teardown: agents, RAG, inference, and data paths
  • Triton/vLLM profiling and token/GPU cost model
  • Guardrails, evals, and a scoped production roadmap
  • Benchmark PRs or spike code where it de-risks the quarter

Monthly retainer

Fractional Founding AI Engineer

$10,000 – $14,000 / month

Retainer · 15–20 hours/week

Best for

Funded teams that need a senior hands-on technical lead without a six-month hiring cycle or equity dilution.

Scope

  • 15–20 hours/week as fractional technical lead
  • Product and engineering alignment; clear external comms
  • Agent/RAG platform ownership and MLOps on the serving path
  • Fine-tuning, evals, and inference cost discipline
  • Team mentoring, hiring support, and production runbooks

Schedule

Book an architecture review.

Tell me what you are shipping and where it hurts—latency, hallucinations, compliance, or cost. We will map the architecture in a working session, not a sales call.

  1. 01The product bet: use case, buyer, and what must be true in 90 days
  2. 02Architecture, burn, and the inference or agent path behind it
  3. 03Stakeholder and team gaps—who needs clarity, who needs hands
  4. 04Sprint vs retainer: what matches your runway and launch window