LLM Inference Economics Calculator
Explore batch size, context length, and cost tradeoffs based on the Reiner Pope lecture. Interactive charts and a deep-dive into the economics of running frontier models at scale.
I design and ship production agentic systems, from discovery to multi-agent architecture, serving, and evaluation. The work is systems that understand the domain they run in: purpose-built skills, grounded tool calls, and multi-turn analysis that keeps its context.
A data-science background sits under that. Every workflow is only as good as the data it is allowed to trust.
I’m open to conversations. Reach me by email, on GitHub, LinkedIn, or X.
01 / Experience
Forward Deployed Engineer (Founding Team) · Remote · Nov 2024 – Present
Embedded with operating teams to turn manual workflows into agentic systems, then stayed through adoption.
How it fits togetherAgents, the serving layer, and the models sit on one path: live data in, a traced answer out, with the token budget enforced before the call.
Azure OpenAI · OpenAI Agents SDK · Langfuse · FastAPI · Machine Learning
Data Scientist · Remote · May 2024 – Aug 2024
Built the analytics behind buyer profiling, from raw filings to a dashboard a team could use.
How it fits togetherRERA records land in SQL, then in the Power BI and Streamlit dashboards.
Python · Selenium · SQL · Power BI · Streamlit
02 / Projects
Explore batch size, context length, and cost tradeoffs based on the Reiner Pope lecture. Interactive charts and a deep-dive into the economics of running frontier models at scale.
Policy-driven RAG where access is decided in code, never by the model. Each vector chunk carries its tenant and role ACL, so unauthorized documents never reach the LLM.
MCP toolkit that lets any agent harness read Databricks jobs, runs, schemas, and failure logs to diagnose a broken pipeline. Read-only by default, raw SQL rejected.
Stacked ensemble of Random Forest, XGBoost, and CatBoost over 100,000+ transactions. 0.987 F1 with SHAP and LIME explanations a reviewer can check.
03 / Writing
AI is becoming a heavy industry, and the race for chips, electricity, and capital could reshape markets, governments, and who holds power.
How I built a PR review agent that scans every changed file, ranks risk, pulls the right context, and keeps track of what was actually reviewed.
Every mature product has a layer of plain database functions. That layer is where your product actually lives.
We're living through what might be the most significant financial event of our generation as AGI development valuations skyrocket.
04 / Contact
Email me at monish.emailbox@gmail.com, or find the work on GitHub and LinkedIn.
Monish Gosar