LLM Proxy and MCP Infrastructure

How AI is changing software engineering at Shopify with Farhan Thawar

Topic 9 of 18

Published Jul 2, 2025 · Clip 21:41–24:03 (2:22)

Farhan details Shopify's internal LLM proxy, built to prevent employees from leaking customer or employee data into public chatbots, built on top of the open-source LibreChat (Shopify is a core contributor). The proxy enforces enterprise APIs, issues tokens, tracks per-team and per-person usage and cost, and features a leaderboard celebrating the biggest AI spenders. Shopify is also on the MCP steering committee and puts MCP servers in front of everything—like their internal wiki 'the Vault,' which crawls all internal documents and talks so anyone can query company history, acting like an internal Perplexity.