ABHISHEK UPADHYAY 
Projects

January 15, 2025

Enterprise AI Orchestration & Creative Suite

Multimodal Generative AI & Real-Time Analytics Platform | Senior Frontend Developer

Executive Overview

The Enterprise AI Orchestration & Creative Suite is a dual-capability platform: it gives organizations visibility into how AI is consumed and costed across every team, while giving creative teams a generative workspace that turns rough sketches and conversation into production-ready visual assets. The result is a single surface that replaced disconnected AI tools with one governed, auditable workspace — cutting graphic production time by 60% and accelerating content generation by 30%+.

Core Architectural Pillars

Canvas & Multimodal AI Engineering

Extended the Excalidraw SDK into a full generative canvas, with a bidirectional Chat-to-Canvas state sync layer so conversational AI can render, reposition, and modify shapes, diagrams, and assets live on the board. Layered a Sketch-to-Asset pipeline on top, combining Gemini Vision for sketch understanding with GPT-4o for asset generation, plus a low-latency OCR overlay that renders recognized text in place with minimal delay.

Enterprise AI Analytics Engine

Built a Highcharts-based analytics engine tracking token usage, API request volumes, model hit rates, and cost estimation, giving engineering and finance stakeholders a shared, real-time view of AI spend across every team and model.

Application Architecture & Micro-Frontends

Structured the platform as a Next.js application shell with Module Federation, allowing the canvas, analytics, and export modules to be developed and deployed independently. Used Redux boundaries and memoization to isolate high-frequency canvas events from the rest of the UI, keeping interactions fluid under heavy load.

Export & Production Workflows

Implemented browser-automation-driven export pipelines that convert complex canvas and chart states into production-ready PDF, XLSX, and PPT deliverables.

Engineering Challenges Solved

  • Async AI Pipeline & Canvas ResponsivenessChallenge: coordinating multi-step asynchronous AI transformations (vision understanding, generation, OCR) without freezing the high-frequency interactive canvas. Solution: moved transformation steps into a queued, cancellable pipeline decoupled from the render loop. Impact: sketch-to-asset conversions stayed responsive even under concurrent multi-user editing.
  • High-Frequency Event IsolationChallenge: real-time stream and cursor updates were causing canvas re-renders to compete with UI state updates. Solution: introduced Redux state boundaries and memoized selectors to isolate canvas events from analytics and chat state. Impact: sustained fluid canvas interaction even during live token-streaming sessions.
  • Enterprise Micro-Frontend IntegrationChallenge: independently deployed feature modules needed to compose into a single host application without version or state conflicts. Solution: adopted Module Federation with a shared dependency contract and isolated Redux slices per module. Impact: teams shipped canvas, analytics, and export features on independent release cycles with zero cross-module regressions.

Technologies Used

  • Next.js + TypeScript + React: For a type-safe, server-rendered application shell.
  • Redux: For coordinating canvas, chat, and analytics state across module boundaries.
  • Excalidraw SDK: As the foundation for the generative infinite-canvas environment.
  • Module Federation: For independently deployable, isolated micro-frontend modules.
  • Gemini Vision + GPT-4o: For sketch understanding and generative asset creation.
  • Highcharts: For real-time token usage and cost analytics dashboards.
  • OCR: For low-latency text extraction and overlay rendering on the canvas.
  • SCSS: For themeable, component-scoped styling.
  • Jest: For unit and integration coverage across canvas and analytics logic.
  • Azure DevOps + Git: For CI/CD and version control across the codebase.

Outcome

The platform gives enterprise teams a single surface to both govern AI usage and create with AI directly, cutting graphic production time by 60% and content generation effort by 30%+ compared to the prior disconnected toolchain.