Concurrency Documentation

This folder contains all documentation related to the Concurrency Management System in Oktivo Voice Platform.

Documents

Document	Description
CONCURRENCY-MANAGEMENT-SYSTEM.md	High-level design & implementation guide for the hierarchical quota system (Platform → Org → Customer → Campaign)
CONCURRENT-CALLING-SYSTEM.md	Developer guide covering Redis key structures, fillCallSlots() internals, circuit breaker, TRAI auto-pause, and ETA calculation

Quick Overview

The concurrency system controls how many calls happen simultaneously at each level:

┌─────────────────────────────────────────────────────┐
│  Platform Provider Capacity (TTS, STT, LLM, SIP)   │
│  → Managed via /superadmin/provider-capacity       │
└─────────────────────────────────────────────────────┘
                        ↓
┌─────────────────────────────────────────────────────┐
│  Organization Quota                                 │
│  → Allocated by SuperAdmin                         │
└─────────────────────────────────────────────────────┘
                        ↓
┌─────────────────────────────────────────────────────┐
│  Customer Quota                                     │
│  → Allocated by Org Admin                          │
└─────────────────────────────────────────────────────┘
                        ↓
┌─────────────────────────────────────────────────────┐
│  Campaign Limit                                     │
│  → Set per campaign                                │
└─────────────────────────────────────────────────────┘

Effective Concurrency = min(campaign, customer, org, ...providerLimits)

Key UI Pages

• /superadmin/concurrency Platform-wide monitoring dashboard
• /superadmin/provider-capacity CRUD management for provider capacity limits

Related Files

Backend

• src/controllers/providerCapacity.controller.ts
• src/controllers/concurrency.controller.ts
• src/services/concurrency.service.ts
• src/services/providerTracker.service.ts
• src/services/circuitBreaker.service.ts

Frontend

• src/pages/superadmin/ConcurrencyDashboardPage.tsx
• src/pages/superadmin/ProviderCapacityPage.tsx
• src/services/concurrency.service.ts
• src/services/providerCapacity.service.ts