FastGPTFastGPT

Deploy and operate

FastGPT self-hosted architecture overview, capacity planning, configuration, and operations.

System Architecture and Components

The FastGPT self-hosted deployment consists of the core application service, plugin and sandbox execution services, and four data services (MongoDB, Redis, vector database, and S3 object storage):

FastGPT core deploymentFastGPT core deployment

Configure the access gateway and surrounding services for your deployment, and select one supported vector database backend.

Plugin and sandbox executionPlugin and sandbox execution

Capacity Planning and Baseline Specifications

Size the deployment with representative documents and queries. Capacity depends on vector dimensions, chunk count, model latency, ingestion concurrency, and retention. Measure before setting production limits:

WorkloadMeasurementsAcceptance Check
EvaluationPeak memory and disk use across required servicesComplete import, retrieval, and conversation flows
ProductionConcurrent requests, queue delay, p95 latency, vector index sizeMeet the service target under a representative load
High availabilityReplica topology, recovery time, backup storageVerify failover and restore in a staging environment

Vector Database Selection and Priority

FastGPT reads environment variables at startup and chooses the first configured driver in this fixed order:

  1. SeekDB (SEEKDB_URL): MySQL-compatible vector driver.
  2. OceanBase (OCEANBASE_URL): OceanBase vector driver; configure compatible server features.
  3. PostgreSQL (PG_URL): Built-in default driver using the pgvector extension.
  4. Milvus (MILVUS_ADDRESS): Requires version 2.5.16+, using the modeldata_v2 collection for unified vector and BM25 full-text storage.
  5. OpenGauss (OPENGAUSS_URL): Enterprise openGauss vector driver.

Deployment Pathways

PathwayScenarioGuide
Docker ComposeSingle-host private deployment, quick staging, and testingDocker Compose Deployment Guide
Sealos Cloud NativeContainer deployment; validate scaling and redundancy separatelySealos Deployment Guide
Source DevelopmentPlatform extension, debugging, and plugin developmentLocal Source Development Guide

Core Configuration and Operations

Edit on GitHub

Last updated

On this page

Put your business knowledge to work with AI

Import company documents and build accurate, reliable, traceable AI answers.