Assembly Line

AIStore

AIStore: scalable storage for AI applications

AIStore is an open-source object storage project on GitHub under the MIT license (permissive), with 2k stars. It is built with Go and CPython. Its last push was today.

Stars
2k
License
MIT
Activity
Active
Latest release
v1.5.2

Code on GitHub Website

Judgement

What it is
Building block
What it does
A distributed storage cluster from NVIDIA for AI workloads that serves an S3-compatible API, caches remote cloud buckets and runs data transformations close to the data.
Adopt it when
You train models on large datasets and need fast, scalable reads, either as primary storage or as a cache in front of cloud buckets.
Watch out
It is specialised for AI data pipelines and its community outside NVIDIA is small.
Ready for
Usable
Runs as
Self-hosted server and library
Built with
Go and Python
How established
Established: started 9 years ago, latest release v1.5.2.
What the license allows
You can build it into a product you sell, as long as you keep its copyright notice.

Judged on 2026-11-06 from the project's README and GitHub data. The license and age lines are worked out directly.

Built from

Follow it down: AIStore → Go → runs on a microchip

How compilers were built, back to punched paper tape

Open-source alternatives to AIStore

  1. 1
    SeaweedFS seaweedfs

    SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

    Building block Production-ready You need self-hosted S3-compatible storage for very many small files and want one system for both object and file access.

    ★ 36k Apache-2.0 Go Active, pushed today
  2. 2
    RustFS rustfs

    RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.

    Building block Usable You need self-hosted S3 storage under Apache 2.0 now that MinIO has moved away from its open-source edition.

    ★ 36k Apache-2.0 Rust Active, pushed today
  3. 3
    Parse Server parse-community

    Parse Server for Node.js / Express

    Framework or platform Production-ready You want a mature, self-hosted app backend with SDKs for many platforms, or you are migrating an old Parse app.

    ★ 21k Apache-2.0 JavaScript Active, pushed today
  4. 4
    JuiceFS juicedata

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    Building block Production-ready You need a shared filesystem across servers or Kubernetes pods backed by cheap object storage, for example for AI training data.

    ★ 15k Apache-2.0 Go Active, pushed today
  5. 5
    GreptimeDB GreptimeTeam

    The open-source observability database. One columnar engine for metrics, logs, and traces, on object storage.

    Building block Usable You want one cost-efficient store for all observability data instead of separate metric and log databases.

    ★ 6.8k Apache-2.0 Rust Active, pushed today
  6. 6
    Mountpoint for Amazon S3 awslabs

    A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

    Developer tool Production-ready Your data-processing or ML jobs read large files from S3 and you want filesystem access without copying the data first.

    ★ 5.8k Apache-2.0 Rust Active, pushed yesterday
  7. 7
    CubeFS cubefs

    cloud-native distributed storage

    Building block Production-ready You run large on-premise data platforms and need one shared storage layer for Hadoop, Kubernetes and S3 clients.

    ★ 5.7k Apache-2.0 Go Active, pushed today
  8. 8
    Garage deuxfleurs-org

    (Mirror) S3-compatible object store for small self-hosted geo-distributed deployments. Main repo: https://git.deuxfleurs.fr/Deuxfleurs/garage

    Building block Usable You want replicated S3 storage across a few machines in different locations, such as homelabs or small organisations, without running Ceph.

    ★ 4.8k AGPL-3.0 Rust Active, pushed 12 days ago

Stars, license and activity come from GitHub and refresh on a rolling hourly schedule. The project's own description is quoted as written.