Assembly Line

Lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides a universal API for building parallel applications in the cloud β˜οΈπŸš€

Lithops is an open-source object storage project on GitHub under the Apache-2.0 license (permissive), with 371 stars. It is built with CPython, Redis, NumPy and pandas. Its last push was 6 days ago.

Stars
371
License
Apache-2.0
Activity
Active
Latest release
3.9.0

Code on GitHub Website

Judgement

What it is
Framework or platform
What it does
A Python framework that runs unmodified functions in parallel across serverless platforms, Kubernetes and VMs on many clouds, using object storage for data exchange.
Adopt it when
You have embarrassingly parallel Python work, such as data processing or simulations, and want to burst it onto cloud functions.
Watch out
It comes from a research setting with a small community, and serverless limits on memory and run time still apply.
Ready for
Usable
Runs as
Library and command line
Built with
Python, Redis and Flask
How established
Established: started 8 years ago, latest release 3.9.0.
What the license allows
You can build it into a product you sell, as long as you keep its copyright notice.

Judged on 2026-11-06 from the project's README and GitHub data. The license and age lines are worked out directly.

Built from

Follow it down: Lithops β†’ CPython β†’ GCC β†’ LLVM project β†’ runs on a microchip

How compilers were built, back to punched paper tape

Open-source alternatives to Lithops

  1. 1
    SeaweedFS seaweedfs

    SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

    Building block Production-ready You need self-hosted S3-compatible storage for very many small files and want one system for both object and file access.

    β˜… 36k Apache-2.0 Go Active, pushed today
  2. 2
    RustFS rustfs

    RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.

    Building block Usable You need self-hosted S3 storage under Apache 2.0 now that MinIO has moved away from its open-source edition.

    β˜… 36k Apache-2.0 Rust Active, pushed today
  3. 3
    Parse Server parse-community

    Parse Server for Node.js / Express

    Framework or platform Production-ready You want a mature, self-hosted app backend with SDKs for many platforms, or you are migrating an old Parse app.

    β˜… 21k Apache-2.0 JavaScript Active, pushed today
  4. 4
    JuiceFS juicedata

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    Building block Production-ready You need a shared filesystem across servers or Kubernetes pods backed by cheap object storage, for example for AI training data.

    β˜… 15k Apache-2.0 Go Active, pushed today
  5. 5
    GreptimeDB GreptimeTeam

    The open-source observability database. One columnar engine for metrics, logs, and traces, on object storage.

    Building block Usable You want one cost-efficient store for all observability data instead of separate metric and log databases.

    β˜… 6.8k Apache-2.0 Rust Active, pushed today
  6. 6
    Mountpoint for Amazon S3 awslabs

    A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

    Developer tool Production-ready Your data-processing or ML jobs read large files from S3 and you want filesystem access without copying the data first.

    β˜… 5.8k Apache-2.0 Rust Active, pushed yesterday
  7. 7
    CubeFS cubefs

    cloud-native distributed storage

    Building block Production-ready You run large on-premise data platforms and need one shared storage layer for Hadoop, Kubernetes and S3 clients.

    β˜… 5.7k Apache-2.0 Go Active, pushed today
  8. 8
    Garage deuxfleurs-org

    (Mirror) S3-compatible object store for small self-hosted geo-distributed deployments. Main repo: https://git.deuxfleurs.fr/Deuxfleurs/garage

    Building block Usable You want replicated S3 storage across a few machines in different locations, such as homelabs or small organisations, without running Ceph.

    β˜… 4.8k AGPL-3.0 Rust Active, pushed 12 days ago

Stars, license and activity come from GitHub and refresh on a rolling hourly schedule. The project's own description is quoted as written.