Vaex

Judgement

What it is

Building block

What it does

A Python DataFrame library that memory-maps HDF5 and Arrow files to compute statistics and plots on billions of rows without loading them into RAM.

Adopt it when

You need to explore very large tabular files on one machine and they are already in HDF5 or Arrow format.

Watch out

Real development has largely stopped since its company pivoted, and Polars or DuckDB now cover most of its uses.

Ready for

Usable

Runs as

Library

Built with

Python, C++, Apache Arrow and HDF5

How established

Established: started 12 years ago, latest release vaexpaper_v1.

What the license allows

You can build it into a product you sell, as long as you keep its copyright notice.

Judged on 2026-11-06 from the project's README and GitHub data. The license and age lines are worked out directly.

Built from

Follow it down: Vaex → CPython → GCC → LLVM project → runs on a microchip

How compilers were built, back to punched paper tape

Open-source alternatives to Vaex

1. 1
   pandas pandas-dev

   Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

   Building block Production-ready You analyse spreadsheets, CSVs or database extracts in Python.

   ★ 50k BSD-3-Clause Python Active, pushed today
   
2. 2
   DuckDB duckdb

   DuckDB is a high-performance analytical database system

   Building block Production-ready You analyse data that fits on one machine and want fast SQL without running a server.

   ★ 43k MIT C++ Active, pushed 6 days ago
3. 3
   Polars pola-rs

   Extremely fast Query Engine for DataFrames, written in Rust

   Building block Production-ready Your pandas workloads are slow or run out of memory on a single machine and you can rewrite them in Polars' expression API.

   ★ 40k MIT Rust Active, pushed today
   
4. 4
   marimo marimo-team

   A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

   Developer tool Usable Notebooks need to live in git, rerun reproducibly and double as small internal data apps without moving to Streamlit.

   ★ 23k Apache-2.0 Python Active, pushed today
   
5. 5
   PyGWalker Kanaries

   PyGWalker: Turn your dataframe into an interactive UI for visual analysis

   Developer tool Usable Data analysts want to explore a DataFrame visually without writing plotting code.

   ★ 16k Apache-2.0 Python Active, pushed 2 months ago
6. 6
   JupyterLab jupyterlab

   JupyterLab computational environment.

   Developer tool Production-ready Data teams work in notebooks all day and want several notebooks, consoles and files open side by side, with extensions installed from PyPI.

   ★ 15k BSD-3-Clause TypeScript Active, pushed today
7. 7
   Jupyter Notebook jupyter

   Jupyter Interactive Notebook

   Developer tool Production-ready Analysts or researchers want the familiar single-document notebook interface for exploring data and sharing worked examples.

   ★ 13k BSD-3-Clause Jupyter Notebook Active, pushed 6 days ago
   
8. 8
   cuDF NVIDIA

   cuDF - GPU DataFrame Library

   Building block Production-ready You process large tabular data and have NVIDIA GPUs available, especially to speed up existing pandas or Polars code.

   ★ 9.8k Apache-2.0 C++ Active, pushed today