😎🔥A selection of tools for Big Data processing

Timeplus Proton is a ClickHouse-based SQL engine designed to process, route, and analyze streaming data from sources such as Apache Kafka and Redpanda, with the ability to transfer aggregated data to other systems.

qsv is a command-line utility designed for quickly indexing, processing, analyzing, filtering, sorting, and merging CSV files. It offers convenient and understandable commands for performing these operations.

WrenAI is an open-source tool that prepares an existing database for working with RAG (Retrieval-Augmented Generation). It allows you to transform text queries into SQL, explore data from the database without writing SQL code, and perform other tasks.

Groll is an open-source CLI utility for managing schema migrations in PostgreSQL. It provides safe and reversible changes, supporting multiple schema versions at the same time. Groll supports complex migrations, ensuring that client applications do not stop working while updating the database schema.

Valkey is a high-performance open-source data warehouse that supports caching, message queues, and can be used as a primary database. It operates as a standalone background service or as part of a cluster, providing replication and high availability.

DataEase is an open-source BI tool for creating interactive visualizations and analyzing business metrics. It simplifies access to analytics with an intuitive drag-and-drop interface, making working with data convenient and understandable.

SurrealDB is a modern multi-model database that combines SQL, NoSQL, and graph databases. It supports relational, document, graph, temporal, and key-value data models, providing a unified solution for managing data without the need for different platforms.

LibSQL is a fork of SQLite, extended with features such as HTTP and gRPC query processing, and transparent replication support. It allows you to create distributed databases with writes on the primary server and reads from replicas. LibSQL provides secure data transfer via TLS and provides a Docker image for easy deployment.

Redash is an open-source data analytics tool designed to simplify connecting, querying, and visualizing data from a variety of sources. It allows you to create SQL and NoSQL queries, visualize results in the form of graphs and charts, and share dashboards with teams.