Awesome Big Data
Section: Data Ingestion ยท distributed publish-subscribe messaging system.
Entry
Appears in 6 awesome lists
๐ - ๐ - Distributed, fault tolerant, high throughput pub-sub messaging system.
Section: Data Ingestion ยท distributed publish-subscribe messaging system.
Section: Data Ingestion and Integration ยท Apache Kafka
Section: Messaging ยท Publish-subscribe messaging rethought as a distributed commit log.
Section: Streaming Analytics with Kafka, Spark, and Cassandra ยท ๐ - ๐ - Distributed, fault tolerant, high throughput pub-sub messaging system.
Section: 3. Message, message broker and message queue ยท High-throughput distributed messaging system, License: Apache 2.
Section: Distributed Messaging ยท Building real-time data pipelines and streaming apps. oss
is a tool for managing events and logs. When used generically, the term encompasses a larger system of log collection, processing, storage and searching activities.
| C++ | - Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including PostgreSQL, MongoDB, Salesforce, Shopify.
Run and schedule dbt-style SQL transformations without Airflow. Adds data ingestion (50+ sources) and built-in data quality to the transformation layer. Open-source CLI or managed Bruin Cloud for teams who want dbt Cloud-like experience with ingestion included.
a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.
The easiest way to sync your customer data from your cloud data warehouse to SaaS applications like Salesforce, Marketo, HubSpot, Zendesk, etc. Census is the operational analytics platform that syncs your data warehouse with all your favorite apps. Get your customer success, sales & marketingโฆ
Apache NiFi is an integrated data logistics platform for automating the movement of data between disparate systems.
Centralizes logs and provides alerting and dashboards through a polished interface. Licensed under the Server Side Public License (SSPL), best described as open-core or source-available. Graylog 7.0 introduced an experimental Model Context Protocol (MCP) endpoint allowing LLM clients to connectโฆ