Awesome Big Data
Section: Data Ingestion · distributed publish-subscribe messaging system.
ActiveScore 84
Entry
Kafka
Appears in 6 awesome lists
🛠 - 🐙 - Distributed, fault tolerant, high throughput pub-sub messaging system.
Found in these lists
Awesome Hadoop
Section: Data Ingestion and Integration · Apache Kafka
StaleScore 48
Awesome Microservices
Section: Messaging · Publish-subscribe messaging rethought as a distributed commit log.
FreshScore 87
Awesome Stacks
Section: Streaming Analytics with Kafka, Spark, and Cassandra · 🛠 - 🐙 - Distributed, fault tolerant, high throughput pub-sub messaging system.
StaleScore 54
Useful Java links
Section: 3. Message, message broker and message queue · High-throughput distributed messaging system, License: Apache 2.
ActiveScore 74
Awesome DevOps
Section: Distributed Messaging · Building real-time data pipelines and streaming apps.
FreshScore 87
Often listed next to it
Logstash
Ship logs from any source, parse them, get the right timestamp, index them, and search them. Logstash is a tool for managing events and logs. You can use it to collect logs, parse them, and store them for later use (like, for searching). Speaking of searching, Logstash comes with a web interface…
In 8 listsDetails
RedPanda
| C++ | - Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
In 6 listsDetails
Apache Pulsar
a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.
In 6 listsDetails
ingestr
CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including Postgres, MongoDB, Salesforce, Shopify.
In 6 listsDetails
Bruin
Run and schedule dbt-style SQL transformations without Airflow. Adds data ingestion (50+ sources) and built-in data quality to the transformation layer. Open-source CLI or managed Bruin Cloud for teams who want dbt Cloud-like experience with ingestion included.
In 6 listsDetails
Census
The easiest way to sync your customer data from your cloud data warehouse to SaaS applications like Salesforce, Marketo, HubSpot, Zendesk, etc. Census is the operational analytics platform that syncs your data warehouse with all your favorite apps. Get your customer success, sales & marketing…
In 5 listsDetails
Apache NiFi
Apache NiFi is an integrated data logistics platform for automating the movement of data between disparate systems.
In 5 listsDetails