Awesome Big Data
Section: Data Ingestion · log management platform for collecting, storing, searching, and alerting on machine data.
Entry
Appears in 5 awesome lists
Centralizes logs and provides alerting and dashboards through a polished interface. Licensed under the Server Side Public License (SSPL), best described as open-core or source-available. Graylog 7.0 introduced an experimental Model Context Protocol (MCP) endpoint allowing LLM clients to connect…
Section: Data Ingestion · log management platform for collecting, storing, searching, and alerting on machine data.
Section: Logging · Fully integrated open source log management platform.
Section: SIEM & Log Analysis · Centralizes logs and provides alerting and dashboards through a polished interface. Licensed under the Server Side Public License (SSPL), best described as open-core or source-available. Graylog 7.0 introduced an experimental Model Context Protocol (MCP) endpoint allowing LLM clients to connect…
Section: Log Monitoring · Open source log management with search, dashboards and alerts. Self-hosted
Section: 6. Useful libraries · Open-source aggregator suited for extended role and permission management. License: GNU 3.
Infrastructure for log storage, processing, and visualization rather than a complete SIEM. Elastic relicensed Elasticsearch and Kibana back to open source in 2024 under a dual license: AGPL-3.0 or Elastic License 2.0, with the core stack freely available under AGPL. However, SIEM-relevant features…
Snort is a free and open source network intrusion prevention system (NIPS) and network intrusion detection system (NIDS)created by Martin Roesch in 1998. Snort is now developed by Sourcefire, of which Roesch is the founder and CTO. In 2009, Snort entered InfoWorld's Open Source Hall of Fame as one…
is a tool for managing events and logs. When used generically, the term encompasses a larger system of log collection, processing, storage and searching activities.
Log collector and forwarder, not a SIEM. Gathers logs from many sources and routes them to other systems for processing, integrating cleanly with Elasticsearch, OpenSearch, Splunk, and Snowflake. Does not perform threat detection, correlation, or alerting, and has no storage layer. Highly…
🛠 - 🐙 - Distributed, fault tolerant, high throughput pub-sub messaging system.
CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including PostgreSQL, MongoDB, Salesforce, Shopify.
Run and schedule dbt-style SQL transformations without Airflow. Adds data ingestion (50+ sources) and built-in data quality to the transformation layer. Open-source CLI or managed Bruin Cloud for teams who want dbt Cloud-like experience with ingestion included.
a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.