Skip to content

Entry

ingestr

Appears in 6 awesome lists

CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including PostgreSQL, MongoDB, Salesforce, Shopify.

Open github.combruin-data/ingestr

Found in these lists

Awesome Apache Airflow

Section: Libraries, Hooks, Utilities · CLI tool to copy data between any source and destination with a single command. Use with BashOperator to load data from 50+ sources (Postgres, MongoDB, Salesforce, etc.) into your warehouse.

FreshScore 81

Awesome Big Data

Section: Data Ingestion · CLI tool for copying data between sources and destinations.

FreshScore 90

Awesome Data Engineering

Section: Data Ingestion · CLI tool to copy data between databases with a single command. Supports 50+ sources including PostgreSQL, MySQL, MongoDB, Salesforce, Shopify to any data warehouse.

FreshScore 93

Awesome dbt

Section: Orchestration & Ingestion · CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including PostgreSQL, MongoDB, Salesforce, Shopify.

FreshScore 83

Awesome DuckDB

Section: Integrations · CLI tool to copy data between databases and SaaS sources, with DuckDB supported as both a source and a destination.

FreshScore 91

Awesome ETL

Section: Libraries · "a CLI tool to copy data between any databases with a single command seamlessly."

SlowScore 74

Logstash

is a tool for managing events and logs. When used generically, the term encompasses a larger system of log collection, processing, storage and searching activities.

In 7 listsDetails

Fluentd

Log collector and forwarder, not a SIEM. Gathers logs from many sources and routes them to other systems for processing, integrating cleanly with Elasticsearch, OpenSearch, Splunk, and Snowflake. Does not perform threat detection, correlation, or alerting, and has no storage layer. Highly…

In 6 listsDetails

Kafka

🛠 - 🐙 - Distributed, fault tolerant, high throughput pub-sub messaging system.

In 6 listsDetails

Bruin

Run and schedule dbt-style SQL transformations without Airflow. Adds data ingestion (50+ sources) and built-in data quality to the transformation layer. Open-source CLI or managed Bruin Cloud for teams who want dbt Cloud-like experience with ingestion included.

In 6 listsDetails

Apache Pulsar

a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.

In 6 listsDetails

Census

The easiest way to sync your customer data from your cloud data warehouse to SaaS applications like Salesforce, Marketo, HubSpot, Zendesk, etc. Census is the operational analytics platform that syncs your data warehouse with all your favorite apps. Get your customer success, sales & marketing…

In 5 listsDetails

Apache NiFi

Apache NiFi is an integrated data logistics platform for automating the movement of data between disparate systems.

In 5 listsDetails

Graylog

Centralizes logs and provides alerting and dashboards through a polished interface. Licensed under the Server Side Public License (SSPL), best described as open-core or source-available. Graylog 7.0 introduced an experimental Model Context Protocol (MCP) endpoint allowing LLM clients to connect…

In 5 listsDetails