Skip to content
84

Awesome Public Real-Time Datasets and Sources

A list of publicly available datasets with real-time data maintained by the team at bytewax.io

3k stars274 forks115 entriesLast push Oct 22, 2026 (25 days ago)License CC0-1.0

This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.

Free >Finance/Crypto

Coinbase Market Data

Coinbase websocket to market data including level 2 orderbook data.

Blockchain transactions

Provides real-time notifications about new transactions and blocks.

Yahoo Finance

wss://streamer.finance.yahoo.com/ - This is not advertised in developer documentation, but discoverable as the websocket is used to update their website.

Finnhub

Limited free usage with a premium data sources also available.

Link may be dead

CoinCheck

a cryptocurrency API that has a WebSocket interface (in beta)

Alpaca Markets

Real-Time and historical market data via HTTP and Websocket.

SEC EDGAR

The SEC offers real-time streaming access to regulatory filings (like 10-K, 10-Q, 8-K) as well as real-time XBRL financial data via RESTful APIs and RSS feeds.

In 2 lists

FilingFirehose

Real-time parsed SEC EDGAR filings via REST. Body-text-classified 8-Ks (catches buried cyber and officer-departure events), activist-tagged Schedule 13D/G, ATM-offering detection in S-3 / 424B5. Free public tier covers last 72h, no API key.

In 2 lists

Binance

WebSocket API that delivers real-time cryptocurrency trading data and order book updates

OANDA

HTTP based FOREX rates stream through the OANDA API.

CoinCap

Provides real-time pricing and market activity for over 1,000 cryptocurrencies

In 2 lists

Polygon.io

Provides real‑time stock market and cryptocurrency data from all US exchanges via REST and WebSocket endpoints.

FinancialData.Net

Stock market data, financial statements, insider and institutional trading data, sustainability data, earnings releases, and much more.

In 2 lists

CoinPaprika

Cryptocurrency market data API with real-time prices, OHLCV, and tickers for 12,000+ coins. Free tier, no API key required.

In 6 listsDetails

DexPaprika

DEX data API with pool data, token prices, OHLCV, trade history, and SSE streaming across 36 chains. Free tier, no signup to start, data delayed up to 15s.

In 6 listsDetails

Pyth Network

Delivers financial market data across every asset class through one API.

Sharpe

Real-time crypto market data API covering funding, derivatives, arbitrage, narratives, listings, and news.

In 3 lists

Agent Gateway

Free REST API for real-time prices of 500+ crypto tokens via Hyperliquid. No API key required. Poll GET /prices for live market data.

Link may be dead

OpenChainBench

Open benchmarks of crypto infrastructure (RPC providers, bridges, oracles, L1 finality, prediction-market data, Hyperliquid builders) refreshed every minute via a JSON feed, with daily Parquet snapshots on Hugging Face (CC-BY-4.0) archived on Zenodo. [DOI]

In 7 listsDetails

Korean Market Data

Daily foreign and institutional net flows for every KOSPI/KOSDAQ common stock (2,555 names) plus all 44 KRX sector indices, rebuilt after each Korean market close. English CSV/JSON over raw HTTP, no key. CC BY 4.0, archived on Zenodo [DOI].

CoinNudge

Crypto market-research datasets over HTTP: free no-key JSON/CSV snapshots for market breadth, funding, open interest, liquidations and listings, plus a daily event-study release with self-service keys or Parquet files.

Link may be dead

0xArchive

Real-time Hyperliquid and Lighter market data via REST and WebSocket, with historical data also available. Permanent no-card free tier.

In 3 lists

Eulerpool

Streaming stock quotes (trades, NBBO, 1-second bars, L2) over WebSocket wss://stream.eulerpool.com/v1/subscribe and SSE, plus a REST API for fundamentals, ETFs, macro, crypto and FX. Free keys receive delayed 1-second aggregates; paid keys get live ticks.

Link may be dead

Adanos

Near-real-time stock and crypto sentiment from Reddit, X, financial news, and Polymarket via REST, with a free API tier.

In 2 lists

Free >Transportation

ADSBiq

Community-powered real-time aircraft positions over WebSocket. Sends an initial snapshot followed by sequence-numbered deltas, with optional geographic subscriptions; free access requires no API key.

Open Rail Data

A collection of APIs that provide data relating to the UK rail network, including reference data, train timetables, and live service updates. The live data is streamed using the STOMP protocol.

Link may be dead

GBFS New York

GBFS is the standard for bike share data with many locations around the world. Find more information here

Open Sky Flight

Data from Open Sky Api via HTTP endpoint. Supports real-time, but not streaming. Need to continually poll.

Open Glider Network

The OGN provides real-time traffic for gliders and other light aircraft. You can use an OGN client like python-ogn-client to connect to OGN servers, parse the APRS messages and push them to a broker like Kafka for streaming processing.

MTA GTFS Feed

Transit data in GTFS format for transit systems like NYC subway and Caltrain.

NY 511 live camera data

This live camera data requires some scraping to use. From this list of cameras you can then source the individual camera id and then request the timestamped image or most recent image by building the url like - https://511ny.org/map/Cctv/<image-id-goes-here>

Transport for London (TfL)

live data about the tube, buses, and more

Link may be dead

Norwegian Coastal Administration

AIS data from vessels within the Norwegian economic zone and the protection zones off Svalbard and Jan Mayen. (https://www.kystverket.no/en/sea-transport-and-ports/ais/access-to-ais-data/)

Link may be dead

German Traffic Data

German real-time traffic information

Swiss Traffic & Public Transport Data

Various real-time transport data from Switzerland such road traffic, status of EV charging stations, shared mobility services and live arrivals/departures of public transport

Link may be dead

Transport for NSW API

Real‑time public transport data (buses, trains, ferries) available for New South Wales, Australia

Ireland National Transport Authority

Real-time update stream for services provided by Dublin Bus, Bus Éireann, and Go-Ahead Ireland.

LiveTrafficCam

Live US state DOT traffic camera data as JSON: cameras by state or mountain pass with verified live status from rolling HTTP checks, plus measured per-state camera uptime. No auth.

Free >Information

Wikimedia SSE

Event Stream of recent changes to the wikimedia foundation pages.

Seismic Data

Seismic Portal provides a websocket interface to real-time seismic events.

Open Weather API

Current weather data available free at rate of 1 request per ~90 seconds (only first 1000 API calls per day are free).

In 2 lists

Clima Cell

Real-time weather data in a free or paid API.

NOAA Buoy Data

Real-time buoy data from NOAA

NOAA Weather Data

Live Weather Data API from NOAA

ENSO Historical Dataset

Monthly ENSO data (1950-2026), 126 records with ONI/SOI/subsurface anomalies, CSV+JSON, CC0.

ENSO Tracker Dashboard

Real-time El Niño/La Niña monitoring. ONI, SOI, trade winds, and subsurface temps from NOAA/BOM/ECMWF, updated daily.

Redfin Realestate

pull up to date data from redfin unofficial API.

EPA Airnow data

Air quality data hosted by the EPA.

UK Flood Data

UK government real-time API for flood data.

ZipCheckup

Free REST API for ZIP-level environmental safety data across the US: water quality, air quality, PFAS contamination, radon, lead, flood risk, and 11 more verticals. Covers 42,000+ ZIP codes. No API key required. CC BY 4.0.

Link may be dead

US Energy Grid Data

Real-time grid information for the US energy grid

DC Hub Grid Prices

Free, no-key REST endpoint (https://api.dchub.cloud/api/v1/lmp/prices) returning live 5-minute real-time LMPs for CAISO, ERCOT, MISO, NYISO, PJM and SPP, with per-hub detail at /api/v1/iso-lmp/snapshot. Part of DC Hub, the live data layer for data-center site selection; the same data is available…

USGS Earthquake Real-time Feed

Live seismological data feed to know about earthquakes as they happen

In 3 listsLink may be dead

News API

Aggregator that pulls headlines and articles from dozens of news outlets worldwide in near real time via API. It offers a free tier (with rate limits)

New York Times Newswire API

The Times Newswire API provides an up-to-the-minute stream of articles published on NYTimes.com.

GDELT 2.0 Event Database

Collection of all events happening everywhere in the world, with emotional valence estimation, realtime translations.

Jobven

Job postings read directly from employer career pages and applicant tracking systems, with webhook events when a role opens, changes or closes. Free tier of 300 jobs a month, and one sample endpoint needs no key.

CrustAPI

Live Google News, web search and Maps results as structured JSON, fetched on every request. Free tier of 3,000 credits per month, no credit card.

LottoLens PH PCSO Draw Results

Free, no-key JSON feed of independently compiled Philippine PCSO draw results, refreshed after scheduled draws are source-verified. Poll over HTTP; records include draw date, draw time, and source URL.

Free >Health

Longevity World Cup

Live public biological-age competition dataset with athlete profiles, biomarker records, proof links, placements, and crowd-age fields. Free JSON over HTTP; no API key required.

Urgences Québec

Live stretcher occupancy and waiting-room counts for every emergency room in Quebec, refreshed from the ministry feed every 15 minutes. JSON over HTTP with no API key needed, and there's an hourly history endpoint per hospital back to August 2026.

AlertX Outbreak Signal Clusters

Clusters of outbreak-shaped public health signals worldwide, rebuilt hourly, with syndrome and disease triage, confidence scores, and whether an official health authority later confirmed the event. Free JSON over HTTP, no API key required; aggregated to WHO region.

Free >IoT

ThingSpeak IoT Public Channels

Crowdsourced IoT channels of users publishing various IoT sensor data in real-time. Accessible via REST API or MQTT API.

Sensor.Community

15,000+ air quality sensors worldwide, REST API.

Free >Cybersecurity

Certstream

Certstream provides a publicly accessible real‐time feed of certificate transparency logs, delivering live updates on SSL/TLS certificate issuance as it occurs.

Free CertStream API

Free hosted WebSocket stream of newly issued TLS certificates and their domain names from Certificate Transparency logs, at wss://api.certstream.dev/. No API key required.

URLhaus

Community-driven repository for real-time malicious URL data, offering actionable threat intelligence to block phishing and malware.

In 2 lists

CISA Automated Indicator Sharing (AIS)

US government-led service that enables public and private organizations to exchange machine-readable threat indicators in real time.

Open Threat Exchange (OTX)

Community-driven threat intelligence platform that streams real-time data on malicious IPs, domains, and URL through the OTX DirectConnect API.

Link may be dead

Shodan Streaming API

Real-time feed of devices/banners discovered on the internet. Free tier available.

GreyNoise Community API

Free IP intelligence lookups for identifying mass scanners and background noise on the internet.

Link may be dead

Free >Development & Testing

Lenses Datagen

Open-source (Apache 2.0) synthetic streaming data generator by Lenses.io. Publishes to Kafka, Pulsar, or any target system. Ships with rich built-in datasets including sea vessel position reports (AIS), NYC taxi trips, telecom Italia network data, IoT device temperature readings, and more.

Mockingbird by Tinybird

Open-source mock streaming data generator. Pairs well with EventSim which is already listed.

SSE.dev

Public SSE test endpoint with configurable intervals. Useful for streaming pipeline testing.; https://sse.dev/test?interval=5000

Link may be dead

Free >AI/ML

AI Detector Arena

Live leaderboard and benchmark dataset for evaluating AI-generated image detectors. Real-time rankings updated as new detectors are evaluated against 2,038 images across 17 AI generators. Data accessible via HTTP API. [DOI]

Free >Sports

World Cup 2026 Tour

Free HTTP API for current 2026 World Cup match-day fixtures, next-match polling, RSS, and calendar feeds. No API key required.

Live Tennis API

Live match state for ATP, WTA, Challenger and ITF over REST: sets, games, points, who is serving and tiebreak flag, plus fixtures and results. Free tier requires a key but no card (30 requests/minute, 100/day); the WebSocket push feed is a paid tier. Open studies dataset (CC BY 4.0) at…

In 3 lists

Lichess TV Feed

Live chess games streamed as NDJSON (https://lichess.org/api/tv/feed) or SSE, per channel (blitz, bullet, rapid, etc.). No authentication. Full game history available under CC0 at database.lichess.org.

MLB Stats API

Unofficial access to MLB's live game feed with pitch-by-pitch play data (statsapi.mlb.com/api/v1.1/game/{gamePk}/feed/live), plus a diffPatch endpoint for incremental updates. No key.

NHL Web API

Undocumented JSON API behind NHL.com (api-web.nhle.com/v1) for live scores, schedules and play-by-play. No key; endpoints may change between seasons.

football-data.org

REST API for fixtures, results and standings across 12 major football competitions on a permanent free tier (10 calls/min, delayed scores); live scores on paid tiers.

Link may be dead

Betfair Exchange Stream API

Push-based stream of betting exchange prices across football, tennis, horse racing and more. Free delayed key for development; requires a Betfair account.

Link may be dead

The Odds API

Live and upcoming odds from multiple bookmakers across many sports via REST. Free tier of 500 requests per month.

Free >Other

US National Parks Live Status (Park Atlas)

Live alerts, entrance fees, reservation requirements, webcams, and conditions for all 474 US National Park System units, aggregated nightly from official federal APIs. Bulk CSV snapshots: park-atlas-data. No key required.

GitHub Events

Use the GitHub API to consume public events happening on GitHub.

EventSim

Tool to simulate event data

Formula 1 Stats & Telemetry

Python package that provides an easy-to-use API into live and historical F1 data.

In 2 lists

International Space Station Live Data

More about the project on GitHub https://github.com/ISS-Mimic/Mimic

Live Satellite Positions

N2YO.COM allows tracking of satellites through REST API with the NORAD catalog number assigned by the United States Space Command.

Hacker News

Near real-time news feed from Hacker News for tech and startup-related topics.

In 2 lists

Bluesky

Firehose is an authenticated stream of events on the protocol that underlies Bluesky, enabling efficient syncing of user updates via a WebSocket connection.

SpaceX API

Open-source REST API for SpaceX launches, rockets, capsules, landing pads.

In 2 lists

OpenF1

Free and open-source API for real-time and historical Formula 1 data, including telemetry, lap timings, race control messages, weather, pit stops, team radio, and standings

Paid >Finance/Crypto

Data Bento

Data Bento provides low-latency market data from many exchanges in several schemas. Access over Raw API, which uses a binary protocol over TCP, and our HTTP API. They also provide client libraries for Rust, Python, and C++.

IEX Trading

IEX was created in response to questionable trading practices that had become widely used across traditional exhcanges! Their API provides streaming Stock market data.

NYSE Cloud Streaming

Provides real-time access to high-quality NYSE exchange data feeds, streaming directly in the cloud using Kafka format.

Alpha Vantage Market News & Sentiment

Live market news & sentiment data from selected news outlets covering stocks, cryptocurrencies, forex, and a wide range of topics such as fiscal policy, mergers & acquisitions, IPOs, etc.

Bloomberg

The Bloomberg Market Data Feed (B-PIPE) provides consolidated, normalized market data in real time.

Paid >Cybersecurity

Kaspersky Threat Data Feeds

Kaspersky Threat Data Feeds deliver continuously updated, real‐time threat intelligence by aggregating data from diverse sources.

Bitdefender Threat Intelligence Feeds

A comprehensive suite of real-time, curated threat data streams that deliver actionable insights on malicious domains, IP addresses, URLs, file hashes, and vulnerabilities.

ANY.RUN Threat Intelligence Feeds

Near real-time feeds generated from interactive malware sandbox sessions, providing deep insights into malware behaviors and associated indicators of compromise (IoCs).

Deepinfo Data Feeds

Real-time updates on domain registrations, subdomain discoveries, and DNS changes accesible via REST-based web services.

Paid >Transportation

AIS Data

Maritime, Aviation and weather data available via Spire.

FlightAware Firehose

Real-time data feed of global aircraft ADS-B positions and flight status.

Spire Data Services

Global maritime vessel tracking, combining Satellite automatic identification systems (AIS), Terrestrial AIS, and Dynamic AIS.

Paid >Information

PurpleAir Air Quality Data

Developer API for accessing purple air sensor data.

NewsAPI

NewsAPI tracks headlines in 7 categories across over 50 countries, and at over a hundred top publications and blogs, in near real time. Free developer version with 24 delays available.

X (Twitter)

X provides a streaming interface for research or enterprise.

Xquik

REST and MCP access for X/Twitter search, profiles, followers, monitors, webhooks, and bulk extraction workflows.

In 5 listsDetails

Bing News Search API

Bing News Search API returns fresh news results from various sources in near real time

Link may be dead

Reuters News API

Low latency news feed from Reuters

webz.io

webz.io provides API with real-time information from thousands of news sites, blogs, and discussion forums.

Mediastack

JSON API delivering worldwide news, headlines and blog articles in real-time

Paid >Sports

Sports Livescores

Developer API of TheSportsDB that gives you access to livescores

Sportradar Sports Data

Global live data of 80 sports, 500 sport leagues and 750k events a year (free 30 day trial available)

See category
93

Awesome Data Engineering

igorbarinov/awesome-data-engineering

A curated list of data engineering tools for software developers

Fresh★ 9.3k326 entriesPushed 5 days ago
90

Awesome Big Data

oxnr/awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

Fresh★ 15k671 entriesPushed 2 days ago
90

Awesome Public Datasets

awesomedata/awesome-public-datasets

A topic-centric list of HQ open datasets.

Fresh★ 80k3 entriesPushed today
83

Awesome Ada

ohenley/awesome-ada

A curated list of awesome resources related to the Ada and SPARK programming language

Fresh★ 880431 entriesPushed yesterday
80

Awesome Streaming

manuzhang/awesome-streaming

a curated list of awesome streaming frameworks, applications, etc

Fresh★ 3k1 entriesPushed today
74

Awesome ETL

pawl/awesome-etl

A curated list of awesome ETL frameworks, libraries, and software.

Slow★ 3.6k65 entriesPushed 6 months ago