Sources
Planning to use dlt
in production and need a source that isn't listed? We're happy to help you build it: book a call with a dltHub Solutions Engineer.
Core sources
🗃️ Filesystem & cloud storage
AWS S3, Google Cloud Storage, Azure Blob Storage, local file system
🗃️ REST APIs
Load data from any REST API
🗃️ 30+ SQL Databases
PostgreSQL, MySQL, MS SQL, BigQuery, Redshift, and more
Verified sources
Choose from our collection of verified sources, developed and maintained by the dlt
team and community. Each source is rigorously tested against a real API and provided as Python code for easy customization.
If you couldn't find a source implementation, you can easily create your own, check out the resource page to learn how!
📄️ Airtable
dlt verified source for Airtable
📄️ Amazon Kinesis
dlt verified source for Amazon Kinesis
📄️ Arrow Table / Pandas
dlt source for Arrow tables and Pandas dataframes
📄️ Asana
dlt verified source for Asana API
📄️ Chess.com
dlt verified source for Chess.com API
📄️ Facebook Ads
dlt verified source for Facebook Ads
📄️ Freshdesk
dlt verified source for Freshdesk API
📄️ GitHub
dlt verified source for GitHub API
📄️ Google Ads
dlt verified source for Google Ads API
📄️ Google Analytics
dlt verified source for Google Analytics API
📄️ Google Sheets
dlt verified source for Google Sheets API
📄️ Hubspot
dlt verified source for Hubspot API
📄️ Inbox
dlt verified source for Mail Inbox
📄️ Jira
dlt verified source for Atlassian Jira
📄️ Kafka
dlt verified source for Confluent Kafka
📄️ Matomo
dlt verified source for Matomo
📄️ MongoDB
dlt verified source for MongoDB
📄️ Mux
dlt verified source for Mux
📄️ Notion
dlt pipeline for Notion API
📄️ Personio
dlt verified source for Personio API
📄️ Postgres replication
dlt verified source for Postgres replication
📄️ Pipedrive
dlt verified source for Pipedrive API
📄️ OpenAPI source generator
OpenAPI dlt source generator
📄️ Salesforce
dlt pipeline for Salesforce API
📄️ Scrapy
dlt verified source for Scraping using scrapy
📄️ Shopify
dlt pipeline for Shopify API
📄️ Slack
dlt verified source for Slack API
📄️ Strapi
dlt verified source for Strapi API
📄️ Stripe
dlt verified source for Stripe API
📄️ Workable
dlt pipeline for Workable API
📄️ Zendesk
dlt pipeline for Zendesk API
🗃️ REST API helpers
2 items
📄️ Add a verified source
How to create a pipeline from a verified source
What's the difference between core and verified sources?
The main difference between the core sources and verified sources lies in their structure. Core sources are generic collections, meaning they can connect to a variety of systems. For example, the SQL Database source can connect to any database which supports SQLAlchemy.
According to our telemetry, core sources are the most widely used among our users!
It's also important to note that core sources are integrated into the dlt
core library,
whereas verified sources are maintained in a separate repository.
To use a verified source, you need to run the dlt
init command, which will download the verified source code to
your working directory.
Get help
- Source missing? Request a new verified source.
- Missing endpoint or a feature? Request or contribute
- Join our Slack community and ask in the technical-help channel.