import Header from '../_source-info-header.md';

Setup#

To connect to your SQL database using dlt, follow these steps:

1. Initialize a dlt project in the current working directory by running the following command:

   ⧉

   dlt init sql_database duckdb
   

   This will add necessary files and configurations for a dlt pipeline with SQL database as the source and
   DuckDB as the destination.

2. Add credentials for your SQL database

   To connect to your SQL database, dlt would need to authenticate using necessary credentials. To enable this, paste your credentials in the secrets.toml file created inside the .dlt/ folder in the following format:

   ⧉

   [sources.sql_database.credentials]
   drivername = "mysql+pymysql" # driver name for the database
   database = "Rfam" # database name
   username = "rfamro" # username associated with the database
   host = "mysql-rfam-public.ebi.ac.uk" # host address
   port = "4497" # port required for connection
   

   Alternatively, you can also authenticate using connection strings:

   ⧉

   [sources.sql_database]
   credentials="mysql+pymysql://rfamro@mysql-rfam-public.ebi.ac.uk:4497/Rfam"
   

   To learn more about how to add credentials into your sql_database pipeline, see here.

3. Add credentials for your destination (if necessary)

   Depending on which destination you're loading into, you might also need to add your destination credentials. For more information, read the General Usage: Credentials.

4. Install any necessary dependencies

   ⧉

   pip install -r requirements.txt
   

5. Run the pipeline

   ⧉

   python sql_database_pipeline.py
   

   Executing this command will run the example script sql_database_pipeline.py created in step 1. In order for this to run successfully, you will need to pass the names of the databases and/or tables you wish to load.
   See the section on configuring the sql_database source for more details.

6. Make sure everything is loaded as expected with

   ⧉

   dlt pipeline <pipeline_name> show