Data sources in Pliable are external data repositories, such as databases, CSV files, or cloud data warehouses (e.g., Snowflake). These serve as the starting point for building your data model in the semantic layer. Connecting a data source allows Pliable to import raw data, which can then be cleaned, modeled, and analyzed.

Adding a Data Source

To add a new data source, navigate to Sources and choose from the available options under “Enabled Sources”. You can either upload a Flat File or connect your existing Snowflake Table. Then, follow the necessary connection details and preview a sample of your data. If it looks good, you can click on “Looks Good”. Finally, you can name and describe your data source and Pliable will automatically build out your source node.

image.png

Supported Data Sources

Source Description
Flat File Upload any file readable by Excel (i.e. CSV format).
Snowflake Connect to your Snowflake data warehouse.
Other Custom integrations (contact [email protected]).

Data Source Nodes

Data source Nodes contain the raw data we’ve extracted from your Snowflake instance. We’ll let you know how many rows we found and how recently the we’ve checked for new records.

Screenshot 2024-04-09 at 5.40.13 PM.png

Configure your data source in the Configure tab. Pliable needs to know the primary or unique key for your table so we know how to search for new records.

We’ll also need you to set the Last Modified Column with a date field so Pliable can recognize when a record has been updated.

<aside> 📎 a note from dan: Your primary key can be a single field or you can use multiple fields to create a composite key. See below for an example of what a composite key looks like

</aside>

Untitled

There are two tabs in the detail view in the center of the screen. The View Data tab shows you the raw data we’ve extracted from your source data. Click on column headers to sort the table or use the Search bar at the top right of your screen to find a particular value.