Source Module
Overview
The Source Module is used to manage data source connectors within the DataFloem platform.
A Source represents a connection to an external data source that can be used by DataFloem to read, transfer, process, or analyze data. Before a data source can be used within a workflow, it must first be registered in the Source Module.
The module supports multiple connector types, allowing DataFloem to connect to a wide variety of storage systems and databases.
Currently supported connector types include:
- Relational Databases (RDBMS)
- NoSQL Databases
- Cloud Databases
- Object Storage
- Cloud Storage
When the system is installed for the first time, the Source list is empty. Administrators must register the required data source connectors before they can be used by Projects, Jobs, or Code Flows.
Access Requirements
To access this page, the user must have at least the GET permission for the Sources module.
If you do not have the required permission, ask your administrator to grant it from one of the authorization pages below.
Authorization
Users without the required permission cannot view this page and will receive the following authorization error:
Access Denied
You don't have access to this resource.
Managing Sources
This page displays all registered Source connectors in the system.
From this page you can:
- View all registered Source connectors.
- Search and filter the Source list.
- Create new Source connectors.
- Update existing Source configurations.
- Remove Source connectors.
- Manage the active status of a Source.
Source Information
Each Source contains the following information.
| Field | Description |
|---|---|
| Connection Name | Name of the Source connector. |
| Connection Type | Type of connector (RDBMS, Object Storage, Cloud Storage, Cloud Database, NoSQL). |
| Database Name | Name of the connected database or storage resource. |
| Database Type | Database or storage engine and its version. |
| Create Date | Date and time when the Source was created. |
| Update Date | Date and time of the most recent update. |
| Status | Indicates whether the Source is active or inactive. |
Supported Connector Types
The Source Module currently supports the following connector categories:
- RDBMS (Microsoft SQL Server, PostgreSQL, MySQL, Oracle, etc.)
- Object Storage
- Cloud Storage
- Cloud Database
- NoSQL Database
Additional connector types may be added in future releases.
Notes
- Every Source represents a reusable connector configuration.
- Sources can be shared across multiple Projects, Jobs, and Code Flows.
- Source connectors must be configured before they can be used within workflows.
- A newly installed DataFloem system does not contain any predefined Source connectors.