In this example, we will walk-through a data integration example of pulling data files from source location such as SFTP, LAN, HTTPS, JMS, API, Email and then parsing the data and loading the data into a table. Table is created on-the-fly based on the flat structure of the source data.
For example, if the source data is a CSV file and has header columns then the resulting table is created with the field names derived from the source file header and all the data is loaded into the table. When subsequent files arrive that are of the same type, the process flow appends the data into the existing table created earlier with the initial file.
Using this example, there is no need to pre-configure a table or create the related Database Target and Database Schema activities in Adeptia Solution, nor it is required to map the source data to the table schema via a data mapper. All of these steps are removed by using this approach.
Let's discuss how to use the dynamic table approach. The activities used for this flow are:
Refer to the video on how to design the process flow.
Click on the Process Flow Variable tab in the Process Designer and add a variable "tablename" with a value as shown below. Table name value can be any name you want to give to the table that is created by the flow.
Refer to the attached DynamicTable script needed for Custom Plugin.