Event Archival

Connect iPaaS Event Archival allows you to save and archive event history to AWS S3 and/or MySQL database. This is the same event information that is available on the Observe Pane on Connect iPaaS in real-time.

Event archival set up can be done on the User Profile page. Users can select the archival method or the destination i.e. AWS S3 and/or MySQL database. While setting up the event archival, you can choose the archival frequency of 4 hours, 8 hours, 12 hours, or 24 hours time interval.

On the user profile page, you will also be able to choose whether to enable or disable archival for all flows. This will be the DEFAULT setting which can be overridden for a specific workflow at the flow design time or from the Manage Pane.

AWS S3 Archival Settings

To enable events archival using AWS S3, you will need to set up a connection with AWS S3 on the User Profile page. You can do so by clicking the Link AWS S3 Account button where you will need to provide AWS access key and the secret key.

Figure 1. AWS S3 Archival Connection Setup on the User Profile Page

Upon setting up the AWS S3 connection, you can configure the following parameters for the event archival.

• S3 Bucket Name
• Folder name within the bucket
• Archival frequency
• Toggle AWS S3 archival on or off as default for all the flows

Figure 2. Setup AWS S3 Archival Parameters on User Profile Page

Once you setup the AWS S3 event archival on the User Profile page, these settings will be visible on each of the workflows just before you deploy the flow. You will be able to override the default AWS S3 archival settings for a specific flow being deployed as shown in the image below. Here you can also toggle on or off the event archival for that specific flow.

Figure 3. AWS S3 Archival Parameters on the Individual Workflow During Flow Deployment

MySQL Archival setting

You can also use MySQL as the storage for the event history archival. To enable events archival using MySQL, you will need to set up a connection with MySQL on the User Profile page. You can do so by clicking Link MySQL Account where you will need to provide the Hostname, Port, Database Name, Username, and Password to set up the connection.

Figure 4. MySQL Event Archival Settings on Connect iPaaS User Profile Page

Upon setting up the MySQL connection, you can configure the frequency for the event archival. You can also copy the DDL (Data Definition Language) SQL query to create an event archival table in your MySQL database as shown in the image below.

Figure 5. Setup MySQL Event Archival parameters on User Profile Page

Once you set up the MySQL event archival on the User Profile page, these settings will be visible on each of the workflows just before you deploy the flow. You will be able to override the default MySQL event archival settings for the specific flow being deployed as shown in the image below. Here you can also toggle on or off the event archival for that specific flow.

Figure 6. MySQL Event Archival Settings on the Individual Workflow During Flow Deployment

Toggle Event Archival for Individual Flows on Manage Page

Connect iPaaS Manage page provides a global toggle button at the top to Enable or Disable event archival for all the flows. In the card view and the list view on the Manage page, it also provides a toggle button on each flow to turn on or off event archival for that specific flow.

Refer to the image below where these toggle buttons are marked in red.

Figure 7. Event Archival Toggle Options on the Manage Page for Individual and All Flows