SFTP Interface And Interface Listeners

The SFTP interface type is used to define the connections between a secured FTP server (a remote server with an SSH connection) and a data stream.

When creating an Interface Listener for a Broadway flow, an SFTP interface is needed to detect new files added to the remote file system.

To create a new SFTP interface, do the following:

  1. Go to Project Tree > Shared Objects, right click Interfaces, select New Interface and then select SFTP from the File System section to open the New Interface window.

    image

  2. Populate the connection's settings and click Save.

  1. Go to Project Tree > Shared Objects, right click Interfaces, select New Interface and then select SFTP from the Interface Type dropdown menu to open the New Interface window.

  2. Enter a suitable name for your new SFTP Interface, then click Create

    image

  3. Populate the connection's settings and click Save.

    image

Connection Settings

Parameter Description
IP Hostname or IP address of the FTP server.
Port Port. Added on release 6.5.3
User  Username.
Password  Password. 
Remote Directory Directory where the files are stored.
Files Filter Regular expression.
Affinity Affinity (Optional) populate this parameter with the IP address of a Fabric node, DC name, or logical identifier for Fabric nodes.
Actions

Test Connection. Click to test the connection.

Add an Interface Listener as a Broadway job. Click to create an Interface Listener job under the specified Logical Unit.

Example of Using an SFTP Interface

To create an Interface Listener Job that runs on an SFTP interface, do the following:

  1. Create an interface using an SFTP interface type.

  2. Click the Add interface listener as Broadway job link in the Interface window and select the Logical Unit from the list to open the Jobs window.

  3. Create a Broadway flow either under Shared Objects or under the same Logical Unit. The flow reads data from a file using the predefined interface and populates it into the DB.

images

  • Note that the interface and the path input arguments of the FileRead Actor are defined as External link type. Their values are passed from the defined interface by the Listener.
  • In the Jobs window, select the Broadway flow and Execution mode and then save the job.

images

  1. Deploy the LU to activate the Listener.

Using the InterfaceListener Actor

The InterfaceListener Actor enables the flow in which it is instantiated to listen to SFTP or File Systems interfaces and trigger another Broadway flow upon arrival of a new file on the interface.

To create an Interface Listener job from a Broadway flow, add the InterfaceListener Actor to the flow.

images

Fill in the following parameters in the Actor's Properties tab:

  • flowName, the flow to be triggered by the Interface Listener.

  • interfaceName, the interface that is being listened and used to trigger the flow defined above, once a new file is detected on the file system to which the interface points.

  • affinity, sets which node/DC name IP address is to be used to run the Interface Listener job.

  • params, refer to the arguments that can be passed to the flow. For example, multiple parameters can be parsed as a key/value object from an external link or from a Const or JavaScript Actor.

Previous

SFTP Interface And Interface Listeners

The SFTP interface type is used to define the connections between a secured FTP server (a remote server with an SSH connection) and a data stream.

When creating an Interface Listener for a Broadway flow, an SFTP interface is needed to detect new files added to the remote file system.

To create a new SFTP interface, do the following:

  1. Go to Project Tree > Shared Objects, right click Interfaces, select New Interface and then select SFTP from the File System section to open the New Interface window.

    image

  2. Populate the connection's settings and click Save.

  1. Go to Project Tree > Shared Objects, right click Interfaces, select New Interface and then select SFTP from the Interface Type dropdown menu to open the New Interface window.

  2. Enter a suitable name for your new SFTP Interface, then click Create

    image

  3. Populate the connection's settings and click Save.

    image

Connection Settings

Parameter Description
IP Hostname or IP address of the FTP server.
Port Port. Added on release 6.5.3
User  Username.
Password  Password. 
Remote Directory Directory where the files are stored.
Files Filter Regular expression.
Affinity Affinity (Optional) populate this parameter with the IP address of a Fabric node, DC name, or logical identifier for Fabric nodes.
Actions

Test Connection. Click to test the connection.

Add an Interface Listener as a Broadway job. Click to create an Interface Listener job under the specified Logical Unit.

Example of Using an SFTP Interface

To create an Interface Listener Job that runs on an SFTP interface, do the following:

  1. Create an interface using an SFTP interface type.

  2. Click the Add interface listener as Broadway job link in the Interface window and select the Logical Unit from the list to open the Jobs window.

  3. Create a Broadway flow either under Shared Objects or under the same Logical Unit. The flow reads data from a file using the predefined interface and populates it into the DB.

images

  • Note that the interface and the path input arguments of the FileRead Actor are defined as External link type. Their values are passed from the defined interface by the Listener.
  • In the Jobs window, select the Broadway flow and Execution mode and then save the job.

images

  1. Deploy the LU to activate the Listener.

Using the InterfaceListener Actor

The InterfaceListener Actor enables the flow in which it is instantiated to listen to SFTP or File Systems interfaces and trigger another Broadway flow upon arrival of a new file on the interface.

To create an Interface Listener job from a Broadway flow, add the InterfaceListener Actor to the flow.

images

Fill in the following parameters in the Actor's Properties tab:

  • flowName, the flow to be triggered by the Interface Listener.

  • interfaceName, the interface that is being listened and used to trigger the flow defined above, once a new file is detected on the file system to which the interface points.

  • affinity, sets which node/DC name IP address is to be used to run the Interface Listener job.

  • params, refer to the arguments that can be passed to the flow. For example, multiple parameters can be parsed as a key/value object from an external link or from a Const or JavaScript Actor.

Previous