Getting Started
Basic Concepts
Tutorials
Advanced Concepts
How-to Guides
Building integration flows
Data transformation
Integration patterns
Developing Components
Tenant Management
Components
CRM Components
ERP Components
E-Commerce Components
Basic Components
Utility Components
References
Sailor
Component Descriptor
Covered in this article
Related articles
Contracts and Workspaces Understanding credentials Data Sample Overview Creating your first integration flow Getting Started What is an integration component? What is an integration flow? What is a tenant? Take a tour of the product Creating a webhook flow Building a component in Java Building a component in Node.js Content-Based Routing Deploying a component How-to Guides Managing flow history Managing OAuth Clients Managing user roles in a tenant Managing Workspaces Mapping data Building real-time flows Sending data to a list of recipients REST API component Managing your SSH keys Managing your Teams/Components Allmysms component Amazon MWS component AMQP component AppDirect Component AWS Lambda component AWS SNS component Bazaarvoice component ChannelAdvisor component Code component Configuration component CSV component Docusign component Dun-and-bradstreet component Ebay component Edifact-parser component Email component Exact Online component Filter component Google PubSub component Google-shopping component Google-translate component Goto-webinar component Google Spreadsheets component Components JDBC Component JDBC Component JDBC Component Jsonata component Key-value-component component Ldap component Lightspeed-ecom component Lightspeed-retail component Lionbridge-translation component Magento1 component Magento2 component Mailchimp component Mandrillapp component Mapper component Microsoft Dynamics CRM component MsSQL component NetSuite component ODATA component Outlook component Petstore-nodejs component Pipedrive component Postgresql component Quickbooks-component component Request-reply component Rest API component Router component Salesforce-cpq component Salesfoce Component Sdl-translate component Shopify-admin component Shopware component Simple-trigger component Smarty-streets component Soap component Splitter component Stripe component Sugar-crm component Timer component Twitter component Webhook component Xml component Component Descriptor Structure References Sailor compatibility matrix View Classes

Sftp component

SFTP component for the elastic.io platform

How to use it

Essentially this component has only one trigger that will regularly pull SFTP location of your choice.

Authentication

Credentials of SFTP component looks like this:

image

fields above are self-explaining

Configuration

After configuring (and verifying) the credentials you should configure incoming folder (mandatory). Optionally

How it works

After file is found on SFTP it does following:

  • It moves the file to the (hidden) .platform_processed directory
  • It pulls it and upload (stream) the file to the attachment storage (aka. steward)
  • After upload is completed, READ-URL of the file will be used to generate one message with the content like below:
{
  "id": "5e00ca80-f2a3-11e6-9fdd-e7b75b43e28b",
  "attachments": {
    "large.xml": {
      "url": "https://steward.address"
    }
  },
  "body": {
    "filename": "large.xml",
    "size": 2508908
  }
}

next component may just read from the URL in attachment in order to get the memory efficient way to read/parse data. Please note that if multiple files are found, SFTP component will generate one message per file.

NOTE: you may need to consider cleaning up the .platform_processed directory manually

Limitations

Currently the maximum file size that is accepted by SFTP component is limited to 100 MB.