Will continuously poll remote SFTP location for files that match given pattern. Found files will be transferred as attachments to the next component.
The following configuration fields are available:
After a file is found:
.elasticio_processed
{
"id": "5e00ca80-f2a3-11e6-9fdd-e7b75b43e28b",
"attachments": {
"large.xml": {
"url": "https://adress/foo&Signature=5%2FsrvmbGGfVoYpKeMH3ugaEL"
}
},
"body": {
"filename": "large.xml",
"size": 2508908
}
}
The next component may read from url
in attachments
for a memory-efficient way to read/parse data. Please note that if multiple files are found, SFTP component will generate one message per file.
Note: you may need to consider cleaning up the
.elasticio_processed
directory manually
Triggers to get all new and updated files since last polling.
The following configuration fields are available:
Emit Individually
emits each object in separate message, Fetch All
emits all objects in one message-271821-04-20T00:00:00.000Z
+275760-09-13T00:00:00.000Z
{
"type": "object",
"properties": {
"filename": {
"title": "File Name",
"type": "string",
"required": true
},
"size": {
"title": "File Size",
"type": "number",
"required": true
},
"type": {
"title": "File Type",
"type": "string",
"required": true
},
"modifyTime": {
"title": "Last Modification Time",
"type": "number",
"required": true
},
"accessTime": {
"title": "Last Access Time",
"type": "number",
"required": true
},
"directory": {
"title": "Directory",
"type": "string",
"required": true
},
"path": {
"title": "Full Path",
"type": "string",
"required": true
}
}
}
Note:
type
field represents type of the file. You can find additional information about Unix file types below.
Click here to learn more about the elastic.io iPaaS