SFTP Integration

Agenty SFTP workflow allows you to upload your agent result CSV file to your FTP or SFTP server automatically.

SFTP is a secure file transfer protocol method and a very popular way for securely transferring files to remote servers. Our SFTP integration helps you to transfer your scraping agent result to your SFTP server automatically.

You can simply attach a SFTP plugin to your agent with details like - Host (IP address) and port number with credentials to allow a connection from Agenty to your FTP server. Once configured, your web scraping result will be automatically transferred to your FTP server every-time a scraping agent completes the jobs execution, either its an on-demand scraping service or the scheduled extraction.

How SFTP Integration works with Agenty. Let’s see step by step:

Configure SFTP Integration

  1. Go to the Workflow tab

  2. Choose the SFTP workflow

  1. This will open the SFTP configuration form
  2. Select the web scraping agent where you want to add this workfow to (the workflow will be triggered automatically on job completion.)

  1. Enter the host, port, username, password, path and name of the file.

  1. You may also use dynamic parameters to generate the file name dynamically on runtime.
  2. Save the configuration
  3. And run your agent.

Logs and Result

  1. Click on the “Start” button to run your scraping agent

  1. Go to “Logs” tab to see the logs trace when the job has been completed
2023-08-07T09:28:27.479Z   INFO  Backup completed successfully
2023-08-07T09:28:27.555Z   INFO  Running workflow #64d0b92216d4f492bdebc7d0 (SFTP workflow)
2023-08-07T09:28:27.559Z   INFO  Running action: sftp on job completed
2023-08-07T09:28:27.562Z   INFO  Connecting to: 121.34.22.198:22
2023-08-07T09:28:27.562Z   INFO  Uploading Job-110981-08052019-output.csv (1,122 bytes)
2023-08-07T09:28:27.562Z   INFO  File uploaded successfully

Signup now to get 100 pages credit free

14 days free trial, no credit card required!