Is It Possible to Use Pipedream Connect File Stash with External Files for User File Uploads?

Help
1

This topic was automatically generated from Slack. You can find the original thread here.

Hi Team,

Quick question; does anyone happen to know if there’s a way to use the Pipedream Connect File Stash with external files? We’re getting increasingly many questions of users wanting to upload a file to our platform, and then use it in an action. Ideally for that we’d store the files on our servers, and whenever that workflow gets triggered, we upload the files to a stash so they can be used.

Is sth like that possible?

2

Ideally you would upload the file to your server and access it (download) within your workflow. You wouldn’t need the File Stash as far as I know

3

Could you expand the high level use case and step by step how all of this would work from the file upload in your platform to all the actions taken in Pipedream?

4

We’re using Connect only, so no workflows necessarily.

Our use-case would be:

  1. Users can upload a file / files in our platform
  2. They should be able to use whatever (sequence of) pipedream app(s) / action(s) they want in our own workflow builder
    So we allow our users to build a workflow with Pipedream Connect actions (we need our users to be able to create completely custom workflows, which is unfortunately not possible through your API, so we built our own solution), and sometimes our customers aren’t allowed to connect certain tools (e.g. company Google Drive) or need to upload some local files and use that in their workflow, which we want to enable for them.

Hope that helps!

5

Gotcha, thought you were using workflows, since you mentioned a workflow was being triggered, but that was referencing your platform’s workflows

6

How would your user declare they want to use a file? Would it be specific to one or more actions, or the whole workflow? Could you give one example or two?

7

We allow users to upload whatever files they want, which our AI agent is aware of. Whenever our AI agent decides a certain file would be needed, ideally it could upload it & use it in whatever action.

Examples might be:

  1. User uploads a bunch of product manuals to our service and then sets up workflow (on our end) “if I receive an email about a product not functioning (), find the right product manual (), and reply to the email with the product manual ()”
  2. User sets up a workflow (our end) “daily () check my meeting notes () and update my Excel CRM () and make sure the updated Excel is also is also in Google Drive ()”
    For 1 we’d need to be able to upload our file to the stash, to then make it available for the pipedream action

2 assumes the user was not allowed to give read access but was allowed write access, so we create a new file with a version number / diff name, and can still store it.

We’ve already built the file store on our end, and our agent is ready to reason about and work on the files, but it’s going to be unexplainable to our users that they can’t then also e.g. send mails with those files attached, so unfortunately that results in us not being able to put the feature live without this issue resolved…