File Upload Interface (Workflow Import Queue)

Overview

The Workflow Import Queue supports bulk data import via uploaded CSV files.

Typically, the Import Process will be configured with an Excel template that the user can download and fill out.

image-20240905-215100.png
Downloading an Excel template for creating the CSV file

Processing an uploaded file

The user’s CSV file is processed in two passes.

  • Pass 1: Initial validation

  • Pass 2: Workflow processing

The first validation pass focuses on non-Workflow validation, such as ensuring that the CSV headers refer to valid Attributes, and that each row can be mapped to an “operation” such as “Create Member and Member Role” or “Update Member Role”.

After the first round of validation, a summary is displayed to the user indicating the number of valid versus invalid rows and which operations each row will trigger.

image-20240906-184753.png
Results of initial validation. Nothing has been saved to the database yet.

The user can then abandon the import (if they want to correct something in the file) or continue.

If they continue, then the valid records are added to a background processing queue, and the status is periodically updated.

Any Workflow-based validation errors are reported at the end.

By default the Import Queue can process about one Workflow operation per second.

If you need to import a very large amount of data, you might want to contact technical services to configure additional queue processors or to perform a custom data migration.