File Upload Interface (Workflow Import Queue)
- Seth Petry-Johnson
Overview
The Workflow Import Queue supports bulk data import via uploaded CSV files.
Typically, the Import Process will be configured with an Excel template that the user can download and fill out.
Processing an uploaded file
The user’s CSV file is processed in two passes.
Pass 1: Initial validation
Pass 2: Workflow processing
The first validation pass focuses on non-Workflow validation, such as ensuring that the CSV headers refer to valid Attributes, and that each row can be mapped to an “operation” such as “Create Member and Member Role” or “Update Member Role”.
After the first round of validation, a summary is displayed to the user indicating the number of valid versus invalid rows and which operations each row will trigger.
The user can then abandon the import (if they want to correct something in the file) or continue.
If they continue, then the valid records are added to a background processing queue, and the status is periodically updated.
Any Workflow-based validation errors are reported at the end.
By default the Import Queue can process about one Workflow operation per second.
If you need to import a very large amount of data, you might want to contact technical services to configure additional queue processors or to perform a custom data migration.