Dynamic PFB Importer

Overview

Dynamic PFB Importer is a new end-to-end import experience that moves data from Gen3 BioData Catalyst into CAVATICA and automatically generates a complete set of reusable project outputs. Unlike earlier importer flows that primarily transferred the PFB payload itself, Dynamic PFB Importer also resolves DRS references and downloads the linked files into the destination project. This gives users both the structured PFB metadata and the underlying file data in a single workflow.

The importer is called "dynamic" because it expands the imported Avro payload into multiple immediately usable outputs. These outputs include schema files, flattened metadata files, node-specific TSVs, a DRS manifest, and downloaded files arranged in preserved folder paths when path information is available.

Before you begin

Before starting an import, make sure the following conditions are met:

• You can sign in to Gen3 BioData Catalyst and access the Exploration page. • You can sign in to CAVATICA and have permission to import into at least one destination project. • Your destination project is appropriate for the data being imported, especially if the import includes controlled-access data. • You have sufficient storage and permissions to view imported files, folders, metadata, and tags after the import completes.

How the Dynamic PFB Importer works

The workflow begins in Gen3 BioData Catalyst and finishes in CAVATICA. Users select the data to export, choose CAVATICA as the destination, and complete the import in CAVATICA by selecting a project and optionally adding tags. Once the import starts, the platform performs the downstream processing automatically.

1. Select data in Gen3 BioData Catalyst

1. Sign in to Gen3 BioData Catalyst: NHLBI BioData Catalyst®

2. Open the Exploration page.

3. Browse or filter the available studies and files.
4. Select the data items you want to export.

5. Open Export to Seven Bridges and choose Export to CAVATICA.

After you choose Export to CAVATICA, the platform redirects you into the CAVATICA import flow. The selected source context is carried forward so the user can continue the import without rebuilding the selection manually.

2. Complete the import in CAVATICA

6. Sign in to CAVATICA if prompted.

7. Review the import context preloaded from Gen3 BioData Catalyst.

8. Choose an existing destination project or create a new one.
9. Add tags that should be applied to the imported content.
10. Click Import Data to start the importer.