{"metadata":{"image":[],"title":"","description":""},"api":{"url":"","auth":"required","results":{"codes":[]},"settings":"","params":[]},"next":{"description":"","pages":[]},"title":"Upload your data to CAVATICA","type":"basic","slug":"upload-your-data-to-cavatica","excerpt":"","body":"You can upload your private data to CAVATICA using any of the following file transfer methods to suit your various requirements and achieve the best upload speed and reliability for the volume and structure of data that you are uploading.\n\n### Upload from your local storage\n\n**Upload directly through CAVATICA's visual interface**\n\nThe easiest and most intuitive way of uploading files to CAVATICA is to use the [integrated upload functionality](doc:upload-from-your-computer). This allows you to browse and select files from your local storage and upload them directly, without using additional tools or services. This upload method is most convenient and demonstrates [best performance for small-scale uploads](doc:upload-from-your-computer#section-upload-performance-benchmarking).\n\n**Upload using the Command-line (CLI) Uploader**\n\nIf you have a larger volume of data on your local machine or cluster and want to upload it to CAVATICA (store it in CAVATICA storage), use the [Command-line (CLI) Uploader](doc:upload-via-the-command-line). The CLI uploader is a fast and secure upload client that has been optimized to efficiently upload files to CAVATICA, taking advantage of parallelization where possible.\n\nIf the two recommended methods above are not convenient or suitable for your use case, you can also consider the following alternative upload option to bring data from your local storage to CAVATICA:\n\n* **Upload via the API**. If you want to implement your own upload mechanism, you can use the [CAVATICA API](doc:upload-files) as a low-level method of uploading data to CAVATICA that treats a file as an ordered collection of smaller parts, manipulates multipart uploads, and offers more direct control over uploads.\n\n### Import from cloud storage\n\nIf the data you want to bring to CAVATICA is located in a cloud storage service, rather than your local machine, here are the import methods you can use depending on the location of your data.\n\n**Import from a volume**\n\nIf the data is already available on a cloud storage service (AWS S3 or Google Cloud Storage) and you want to use it on CAVATICA without transferring it to CAVATICA storage, use the [Connect Cloud Storage](https://docs.sevenbridges.com/docs/connecting-cloud-storage-overview) feature.\n\n### Upload from an HTTP(S)/FTP server\n\nIf the data is available on an FTP or HTTP endpoint and you want to upload it to CAVATICA (store it in CAVATICA storage), use the [HTTP(S)/FTP upload](doc:upload-from-an-ftp-server) option. \n[block:callout]\n{\n  \"type\": \"info\",\n  \"title\": \"\",\n  \"body\": \"This method is also used to upload data from a cloud storage service such as AWS S3 or Google Cloud Storage, using pre-signed URLs.\"\n}\n[/block]\n\n\n## File repositories  \n\nThere are two file repositories on CAVATICA.\n\n  * Every project has its own **Project Files**. This repository is located within the project and contains the input and output files for workflows in that project. You can upload files directly to a project or copy them from other projects and repositories.\n  * **Public Files**, a repository of files maintained by our bioinformatics team, which contains the latest and most frequently used reference genomes and annotation files so you won't have to upload your own reference files every time you run a task. Many bioinformatics tools and workflows require reference and annotation files to work properly. If you cannot see the reference files you use for your analysis, please send us an email at support:::at:::sbgenomics.com, and we'll be sure to add them. Files stored in this repository can be copied to your Project Files for use in analyses. \n[block:callout]\n{\n  \"type\": \"info\",\n  \"body\": \"**Project Files** can be viewed, edited, and copied by the project administrator and by project members with copy permissions.\"\n}\n[/block]\n## File Metadata\nMetadata is information about a file, such as specifics about the sequencing platform used to produce it. This information is linked to files and enables them to be searched and properly grouped for analyses. We recommend that you set the [metadata fields](doc:set-metadata-using-the-visual-interface) for your input files before executing analyses on the Platform.\n\n \n<hr>\n**Suggested pages:**\n\n[Upload via the command line](doc:upload-via-the-command-line) \n[Upload from an FTP or HTTP(S) server](doc:upload-from-an-ftp-server) \n[Upload via the API](doc:upload-via-the-api)","updates":[],"order":0,"isReference":false,"hidden":false,"sync_unique":"","link_url":"","link_external":false,"_id":"5a3a578bb1490c001c182099","project":"5773dcfc255e820e00e1cd4d","version":{"version":"1.0","version_clean":"1.0.0","codename":"","is_stable":true,"is_beta":false,"is_hidden":false,"is_deprecated":false,"categories":["5773dcfc255e820e00e1cd51","5773df36904b0c0e00ef05ff","577baf92451b1e0e006075ac","577bb183b7ee4a0e007c4e8d","577ce77a1cf3cb0e0048e5ea","577d11865fd4de0e00cc3dab","578e62792c3c790e00937597","578f4fd98335ca0e006d5c84","578f5e5c3d04570e00976ebb","57bc35f7531e000e0075d118","57f801b3760f3a1700219ebb","5804d55d1642890f00803623","581c8d55c0dc651900aa9350","589dcf8ba8c63b3b00c3704f","594cebadd8a2f7001b0b53b2","59a562f46a5d8c00238e309a","5a2aa096e25025003c582b58","5a2e79566c771d003ca0acd4","5a3a5166142db90026f24007","5a3a52b5bcc254001c4bf152","5a3a574a2be213002675c6d2","5a3a66bb2be213002675cb73","5a3a6e4854faf60030b63159","5c8a68278e883901341de571","5cb9971e57bf020024523c7b","5cbf1683e2a36d01d5012ecd","5dc15666a4f788004c5fd7d7","5eaff69e844d67003642a020","5eb00899b36ba5002d35b0c1","5eb0172be179b70073dc936e","5eb01b42b36ba5002d35ebba","5eb01f202654a20136813093","5eb918ef149186021c9a76c8","5f0839d3f4b24e005ebbbc29","5f893e508c9862002d0614a9","6024033e2b2f6f004dfe994c","60a7a12f9a06c70052b7c4db","60a7ab97266a4700161507c4","60b0c84babba720010a8b0b5"],"_id":"5773dcfc255e820e00e1cd50","__v":39,"createdAt":"2016-06-29T14:36:44.812Z","releaseDate":"2016-06-29T14:36:44.812Z","project":"5773dcfc255e820e00e1cd4d"},"category":{"sync":{"isSync":false,"url":""},"pages":[],"title":"Bring data to CAVATICA","slug":"bring-your-data","order":6,"from_sync":false,"reference":false,"_id":"5a3a574a2be213002675c6d2","project":"5773dcfc255e820e00e1cd4d","version":"5773dcfc255e820e00e1cd50","createdAt":"2017-12-20T12:27:54.317Z","__v":1},"user":"566590c83889610d0008a253","createdAt":"2017-12-20T12:28:59.985Z","githubsync":"","__v":0,"parentDoc":null}

Upload your data to CAVATICA


You can upload your private data to CAVATICA using any of the following file transfer methods to suit your various requirements and achieve the best upload speed and reliability for the volume and structure of data that you are uploading. ### Upload from your local storage **Upload directly through CAVATICA's visual interface** The easiest and most intuitive way of uploading files to CAVATICA is to use the [integrated upload functionality](doc:upload-from-your-computer). This allows you to browse and select files from your local storage and upload them directly, without using additional tools or services. This upload method is most convenient and demonstrates [best performance for small-scale uploads](doc:upload-from-your-computer#section-upload-performance-benchmarking). **Upload using the Command-line (CLI) Uploader** If you have a larger volume of data on your local machine or cluster and want to upload it to CAVATICA (store it in CAVATICA storage), use the [Command-line (CLI) Uploader](doc:upload-via-the-command-line). The CLI uploader is a fast and secure upload client that has been optimized to efficiently upload files to CAVATICA, taking advantage of parallelization where possible. If the two recommended methods above are not convenient or suitable for your use case, you can also consider the following alternative upload option to bring data from your local storage to CAVATICA: * **Upload via the API**. If you want to implement your own upload mechanism, you can use the [CAVATICA API](doc:upload-files) as a low-level method of uploading data to CAVATICA that treats a file as an ordered collection of smaller parts, manipulates multipart uploads, and offers more direct control over uploads. ### Import from cloud storage If the data you want to bring to CAVATICA is located in a cloud storage service, rather than your local machine, here are the import methods you can use depending on the location of your data. **Import from a volume** If the data is already available on a cloud storage service (AWS S3 or Google Cloud Storage) and you want to use it on CAVATICA without transferring it to CAVATICA storage, use the [Connect Cloud Storage](https://docs.sevenbridges.com/docs/connecting-cloud-storage-overview) feature. ### Upload from an HTTP(S)/FTP server If the data is available on an FTP or HTTP endpoint and you want to upload it to CAVATICA (store it in CAVATICA storage), use the [HTTP(S)/FTP upload](doc:upload-from-an-ftp-server) option.  [block:callout] { "type": "info", "title": "", "body": "This method is also used to upload data from a cloud storage service such as AWS S3 or Google Cloud Storage, using pre-signed URLs." } [/block] ## File repositories There are two file repositories on CAVATICA. * Every project has its own **Project Files**. This repository is located within the project and contains the input and output files for workflows in that project. You can upload files directly to a project or copy them from other projects and repositories. * **Public Files**, a repository of files maintained by our bioinformatics team, which contains the latest and most frequently used reference genomes and annotation files so you won't have to upload your own reference files every time you run a task. Many bioinformatics tools and workflows require reference and annotation files to work properly. If you cannot see the reference files you use for your analysis, please send us an email at [email protected], and we'll be sure to add them. Files stored in this repository can be copied to your Project Files for use in analyses. [block:callout] { "type": "info", "body": "**Project Files** can be viewed, edited, and copied by the project administrator and by project members with copy permissions." } [/block] ## File Metadata Metadata is information about a file, such as specifics about the sequencing platform used to produce it. This information is linked to files and enables them to be searched and properly grouped for analyses. We recommend that you set the [metadata fields](doc:set-metadata-using-the-visual-interface) for your input files before executing analyses on the Platform. <hr> **Suggested pages:** [Upload via the command line](doc:upload-via-the-command-line) [Upload from an FTP or HTTP(S) server](doc:upload-from-an-ftp-server) [Upload via the API](doc:upload-via-the-api)