Move your already catalogued camera trap data into Wildlife Insights
If you've already catalogued your data and identified species in images, you don't need to let all that hard work go to waste! You can bring all of your old and new data together in Wildlife Insights. Continue reading below to learn how you can bulk upload all of your catalogued data into Wildlife Insights.
If this seems complicated and you have data you'd like to bulk upload to Wildlife Insights - just contact us at [email protected] and we'll help you out!
1. Download the batch upload templates
To batch upload your annotated data into Wildlife Insights, you'll need to make sure your data is in the batch upload template format. There are four templates needed to complete a batch upload for one project: one template each for a Project, Camera, Deployment and Images. To get started migrating your data into this format:
You can also visit the Wildlife Insights Data Migration page on GitHub for more information about the batch upload process and additional resources.
2. Complete the templates with your data
Enter your data into each of the templates. As you enter your data, make sure to refer to the Batch Upload Data Dictionary for default values, accepted formats, and required fields. Here are a few important steps to complete and recommendations to consider as you complete the templates:
3. Submit completed templates to Wildlife Insights
Once you finalize your batch upload template, please submit this form with a short description of your project and the completed templates. Once submitted, the Wildlife Insights team will validate that the templates are correctly completed and will contact you with next steps.
4. Make your images available from a public URL or cloud bucket
You can transfer images to the Wildlife Insights by either making the images available from a public URL (e.g. a Google Drive, AWS link, etc) or by uploading the images directly to a private storage bucket in the Google Cloud Platform.
NOTE: Please avoid spaces and any special characters (hyphens and underscores are OK) in your folder paths and file names.
Uploading images to Google Cloud Platform
A. Please share your Google account name with the Wildlife Insights admins. This can either be a Gmail or associated business Google Cloud account.
The WI Admin will associate your account to a private storage object in the Google Cloud Platform and assign you access to the GCP storage bucket.
B. Install gsutil
C. Uploading Batch Upload Templates and Images to GCP
Once you have gsutil installed the next step is to upload your images. WI Admins will create a top-level ‘bucket’ to house images for your organization. In this example, the bucket is called gs://LondonHogwatch
To copy files from your local storage location (i.e. laptop, attached drive, SAN, etc) you will need to follow these steps:
gsutil -m cp -r YOUR_TOP_LEVEL IMAGE_DIR gs://LondonHogwatch
The above command means the following:
-m: starts many computer threads to upload (i.e. this means it will upload more than one image at a time);
-r: recursive, or that all images and directories below your’ top level image dir’ will be copied.
In this example, the command would be
gsutil -m cp -r Desktop/LH_Project1 gs://LondonHogwatch
If you have questions about this process, please consult this gsutil documentation.