Batch Uploading High-Resolution Images

Using the iDigBio appliance described below is the primary method for uploading images to the SCAN/LepNet database,  we have phased out the alternative DropBox solution for batch image uploading.  As of April, 2018 the utility has been stable, with no reported problems except creating skeletal records.

Prior to uploading make sure all your filenames that include the catalog number are correctly assigned to the image you are uploading. 

Catalog number is in the image filename in the SAME format as it is on the digital record in SCAN. E.g. a specimen with the catalog number EXAMPLE0001234 can have an image linked to it ONLY if the image’s filename contains the EXACT catalog number “EXAMPLE0001234” in its filename, for example “EXAMPLE0001234.jpg” or “EXAMPLE0001234_dorsal”. As long as the verbatim catalog number is present in the filename, the image can be linked to the specimen.

iDigBio Image Ingestion Utility Guide  – For Symbiota users

  1. Ensure that you have the latest version of the iDigBio Image Ingestion tool – it may be found here: https://github.com/iDigBio/idigbio-media-appliance/releases
    1. Installation guide for the utility: https://github.com/iDigBio/idigbio-media-appliance/wiki/Installing
  2. In order to run the utility, you will need a UUID and API key from iDigBio. This is like a username and password. If you are a Symbiota data collection manager and do not have either of these things, you may request them from the iDigBio Technical Team (idigbio@acis.ufl.edu).
  3. Launch the image ingestion utility. Log in with your UUID and API key.

         PC users should use a browser other than Internet Explorer.  In other words, use Chrome or Firefox.

        For Windows users to launch the iDigBio Media Appliance once the install is finished, go to the start menu and type: idigbio_media_appliance.

        You can also create a shortcut to the program by creating a new shortcut and entering that command in the “command to run” box. This should open a command              prompt, and then shortly afterwards your default browser should open a web page pointed at the iDigBio Media Appliance.

       To close the appliance once you are done using it (and all uploads have finished). Close the browser tab with the appliance in it, then click the X box in the upper           right hand corner of the appliance command prompt window.

  1. From the main page, you will see options for generating a CSV. This CSV is used to index the images you wish to load into iDigBio (and later your Symbiota portal).
  2. You will see three fields: Upload Path, GUID Syntax, and GUID Prefix.
    1. Upload Path: The directory where your images are stored. Clicking within this field should bring up a window allowing you to point-and-click to where the directory is located on your computer. (Note: the window may pop up in the background, minimize your browser to check) If your directory has nested subdirectories, be sure to tick the “Also Search Files in Subdirectories” box.
    2. GUID Syntax: For linking images to records within Symbiota data portals, you’ll need to choose the [GUID Prefix][File Name] option. Your file name MUST start with the catalog number of the corresponding record in Symbiota. After the catalog number follow with an underscore and use whatever information you want to describe the image. For example, a record’s catalog number is WFBM0000008, and the image filename is “WFBM0000008_dorsal.jpg”
    3. GUID Prefix: If your institution code should already a part of your image filenames, you may leave this field blank. Otherwise, enter your institution code and/or collection code as instructed by the data portal manager.

  1. Click “Generate CSV and Upload Files” to begin the upload to iDigBio. Depending on the amount of images you are uploading, this may take a long time.
  2. When the upload procedure is complete, from the Upload History tab, click the green “Download Media as CSV” button. You will use this file to link your uploaded images to Symbiota.

  1. Log in to your Symbiota portal and navigate to the collection whose images you had loaded into iDigBio.
  2. From the collections administration menu, select “Processing Toolbox”, and then the “Image Loading” tab.

  1. If you don’t see an option for “iDigBio CSV Upload” like in the above screenshot, it will need to be set up by the portal manager. This only needs to be done once:
    1. Select “iDigBio CSV Upload” from the Upload Type drop-down menu.
    2. Enter a regular expression that will correctly capture the catalog number from the image file name. Remember to enclose the portion of the expression representing the catalog number in parentheses. Regular expressions can be difficult to set up http://www.regexr.com is a useful resource in setting one up. If problems persist, don’t hesitate to ask Cat Chapman (cac469@nau.edu) for help in setting up the regular expression.
  2. You will now need to choose the CSV file that you downloaded from the Upload History page in the image loader.
  3. Click the Process Output File
  4. If you have followed the steps correctly and encountered no errors, Symbiota will extract the catalog number from the filename; check to see if a record with that catalog number exists within the Symbiota data portal; if a record does exist with that catalog number, the image will be linked to the record; if a record does not exist with the that catalog number, an empty record with only the image and catalog number will be created.

DropBox Method (We have phased out this option out and will be directing people to use the iDigBio appliance)

If any further assistance is needed, don’t hesitate to contact Cat Chapman at cac469@nau.edu.

Comments are closed.