Tangible Media Project Guide

Transcription

Tangible Media Project Guide
2015
Information Guide &
Process Manual
Tangible Media Project
Page
Kimberly Jackson, Preservation Digital Technology Intern
The Library of Congress
7/27/2015
0
Preservation & Reformatting Division
Table of Contents
Tangible Media Project (TMP) ..........................................................................................................................................................2
Defining the Tangible Media ........................................................................................................................................................2
Vulnerable Collections..................................................................................................................................................................2
Pilot Project: Preserving Tangible Media .....................................................................................................................................2
Before You Begin ..............................................................................................................................................................................3
How to Set Up Your Login/Station ...............................................................................................................................................3
Adobe Photoshop .........................................................................................................................................................................3
Familiarize Yourself with the Workflows .....................................................................................................................................4
Basic Workflow Pattern ....................................................................................................................................................................4
Workflow Processes .........................................................................................................................................................................5
Add Items to Tracking Spreadsheet .............................................................................................................................................5
Scan TIFs of Media........................................................................................................................................................................6
Acquiring Content from Media ...................................................................................................................................................... 14
Ripping CD/DCDs ....................................................................................................................................................................... 14
Re-Ripping MDF/MDS Discs for File Content ............................................................................................................................ 19
3” Mini CD/DVD Discs................................................................................................................................................................ 20
3.25” Floppy Disks ..................................................................................................................................................................... 25
5.25” Floppy Disks ..................................................................................................................................................................... 30
Acquiring Content Using FTK Imager ............................................................................................................................................. 37
Finding Content ......................................................................................................................................................................... 37
Creating a Physical Image.......................................................................................................................................................... 39
Creating a Logical Image............................................................................................................................................................ 42
Acquiring Content Using Command Prompt/XCopy ..................................................................................................................... 45
Assembling Content for CTS .......................................................................................................................................................... 46
CTS Ingest (post-ripping) ............................................................................................................................................................... 48
APPENDIX ...................................................................................................................................................................................... 57
Barcode Errors ........................................................................................................................................................................... 57
Unzip Errors ............................................................................................................................................................................... 57
Status Slips ................................................................................................................................................................................ 58
Page
XCOPY Parameters/Commands................................................................................................................................................. 59
1
Tracking Spreadsheet ................................................................................................................................................................ 58
Tangible Media Project (TMP)
Defining the Tangible Media



Digital items stored on physical, tangible media.
Includes, but is not limited to: CD/DVDs, Hard Drives, Thumb Drives, Digital Tape, Floppy Discs and
Flash Drives.
Does not include: Digital items transferred directly onto Library servers via FTP, or stored elsewhere
and only accessed at the Library.
Vulnerable Collections
Digital items are kept across Library divisions, stored on a wide variety of degrading tangible media, with more
items coming in every day. As long as the data remains only on the tangible media it is not backed up and is
vulnerable.
Pilot Project: Preserving Tangible Media
In 2013, the Preservation and Reformatting Division Creating began a pilot program called the Tangible Media
Project. The goal of this project is to create a preservation copy of digital tangible media which is included with
newly bound monographs. The process to achieve a preservation copy includes:
2



Ripping the content from the media;
Using forensic data extraction software if the media is not able to be ripped or if the media is obsolete
or damaged;
Creating tracking metadata;
Assembling and inventorying the content (Bagging);
Ingest into LC Content Transfer Services (CTS) which also runs a variety of scripts and software such as
fixity checks, malware and virus scans, backed-up and stored in long term tape storage.
Page


Before You Begin
How to Set Up Your Login/Station
Before you can begin to work on the TMP, you must do the following:




Verify that you have Adobe Photoshop, import scanning actions and create shortcuts
Copy the Ripstation shortcuts folder to your desktop or taskbar.
Know the login and password for FTK Imager (FTKAdmin, prdrocks!)
Know the login and password for OptiPlex computer login (Administrator, [blank])
Adobe Photoshop
PROMPT: You have been tasked with scanning TIF images of media for the TMP.
ACTION 1: Confirm that you have access to Photoshop; add required recorded actions and menu shortcuts.
Importing and Loading the Actions file
1.
2.
3.
4.
5.
Go to the Ripstation (TMP3) computer and login using your LC username and password.
Go to the Start Button and locate Photoshop, then right-click the icon and select Pin to Taskbar.
Open Photoshop.
View Actions by selecting Windows > Actions (Alt +F9)
On the Right Side Panel select the Actions tab
6.
7.
8.
9.
10.
11.
On the right corner of the panel, click on the drop down tool
and select Load Actions.
Locate and select the action file by going to: M:\PRD\OptiCopy\BCCD-MRC\_Instructions\Photoshop Actions
Once the actions have loaded you will need to change the WIA Support destination folder.
In the BCCD-MRC Action folder on the PSD panel, click on Begin Scan.
Select WIA Support then, double-click.
Under Destination Folder, click on Browse and change the save location to M:\PRD\OptiCopy\BCCDMRC\_MediaScans
Adding Menu Shortcuts
In the Photoshop drop-down menu, select Edit > Menus
Select the Keyboard Shortcuts tab.
Click on File > Save As. Click on the shortcut field and change by pressing the F11 button.
Scroll to File > Close. Click on the shortcut field and change by pressing the F12 button.
Scroll to Image > Image Rotation > Arbitrary. Click on the shortcut field and change by pressing the F10
button.
6. Click OK to save.
Page
3
1.
2.
3.
4.
5.
Familiarize Yourself with the Workflows
All new incoming items from BCCD with tangible media will need to follow a specific workflow. You can begin
familiarizing yourself with the process by looking at the signs in the TMP area and also by reading this guide.
Receive New Items
Return Completed
Items for Shelving
Add to Tracking
Sheet
Ingest Bagged
Content into CTS
Scan TIF
Basic Workflow Pattern
Bag Assembled
Items
Troubleshoot
Errors
4
Return
Unsolveable Items
to Sender
Page
Assemble Ripped
Files & TIFs for
Bagging
Rip Media
Workflow Processes
Add Items to Tracking Spreadsheet
All new items must first be added to the tracking spreadsheet before any work is completed. This allows PRD to keep
track of the activities performed on the items and by whom as well as any errors that occurred. This information is used
later in the workflow process to glean metadata for ingest into CTS.
1. Choose 10 items from the new incoming items staging area and bring them to the workstation.
2. Open the Tracking Spreadsheet which is found in your Ripstation Shortcuts folder which should now be copied
to your desktop or taskbar.
3. Go to the most recent blank line and scan the barcode into the first two lines.
4. Save the document.
5. You may now begin the first step in the workflow process – Scanning Media on a Flatbed Scanner.
Figure 1: Choose new items.
Page
5
Figure 2: Add new items to spreadsheet (barcode only).
Scan TIFs of Media
PROMPT: New Items Have Arrived From BCCD
ACTION 1: Select 10 books from the cart and bring them to the scanning
workstation and follow the steps below.
ACTION 2: Check to make sure that the scanner cord is plugged in.
ACTION 3: Log onto the scanning station computer with your LC username
and password and open Photoshop.
Figure 3: Cord connected.
ACTION 4: If you have not already done so, open the Tracking Spreadsheet from the Ripstation shortcuts
folder. Go to the end of the sheet, scan the barcode twice. Enter your name under the scanned by section
after each item once they have been scanned. Do not add additional information until the action is performed.
Page
6
Figure 4: Enter information into the tracking spreadsheet as actions are completed.
ACTION 5: Take the CD/DVD out of the first book and place it label side down on the scanner.
ACTION 6: In Photoshop, press F2 button, press ENTER to select the scanner device, and then ENTER once
more to set it for a color scan.
Quick Action: F2 + Enter + Enter
Page
7
Figure 5: Press ENTER to select the scanner.
Figure 6: Press ENTER once more to set scan for color.
Once the scan starts you should see a progress bar.
Figure 7: Progress bar in action.
Once the scan is complete you’ll see it in Photoshop.
Page
8
Figure 8: What you see when the scanner is finished scanning.
ACTION 7: While in Photoshop, choose the CROP tool on the left side toolbar.
ACTION 8: Click once in the white area until you see a grid.
Figure 9: You will see a grid appear.
ACTION 9: Move the image of the CD until the bull’s eye mark is in the center of the CD/DVD then press ENTER.
Page
9
Figure 10: Center bull's eye mark to center of CD/DVD.
ACTION 10: Select the RULER tool to align the item so that the text is level.
If you do not see the ruler, right click on the Eyedropper tool and select Ruler Tool.
ACTION 11: Once the Ruler Tool is selected, click once under the text on the media item, hold and draw a
straight line, then release the mouse.
Page
10
Figure 11: Draw a straight line under the text using the ruler tool.
ACTION 12: After you have underlined the text and released the mouse, press F10 to rotate the image using
arbitrary rotation.
ACTION 13: You will see a suggested degree of rotation. Press ENTER.
Figure 12: Suggested degree of rotation.
Figure 13: Image text is now aligned.
Page
11
The writing should now be straight. If not, repeat actions 8-10.
ACTION 14: Press F4 for a final crop.
Figure 14: Final Close Crop.
ACTION 15: Press F11 (File>Save As).
Figure 15: The automatic file name and format need to be changed.
ACTION 16: Scan the LCCN barcode (located on the back of the item).
Page
12
Figure 16: Scan the barcode to copy the number.
ACTION 17: Add the _001 extension (or _002 etc. if there is more than one media item).
Note: If there is more than one media item, then write the corresponding number on the Tyvek envelopes in
pencil only.
Figure 17: Add the CD number extension to the file name.
ACTION 18: Press TAB + T + T to change the Format type to TIFF then press Save/Enter.
Figure 18: ALWAYS save as TIFF.
ACTION 19: When you see additional saving options, press OK/Enter.
Page
ACTION 20: Press F12 to close the image in your screen, select a new item and return to Action 1.
13
Figure 19: Verify TIFF options by pressing ENTER.
Acquiring Content from Media
Ripping CD/DCDs
PROMPT: New items arrived from BCCD and have been scanned and their content needs to be ripped.
ACTION 1: Select 10 items from the Scanned. Need to be Ripped stack.
ACTION 2: Take your 10 items to either of the two (2) designated Ripstations (TMP1 or TMP3).
1. Be sure that an external hard drive is plugged in to the computer, that the Ripstation machine is on,
and that the Ripstation cord is plugged in.
Figure 20: Ready light should be green.
Figure 21: Ripstation cord is plugged in.
ACTION 3: Go to the Ripstation Shortcuts folder and open the file 1_RipstationLogin.txt.
ACTION 4: Copy the login username for the station you are currently working (Ex: TMP3 station login =
Page
14
LSH5ZJLC1\#1CLJZ5H). Keep this file open so you can still see the password information which will also be needed.
ACTION 5: Go back to the Ripstation Shortcuts folder, locate the 2_Ripstation DataGrabber shortcut, right-click using
your mouse and click on Run as Administrator.
Figure 22: Ripstation Shortcuts
ACTION 6: When the Admin login screen comes up, paste the login information (Ex: LSH5ZJLC1\#1CLJZ5H)
ACTION 7: Press TAB, and then type in the password as seen on the login file (Ex: ^On3Day@tthePark).
Should you need a new password, contact John Makar in APLO for assistance (202) 707-1248.
Page
15
Figure 23: Logging into DataGrabber
Figure 24: Verify all selections before ripping media.
ACTION 8: Before placing any media in the device, be sure that the DataGrabber application shows the following:
a. Loader Type is 7601XDP
b. Output format is ISO Image
c. Disc Count is 0
d. Folder Name is %0\1
e. The Destination Folder is F:\BCCD\ (be aware that the drive many vary)
f.
The G:\Optiarc drive is checked (be aware that the drive many
vary)
ACTION 9: Open the 3_UserData.txt file.
ACTION 10: Delete any barcode numbers currently in the file and save.
ACTION 11: Verify that there is a barcode on the back of the item.
1
It’s a variable that tells the program to name the file/folder with the Barcode ID that you put into the userdata file earlier.
Page
Figure 25: Add barcodes to UserData
and save before ripping.
16
i. If there is no barcode present, go to Troubleshooting –
Barcodes for more information.
ACTION 12: Scan barcode on the back of each item to the UserData file and be sure to SAVE.
ACTION 13: Remove the CD/DVD from the envelope and place it inside the Ripstation machine.
ACTION 14: Continue to do this for all remaining discs for items selected until all are stacked in the machine and close
the lid.
ACTION 15: Navigate to the DataGrabber Program.
ACTION 16: Verify the selections, and then click the green arrow to begin ripping.
Page
17
Figure 26: Click on the green arrow to begin ripping.
ACTION 17: As CD/DVDs are finished, they’ll drop out of the front into the container.
ACTION 18: Any CDs that don’t rip will drop out of the bottom back.
ACTION 19: As the ripped and error CDs come out, place them back in the item’s Tyvek envelope.
ACTION 20: Update the status for each item on the tracking spreadsheet.
ACTION 21: Place a Status Slip in each item where errors occurred and transfer it to the FRED station for further work
on FTK or XCopy.
ACTION 22: Set successful items aside for assembling.
ACTION 23: Return to any items with MDF/MDS files that need to be re-ripped.
Figure 28: Unripped Disc (Error Status).
Page
18
Figure 27: Ripped disc (OK status).
Re-Ripping MDF/MDS Discs for File Content
There will be instances where content has ripped from CD/DVD media, but extracts an MDF/MDS file rather
than an ISO. To remedy this, you must re-rip the media with the file output set to Files.
PROMPT: Ripped discs extracted MDF/MDS format and need to be re-ripped.
ACTION 1: Determine what items that were ripped need to be re-ripped by
looking at the folder contents.
ACTION 2: Open the 3_UserData.txt file.
ACTION 3: Delete any barcode numbers currently in the file and save.
ACTION 4: Scan barcode on the back of each item to the UserData file and be
sure to SAVE.
ACTION 5: Remove the CD/DVD from the envelope and place it inside the
Ripstation machine.
ACTION 6: Continue to do this for all remaining discs for items selected until all are Figure 27: Add barcodes to UserData
stacked in the machine and close the lid.
and save before ripping.
ACTION 7: Navigate to the DataGrabber Program.
ACTION 8: Verify that the output selection has been changed to Files, and then click the green arrow to begin ripping.
Figure 28: Be sure to change output to Files.
ACTION 9: Once the files have finished ripping, set aside for assembling. You can now move on to the next step in the
Page
19
workflow process, Assembling Ripped Files for Bagging.
3” Mini CD/DVD Discs
Mini CD/DVD discs must be ripped at the FRED station using FTK Imager or Xcopy. Do not attempt to rip multiple minidiscs using the adapter as it may cause unnecessary wear and tear and/or jam the Ripstation. On FTK, you will make a
physical and logical copy. If this fails, you must clone the content using Xcopy in Command Prompt. See Using Command
Prompt for additional instructions.
PROMPT: There are several items with 3” mini CD/DVD items at the FRED station which need to be cloned.
ACTION 1: Select one item from the stack, open the envelope containing the media and place in the mini-disc adapter.
Be sure that the disc is label side up and is locked in correctly on all sides.
Figure 29: Insert in label side up.
Figure 30: Be sure it is locked into place.
ACTION 2: Open the CD/DVD drive (F:/) on FRED, insert the disc label side up and close the drive.
Page
20
Figure 31: Ready to copy content.
ACTION 3: Open My Documents and navigate to the H:/ drive (aka Maui).
ACTION 4: Create a new folder and name with the item barcode.
Page
21
ACTION 5: Within that new folder, create two subfolders: Logical, and Physical.
ACTION 6: Navigate to and open FTK Imager and click on Add All Attached Devices
ACTION 7: Select the F:\ drive which contains the disc media, right click and select Export Disk Image. This is the
physical copy of the disc which is a clone of the disc geometry, or a complete physical copy.
Page
22
ACTION 8: Click on Add to add the disk image source.
ACTION 9: Browse to the destination (save to) folder you created in the H:\ drive entitled Physical and insert the
barcode for the Image Filename.
ACTION 10: Click on Finish, then click Start to begin the process.
ACTION 11: When the process is finished, click Close twice
23
Figure 35: When completed, click close.
Page
Figure 32: Creating physical image of disc.
ACTION 12: Next, you will need to extract an archival copy of the logical image of the disc. The logical copy serves a
listing of the data set and also a set of pointers which lead to the physical copy of the disc content. Please note that if
the data from the physical copy changes, then these pointers on the logical copy may not point to the files properly.
ACTION 13: After selecting Export Logical Image, you will be prompted to select the file folder where you wish to save
the logical copy. Click, Add > Next (do not add any metdata)> H:\ > FTK_Images > [Barcode specific to item] > Logical.
ACTION 14: Add the Image Filename (Barcode specific to item).
ACTION 15: Click on Finish and allow FRED to run through cloning the logical image of the disc. When it is done with the
Page
24
process you will see a screen which shows a fixity check/checksum for both SHA1 and MD5 algorithms. Fixity
checks/checksums also known as hashes are meant to guarantee authenticity that the file has not changed from the
time that it was cloned to the time that it is opened for use by an outside user or otherwise.
3.25” Floppy Disks
3.25” floppy discs must be ripped at the FRED station using FTK Imager or Xcopy. Using FTK, you will make a physical and
logical copy. If this fails, you must clone the content using Xcopy in Command Prompt. See Using Command Prompt for
additional instructions.
PROMPT: There are several items with 3.25” floppy disks at the FRED station which need to be cloned.
ACTION 1: Select one item from the stack, open the envelope containing the media and insert it into the 3.25” floppy
reader label side up. Be sure that it is connected to a USB port.
Figure 36: Insert in label side up.
Figure 37: Be sure it is locked into place.
Page
25
Figure 38: Plug in the drive reader and turn on
write protect.
ACTION 2: Open My Documents and navigate to the H:\ drive (aka Maui).
ACTION 3: Create a new folder and name with the item barcode.
Page
26
ACTION 4: Within that new folder, create two subfolders: Logical, and Physical.
ACTION 5: Navigate to and open FTK Imager and click on Add All Attached Devices
ACTION 6: Select the F:\ drive which contains the disc media, right click and select Export Disk Image. This is the
physical copy of the disc which is a clone of the disc geometry, or a complete physical copy.
Page
27
ACTION 7: Click on Add to add the disk image source.
ACTION 8: Browse to the destination (save to) folder you created in the H:\ drive entitled Physical and insert the
barcode for the Image Filename.
ACTION 9: Click on Finish, then click Start to begin the process.
ACTION 10: When the process is finished, click Close twice
28
Figure 40: When completed, click close.
Page
Figure 39: Creating physical image of disc.
ACTION 11: Next, you will need to extract an archival copy of the logical image of the disc. The logical copy serves a
listing of the data set and also a set of pointers which lead to the physical copy of the disc content. Please note that if
the data from the physical copy changes, then these pointers on the logical copy may not point to the files properly.
ACTION 12: After selecting Export Logical Image, you will be prompted to select the file folder where you wish to save
the logical copy. Click, Add > Next (do not add any metadata)> H:\ > FTK_Images > [Barcode specific to item] > Logical.
ACTION 13: Add the Image Filename (Barcode specific to item).
ACTION 14: Click on Finish and allow FRED to run through cloning the logical image of the disc. When it is done with the
Page
29
process you will see a screen which shows a fixity check/checksum for both SHA1 and MD5 algorithms. Fixity
checks/checksums also known as hashes are meant to guarantee authenticity that the file has not changed from the
time that it was cloned to the time that it is opened for use by an outside user
5.25” Floppy Disks
PROMPT: New Items Have Arrived From BCCD that contain 5.25” floppy disks.
ACTION 1: Select 10 books from the cart and bring them to the scanning workstation and follow the steps
below.
ACTION 2: Turn on the OptiPlex machine, use CNTL+ALT+DELETE and use the default Administrator login. No password
is required.
ACTION 3: Insert media into disk drive. Be aware that while the 5.25” is typically found on B:\, however the OptiPlex
shows it on the A:\
Figure 44: Insert into drive.
30
Figure 43: Select item.
Figure 42: No password is required.
Page
Figure 41: Turn on OptiPlex and select Windows NT.
ACTION 4: Make sure that the drive latch is closed.
ACTION 5: Open Command Prompt and My Computer from the Tangible Media Project folder on the desktop.
Figure 48: Open My Computer to see all drives.
31
Figure 47: Open Command Prompt.
Figure 46: Open the Tangible Media Project folder.
Page
Figure 45: Close the drive latch.
ACTION 6: Open the C:\xcopy folder and create a new folder, naming it with the item barcode.
ACTION 7: In Command Prompt, run the xcopy command to clone all files from the A:\ to the new folder you created
on the C:\xcopy/barcode number and run a sequence of commands to capture all directories, subdirectories and hidden
files. For more xcopy commands go to the Appendix.
Example: Xcopy A:\ C:\xcopy/00012345678 /v /d /s /h /k
In English: Run xcopy on the media in drive A, and then copy it to drive C in the folder xcopy, subfolder 00012345678.
While running xcopy, verify content on media, find all directories, subdirectories and hidden files and copy everything.
Commands used when running xcopy in Command Prompt
/v = Verify the files are on the media
/d = Copy all existing directories
/s = Copy all existing subdirectories
/h = Copy all hidden files
/k = Copy all files on media
32
Figure 50: Run Command Prompt to clone all files from disk.
Page
Figure 49: Create new folder in C:\
ACTION 8: When the files have been copied successfully, you will see the number of files copied at the bottom of the
file listing in Command Prompt.
ACTION 9: Open the destination folder in C:\xcopy/[barcode] to verify that the files were cloned properly.
ACTION 10: Find the designated flash drive and plug it into the back of the OptiPlex machine.
to export files.
Figure 54: Plug it into the back of the OptiPlex.
33
Figure 53: Use the designated thumb drive
Figure 52: Verify files are in new folder.
Page
Figure 51: Files have been copied.
ACTION 11: Copy the cloned content folder found on C:\xcopy
ACTION 12: Paste the cloned content folder to the F:\ for transport to the Apollo portable hard drive.
Figure 55: Copy the item folder with cloned files.
Figure 56: Paste the copy into the flash drive.
Page
Figure 57: Bring flash drive and items to TMP3 station.
34
ACTION 13: Bring flash drive to the TMP3 station.
ACTION 14: Copy cloned content to the Apollo hard drive (F:) into the folder named, Waiting for FTK.
Figure 58: Copy cloned files to the "Waiting for FTK" folder.
ACTION 15: Navigate to the RipStation shortcuts folder on your desktop, open 5_Media Scans (TIFs) and copy
the corresponding TIF file to the new folder in Waiting for FTK. Then, transfer assembled files to the File ISO >With
Page
Figure 59: Add corresponding TIF file from TIF folder.
35
Pics folder.
ACTION 16: In the RipStation shortcut folder, open the 6_TMP Tracking.xls file and update the item entry to reflect
that the content has been cloned in X-copy and by whom.
ACTION 17: Place completed items with media on the cart in the TMP1 station where they will be bagged and
ingested into CTS.
Page
36
ACTION 18: Delete the cloned files from the flash drive and return the device to the OptiPlex station.
Acquiring Content Using FTK Imager
Finding Content
How to create both a Physical and a Logical Image of an optical disc (e.g. CD, DVD, etc.) when the RipStation has failed to
do so, or when another problem arises. Logical Image-the copy that contains the full file structure (the data on the disc),
but no information about the actual, physical drive. Physical Image-the copy that shows the disk, partitions, and file
structure, as well as drive data (Instructions originally compiled by Rachel McPherson and updated by Kimberly Jackson).
ACTION 1: Turn FRED on
a. Press and hold the Power Button in the top left corner, then release.
Note: the button may need to be held for a few seconds.
ACTION 2: Open the program AccessData FTK Imager program.
ACTION 3: Put optical disc in the BluRay BD-RE/DVD±RW drive. Note: disc may try to run using AutoPlay-exit if
Page
37
necessary.
ACTION 4: Click File-Remove all Evidence Items, or the Remove all Evidence Items button (if necessary).
Note: This will clear any items that were not removed after a previous session.
ACTION 5: Click File-Add all Attached Devices, or the Add all Attached Devices button.
Note: Unless it is known what the disc or drive is specifically called, it may be easier to add them all and figure out which
one is correct.
D:\ Calliope –this is one of the swappable hard drives in FRED.
G:\ CODEMETER [FAT32] –this may or may not appear, as it is the dongle that allows
one to login to another program: the FTK5 Software. Typically only there if someone has been using FTK5 and
hasn’t returned the dongle (looks like a USB flash drive) to the locked cabinet.
Page
38
F:\ –this is typically the drive wanted. It will specify the name of the disc.
Creating a Physical Image
After you have created the logical disk image, you will need to proceed to the physical file copy.
ACTION 1: Right-click on the F:\
ACTION 2: Select Export Disk Image…
ACTION 3: The Create Image box will pop up. Click Add…, the Select Image Destination Box will pop up. Note: this will
Page
ACTION 4: Image Destination Folder: using the Browse button, find the folder where the files will be saved.
39
be the destination of the images after ripping.
ACTION 5: Image Filename (Excluding Extension): enter in the barcode of the book (or whatever naming convention is
decided), adding a “p” to the end of the barcode to differentiate it from the Logical Image that will be created later.
ACTION 6: Click Finish.
ACTION 7: The Create Image Box will appear. Make sure all options are checked (Verify images after they are created,
Precalculate Progress Statistics, and Create directory listings of all files in the image after they are created).
Page
40
ACTION 8: Click Start-the application will then proceed to create the Physical Image.
ACTION 9: A message will appear that the Image Created Successfully.
Page
41
ACTION 10: Click Close. The image will now be in folder you specified earlier.
Creating a Logical Image
ACTION 1: Right-click on contents listed under the F:\
ACTION 2: Select Export Logical Image (AD1)…
ACTION 3: The Create Image Box will pop up. Click Add…, the Evidence Item Info Box will pop up.
Page
42
Note: this is identifying info for the item, which is not needed at this time.
ACTION 3: Click Next; the Select Image Destination Box will pop up. Note: this will be the destination of the images
after ripping.
ACTION 4: Image Destination Folder: using the Browse button, find the folder where the files will be saved.
ACTION 5: Image Filename: enter in the barcode of the book (or whatever naming convention is decided).
ACTION 6: Click Finish.
ACTION 7: The Create Image box will appear.
Page
43
a. Make sure all options are checked (Verify images after they are created, Precalculate Progress
Statistics, and Create directory listings of all files in the image after they are created).
ACTION 8: Click Start-the application will then proceed to create the Logical Image.
b. A message will appear that the Directory Listing Created Successfully.
Note: After the image has been created successfully, the hashes will be displayed to show that the
image was unaltered in the copying.
ACTION 9: Continue to click Close until all pop-up windows are closed. The image will now be in folder you specified
earlier.
ACTION 10: When creation of both Physical and Logical Images is complete, eject the optical disc by right-clicking on
the disc (located on your computer’s Desktop) and select the Eject option.
ACTION 11: Click File-Remove all Evidence Items, or the Remove
Page
44
all Evidence Items button to prepare for the next item.
Acquiring Content Using Command Prompt/XCopy
FRED
FRED
OptiPlex
Page
FRED
45
Many items that come through PRD for the Tangible Media Project are CDs and DVDs and may be ripped successfully
using the Ripstation workflow. However, there are several items that arrive for preservation reformatting which contain
obsolete media that cannot be ripped. In this case, you will need to run Xcopy in Command Prompt in order to clone the
files. The list below shows what types of media should be cloned using Command Prompt on a specific device in PRD.
Assembling Content for CTS
After you have scanned a TIF image of the item media and ripped or cloned the content, you must assemble the files
together so that they can be bagged and then later ingested into CTS.
Most of the CD/DVDs that you rip will produce an ISO-9600 file type. However, the media may also rip an MDF/MDS file
and even more file types if the media had to be cloned using FTK or Xcopy. Below are scenarios that you should look for
in the various circumstances.
Overall, a complete assembled file should contain the following regardless of ripped file types:
Standard ISO with TIF
Standard ISO with Multiple TIFs
Multiple ISOs and Multiple TIFs
MDF/MDS file with TIF
46
TIF(s) of media scanned on flatbed
Media content (regardless of file type)
Unzipped media content (for ISO files)
Page



Multiple ISO, MDF and TIFs
BIN/CUE, ISO and TIF
BIN/CUE, multiple ISO fragments and TIF
Multiple Media Items with BIN/CUE, ISO and TIF
Page
47
Varied File Types (FTK/Xcopy) and TIF
CTS Ingest (post-ripping)
Once the materials are ripped, the labels scanned, and the metadata prepared, there remains the need to transfer the
digital files to the CTS system.
Using the FileZilla application, authorized users may log in to the sun9 server, where the files are put for ingest into the
CTS long term storage system. After FileZilla opens, select “File, site manager” as shown below. After initial use, most
the information will not need to be entered again.
The Host is the sun9, where PRD archives its digital files. Servertype is should be SFTP-SSH File Transfer Protocol. The
Logontype should be “Ask for Password.” The user will have to be authorized to logon to CTS. The password will be
provided when the user authorization is given.
Page
48
Once logged in one find the following screen, depending upon the machine used. The following example was taken from
LSH5ZJLC1, one of the machines with a Ripping Station attached in the DPL work area in PRD.
Note the yellow line down the middle of the screen. On the left hand side are listed local and network directories where
the files were ripped. On the right side of the screen are directories on the server to which the directories and files are
being moved.
Page
49
The red dot on the left shows the Apollo drive (E:BCCD\FilesISO\WithPics) where ripped files with pics are stored. The
red line lists all the directories ripped named after their barcodes. The right side shows the home directory of whatever
user has logged in. (red dot right) It is necessary to change directories on the right to locate the directory where the files
should go for transfer to CTS. The directory for transfer of Tangible Media files to CTS is
/sh_ingest/tangmed/prd/staging, and it may be reached by typing it in on the right (see red dot) and hitting enter.
Page
It may take several minutes for the files to transfer, depending upon how much information was on the ripped CD or
DVD. Once the files are transferred, the permissions need to be changed on the CTS server, so they can be moved to
their final location. To do this, right click the mouse on the right side to make the following menu appear. Check all the
permissions boxes as shown, including “Recurse into subdirectories and “Apply to all files and directories” near the
bottom of the menu. Check ok. It may take a minute or longer before the permissions are changed.
50
Once in the proper directory (//sh-ingest/tangmed/prd/staging), one may right click on a directory on the local drive, on
the left and a pop-up menu will appear. Select “Upload”.
Page
51
Lastly, if confident that the files transferred, delete the directory from the left hand side of the screen so the hard drive
we rip to doesn’t fill up. Log off the sun9 by closing FileZilla. The CTS system is entered from the URL:
https://cts.loc.gov/transfer/login/login_form.html, or just https://cts.loc.gov. Users must have an account. The
username is the same as the login to the LIB network, as is the password. CTS recommend that Firefox be used to
connect to CTS.
After logging in, select, “Start”, then “Multiple receives” as shown below:
The Multiple Receive screen will come up. It looks like the following:
A long screen as following will appear:
Page
52
Note the red dots. The Project for DVD and CDs is called “PRD Digital Content”. The storage system is “sun9”. The file
path it should be set to is /sh_ingest/tangmed/prd/staging”. If all this information appears, click “Submit”.
Page
53
Typically, no fields here need to be changed, except for the bag-info.csv (see red dot). Click on the “Browse” button by
the red dot.
Find the .CSV file on the OptiCopy drive (\\lcdat3\preserv\prd) (See red dot) and select it, and open it. This contains
metadata that provide information about the directories we are adding to CTS.
Page
Note the red dots. Click on the boxes next to the items you are ingesting into CTS, the ones listed on the .CSV file you
associated with them by browsing on the last screen. Then click the green button “Start” at the bottom of this screen. It
will take CTS some time to process the items. It will report that N number of workflows have started, which will confirm
that the ingest is working.
54
A list of all the files ready or already being processed in CTS will appear.
It can take several hours for the files and directories to be ingested, depending upon the load on the system and file
sizes. The final step to ingesting items into CTS is to verify that a “best copy” has been received, and to add metadata
tags, if necessary.
The barcode for the item in question can be searched or scanned with a barcode reader. (Red dot at top right) The
information about the item is displaced. If the ingest was successful, a “long-term storage best copy” will be listed (Red
dot below). By clicking on “Tags” (red dot middle) a list of metadata tags may be seen, and edited as needed.
Page
After a best copy is received, the PRDArchive application is run to update the catalog record to show that CTS has a best
copy in the digital archive. This application is currently available on LS2PS9QG1 in the PRD. It is a very simple application,
and works with a barcode scanner, or the barcodes can be typed, if necessary. A login and password for Voyager are
needed.
55
By right clicking at the red dot, one may change or add metadata. A drop down list will appear and metadata tags may
be selected from that list. One example would be “MDF/MDS Image” which is a type occasionally found in the workflow
of ripped discs, although less often than ISO9600 image.
Once the application login is complete, a simple screen with a window for typing appears. Scan or type in the barcode
and the process begins. Once complete, the window will turn green.
This means that the catalog record has been altered to add the text “Tangible Media Preservation Project” so staff may
know that we have archived a digital copy of the CD or DVD in the CTS system. Below is an example of what altered
record will look like once the process is completed.
Page
56
Note the red dots by the 985 field of the MARC record. The phrase “Tangible Media Preservation Program” has been
added. Once this process is complete, the books with discs may be put on the cart for MRC pickup.
APPENDIX
Barcode Errors
When you select an item, the first thing you need to do is check for the presence of an LC barcode on the back cover. If
there is no barcode present, you must search the Voyager catalog for the item to see if there was ever a barcode
assigned.
No barcode in Voyager assigned to item? Give to Adrija to create a temporary barcode for the item. Place item back
into the workflow.
Barcode assigned in Voyager? Return to Cliff in BCCD with a status slip checked off with “Barcode Missing.” He or his
team will add a barcode and return to PRD to be reintroduced to the Tangible Media Project workflow.
Unzip Errors
There may be times when you rip a CD/DVD or a mini disc and which contain .iso files and find that you
receive an error message when attempting to unzip them.







The archive file may be compressed using a newer format than what is supported by the version of
WinZip currently installed. Please check the WinZip website to see if there is a newer WinZip version
that may be able to open the archive.
The archive file does not exist or is in use by another program.
The specified folder does not exist.
The file is not an archive.
The archive has been damaged or corrupted.
There were disk errors or insufficient memory while reading the archive.
The archive contains invalid or illegal filenames.
The Zip file does not conform to the Zip standard and contains non-standard data.
Page

57
This message is displayed if WinZip® was unable to open the requested archive. Specific causes for this error
include:
If you are working with a Zip file, you can try repairing the file as described in Fixing Zip Files.
If you are attempting to open an IMG or ISO file, please note that WinZip includes support to read and extract
from ISO files and disc image IMG files. Many programs use the IMG file extension for what they would term
"image data". In such a case, the "image" may be a graphic or it may be a digital image of a disc (or diskette).
Attempting to open an IMG file that is not in the expected ISO format is one way to cause WinZip to display
this error.
WinZip supports ISO file systems that include ISO 9660 and UDF from 1.02 to 2.6 (a subset of ISO 13346).
Usually, CD images use ISO 9660, DVD images use UDF1.02/ISO9660 bridge, and Blu-ray Disc images use UDF
2.5.
Status Slips
The status slips are used to keep track of errors and missing actions. The only time you will need to use a slip for an item
is when there is a problem, error, or missing action that is still needed.
The template for the status slip is located in: M:\PRD\OptiCopy\BCCD-MRC\_Instructions\Status Slips
Tracking Spreadsheet
It is important to note that the tracking spreadsheet is used to not only track the actions performed on each item, but
that the metadata collected on this sheet is also used to assist with bagging the items in a CSV format.
Therefore, it is critical that each item has a complete record before it is considered “complete.” While tempting, you
must not enter your name for the completed by sections until the action is truly complete. Entering this information
before the action is complete can lead to errors or extra work later.
Each item (book with media) should have its own line and contain the following information:







bag_id
Barcode_id
Scanned-By
Ripped-By
FTK’d-By
XCopy-By
Assembled-By
Page
In rare circumstances, someone else may have the spreadsheet open at the same time as you. In this case ONLY, you
may create a copy, delete all previous entries from the COPY ONLY, and then enter your new information in that copy.
Before walking away from the project, or leaving for the day, be sure to copy and paste all of your new information into
the ORIGINAL spreadsheet when it is again available for use.
58
Important to Note
XCOPY Parameters/Commands
Control + C: Immediately cancels current activity.
/w : Displays the message “Press any key to being copying file(s) and waits for your response before starting
/d: Copies the directory structure.
/p: Prompts you to confirm whether you want to create each destination file
/c: Ignores errors
/v: verifies each file as it is written to the destination file to make sure that the destination files are identical to the
source files
/q: suppresses the display of xcopy messages
/f: Displays source and destination files names while copying
/l: displays a list of files that are to be copied
/g: creates decrypted Destination files when the destination does not support encryption
/d [:MM-DD-YYYY]: copies source files changed on or after the specified date only. If you do not include this value,
xcopy copies all source files that are newer than existing Destination files. This option allows you to update files that
have changed.
/u: Copies files from Source that exist on Destination only.
/i: If Source is a directory that contains wildcards and Destination does not exist, xcopy assumes Destination specifies a
directory name and creates a new directory. Then, xcopy copies all specified files into the new directory. By default,
xcopy prompts you to specify whether Destination is a file or a directory, when Destination does not already exist.
/s: Copies directories and subdirectories, unless they are empty. If you omit /s, xcopy works within a single directory.
/e: copies all subdirectories, even if they are empty. Use /e with the /s and /t command-line options.
Page
/k: Copies files and retains the read-only attribute on Destination files if present on the Source files. By default, xcopy
removes the read-only attribute.
59
/t: Copies the subdirectory structure (that is, the tree), not the files. To copy empty directories, you must include the /e
command-line option.
/r: copies read-only files.
/h: copies files with hidden and system file attributes. By default, xcopy does not copy hidden or system files.
/a: copies only Source files that have their archive files attribute set. /a does not modify the archive files attribute of the
source file.
/m: copies Source files that have their archive attributes set. Unlike /a, /m turns off archive file attributes in the files
that are specified in the source.
/n: creates copies by using the NTFS short files or directory names. /n is required when you copy files or directories from
an NTFS volume or when the FAT file system naming convention (that is, 8.3 characters) is required on the Destination
file system. The Destination file system can be FAT or NTFS.
/o: copies file ownership and discretionary access control list (DACL) information.
/x: copies files audit settings and system access control list (SACL) information (implies /o).
/exclude: FileName1[+[FileName2][+[Filename3](...)]: Specifies a list of files. At least one file must be specified. Each
file will contain search strings with each string on a separate line in the file.
When any of the strings match any part of the absolute path of the file to be copied, that file will be excluded from being
copied. For example, specifying the string, \obj\ or .obj will exclude all files underneath the directory obj or all files with
the .obj extension.
/y: suppresses prompting to confirm that you want to overwrite an existing destination file.
/-y: prompts to confirm that you want to overwrite an existing destination file.
/z: Copies over a network in restartable mode.
/b: copies the symbolic link instead of the files. Parameter introduced in Windows Vista.
/j: Copies files without buffering. Recommended for very large files. Parameter introduced in Windows Server 2008 R2.
Page
60
/?: displays help at the command prompt.