PDF Shadow File

PDF Shadow File

• is a tar.gz that contains a tar'ed and compressed set of files
• each file is a "shadow" of a PDF file in the S3 bucket
• the timestamp of the "shadow" is the timestamp of the file in S3
• the "shadow" file contains either
  • a) ASCII/utf8 numbers 0-9, representing the number of bytes in the PDF file
  • b) NEW an ASCII/utf8 string starting FAILED:, representing that the generation of the PDF from the EAD has previously failed

                                                                                             
 NEW                                                                                         
                                                                                             
                                                                                             
┌──────────────────────┐┌────────────┐┌────────────┐┌─────────────┐┌────────────────────────┐
│   EAD URL on voro   ─┼┼▶          ─┼┼▶          ─┼┼▶           ─┼┼▶      PDF on S3        │
└──────────────────────┘│ figure out ││ launch EC2 ││ Create PDF  │└────────────────────────┘
┌──────────────────────┐│   batch    ││            ││    files    │                          
│ "Shadow File" on S3 ─┼┼▶           ││            ││             │                          
└──────────────────────┘└─────┬──────┘└────────────┘└─────────────┘                          
                              │                                    ┌────────────────────────┐
                              └───────────────────────────────────▶│new "Shadow File" on S3 │
                                                                   └────────────────────────┘
                                                                                             
                                                                                             
                                                                                             
 OLD                                                                                         
                                                                                             
┌────────────────────┐  ┌────────────┐┌────────────┐┌─────────────┐┌────────────────────────┐
│  EAD URL on voro   ├──▶           ─┼┼▶          ─┼┼▶           ─┼┼▶      PDF on S3        │
└────────────────────┘  │ figure out ││ launch EC2 ││ Create PDF  │└────────────────────────┘
┌────────────────────┬──▶   batch    ││            ││    files    │                          
│  Amazon Simple DB  │  │            ││            ││             │                          
└────────────────────◀──┴─────┬──────┘└────────────┘└─────────────┘                          
                              │                                    ┌────────────────────────┐
                              └───────────────────────────────────▶│new "Shadow File" on S3 │
                                                                   └────────────────────────┘