Reports

Data generated by your S3 client about your content is saved in the -managed bucket associated with your S3 account.

After you begin creating buckets and uploading content, you will see folders in the -managed bucket, including:

• audit: AWS generated Audit logs
• batch: AWS generated files related to S3 batch operations
• cloudtrail: AWS generated files for events related to S3
• feedback: Application generated files for troubleshooting issues
• manifests: AWS generated inventory files
• metadata: Application generated files related to various stats (checksum, usage etc.)
• reports: Application generated files intended for user review and download

audit

• A folder for each bucket you created
• Mostly machine-readable data
• Provides details about activities performed on your data

batch

• Mostly machine-readable data
• Provides outputs from S3 batch operations

cloudtrail

• Mostly machine-readable data
• Provides outputs from S3 events

feedback

• Provides files for recording issues that arise

manifests

• Mostly machine-readable data
• Provides outputs from S3 inventory

metadata

• Provides raw stats related to checksum and inventory processes

reports

This is the primary folder for content intended for review.

Checksum

Checksum reports are organized by date and stored under reports/ in the managed bucket.

There are two types of checksum reports:

1. Checksum verification report (_checksum-report.csv)
2. Checksum inventory report (_checksum-inventory.csv)

Checksum verification report

A checksum verification report that provides generated summarising totals: matches, mismatches, missing replicas, and failures.

Checksum inventory report

This report uses existing inventory reports to generate csv of checksum metadata.

• reports/latest/checksums/<bucket>_checksum-inventory.csv — most recent report
• reports/YYYY-MM-DD/checksums/<bucket>_checksum-inventory.csv — date-stamped archive

Each CSV is a per-object checksum inventory. Each row includes the object key, its CRC64NVMe checksum (when present), and a status:

• ok — no errors were encountered retrieving metadata for this object
• not_found — object was not found
• missing_checksum — object exists but has no checksum recorded
• error — other failure

Note: checksum inventory does not provide checksum verification.

Manifest

Inventory manifest reports provide a listing of all files in each bucket. They are stored under reports/ in the managed bucket:

• reports/latest/manifests/<bucket>.csv — most recent report
• reports/YYYY-MM-DD/manifests/<bucket>.csv — date-stamped archive

Each CSV contains one row per object with metadata including filename, size, last modified date, and storage class.

Storage

Storage reports are interactive HTML files generated weekly. They are stored under reports/ in the managed bucket:

• reports/latest/storage/<stack>.html — most recent report
• reports/YYYY-MM-DD/storage/<stack>.html — date-stamped archive

Open the HTML file in a browser to view charts and tables covering:

• Aggregated totals — storage usage across all buckets in the stack
• Per bucket totals — storage usage broken down by individual bucket
• Per bucket / per prefix totals — storage usage by folder within each bucket

These reports are the most human-readable summaries available.

You may download data from any of these folders for local review and storage.

Accessing Reports

Cyberduck

1. Connect to your S3 account (see Connecting to S3).
2. Navigate to the duracloud-$ID-managed bucket and open the reports/latest/ folder.
3. Open the relevant subfolder:
   • checksums/ — checksum report CSVs per bucket
   • manifests/ — inventory manifest CSVs per bucket
   • storage/ — interactive HTML storage report for your stack
4. Right-click (or control-click on macOS) the file and select Download, Download As, or Download To to save it locally.
5. To view the storage report, open the downloaded .html file in your browser.

Tip

• Downloaded files are saved to your default Downloads folder. You can change this in Edit → Preferences → Transfers under the General tab.
• Right-click to rename files when downloading to avoid overwriting reports from previous dates.

SFTPGo

1. Log in to the SFTPGo web interface (see Connecting to S3).
2. Navigate to the managed folder, then open reports/latest/.
3. Open the relevant subfolder:
   • checksums/ — checksum report CSVs per bucket
   • manifests/ — inventory manifest CSVs per bucket
   • storage/ — interactive HTML storage report for your stack
4. To download a single file, click directly on its filename.
5. To download multiple files, check the boxes next to them and use the Actions menu → Download. Selected items will be zipped automatically.
6. To view the storage report, download the .html file and open it in your browser.

AWS CLI

Download the latest storage report:

aws s3 cp s3://duracloud-$ID-managed/reports/latest/storage/$ID.html .

Download the latest checksum inventory for a bucket:

aws s3 cp s3://duracloud-$ID-managed/reports/latest/checksums/$BUCKET_checksum-inventory.csv .

Download the latest manifest report for a bucket:

aws s3 cp s3://duracloud-$ID-managed/reports/latest/manifests/$BUCKET.csv .

Sync an entire dated archive locally:

aws s3 sync s3://duracloud-$ID-managed/reports/ ./reports/