Resolve extreme scale from large manifest files
Instructor, no.
Incydr Professional, Enterprise, Horizon, and Gov F2, no.
Incydr Basic, Advanced, and Gov F1, yes.
Overview
Extreme scale due to large manifest files can cause issues such as slow loading of file restore options, file restores that take a long time to complete, restores that time out, and problems with synchronization. This article describes what a file manifest is, what causes extreme scale, and what you do to resolve these issues.
About large manifests
A manifest file is a binary file that stores the file paths in the archive. A history data file is a binary file that stores the version information of all backed up files. During the restore process, Code42 checks the manifest file to identify the path to use when restoring a file. Code42 also checks the history data file to confirm that the file exists and fetches the file for you.
Causes of extreme scale
Backup archives can reach extreme scale due to large manifest files as a result of:
- Backing up file versions at a high frequency
- Retaining more file versions than necessary
- Backing up system or application files (like app data, temp data, system files, and so on) that the Code42 agent is not designed to back up. For more information, see What should you back up?.
Recommended solution
You can manage the size of the manifest file and the history data file by updating your file selection, updating frequency and version settings, and changing the Remove deleted files setting. See Optimize Code42 console settings for backup and legacy agents for full details on how to optimize your settings.
Step 1: Change the file selection
Update files and folders in your file selection:
- Open the Code42 agent.
- Go to Manage files.
- Uncheck the box next to:
- Windows: C:
- Mac: / or Macintosh HD
Do not Save until file selection is complete
After you have deselected your main drive, you must select all the files and folders you want backed up before you save your changes. Deselected files are no longer included in the backup file selection and are permanently deleted from the backup archive the next time daily maintenance runs. Files that have been permanently deleted can't be restored. - Verify any external drives you want backed up are selected.
- Navigate to the files and folders you want backed up. User files are typically stored in a User directory or Home folder.
- Select the check box next to the files and folders you want backed up.
- Click Save.
For detailed instructions, see Change the file selection.
Step 2: Update frequency and versions settings
Updating the frequency and version settings for your backups can help reduce the size of your manifest file and the history data file, resolving issues with file restores and synchronization.
You can update frequency and version settings from the Code42 agent or from the Code42 console. When adjusting these settings:
- Decrease the number of file versions that are backed up.
- Change the Remove deleted files setting to 90 days.
Step 3: Start archive maintenance
To reduce the size of your backup archive, manually start archive maintenance:
- Sign in to the Code42 console.
- Select Administration > Environment > Devices from the menu.
- On the Active tab, select the device for which you want to start archive maintenance.
- From the device details, select the Archive Options icon
.
- Select Maintain Archive.
A message informs you that running archive maintenance may cause the archive to become unavailable for restore or backup until maintenance finishes. - Click OK.
Your job is added to the queue.
Next steps
- You can confirm the issue is resolved when you can navigate the restore files options (from the Code42 agent or the Code42 console) without experiencing any slowness. From a technical standpoint, the manifest file should be around 300 MB or less, and the manifest file should be 1 GB or less.
- For more information about how to configure your environment for optimal performance, see Optimize Code42 console settings for backup and legacy agents.