Identify and resolve device issues in the Code42 console
Overview
A healthy Code42 environment is one that actively collects file activity from active endpoints or data connectors and reports it in the Code42 console for review and investigation in Forensic Search, on dashboards, and in Alerts. There are several tools available to help you identify devices that may need attention. This article describes how you can use these tools to identify and resolve issues to maintain and improve your Code42 environment health.
For information on monitoring and resolving issues for Incydr Professional, Enterprise, Horizon, and Gov F2, see Monitor and improve Incydr environment health.
Environment health monitoring tools
Risk Exposure dashboard
Users and Devices
Both the Users list and Devices list allow you to quickly view either active or deactivated users and devices: just click the appropriate tab. You can use this information to determine whether a user or device should be deactivated because that user is no longer with your organization or that device has been replaced.
Users that are custodians of a legal hold (and their associated devices) cannot be deactivated in the Code42 console. These users and devices are included in active totals, even if those users are no longer with your organization.
Work with your Legal department to identify users that are involved in a legal hold, and remember to account for these users and their devices when reviewing the totals in active users and devices lists.
The User details screen lists all devices associated with a user. Click a device name to open the Device details screen for that device. The device details and user details Preservation tab display a progress bar that indicates the health of that device:
- Green: The device has sent data to the Code42 cloud within the past three days.
- Yellow: Indicates a warning state, meaning that the device hasn't sent any new data to the Code42 cloud in three days.
- Red: Indicates a critical state, meaning that the device hasn't sent any new data to the Code42 cloud in seven days (or longer).
In addition, statistics displayed throughout the Code42 console can help you identify devices that may need attention:
- In the Devices list, the Last Backup Activity column displays the amount of time that has elapsed since the device last sent data to Code42.
- On the Device details screen, Authority Connection indicates whether the device is Online (and authenticated with the Code42 cloud) or Offline. Offline does not necessarily indicate a problem with that device as users may be on vacation or extended leave and not actively using it.
- On the Device details screen, Last Activity displays the time elapsed since the device last sent backup data to Code42. If there hasn't been activity for multiple days:
- Verify that the computer has been turned on and connected to the Internet.
- Access the client device to verify that it’s connected to the Code42 cloud and is operational.
- Run a network connection test over port 4287 to the destination's IP address to verify connectivity.
- On the Device details screen, Completed represents the time elapsed since the device reached 100% backed up. If this shows that the last 100% backup happened many days or weeks ago, the device is likely sending new files, but a small number of files may be locked and preventing backup. To troubleshoot these situations, follow these articles:
If a device has multiple backup sets backing up to the same destination, the backup progress and statistics indicate the combined status of all backup sets. (Devices using Code42 agent 10.x and earlier only report the status of the backup set with the most recent activity.)
Endpoint dashboard
The Endpoint dashboard (available for Incydr Advanced only) helps you identify device issues by showing endpoint activity throughout your entire Code42 environment, including endpoints that aren't reporting security events.
Device Status report
Use the Device Status report to gather information about the devices in your Code42 environment. You can use this report to:
- Identify devices with abnormally small archives (such as 10 MB or less), which may indicate installation or deployment errors that prevent those devices from sending data to the Code42 cloud.
- Verify the version of the Code42 agent installed on devices to determine which may need to be upgraded.
- List devices by the date and time they last sent data to the Code42 cloud. This can help you identify those that have not connected in some time.
- List devices by the date and time they last completed a backup. This can help you identify devices with locked files or other issues that are preventing backup.
For more information, see Device status report use cases.
Email warnings
The Code42 cloud sends out warning emails if a device hasn't sent data to any backup destinations after a certain time period. The default is to send a warning message after three days and a critical message after five days. A warning email indicates that further investigation is needed.
You can configure the number of days that trigger either warning or critical emails in the organization Reporting settings.
Data Connections status
Code42 API
- Legal Hold and Cases: Identify the users who are associated with active investigations and gather information about the file events involved. From this information, you can identify devices that may need to be preserved until the investigation completes.
Code42 CLI
- Legal Hold and Cases: Identify the users who are associated with active investigations and gather information about the file events involved. From this information, you can identify devices that may need to be preserved until the investigation completes.
Code42 Insider Threat app for Splunk
Actions to improve environment health
Ensure devices are up-to-date
When a device is running an outdated version of the Code42 agent, it may not be reporting all file activity efficiently (or may not be reporting activity for new exfiltration vectors and destinations at all), which may represent a weakness in your insider risk strategy. Use the tools in the Code42 console, Code42 API, or Code42 CLI to identify devices that aren't running the current version of the Code42 agent.
To troubleshoot device updates:
- Verify that those devices are still in use and can connect to the Code42 cloud. Deactivate devices that are no longer used to connect to Code42.
- Verify that devices are using current deployment policy properties, scripts, and tokens. If the Code42 agent is deployed to a device with incorrect properties, initial installation may not have completed successfully (and thus, subsequent upgrades cannot complete either). Ensure that the scripts used to associate a username with a device are correct and use the appropriate commands and arguments for the operating system. Generate a new token as needed.
- If needed, uninstall and reinstall the Code42 agent to resolve issues with upgrading.
Troubleshoot connection issues
If a user's device is unable to connect to the Code42 cloud, Code42 cannot accurately report security events, file activity, or statistics regarding backup completions occurring on that endpoint.
Causes
The most common reasons that a device cannot connect to the Code42 cloud include:
- The user is on extended leave, and his or her endpoint is powered off or is not actively in use.
- The user has left the organization but has not been deactivated.
- The user has received a new device and no longer needs to use the previous endpoint.
- Other applications installed on the device are interfering with connectivity.
- Communication between the Code42 agent installed on the device and the Code42 cloud is blocked.
- The user has uninstalled the Code42 agent or has stopped the Code42 service.
- An administrator is using deep packet inspection to examine traffic from devices to the Code42 cloud.
- Mac devices don't have full disk access, or the .mobileconfig file deployed to the device isn't set up correctly.
Solutions
To resolve device connectivity issues, take the following actions:
- If employees have access to the Code42 agent, verify that the employee is able to connect to backup destinations and the Code42 service. Make sure that all backup destinations are available. Use the status messages displayed in the Code42 agent to help diagnose any issues.
- Verify that endpoints are reporting security events as they should.
- Verify employee status with managers or your organization's Human Resources department. Remember that users who are custodians of legal holds cannot be deactivated.
- Deactivate devices that are no longer used to connect to Code42.
- Verify that employees use the replace device wizard to associate their previous device's backup archive with their new device and prevent backups from starting over.
- Verify that you have created exceptions for Code42 in any antivirus, security, or endpoint detection and response (EDR) applications your organization uses, and that those exception are valid and working correctly.
- Verify that the IP addresses and ports used by Code42 are open and that there is no deep packet inspection on Code42 traffic on port 4287. Verify that network traffic settings are optimized for where your employees work.
- Deploy the Code42 agent so that it cannot be uninstalled.
- Disable client visibility on user devices or deploy the Code42 agent using the DEVICE_CLOAKED argument in deployment scripts.
- Use Jamf's Privacy Preferences Policy Control (PPPC) Utility to create and deploy a .mobileconfig file to the Mac devices in your environment to grant these devices full disk access. When creating this file, verify that the settings are correct for your organization:
- In Properties, all areas you want to monitor are selected.
- In Apple Events, all web browsers you want to monitor for uploads are selected.
- In System Extensions, the Code42 agent team identifier and system extension are correct.
Troubleshoot backup issues
Even though an endpoint may be able to connect to the Code42 cloud, it may not be able to successfully complete a backup.
Causes
The most common reasons that a device cannot complete a backup include the following:
- The file selection is incorrect.
- The file selection may include files that are constantly changing (such as log files).
- The file selection may include temporary files that no longer exist at the next backup session.
- Files are locked, or the Code42 agent doesn't have the correct permissions to back up those files.
- Users may have paused backups.
- If CPU throttling is restricted, the Code42 agent may not have the CPU resources required to complete a backup.
- If network throttling is restricted (either in the Code42 agent or by your organization's network settings), the Code42 agent may not have enough bandwidth to send the backup data.
- The frequency between backup sessions is too short when compared to the size of the backup set, making the Code42 agent unable to complete a backup before the next backup begins.
Solutions
To resolve device backup issues, take these actions:
- If employees have access to the Code42 agent, verify that the employee is able to connect to backup destinations and the Code42 service. Make sure that all backup destinations are available. Use the status messages displayed in the Code42 agent to help diagnose any issues.
- Verify that the file selection is correct. After verifying the backup set, review the device backup history log for files that aren't backed up and adjust file exclusions to exclude temporary files or files that are constantly being updated.
- Verify that the Code42 agent has the necessary permissions (especially for Mac devices).
- Ask employees to restart backups. If needed, you can disable users' ability to pause backups.
- Increase the amount of CPU processing available for backup activity.
- Increase the network bandwidth available for backup activity. You can update network settings in the Code42 console to address Code42 agent network usage.
- If the employee is backing up large files that frequently change, consider updating the backup frequency setting to allow more time between backup sessions.
Resolve devices with invalid archives
Generally, a device demonstrates that it can successfully connect to and send data to the Code42 cloud when it has an archive that is larger than 10 MB. Devices with archives smaller than 10 MB likely have issues that need attention.
- The user home directory for that device may be incorrect, which may interfere with the device sending backup data at all. You can reset a device's home directory with the
agent.userhome
command in the Code42 console's command-line interface. - The file selection is incorrect and thus the device isn't sending backup data as expected. To resolve file selection issues:
- Verify that file exclusions are entered correctly.
- Verify the capitalization used in the file selection matches file paths and file names.
- Clear the device's cache.
- One (or more) Mac devices may not have full disk access.
Use the Device Status report to list devices with archives smaller than 10 MB for investigation.