I’m getting this error message from BE when attempting to run jobs on two separate servers.
The jobs are attempting to backup SQL server databases
Final error: 0xe00084f8 - The network connection to the Backup Exec Remote Agent has been lost. Check for network errors. Final error category: Resource Errors
This error happens on the Full and Daily Differential backups, not the log backups.
This happens when initiated manually or when run automatically
So background on the servers/other info
One is a physical machine, one runs on VMware ESXi 5.1
Both have 4 gigs of ram and similar CPU (8 cores)
OS: Windows 2003 R2
SQL Server: 2005 SP4
BE: 2010 R2
Job size is 250 gigs for one server, 300 gigs for another (We have several TB size databases that do not fail)
When failing on a full backup fails significantly % wise, 250 gig db only hits about 40-60gigs
Backups have their own dedicated network with 1gig access
Permissions are not an issue, tested via elevation
I've noticed that after a time if I'm watching the job run, the byte count will just stop increasing, it will fail 5-10 minutes after that.
So I’ll go through all of the things I’ve done thus far to try and solve this problem
-Restarted the be agent
-Restarted the server
-Uninstalled/Reinstalled the be agent
-Upgraded to SQL Server 2005 SP4 (This seemed to fix the problem for a couple of days)
-Originally these databases and servers were part of a large backup job with a number of SQL databases they have been since isolated and separate jobs created
--Tested each database individually and it appears size related (maybe?), as the larger databases fail, but the smaller ones grouped together also cause a fail.
-netstat –a shows nothing on port 10000
I get 4 or 5 error messages in the event log on the agent’s server, these pop up around the time the backup is running and are likely related. Here is the output from the latest attempt to run the job. (I’ve removed what I think might be sensitive info with ****)
---
Event Type: Error
Event Source: SQLVDI
Event Category: None
Event ID: 1
Date: 6/3/2014
Time: 11:56:30 AM
User: N/A
Computer: ****
Description: SQLVDI: Loc=SignalAbort. Desc=Client initiates abort. ErrorCode=(0). Process=4572. Thread=4492. Client. Instance=. VD=Global\****_00__215eddd0_1765_4cb6_978b_815fbd697760__SQLVDIMemoryName_0.
---
Event Type: Error
Event Source: SQLVDI
Event Category: None
Event ID: 1
Date: 6/3/2014
Time: 11:56:30 AM
User: N/A
Computer: ****
Description:SQLVDI: Loc=TriggerAbort. Desc=invoked. ErrorCode=(0). Process=1672. Thread=944. Server. Instance=MSSQLSERVER. VD=Global\****_00__215eddd0_1765_4cb6_978b_815fbd697760__SQLVDIMemoryName_0.
--
Event Type: Error
Event Source: MSSQLSERVER
Event Category: (6)
Event ID: 3041
Date: 6/3/2014
Time: 11:56:30 AM
User: ****
Computer: ****
Description: BACKUP failed to complete the command BACKUP DATABASE **** WITH DIFFERENTIAL. Check the backup application log for detailed messages.
--
Event Type: Error
Event Source: MSSQLSERVER
Event Category: (2)
Event ID: 18210
Date: 6/3/2014
Time: 11:56:30 AM
User: ****
Computer: ****
Description: BackupVirtualDeviceFile::ClearError: failure on backup device '****_00__215eddd0_1765_4cb6_978b_815fbd697760_'. Operating system error 995(The I/O operation has been aborted because of either a thread exit or an application request.).
---
Event Type: Error
Event Source: MSSQLSERVER
Event Category: (2)
Event ID: 18210
Date: 6/3/2014
Time: 11:56:30 AM
User: ****
Computer: ****
Description: BackupVirtualDeviceFile::RequestDurableMedia: Flush failure on backup device '****_00__215eddd0_1765_4cb6_978b_815fbd697760_'. Operating system error 995(The I/O operation has been aborted because of either a thread exit or an application request.).
--
I’ve got the last bit of output from SGMon from a job I ran on Friday and truncated the log down to around the time the job failed if that would be helpful.
I’m new to systems administration and none of my coursework in the past covered third party backup applications. So please any help would be appreciated.
Also I know very little about SQL functionality so if I need to run queries I’ll need some help with that.
Thanks