Error at backup job - OS mount failed

Last post 04-22-2019, 6:51 AM by AmolJ. 15 replies.
Sort Posts: Previous Next
  • Error at backup job - OS mount failed
    Posted: 10-15-2018, 3:20 AM

    Hello,

    i've a big problem because on the backupjob i get this error message.

    Error Code: [32:392] Description: OS mount failed : [Mount failed:E_FAIL (MM.60611)] Source: ntbackup1, Process: FileScan

    Until this tine every backup works well an we doesn't have any problems like this. And it get only on Snap Backup.

    Can you help me ?   It's urgent.

    Our system was Commvault V11 SP12+

     

    regards

    Chris

  • Re: Error at backup job - OS mount failed
    Posted: 10-15-2018, 3:34 AM

    Can you provide additional information regarding the scenario for this backup?
    What is backed up and how.


    Jos Meijer
    Senior Technical Consultant
  • Re: Error at backup job - OS mount failed
    Posted: 10-15-2018, 3:59 AM

    Hello,

    it was stuppied because until thie time it works well. We have some fileserver systems in a windows 2016 cluster and on that are some shares which we backup on our commserve.

    Until a progress of 65% it works and it was also in scan mode.

    But i think it was better that i send you the logfile of the job.

    i hope it will be sended. ;)

     

    regards

    chris

  • Re: Error at backup job - OS mount failed
    Posted: 10-15-2018, 4:47 AM

    Hi Chris,

    I don't see the log, can you try to upload it again?


    Jos Meijer
    Senior Technical Consultant
  • Re: Error at backup job - OS mount failed
    Posted: 10-15-2018, 5:11 AM

    ohhh i think it does upload the logfile now.

    Perhaps this part of the CVMA.log can help to solve the problem.

     

    6040 208c 10/15 10:16:51 1472056 VdsUtil::Init VDS service is started\ready at time [2018/10/15 08:16:51.926826Z].
    6040 208c 10/15 10:16:51 ####### CvVds::FindAndAssignAccessPath() - Searching for volume [\\?\PhysicalDrive6], number [1], type [5], SearchFlags [0x00000001] and adding accesspath [C:\Program Files\CommVault\Simpana\MediaAgent\SnapVolumeMounts\SnapMnt_1_2_8970062_51_77372]
    6040 208c 10/15 10:16:51 ####### CvVds::FindAndAssignAccessPath() - Found the disk with Name : [\\?\PhysicalDrive6]
    6040 208c 10/15 10:16:51 ####### CvVds::FindAndAssignAccessPath() - Error: Recover operation failed on the offline non-foreign pack: 8004251a
    6040 208c 10/15 10:16:51 1472056 DoMount FindAndAssignAccessPath:[E_FAIL]
    6040 208c 10/15 10:16:51 1472056 CVSnapOSUtilWin::mountVolumes DoMount() failed. Retrying..
    6040 208c 10/15 10:16:52 ####### CvException::init(): func_name=CVSnapOSUtilWin::mountVolumes, file_name=cvsnaposutilwin.cpp, message='Mount failed:E_FAIL (MM.60611)', errno= 60611
    6040 208c 10/15 10:16:52 1472056 CVSnapOSUtilWin::mountVolumes 60611:Mount failed:E_FAIL (MM.60611) (cvsnaposutilwin.cpp:543)
    6040 208c 10/15 10:16:52 1472056 CVSnapOSUtil::mountVolumes() - Volume (77372) mount status is 40 RemOp:2220-0
    6040 208c 10/15 10:16:52 1472056 CVMASnapHandlerInternal::mountVolumes() - Failed with error [60611:Mount failed:E_FAIL (MM.60611)].
    6040 208c 10/15 10:16:52 1472056 CVMASnapHandlerInternal::mountVolumes() - Failed to mount volumes from snap devices. Err [60611:Mount failed:E_FAIL (MM.60611)].
    6040 208c 10/15 10:16:52 1472056 CVMASnapHandlerInternal::mountVolumes() - Request for mountVolumes Failed. Status [-1].
    6040 208c 10/15 10:16:52 1472056 WORKER [2331527/0/0 ] Failed to Mount Volume . Err [60611:Mount failed:E_FAIL (MM.60611)].
    6040 208c 10/15 10:16:52 1472056 WORKER [2331527/0/0 ] ProcessVolSnapMount from completed
    6040 23d4 10/15 10:19:51 1471833 SERVICE [2331548/0/0 ] Received CVMA_MAGNETIC_INITVOL_REQ.
    6040 208c 10/15 10:19:52 1471833 WORKER [2331548/0/0 ] Created directory [\\BD1\Pool$\lv0001\Folder1\CV_MAGNETIC\V_1267473]
    6040 208c 10/15 10:19:52 1471833 WORKER [2331548/0/0 ] Revoked delete permissions for path [\\BD1\Pool$\lv0001\Folder1\CV_MAGNETIC\V_1267473].
    6040 208c 10/15 10:19:52 1471833 OML [2331548/0/0 ] WRITE OML returned OML on the media
    MagicNumber =CVMEDIALABEL
    LabelVersion =11(BUILD80)
    MMSCommCellId =1020610
    LabelType =CommVault Media Label
    Vendor =CommVault Systems
    MediaCreationTime =1450277284
    Application =Galaxy
    MediaName =
    MediaID =1020610_BC_CV_MAGNETIC_51
    LabelGUID =
    BarCode =CV_MAGNETIC
    SideName =A_51
    FriendlyName =
    CheckSum =
    6040 208c 10/15 10:19:55 1471833 WORKER [2331548/0/0 ] CVMMClient API for initVolResp from completed
    6040 a00 10/15 10:20:11 ####### TPool [CVMASvcThPool]. Ser# [0] Tot [2], Pend [0], Comp [2], Max Par [1], Time (Serial) [25.703217]s, Time (Parallel) [25.703217]s, Wait [0.000064]s
    6040 a00 10/15 10:20:11 ####### TPool [IOCPServerPool_DataServer]. Ser# [1] Tot [40], Pend [40], Comp [0], Max Par [0], Time (Serial) [0.000000]s, Time (Parallel) [0.000000]s, Wait [0.000000]s
    6040 a00 10/15 10:20:11 ####### TPool [IOCPServerPool_CvMountdServer]. Ser# [1] Tot [40], Pend [40], Comp [0], Max Par [0], Time (Serial) [0.000000]s, Time (Parallel) [0.000000]s, Wait [0.000000]s
    6040 a00 10/15 10:20:11 ####### TPool [CvMountdServer]. Ser# [1] Tot [2], Pend [0], Comp [2], Max Par [1], Time (Serial) [0.000481]s, Time (Parallel) [0.000481]s, Wait [0.000112]s
    6040 208c 10/15 10:24:12 ------- WORKER [ ] DLP log level is 80010040
    6040 208c 10/15 10:24:12 ------- WORKER [ ] DLP log query freq. is 5 secs
    6040 208c 10/15 10:24:12 ####### WORKER [2331608/0/0 ] cvmamagneticworker.cpp:5797 Failed to open DLP port. Driver may not be running.
    6040 2014 10/15 10:24:26 ------- CVMMIdxSIDBStoreInfo::getSIDBSubStoreList() - Received SIDBSubStores [2] for SIDBStoreId [20].
    6040 1be0 10/15 10:24:26 ------- CVMMIdxSIDBStoreInfo::getSIDBSubStoreList() - Received SIDBSubStores [2] for SIDBStoreId [21].
    6040 23d4 10/15 10:24:28 ####### SERVICE [2331637/0/0 ] Received CVMA_MAG_PRUNE_REQ.
    6040 17c4 10/15 10:24:28 ####### SERVICE [2331638/0/0 ] Received CVMA_MAG_PRUNE_REQ.
    6040 23d4 10/15 10:24:28 ####### SERVICE [2331639/0/0 ] Received CVMA_MAG_PRUNE_REQ.

  • Re: Error at backup job - OS mount failed
    Posted: 10-15-2018, 6:09 AM
    Resource issues:
    14944 5390 10/15 09:50:49 1472022 Scheduler Ignored pending cause [File scan initialization failure. Possible causes: Services down on Client and/or CommServe, lost network connectivity to CommServe, out of process memory, handles or corrupted install.]::Client [ntbackup1] Application [FileScan] Message Id [285212704] RCID [0] Reservation Id [0]. Level [0] flags [0] id [0] overwrite [0] append [0] CustId[0].
    Mount issue PhysicalDrive4
    6040 1aec 10/15 09:50:48 ####### CvVds::FindAndAssignAccessPath() - Searching for volume [\\?\PhysicalDrive4], number [1], type [5], SearchFlags [0x00000001] and adding accesspath [C:\Program Files\CommVault\Simpana\MediaAgent\SnapVolumeMounts\SnapMnt_1_2_8969986_51_77365]
    6040  1aec  10/15 09:50:48 ####### CvVds::FindAndAssignAccessPath() - Found the disk with Name : [\\?\PhysicalDrive4]
    6040 1aec 10/15 09:50:48 ####### CvVds::FindAndAssignAccessPath() - Error: Recover operation failed on the offline non-foreign pack: 8004251a
    6040 1aec 10/15 09:50:48 1472022 DoMount FindAndAssignAccessPath:[E_FAIL]
    6040 1aec 10/15 09:50:48 1472022 CVSnapOSUtilWin::mountVolumes DoMount() failed. Retrying..
    6040 1aec 10/15 09:50:49 ####### CvException::init(): func_name=CVSnapOSUtilWin::mountVolumes, file_name=cvsnaposutilwin.cpp, message='Mount failed:E_FAIL (MM.60611)', errno= 60611
    6040 1aec 10/15 09:50:49 1472022 CVSnapOSUtilWin::mountVolumes 60611:Mount failed:E_FAIL (MM.60611) (cvsnaposutilwin.cpp:543)
    6040 1aec 10/15 09:50:49 1472022 CVSnapOSUtil::mountVolumes() - Volume (77365) mount status is 40 RemOp:2220-0
    6040 1aec 10/15 09:50:49 1472022 CVMASnapHandlerInternal::mountVolumes() - Failed with error [60611:Mount failed:E_FAIL (MM.60611)].
    6040 1aec 10/15 09:50:49 1472022 CVMASnapHandlerInternal::mountVolumes() - Failed to mount volumes from snap devices. Err [60611:Mount failed:E_FAIL (MM.60611)].
    6040 1aec 10/15 09:50:49 1472022 CVMASnapHandlerInternal::mountVolumes() - Request for mountVolumes Failed. Status [-1].
    6040 1aec 10/15 09:50:49 1472022 WORKER [2329495/0/0 ] Failed to Mount Volume . Err [60611:Mount failed:E_FAIL (MM.60611)].
     
    Proxy host initialization issue:
    9316  2308  10/15 09:50:49 1472022 CVMMSnapAPI::processVolSnapOperation() - Response from MM -- << OpType[2: Mount] SnapJob[1472022] SrcClient[635] MountHost[488] VmHostId[0] OpSrc[1: IDA] OpMode[3: HWDB] Flags[2] HopCount[0] Status[-1] Error[60611] ErrStr[Mount failed:E_FAIL (MM.60611)] >>
    9316 2308 10/15 09:50:49 1472022 CVMMSnapAPI::processVolSnapOperation() - VolSnap from MM -- << [V-1: 77365] [MS: 58] [S-1: 92497] [MD-9: -1 -2 -3 -4 -5] [M-1: 92497] [C-1: 15] [E-1: 3] >>
    9316 2308 10/15 09:50:49 1472022 CVMMSnapAPI::processVolSnapOperation() - VolSnaps Operation Failed. Status [-1] Err [60611:Mount failed:E_FAIL (MM.60611)]
    9316 2308 10/15 09:50:49 1472022 CVSnapClientAPIInternal::mountVolumes () - Failed to mount Volume. Err [60611:OS mount failed]. VolSnapInfo Status-[-1] Err [60611:Mount failed:E_FAIL (MM.60611)].
    9316 2308 10/15 09:50:49 1472022 CVSnapClientAPIInternal::setJPR() - Setting JPR Job Id [1472022] Err [60611] EvErr [1040189270] ErrStr [Mount failed:E_FAIL (MM.60611)]
    9316 2308 10/15 09:50:49 1472022 CVSnapClientAPIInternal::setJPR() - JPR Set - Error [60611, Mount failed:E_FAIL (MM.60611)] Custom Error [Mount failed:E_FAIL (MM.60611)]
    9316 2308 10/15 09:50:49 1472022 CVSnapClientAPIInternal::mountVolumes() - Request for mountVolumes Failed. Status [-1].
    9316 2308 10/15 09:50:49 1472022 CSnapBackupPathTranslator::MountSnapshots(2922) - Failed to mount snapshots
    9316 2308 10/15 09:50:49 1472022 CSnapBackupPathTranslator::initialize(2497) - InternalInitialize failed, error=0x80004005:{CSnapBackupPathTranslator::InternalInitialize(2518)} + {CSnapBackupPathTranslator::SBInitPathResourceMapper(2354)/Failed to build snap backup proxy resource map} + {CSnapBackupPathTranslator::BuildSBResourceMap(2301)/HR.0x80004005-(Unbekannter Fehler)-Failed to mount snapshots}
    9316 2308 10/15 09:50:49 1472022 CFind::InitializeProxyHost(3553) - Proxy host mapper not initialized, AppId=[2:1622]
    9316 2308 10/15 09:50:49 1472022 CFind::InitializeProxyHost(3538) - --- 0:22.146153
    9316 2308 10/15 09:50:49 1472022 CFindAdvanced::InitializeProxyHost(1077) - --- 0:22.146900
    9316 2308 10/15 09:50:49 1472022 CFind::ConfigureRunSequence(753) - JobDisposition handled, JobDisposition=[1], MessageId=[285212704 0xFFFFFFFF], Item=[CFind::InitializeProxyHost], error=0x8007065B:{CFindAdvanced::InitializeProxyHost(1147)/W32.1627.(Beim Ausf��n der Funktion ist ein Fehler aufgetreten.)-Failed to initialize proxy host mapper, exiting, AppId=[2:1622]}
    9316 2308 10/15 09:50:49 1472022 CFind::ProcessJobDisposition(7553) - +++ Status=[1], FailJobFlag=[0]
    9316 2308 10/15 09:50:49 1472022 JOBRESULTSTABLE(C:\Program Files\CommVault\Simpana\iDataAgent\JobResults\CV_JobResults\2\0\1472022\J removing copy 'C:\Program Files\CommVault\Simpana\iDataAgent\JobResults\CV_JobResults\2\0\1472022'
    9316 2308 10/15 09:50:49 1472022 BKP CALLED COMPLETE (PHASE Status::FAIL), 1472022. Token [1472022:8:1:1]
    9316 2178 10/15 09:50:49 1472022 CVJobCtrlLog::unregisterProcess(): successfully removed file [C:\Program Files\CommVault\Simpana\Base\JobControl\9.316]
    9316 2308 10/15 09:50:49 1472022 CFind::ProcessJobDisposition(7553) - --- Status=[1], FailJobFlag=[0]
    9316 2308 10/15 09:50:49 1472022 CFind::Run(969) - --- 0:22.435981
    9316 2308 10/15 09:50:49 1472022 _enclosed_main(388) - Run failed, error=0x8007065B:{CFind::Run(975)} + {CSimpleRunSequence::Run(107)/SequenceItem=[CFind::InitializeProxyHost]} + {CFindAdvanced::InitializeProxyHost(1147)/W32.1627.(Beim Ausf��n der Funktion ist ein Fehler aufgetreten.)-Failed to initialize proxy host mapper, exiting, AppId=[2:1622]}

    Don't have all the circumstances in place, but seems to be a resource issue on the client.
    Are there relevant system event logs from these timestamps?

    Jos Meijer
    Senior Technical Consultant
  • Re: Error at backup job - OS mount failed
    Posted: 10-15-2018, 8:22 AM

    thanks

  • Re: Error at backup job - OS mount failed
    Posted: 10-15-2018, 8:22 AM

    ok, but i have restarted all services on backupserver and fileserver again, but nothing.

    I thin i'll open a direct commvault ticket.

    Thanks to you but if you have any idea to solve my problem, you can write to me.

     

    regards

    chris

     

  • Re: Error at backup job - OS mount failed
    Posted: 10-16-2018, 3:46 AM

    Now i hear that my admin of the storage-cluster had changed the storagesystem on an veritas storage with active state.

    Can this be a possible problem of my problem?

  • Re: Error at backup job - OS mount failed
    Posted: 10-16-2018, 6:44 AM

    Hi Macmeki,

     

    what is your proxy server? this looks like mount path issue which is being used during the mount process on your proxy server. can you please tell us more about this. There could be a workaround for this issue.

  • Re: Error at backup job - OS mount failed
    Posted: 10-16-2018, 9:00 AM

    sorry, i hear that it was no veritas storage, of corse it will only the "Veritas Volume Manager" Tool under the netapp storage. It was an idea of our storage-Admin.

    Since we have this situation it looks the error off "OS mount failed" but before we had this error-message.

    Failed to create VSS snapshot within the 10 second write inactivity limit. See the Windows application log for more details. Source: ntdaten02, Process: CVFSSnap

    Perhaps it can help to solve the problem with the snapshot backup problem.

     

    regards

    chris

  • Re: Error at backup job - OS mount failed
    Posted: 10-17-2018, 6:26 AM

    Hi Chris,

     

    Try restarting VDS service where it is mounting.

     

    Thanks 

    AJ

  • Re: Error at backup job - OS mount failed
    Posted: 10-18-2018, 3:58 AM

    Sorry but you thing this was the "ntdaten02" to my part ?   This will be one if the clusterserver.

    Or do you think on the commvault backupserver?

     

    I only see an VCS Service ?!?

     

    regards

    chris


  • Re: Error at backup job - OS mount failed
    Posted: 10-19-2018, 8:17 AM

    Virtual disk service on the proxy server where that snap is mounting.

     

    Thanks

    AJ

  • Re: Error at backup job - OS mount failed
    Posted: 10-29-2018, 9:17 AM

    OK, after we had reboot the clusterserver we doesn't have the Problen wit "OS mount failed..." but we get an other new Error. Also wie installed the SP13 + Hotfixes.

     

    Error Code: [32:392]
    Description: Mount Volumes failed : [Failed to map snaps]
    Source: ntdaten02, Process: FileScan

     

    On the proxy we use was allways an Veritas Volume Manager installed but the SnapBackup can't mount.

    I believe it was the combination of Server 2016 and the Commvault SnapBackup Option.

     

    Chris

  • Re: Error at backup job - OS mount failed
    Posted: 04-22-2019, 6:51 AM

    This is most likely Zoning issue, Side A and Side B. Storage Admin should be able to help you on this error. 

     

    Thanks,

    AJ

The content of the forums, threads and posts reflects the thoughts and opinions of each author, and does not represent the thoughts, opinions, plans or strategies of Commvault Systems, Inc. ("Commvault") and Commvault undertakes no obligation to update, correct or modify any statements made in this forum. Any and all third party links, statements, comments, or feedback posted to, or otherwise provided by this forum, thread or post are not affiliated with, nor endorsed by, Commvault.
Commvault, Commvault and logo, the “CV” logo, Commvault Systems, Solving Forward, SIM, Singular Information Management, Simpana, Commvault Galaxy, Unified Data Management, QiNetix, Quick Recovery, QR, CommNet, GridStor, Vault Tracker, InnerVault, QuickSnap, QSnap, Recovery Director, CommServe, CommCell, SnapProtect, ROMS, and CommValue, are trademarks or registered trademarks of Commvault Systems, Inc. All other third party brands, products, service names, trademarks, or registered service marks are the property of and used to identify the products or services of their respective owners. All specifications are subject to change without notice.
Close
Copyright © 2019 Commvault | All Rights Reserved. | Legal | Privacy Policy