Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer

Last post 04-19-2016, 8:40 AM by isle. 7 replies.
Sort Posts: Previous Next
  • Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 11-25-2015, 2:11 PM

    Good afternoon,

    I have a media agent in AWS to which I Aux Copying primary storage policy data.  We have been running the Aux copies for some time now, and have yet to complete the initial copy of the data up to our AWS media agent.  Our next option is to use the AWS service, Snowball to load up the data onto disk an thus seed the Media agent.  I need to determine how much disk to order to complete the task.  Where is the best place to find the most accurate answer?

     

    Thank you,

    TexasKAT...

  • Re: Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 11-25-2015, 2:19 PM
    • Ali is not online. Last active: 07-03-2019, 12:32 PM Ali
    • Top 10 Contributor
    • Joined on 08-05-2010

    Hi Texas, just to clarify didn't fully follow.

    The aux to AWS is slow and to work around that you are trying to do something in that regard?  You are deduping also?

  • Re: Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 11-25-2015, 2:25 PM

    Hi Ali,

    Yes, the Aux copy is slow and we are planning on ordering a service from Amazon Web Services called Snowball (you order disk packs by the GB or TB).  Disk is delivered to your location, files can be transferred (in this case a AUX copy run).  The disk is then sent to Amazon, where it is loaded into a storage location for you to transfer your data (in this case another AUX copy).  Beacuse it it not going over the wire like we are doing currently, I can get the AUX copy base line "caught up" and then the changes will run normally.

    Yes, we are deduping.

     

    Thank you,

    TexasKAT...

  • Re: Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 11-30-2015, 12:35 PM
    • isle is not online. Last active: 06-04-2019, 3:28 PM isle
    • Top 25 Contributor
    • Joined on 08-21-2012
    • NJ
    • Adept
    • Points 308

    I would do at least the estimated baseline + some overhead found on the deduplication tab of the copies properties

     

    http://documentation.commvault.com/commvault/v10/article?p=features/cloud_storage/cloud_library_seeding.htm

  • Re: Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 12-04-2015, 4:04 PM
    • isle is not online. Last active: 06-04-2019, 3:28 PM isle
    • Top 25 Contributor
    • Joined on 08-21-2012
    • NJ
    • Adept
    • Points 308

    texaskat- you cannot use SNowBall currently. You will need to follow the procedure above -

  • Re: Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 12-04-2015, 4:11 PM

    Isle,

    I was told that snowball is simply an pack of disk (50TB) that attaches to your network in order for you to  copy files.  How does it not fit into the proceedure above?

     

    thank you,

    TexasKAT...

  • Re: Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 12-04-2015, 4:27 PM
    • isle is not online. Last active: 06-04-2019, 3:28 PM isle
    • Top 25 Contributor
    • Joined on 08-21-2012
    • NJ
    • Adept
    • Points 308

    It requires a different process- in commvault's current seed example process you must setup a simulated cloud storage library-> http://documentation.commvault.com/commvault/v10/article?p=features/cloud_storage/config_simulated_cloud_lib.htm

     

    Currently we do not have a document for you to follow.

    How soon are you looking to do this ?

    I am assuming ASAP... which it may be best to talk to your account team on if so to avoid any downtime/issues.

  • Re: Seeding to Media Agent in AWS using Snowball - Determining disk size needed to transfer
    Posted: 04-19-2016, 8:40 AM
    • isle is not online. Last active: 06-04-2019, 3:28 PM isle
    • Top 25 Contributor
    • Joined on 08-21-2012
    • NJ
    • Adept
    • Points 308

     

     

     

    Hi Texaskat

     

    There is a new article you may be interested in: 

     

    http://www.commvault.com/news/2016/april/commvault-extends-workload-portability-to-the-cloud-with-aws-snowball-support

     

     

     

     http://docs.commvault.com/commvault/v11/article?p=features/cloud_storage/cloud_library_seeding.htm

     

    Support

    • Amazon S3 with Snowball.

      To configure the Snowball device to be used for seeding the data you must create an import job,  receive the Snowball Appliance and connect the appliance to your network.

      For details, see Importing Data into Amazon S3 with Snowball.

     

     

     

The content of the forums, threads and posts reflects the thoughts and opinions of each author, and does not represent the thoughts, opinions, plans or strategies of Commvault Systems, Inc. ("Commvault") and Commvault undertakes no obligation to update, correct or modify any statements made in this forum. Any and all third party links, statements, comments, or feedback posted to, or otherwise provided by this forum, thread or post are not affiliated with, nor endorsed by, Commvault.
Commvault, Commvault and logo, the “CV” logo, Commvault Systems, Solving Forward, SIM, Singular Information Management, Simpana, Commvault Galaxy, Unified Data Management, QiNetix, Quick Recovery, QR, CommNet, GridStor, Vault Tracker, InnerVault, QuickSnap, QSnap, Recovery Director, CommServe, CommCell, SnapProtect, ROMS, and CommValue, are trademarks or registered trademarks of Commvault Systems, Inc. All other third party brands, products, service names, trademarks, or registered service marks are the property of and used to identify the products or services of their respective owners. All specifications are subject to change without notice.
Close
Copyright © 2019 Commvault | All Rights Reserved. | Legal | Privacy Policy