H1 Text Can Go Here


Odysee Escapes Vendor Lock-in with Wasabi and Cloudflyer Cloud-to-Cloud Migration

Industry


  • Media and Entertainment

CHALLENGES


  • Skyrocketing storage costs
  • Needed cloud-to-cloud migration solution to escape vendor lock-in
  • Sought secondary storage for growing video library

Partner Ecosystem


  • Technology Alliance Partner: Cloudflyer
  • Wasabi hot cloud storage

Results


  • Avoided egress fees and vendor lock-in
  • Quickly and cost-effectively migrated petabytes of data from AWS S3
  • Dramatically reduced cloud storage bill with Wasabi

“If you’re on AWS or a similar platform and you’re starting to get worried about the cost, don’t wait. Migrate as soon as you can because it’s just going to cost you more and more, and it will be even harder to leave.”
– Niko Storni, DevOps and Infrastructure Engineer at Odysee Inc.

Overview

Odysee is a YouTube-like video-sharing experience that recently spun off from LBRY inc., a decentralized content publishing platform that leverages blockchain technology to give its users ultimate control over the content they create and access. Combining the advantages of Bitcoin and BitTorrent, LBRY is a community-managed digital marketplace where users can view and upload media, make their content free or set prices, then pay or get paid for that content by sending and receiving LBRY Credits (LBCs), the secure peer-to-peer network’s digital currency.
To ensure that their content would always be accessible to users, Odysee was storing a copy of all of the content published to the blockchain in AWS S3. “You can’t expect content published to the blockchain to be forever available. You see this with torrents all the time,” explained Niko Storni, DevOps and Infrastructure Engineer at Odysee Inc. “Someone may have published a movie a few years back but today it’s no longer available.” However, as the company’s content library grew, its storage costs skyrocketed and Amazon’s policy of charging for egress made migrating to another solution a painful and cost-prohibitive option.

Lured in by low prices. Locked in with egress fees

Odysee was already using AWS when Storni first joined the company. “When you’re a startup, the incentive package you get from AWS is very attractive,” said Storni. “They give you a bunch of credits that you can use within the first 12 months, so we did everything with them, including storage with AWS S3. At first, storage was rather cheap because we were paying with these credits and didn’t have a lot of data at that time. But as our data library expanded, it turned out to be a huge expense.”

The company’s first decision was to build or buy. “Do we buy and manage our own hard drives or look for a new storage provider?” said Storni. After careful consideration, the company determined that they did not want to be in the storage business, so the search for a viable S3 alternative was on. They whittled their shortlist to two potential vendors: Wasabi and another alternative to the hyperscalers. “We tested the latencies and speeds of each provider, and, of course, we compared costs,” said Storni. “In all cases, Wasabi was the clear winner. So, Wasabi would be their new storage target, but they still needed a viable solution for migrating all of their data out of Amazon.

Odysee Escapes Vendor Lock-in with Wasabi and Cloudflyer Cloud-to-Cloud Migration

Migrating from AWS is not easy…or cheap

Odysee had nearly 2 petabytes of data stored in AWS. “Because you have to pay Amazon for egress, migrating that much data was a big concern,” explained Storni. “In fact, we were ready to take the hit and delete a whole bunch of content. We started planning for that possibility when the team at Wasabi introduced us to Cloudflyer.” A Wasabi technology alliance partner, Cloudflyer is a unique cloud-to-cloud migration solution with a proprietary object management and network optimization technology that increases throughput and minimizes response times for both ingress and egress. Best of all, Cloudflyer assumes the cost of egress for their customers. Since Wasabi costs up to 80% less than AWS S3, most customers migrating to Wasabi see a return on investment in approximately 4-6 weeks and ongoing storage savings thereafter.

Cloudflyer set up a 10-Gbps direct link between Amazon and Wasabi and worked closely with Storni and his team to make sure everything went smoothly throughout the migration process. “Using Cloudflyer to migrate to low-cost Wasabi is easy and seamless. It doesn’t require a lot of engineering behind it and their support is such that you don’t really have to think about anything,” said Storni.

Big savings and performance boost with Wasabi

“We were using AWS intelligent tiering, which makes it so that if you don’t access an object it gets moved over to infrequent access storage, which costs less than AWS S3,” explained Storni. “Still, we ended up saving a lot of money by moving to Wasabi because AWS is freaking expensive, there’s no denying that. They’re in a position where they can charge whatever they want, so they do. It’s the same with Google Cloud and Azure.”

The problem that Odysee was having with AWS intelligent tiering is that they charge on a per-object basis. “We split all our videos into 2MB files. We have approximately three petabytes of data currently stored in Wasabi, so that’s about 1.5 billion objects! So, even though we weren’t storing everything in S3, when you have billions of objects in intelligent tiering, it gets expensive – adding another couple of dollars per terabyte. I was looking at the charts and the costs were going up and up.” By migrating to Wasabi, Storni is not only saving on storage costs but is seeing a substantial increase in performance. “Wasabi is considerably faster than AWS and other competitive solutions we tested,” said Storni.

Next steps for Odysee

Beyond storing content that is uploaded and published through the blockchain, the company uses Wasabi to store live streams that users create on Odysee.com. “This way, users can watch them again as video on demand (VoD) or publish them to the blockchain,” said Storni. “We also transcode videos published to the blockchain and save them on our servers so it’s easier for users with poor internet connections to view them. However, the cost of maintaining these servers doesn’t make a lot of sense. To save on disk space, we have to delete older content. We want to avoid that so we’ll be moving those transcoded files to Wasabi, as well.”

Having to choose between exorbitant storage fees or deleting content is never a good position to be in. Fortunately, Odysee didn’t have to make that decision. “Thanks to Cloudflyer and Wasabi, we haven’t had to wipe a single byte yet. In fact we’re growing.”