Fornax
patreon
Erasure coding is live!
🕑 Added 2022-09-26 14:10:13 +0000 UTCHere we go! The update I have been working on for the last two months is now running in production. Pixeldrain now uses Reed-Solomon encoding to store files. This encoding scheme has a lot of benefits over the way pixeldrain used to store files:
- Files are stored with a 8/4 data/parity ratio. This means that 4 disks would have to fail simultaneously before any data is lost (for reference, pixeldrain has had one disk failure since the project started in 2015).
- Since files are equally distributed over 12 different servers, we can use the combined bandwidth of those servers to read the files. Files which were previously only accessible at 1 Gbps can now be read at 8 Gbps.
- This saves a lot of storage space. Pixeldrain used to store two copies of every file on two different servers in RAID5. Now that pixeldrain has its own parity calculations we don't need RAID anymore, this saves about 25% storage space. And we don't need redundant copies anymore which saves another 50%.
Because this new system is so space efficient I can afford to store larger files for longer periods of time. Soon I will be increasing storage limits.
Merge request for the new storage system. 3039 lines of code added and 1683 lines removed.
Storage servers migrating files to the new storage system. This uses a lot of bandwidth!
Comments
Rashed Islam
Subject: Pixeldrain Subscription Active but Files Not Working Dear Pixeldrain Team, I renewed my Pixeldrain premium subscription on **October 21**, but my videos are still not playable. It’s now October 23, and my account still shows “data cap used up” even though I made a successful payment. Here are my details: - Account Email: [your email here] - Username: [your Pixeldrain username] - Payment Date: October 21 - Plan: [8 TB / premium] - Issue: Files not accessible or playable after renewal. I’ve already cleared cache and tried multiple browsers. Kindly verify my payment and reset or reactivate my subscription manually. Thank you for your help and quick response.
Rashed Islam
Hi, my Pixeldrain account (username: motalebhossain) is not syncing after my renewal today. Videos are not playing. Please reset my data cap.
Ahmad Egbaria
I have aa problem with Egyptian peoples.. The videos loading without stop!
Fornax
Fixed it
Matt Schulte
The APK files aren't being detected correctly anymore.
Teeaboo
Awesome!
working perfect, thanks!
Fornax
You're right. I forgot to add the mime type parser to the new storage system. Should be fixed now.
I think that something has changed, it recognizes the .rar files differently. the same file just uploaded vs. file uploaded a few days ago: https://gyazo.com/defbaa5a2b9e06fe492a0827677a8617
Fornax
Apparently that's the official mime type. I will add an icon for it.
bug possibly related to this update: .rar files appear as 'application/vnd.rar' (? icon) https://gyazo.com/e9d80632338479835dab6e38568e5ddc & https://gyazo.com/80c220ad2f500a30c2817e16ecead5ad - Thanks for all the effort, Pixeldrain is amazing!
