Improve the feature of synchronizing more than 100,000 items on a stable basis for OneDrive.
I am aware of the behavior the restriction mentioned that the sync performance will possibly deteriorate when the stored items in the library exceed 100,000 items more. However, I need to operate this process frequently so that I wish the feature will be improved enables sync more than 100,000 items on a stable basis as soon as possible.
Although I have concerns about if the synchronization is going to be impossible to proceed unexpectly, but so as MS described as "We are working on optimization of OneDrive to improve processing of many Libraries." below the Reference information.
Title: Restrictions on synchronizing files and folders
Thank you for your continued support.
We are working on changes to improve the experience when syncing large file collections.
Please update the onedrive client to handle larger numbers of files. The fact that the client cannot handle more than 100,000 files reliably and 300,000 files at all is ludicrous in this work from home era.
I'm using 365 for Business and the OneDrive client sync app on MacOS is not fit for purpose.
Even with "Files On-Demand" enabled, which should involve no file uploads/downloads, only meta-data, installing the client on a new machine results in it attempting to very, very slowly "process" all the files.
I have over 400,000 files on OneDrive and the client is unable to process these at anywhere a near acceptable speed - sometimes taking several seconds per file.
I understand that OneDrive needs to ensure that local files and online files are in-sync, but if these are largely maintained online, then the creation of local "stubs" should be very fast.
Unfortunately, while this processing is taking place, OneDrive also appears unable to upload any new files created on the local machine.
DropBox syncs almost immediately in the same situation. Unfortunately, DropBox's pricing models are very inflexible, with nothing between the free 2GB and 2TB, which would involve paying for 5 times the storage I require.
I have seen the same behaviour on multiple computers, both MacOS and Windows, and have to conclude that it simply can't handle the number of files that I have.
I will keep OneDrive as a long-term archive solution, but it does not work as a file sync solution for files that are being actively used if you have a large number of files to sync.
Cassio Santos commented
Any news about this issue?
The biggest problem with the file size limitations is that the client does not have any indication of it for users. Further there is no clear way for Admins to diagnose the number of files that a user may be syncing to know if they're encountering this or not. If that information were at least presented to the users or admins, workarounds could be established.
Is there any update on this limitation?
Alexis Clément commented
Shaun Kilmartin commented
Can we please get an update? We're considering archiving files that aren't ready for archive yet, just to get around this 300,000 file synchronization limit.
Shaun Kilmartin commented
Our libraries have grown to over 300k files that need to sync to user computers. Is there an update? Would love to see 500k+ as the limit.
Antonio Delatorre commented
Caution with files tagged as ~ .tmp;
They not working to the PC at cloud. Rename it
Any update to this pleaaaaaaaaase?
olivier karangwa commented
hi my name is Olivier i'am from Rwanda how you from
hertier habimana commented
hi my name is hertier
Jonathan H commented
YEs, we are in the process of moving network shares to SharePoint. WE do as users to clean up files and we suggest to them to choose only folders they would like to sync, but we still run into issues where users select many folders and as well as their personal OneDRive exceed the best practice of 300k files. we have to run reset many times when it hangs up. thanks!
Michael Stockwell commented
Large file libraries are a nightmare! My place of employment is moving its network storage into the cloud, and my computer is CONSTANTLY using large amounts of CPU usage. If I reboot the PC, it takes HOURS for the indexes to rebuild. I see "processing changes" constantly on the taskbar icon. It just doesnt work well for syncing large sets of data. I have 2 very large libraries that I have to maintain full access to. One is 148GB, with 33,552 files and 1,858 folders. The other is 365GB, with 529,150 files and 45,624 folders. These libraries bring my workstation laptop (i7-9850H, 48GB of RAM, and Quadro T2000 graphics) to its knees. Please fix!
It’s been a few day, my new computer is still “synching” the thumbnails.... MS needs to do something, it is 2020! Why not just prepackage them, download together and then update the new changes instead of one by one? Each one takes 1-2 second on a high speed connection.
Still nothing? This makes OneDrive almost unusable for me. I just renamed a folder by mistake, with ~200k photos, and OneDrive is unable to simply process those changes. It stalls and the only way to get it to work is to close OneDrive, start again, every 10 minutes or so. Unbelievable this happening in 2020. I just got Google Drive and will see if they handle these all too common scenario correctly.
Just think how many clients lost to DropBox and Google Drive because of this short coming.
If the /settings/***.DAT file exceeds 4GB One-drive completely crashes and no longer functions. I assume this is due to a large number of files in the one drive folder.
Allowing for certain folder exclusions could prevent this for many.
Can we get an update on where your up to with the improvements to large file collection syncs are yet - we have multiple customers who are now facing the issue as their syncing over 300,000 files -
It's becoming quite common for business data sets OneDrive to have larger than 300k files and our support desk is now getting calls regularly about this issue to which there is no resolution yet
Let us know, thanks.
In my OneDrive I have currently about 315000 files - on my private PC. When using OneDrive for business needs, I will have more. As a software developer working for multiple huge enterprises, I would expect OneDrive to handle multi-million files without any issues.