Improve the feature of synchronizing more than 100,000 items on a stable basis for OneDrive.
I am aware of the behavior the restriction mentioned that the sync performance will possibly deteriorate when the stored items in the library exceed 100,000 items more. However, I need to operate this process frequently so that I wish the feature will be improved enables sync more than 100,000 items on a stable basis as soon as possible.
Although I have concerns about if the synchronization is going to be impossible to proceed unexpectly, but so as MS described as "We are working on optimization of OneDrive to improve processing of many Libraries." below the Reference information.
Title: Restrictions on synchronizing files and folders
URL: https://support.microsoft.com/ja-jp/help/3125202/
Thank you for your continued support.
Office 365 Japan Support Team
shared this idea
We are working on changes to improve the experience when syncing large file collections.
23 comments
-
Anonymous
commented
300000 files only? Are you kidding? I have over 500000 and its taking AGES
-
Anonymous
commented
SPO and OneDrive are currently only suitable for small amounts of files and data and not a replacement for file servers, even it would make sense to have everything stored in O365.
I see that it is common to move file servers to SharePoint and use On Demand with OneDrive to have access to files, but users are used to have all their data at hand, even they don't use 95% of the data at all (but the feeling they could, makes them happy😊 and so the admins). Moving off data to archives or only synching partially is not an option, no one has time to do that nor does the user have the know-how how to do it right to synch from SharePoint what he needs - too complicated. On top provisioning and permission limitations make it a headache when splitting data to be synched or having multiple sites/libraries to remediate SPO limitations.
I would expect, especially when using OneDrive with "on demand" functionality it should be possible to have more than 500k files and not just hit your clients CPU to 100% for 2 hours to get some updates lined up. By the way, 500k+ are not an uncommon number of files for smaller companies at all.
So please make the OneDrive on demand piece at least smart enough (and fast) so it can handle more than 100k files.
Another request in this area would be to lift the size of “free” SharePoint storage from 1TB + 10GB per licensed users. It’s fine that every user could use 1TB on his personal drive (which no one does, so it’s pure sales arguments), but the company data is limited to 1TB plus 10gb per user. Buying storage is way too expensive with SharePoint, so our customers are not moving to SharePoint and considering other offers (Dropbox, box.com etc.). So, for us, the partners it’s hard to move customers to the cloud if they can’t move a simple file server - still a core piece of infrastructure in 2019. Other approaches like Azure file servers or services for files in Azure are way too expensive. So please start to fix this better sooner than later - OneDrive has evolved, but's still not there where it should be..... -
Erik
commented
I wonder why this still is an issue. A cloud storage solution that doesn't work on your own operation system. How is that even possible?
-
Myles
commented
For those needing to access large numbers of files from File Explorer, try mapping a network drive to your SharePoint Online document libraries with Zee Drive as it supports libraries with large numbers of files http://www.thinkscape.com/Map-Network-Drives-To-Office-365-OneDrive/
Myles
-
Jace
commented
How is this possible? 300,000 file limitation sounds like a lot, until you realize how easy it is for departments to surpass that number. By restricting the number, it puts teams in a very difficult situation who needs to have quick access to these files.
This means, sticking with Network drives is the option.
-
Daniel Wirjoprawiro commented
This is absolutely critical and is preventing us from migrating more users. Please action this one!
-
Mohcine Chaouki
commented
A huge roadblock for our company to migrate to sharepoint online from our network drives that have well over millions of files for some departments.
-
Gerardo
commented
There are environments where you need this optimized. I support this
-
Saša Jovanović commented
Limit of 100.000 files is not ok. I looking around for better solution than One Drive.
-
Automated Builder
commented
Trying to Sync with 481,473 Files, 577 Folders it chugs but eventually finishes... Crashes every so often but once its uploaded *seems to work*
-
Anonymous
commented
Same experience here. I guess we will have to go back to DropBox enterprise or Gdrive. I was so hopeful for an all in one solution using sharepoint and OneDrive synch for our companies client files archive. Not working. Fix it. 100,000 File count libraries are more and more common.
-
James Beaty
commented
Our Org is migrating 500+ users from Network SAN (Personal Mapped Drive) to OneDrive. We're running into this issue. This is a major problem for us. The client doesn't tell you that it's struggling it just stalls out, no errors. The client has got to be hardened and more informative about problematic conditions. If it's going to choke on 100K files then it should tell you or be re-engineered to handle this condition. Unacceptable.
-
Anonymous
commented
This is more than just «nice to have».
What about our 5TB-limit that we use? How would you ever make use of those 5TB if you cant have more than 100K files in it?
-
Anonymous
commented
nice to participate good idea
-
Kane
commented
This is a huge drawback when using OneDrive sync client. Users are given 1 TB of storage space but their limited to 100k files when syncing. I've seen this issue when users reach 85k+ files. The 100k mark doesn't appear to be correct.
-
Edward Rush
commented
How about just improving it period. I sync about 6 gig of my 500 G in storage to my Surface. I have one server that syncs the entire REPO. The Server seems to sync fine cause all it does is download so I always have a machine with my entire REPO available offline. My surface with only current work, and selected folders takes forever to determine what has changed. I pause syncing while working, and start it back when I am not working. With minor file changes, it takes hours to resolve differences. I pay for storage and I am considering going back to DropBox cause OneDrive Performance is terrible. This is truly horrid software to keep files synchronized. I liked it cause it works with groove for music as well. But I am getting sick of this software hanging up with no progress indicators as it works to compare file differences. It just says "OneDrive is Updating Files", "Processing changes"
-
Derek Gould
commented
Agree. I recently moved to a new PC, set up my Office 365 account (including Onedrive), and waited for the approximately 110gb of files to sync to my machine. Two weeks later, and multiple MS support emails, and the sync is still plodding onwards with about 40gb to go.
Realistically, restoring a machine after a crash, or setting up a new computer, is the kind of situation that Onedrive should be intended for. Allowing a terabyte of storage, but limiting the user to 100K files, is a ridiculously low threshold. I do a lot of Visual Studio development (MIcrosoft's own product!) and most of my project folders end up containing several thousand files.
-
Office 365 Japan Support Team
commented
I would like to add my comments on the post above.
When I look into the public information about the feature to select synchronized folders into sync client, I find the performance become degraded during the synchronization of a hundred thousand items even if I choose the folder to be synchronized. I understand that the sync of a hundred thousand items would not be stable enough for its completion, but I hope this incident to be avoided along with immediate measure if nothing else in selecting the folders for synchronization.
-
Office 365 Japan Support Team
commented
I would like to tell the same feature improvement has been requested by multiple users continuously.
Currently, we are using about 300GB among of 1TB capacity, however, the number of items are reaching to 200 thousand thus we are not able to synchronization completed smoothly. It is in the course that trying to use as much capacity as we have 1TB of capacity, hence I feel it is very inconvenient that synchronization cannot be made due to the number of items.
Therefore, I also hope the feature will be enabled to provide the operation smoothly in order not to degrade performance even if it exceeds 100,000 items.
-
JP
commented
This happens easily if you sync an Adobe Lightroom catalog folder in onedrive that has a few thousand photos in
