Improve the feature of synchronizing more than 100,000 items on a stable basis for OneDrive.
I am aware of the behavior the restriction mentioned that the sync performance will possibly deteriorate when the stored items in the library exceed 100,000 items more. However, I need to operate this process frequently so that I wish the feature will be improved enables sync more than 100,000 items on a stable basis as soon as possible.
Although I have concerns about if the synchronization is going to be impossible to proceed unexpectly, but so as MS described as "We are working on optimization of OneDrive to improve processing of many Libraries." below the Reference information.
Title: Restrictions on synchronizing files and folders
Thank you for your continued support.
We are working on changes to improve the experience when syncing large file collections.
Marc Tremmel commented
A restriction of 300.000 files is just ridiculous. As one of the leading companies in terms of modern cloud based Data-Pools Microsoft certainly has to push this topic even more. This is next step for many companies to get rid of old server-structures. ODFB is a great tool for simpliflying processes and push the acceptance for the older generation to work with the cloud.
@MS this is your chance to improve work sustainedly
Unfortunately I read this article after we did a big migration from a file server to SPO.
We got large Performance Issues with ODFB when we synchronized 450.000 Elements from SPO to the client (Files on Demand). The speed of the initial sync was OK but when we worked with these files, we had to wait 20-30 minutes until new / edited Office files were synced to the clients. Not acceptable for the users. In our misery we started to sync all Documents with OFDB on a fileserver again and connect the users via file share to the documents. We had to rebuild all Permissions and so on …
Very bad situation because we see a great potential in this way of syncing, and it is of cause one huge advantage of ODFB / SPO. But now we a really frustrated. Hope that MS is improving ODFB soon!!
Ferhat Baydemir commented
In modern Cloud based Data-Pools is the restriction of 300.000 files to low. Sharepoint Online can handle millions of files. OneDrive is the perfect tool to work in the Cloud with your usual tools like the Windows-Explorer.
Not every user is a Generation Y user with perfect working skill. The big part of the Users are older. They don't want to learn new working forms like in Sharepoint Online --> Browser based.
300000 files only? Are you kidding? I have over 500000 and its taking AGES
SPO and OneDrive are currently only suitable for small amounts of files and data and not a replacement for file servers, even it would make sense to have everything stored in O365.
I see that it is common to move file servers to SharePoint and use On Demand with OneDrive to have access to files, but users are used to have all their data at hand, even they don't use 95% of the data at all (but the feeling they could, makes them happy😊 and so the admins). Moving off data to archives or only synching partially is not an option, no one has time to do that nor does the user have the know-how how to do it right to synch from SharePoint what he needs - too complicated. On top provisioning and permission limitations make it a headache when splitting data to be synched or having multiple sites/libraries to remediate SPO limitations.
I would expect, especially when using OneDrive with "on demand" functionality it should be possible to have more than 500k files and not just hit your clients CPU to 100% for 2 hours to get some updates lined up. By the way, 500k+ are not an uncommon number of files for smaller companies at all.
So please make the OneDrive on demand piece at least smart enough (and fast) so it can handle more than 100k files.
Another request in this area would be to lift the size of “free” SharePoint storage from 1TB + 10GB per licensed users. It’s fine that every user could use 1TB on his personal drive (which no one does, so it’s pure sales arguments), but the company data is limited to 1TB plus 10gb per user. Buying storage is way too expensive with SharePoint, so our customers are not moving to SharePoint and considering other offers (Dropbox, box.com etc.). So, for us, the partners it’s hard to move customers to the cloud if they can’t move a simple file server - still a core piece of infrastructure in 2019. Other approaches like Azure file servers or services for files in Azure are way too expensive. So please start to fix this better sooner than later - OneDrive has evolved, but's still not there where it should be.....
I wonder why this still is an issue. A cloud storage solution that doesn't work on your own operation system. How is that even possible?
For those needing to access large numbers of files from File Explorer, try mapping a network drive to your SharePoint Online document libraries with Zee Drive as it supports libraries with large numbers of files http://www.thinkscape.com/Map-Network-Drives-To-Office-365-OneDrive/
How is this possible? 300,000 file limitation sounds like a lot, until you realize how easy it is for departments to surpass that number. By restricting the number, it puts teams in a very difficult situation who needs to have quick access to these files.
This means, sticking with Network drives is the option.
Daniel Wirjoprawiro commented
This is absolutely critical and is preventing us from migrating more users. Please action this one!
Mohcine Chaouki commented
A huge roadblock for our company to migrate to sharepoint online from our network drives that have well over millions of files for some departments.
There are environments where you need this optimized. I support this
Saša Jovanović commented
Limit of 100.000 files is not ok. I looking around for better solution than One Drive.
Automated Builder commented
Trying to Sync with 481,473 Files, 577 Folders it chugs but eventually finishes... Crashes every so often but once its uploaded *seems to work*
Same experience here. I guess we will have to go back to DropBox enterprise or Gdrive. I was so hopeful for an all in one solution using sharepoint and OneDrive synch for our companies client files archive. Not working. Fix it. 100,000 File count libraries are more and more common.
James Beaty commented
Our Org is migrating 500+ users from Network SAN (Personal Mapped Drive) to OneDrive. We're running into this issue. This is a major problem for us. The client doesn't tell you that it's struggling it just stalls out, no errors. The client has got to be hardened and more informative about problematic conditions. If it's going to choke on 100K files then it should tell you or be re-engineered to handle this condition. Unacceptable.
This is more than just «nice to have».
What about our 5TB-limit that we use? How would you ever make use of those 5TB if you cant have more than 100K files in it?
nice to participate good idea
This is a huge drawback when using OneDrive sync client. Users are given 1 TB of storage space but their limited to 100k files when syncing. I've seen this issue when users reach 85k+ files. The 100k mark doesn't appear to be correct.
Edward Rush commented
How about just improving it period. I sync about 6 gig of my 500 G in storage to my Surface. I have one server that syncs the entire REPO. The Server seems to sync fine cause all it does is download so I always have a machine with my entire REPO available offline. My surface with only current work, and selected folders takes forever to determine what has changed. I pause syncing while working, and start it back when I am not working. With minor file changes, it takes hours to resolve differences. I pay for storage and I am considering going back to DropBox cause OneDrive Performance is terrible. This is truly horrid software to keep files synchronized. I liked it cause it works with groove for music as well. But I am getting sick of this software hanging up with no progress indicators as it works to compare file differences. It just says "OneDrive is Updating Files", "Processing changes"
Derek Gould commented
Agree. I recently moved to a new PC, set up my Office 365 account (including Onedrive), and waited for the approximately 110gb of files to sync to my machine. Two weeks later, and multiple MS support emails, and the sync is still plodding onwards with about 40gb to go.
Realistically, restoring a machine after a crash, or setting up a new computer, is the kind of situation that Onedrive should be intended for. Allowing a terabyte of storage, but limiting the user to 100K files, is a ridiculously low threshold. I do a lot of Visual Studio development (MIcrosoft's own product!) and most of my project folders end up containing several thousand files.