It would be great to have a process where we can request large bulk batches of data - at the moment we have a limit of 200k from the platform which makes instances of working with larger datasets externally very very difficult and time consuming as it needs to be exported in batches. This would also free up a significant amount of time for our Research Team as well, as this is often a task that has to be carried out for client reports.
This is also quite important for end of contracts, where a client may request an export of their confidential data - it would be great to have a function to allow this to be a simple process.
Guest
Just adding to this—even if the export size remains limited, it would still be a huge timesaver if the platform could automatically break down a large request into batches of 200k or whatever the limit is. It takes a lot of effort to manually identify exactly which time stamps to use for approximating the 200k limit (especially in data sets where there are very high-volume moments)
Attachments Open full size
Thanks Lucy. I take it you're referring to the xls results exports? The reason why there's a limit is because this has performance implications, but we can certainly review the limit and see what's feasible.
We have plans later this year to move exports to the Reports Micro service, so we'll review this then.
Cheers
Attachments Open full size