Hi Team,
I’ve got a SharePoint 2013 list (demand trackers) with hundreds of thousands of items. We want to export them and run dashboard / analysis.
What tools / systems would you recommend to export existing data and quickly update with new records?
Thanks in advance
HI Albert, I work for AxioWorks and we have a product that many organisations use to simplify reporting on large SharePoint data sets
Our SQList product replicates SharePoint lists or libraries to SQL Server or SQL Azure tables. Once in SQL, you can obviously use SSRS, Power BI or other reporting/BI tools.
Our product is a windows service (with a management UI) that automatically generates all the SQL schema and keeps the SQL tables up to date as your SharePoint data or even schema changes. So if you add or remove a column in SharePoint then SQList will add or remove a properly typed SQL column.
By the way, you wont run across any issues with the list view or look thresholds with SQList.
SQList works with all versions of SharePoint including SharePoint Online and also with all versions of SQL Server including SQL Azure.
No changes to SharePoint or SQL Server are required – SQList connects to SharePoint and SQL using standard HTTP(s) and TCP connections.
You can read more about SQList here
http://www.axioworks.com/sqlist
And you can download a fully working trial here:
https://www.axioworks.com/sqlist/try-sqlist/
I’d be happy to jump on a webex and give you a quick demo to see if it would work for your particular use case. Please feel free to book some time in my diary that suits you
https://meetings.hubspot.com/paul-gallagher
Alternatively, you can connect to the large list using PowerBI or Microsoft Access and then you won’t be hit by the list view threshold limits.
Thanks Paul,
I’m going to investigate, and show to my supervisors!
There are a few tools to do the analysis, however, can you clarify a little more about the updating of new records? Are SharePoint’s normal list forms not working for you for that part?