DataFactory: Extract data from SharePoint Online
Why Stack Overflow recommends it
Stack Overflow users link it when answering questions about copying SharePoint Online files or lists into Blob storage or a data lake with Azure Data Factory, especially for authorization and app registration errors.
Recommended by 1 people across 1 different months, 2022 to 2023.
What it is
A roughly ten minute tutorial from the javiBI channel showing how to extract data from SharePoint Online with Azure Data Factory. It points to Microsoft's connector documentation and walks through setting up access and copying files into other storage.
What people said
Recommends Ziya Mert Karakas · 2023-08 · Stack Overflow · on “Fabric datafactory copy data to ingest Sharepoint files”
First of all, to connect to your sharepoint you need to make sure you are authorized, accessing a sharepoint hosted on another tenant from another tenants ADF will need further steps to make it possible. I understand sharepoint lists are not the thing you want, but actual files. I also understand that the documentation seems to be confusing when working with sharepoint, this list and file dichotomy is confusing to many. To copy from Sharepoint, you still need to follow the process listed on documentation, such as registering the app, and use a web activity to authenticate, then passing to a connected copy activity with HTTP connector as source. I want to give this to you as visually as possi
Cites NiharikaMoola · 2022-07 · Stack Overflow · on “importing data from online sharePoint to Azure Blob using Azure Data Factory”
This error occurs when the connection to your blob storage is not established correctly. In your linked service, you can provide the account selection from the subscription or enter it manually. If you manually provide the connection string in Azure blob storage linked service, provide the storage account name and get the storage account key from Access keys from your storage account instead of getting the whole connection string from the blob account. [LINK] [LINK] You can refer this link [this video] to copy from SharePoint to blob using azure data factory
Cites Vamsi Bitra · 2022-08 · Stack Overflow · on “Copy Sharepoint online csv to datalake using Azure Data Factory”
The above error is mainly because of Authorization Failure. Please make sure to check whether the below permissions are granted or not. Go to Azure Active directory -> App registration and open app -> API permission -> Add this permissions. And also please follow the below reference: It has detailed information about app permission on specific site collection and Authorization of SharePoint. Reference: DataFactory: Extract data from SharePoint Online by javiBI [this video] Access SharePoint Online using Postman by Shantha Kumar [LINK]