OneDrive

Microsoft OneDrive is a cloud storage service that lets you store, share, and collaborate on files. You can connect your OneDrive for Business instance as a data source for your managed knowledge base to crawl the personal drives of users in your Microsoft 365 tenant. omniload supports OneDrive as a data source.

URI format

The URI for connecting to OneDrive is structured as follows.

onedrive://<drive_name>/path/to/data.xlsx?client_id=1d2befad-2f22-4124-a779-b147dfeca342&tenant_id=6b337423-f504-4060-a91b-e9eaaf782609&client_secret=abc~xyz789EXAMPLE_foo

URI parameters

drive_id:

The ID of the OneDrive drive. If provided, enables single-site mode.

client_id:

OAuth2 client ID. Can also be set via MSGRAPHFS_CLIENT_ID or AZURE_CLIENT_ID environment variables.

tenant_id:

OAuth2 tenant ID. Can also be set via MSGRAPHFS_TENANT_ID or AZURE_TENANT_ID environment variables.

client_secret:

OAuth2 client secret. Can also be set via MSGRAPHFS_CLIENT_SECRET or AZURE_CLIENT_SECRET environment variables.

site_name:

The name of the OneDrive site. If provided with drive_name, enables single-site mode.

drive_name:

The name of the OneDrive drive/library (e.g., “Documents”, “CustomLibrary”). If provided with site_name, enables single-site mode.

url_path:

URL-style path specification (e.g., “msgd://TestSite/Documents”). If provided, extracts site_name and drive_name from the URL. URL parameters override direct site_name/drive_name parameters.

oauth2_client_params:

Parameters for the OAuth2 client. If not provided, will be built from client_id, tenant_id, client_secret. Type: dict. Use JSON to encode the dictionary.

use_recycle_bin:

If True, deleted files are moved to recycle bin. Default is False. Truthy values are "true", "yes", "on", "y", "t", "1". Falsy values are "false", "no", "off", "n", "f", "0".

Note

Access works unified for both OneDrive sites and drives. The module handles both single-site/drive operations and multi-site operations based on the parameters provided during initialization:

• Single-site mode: When site_name + drive_name or drive_id are provided

• Multi-site mode: When neither site_name + drive_name nor drive_id are provided

Multi-site mode can handle URL-based paths that specify the site and drive dynamically (e.g., msgd://SiteA/DriveB/file.txt).

Authentication

The OneDrive connector uses OAuth 2.0 to authenticate with the Microsoft Graph API. Microsoft Graph is a protected API gateway for accessing data in Microsoft cloud services like Microsoft Entra ID, Microsoft 365, OneDrive, or SharePoint. It is protected by the Microsoft identity platform, which authorizes and verifies that an app is authorized to call Microsoft Graph.

Please get familiar with relevant concepts to configure OAuth 2.0 authentication properly, see also authentication and authorization basics and set up OAuth 2.0 authentication for OneDrive tutorial by AWS.

Example: Load CSV file from OneDrive into DuckDB

omniload ingest \
    --source-uri   'onedrive://?client_id=1d2befad-2f22-4124-a779-b147dfeca342&tenant_id=6b337423-f504-4060-a91b-e9eaaf782609&client_secret=abc~xyz789EXAMPLE_foo' \
    --source-table '<site_name>/<drive_name>/path/to/data.csv' \
    --dest-uri     'duckdb:///demo.duckdb' \
    --dest-table   'testdrive.data'

Running the command creates a table named data within the testdrive schema in the DuckDB database file located at demo.duckdb.

Tip

Here, instead of defining the remote resource exclusively per source URI using its <path> component, the --source-table option can specify the base directory on the server where omniload should start looking for files.