OpenAI connector reference

Important

This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Azure Databricks previews.

This page has reference information for the managed OpenAI connector, including supported source tables and destination table schemas.

Supported source tables

The OpenAI connector supports the following source tables, all under the default source schema:

Source table	Primary key	Description	Sync mode	Cursor field
`audit_logs`	`id`	Organization audit log events, such as API key, user, project, and login events. One row per event.	Incremental	`effective_at`
`users`	`id`	Members of your OpenAI organization, including name, email, and organization role.	Full refresh only
`projects`	`id`	Projects in your OpenAI organization, including archived projects, with status and creation time.	Full refresh only
`invites`	`id`	Pending and accepted invitations to your OpenAI organization, including the invited email and role.	Full refresh only
`admin_api_keys`	`id`	Organization-level Admin API keys, including name, redacted value, and last-used time.	Full refresh only
`certificates`	`id`	Certificates uploaded to your OpenAI organization.	Full refresh only
`project_users`	`id`, `project_id`	Members of each project in your organization, including their project role.	Full refresh only
`project_service_accounts`	`id`, `project_id`	Service accounts belonging to each project in your organization.	Full refresh only
`project_api_keys`	`id`, `project_id`	API keys belonging to each project, including name, redacted value, and owner.	Full refresh only
`project_rate_limits`	`id`, `project_id`	Per-model rate limits configured for each project.	Full refresh only
`project_certificates`	`id`, `project_id`	Certificates associated with each project in your organization.	Full refresh only
`usage_completions`	`start_time`	Daily completions usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`usage_embeddings`	`start_time`	Daily embeddings usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`usage_moderations`	`start_time`	Daily moderations usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`usage_images`	`start_time`	Daily image generation usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`usage_audio_speeches`	`start_time`	Daily text-to-speech usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`usage_audio_transcriptions`	`start_time`	Daily speech-to-text usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`usage_vector_stores`	`start_time`	Daily vector store usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`usage_code_interpreter_sessions`	`start_time`	Daily code interpreter session usage for your organization, aggregated into time buckets.	Incremental	`start_time`
`costs`	`start_time`	Daily spend for your organization, aggregated into time buckets.	Full refresh only

Connector options

The OpenAI connector has no additional configuration options beyond the pipeline settings available for all managed connectors. See Ingest data from OpenAI.

Destination table schemas

`audit_logs`

Primary key: id Cursor field: effective_at

Field	Data type
`object`	`STRING`
`id`	`STRING`
`type`	`STRING`
`effective_at`	`BIGINT`
`actor`	`STRING`
`project`	`STRING`
`raw_event`	`STRING`

`users`

Primary key: id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`name`	`STRING`
`email`	`STRING`
`role`	`STRING`
`added_at`	`BIGINT`

`projects`

Primary key: id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`name`	`STRING`
`status`	`STRING`
`created_at`	`BIGINT`
`archived_at`	`BIGINT`

`invites`

Primary key: id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`created_at`	`BIGINT`
`status`	`STRING`
`accepted_at`	`BIGINT`
`email`	`STRING`
`expires_at`	`BIGINT`
`projects`	`STRING`
`role`	`STRING`

`admin_api_keys`

Primary key: id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`name`	`STRING`
`redacted_value`	`STRING`
`created_at`	`BIGINT`
`last_used_at`	`BIGINT`
`expires_at`	`BIGINT`
`owner`	`STRING`

`certificates`

Primary key: id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`name`	`STRING`
`created_at`	`BIGINT`

`project_users`

Primary key: id, project_id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`name`	`STRING`
`email`	`STRING`
`role`	`STRING`
`added_at`	`BIGINT`
`project_id`	`STRING`

`project_service_accounts`

Primary key: id, project_id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`name`	`STRING`
`role`	`STRING`
`created_at`	`BIGINT`
`project_id`	`STRING`

`project_api_keys`

Primary key: id, project_id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`name`	`STRING`
`redacted_value`	`STRING`
`created_at`	`BIGINT`
`last_used_at`	`BIGINT`
`owner`	`STRING`
`owner_project_access`	`STRING`
`project_id`	`STRING`

`project_rate_limits`

Primary key: id, project_id Sync mode: Full refresh only

Field	Data type
`id`	`STRING`
`object`	`STRING`
`model`	`STRING`
`max_requests_per_1_minute`	`BIGINT`
`max_tokens_per_1_minute`	`BIGINT`
`max_images_per_1_minute`	`BIGINT`
`batch_1_day_max_input_tokens`	`BIGINT`
`project_id`	`STRING`