Okta connector reference

Important

This feature is in Beta. To use it, a workspace admin must turn on Lakeflow Connect for Okta from the Previews page. See Manage Azure Databricks previews.

The managed Okta connector in Lakeflow Connect supports 25 source tables in the default schema. The users, groups, devices, group_members, and group_push_mappings tables sync incrementally, and the other 20 tables use full refresh.

Supported source tables

The Okta connector supports the following source tables, all under the default source schema:

Source table	Primary key	Description	Sync mode	Cursor field
users	id	Users in the Okta organization, in every user status, including deprovisioned users.	Incremental	lastUpdated
groups	id	Groups, including group profiles and group statistics.	Incremental	lastUpdated
devices	id	Devices registered in the Okta organization.	Incremental	lastUpdated
group_rules	id	Group rules that assign users to groups based on rule conditions.	Full refresh only
applications	id	App integrations in the Okta organization.	Full refresh only
policies	id	Policies for each supported policy type.	Full refresh only
identity_providers	id	Identity providers configured in the Okta organization.	Full refresh only
network_zones	id	Network zones.	Full refresh only
user_types	id	User types.	Full refresh only
custom_roles	id	Custom administrator roles.	Full refresh only
resource_sets	id	Resource sets for custom administrator role assignments.	Full refresh only
profile_mappings	id	Profile mappings between Okta user profiles and app or directory profiles.	Full refresh only
api_tokens	id	Metadata for the organization's API tokens. Token values aren't included.	Full refresh only
group_members	groupId, id	Users who are members of each group.	Incremental	groupLastMembershipUpdated
group_role_assignments	groupId, id	Administrator roles assigned to each group.	Full refresh only
application_users	appId, id	Users assigned to each app integration.	Full refresh only
application_groups	appId, id	Groups assigned to each app integration.	Full refresh only
group_push_mappings	appId, id	Group push mappings for each active app integration.	Incremental	lastUpdated
device_users	deviceId, userId	Users associated with each device.	Full refresh only
policy_rules	policyId, id	Rules for each policy.	Full refresh only
custom_role_permissions	roleId, label	Permissions granted by each custom administrator role.	Full refresh only
resource_set_resources	resourceSetId, id	Resources in each resource set.	Full refresh only
user_role_assignments	userId, id, assignmentType	Administrator roles assigned to each user.	Full refresh only
user_factors	userId, id, factorType	Multifactor authentication (MFA) factors enrolled for each user.	Full refresh only
user_authenticator_enrollments	userId, id	Authenticator enrollments for each user.	Full refresh only

Connector options

The Okta connector accepts the following option. For usage, see Examples.

Option	Type	Scope	Required	Applies to	Description
start_datetime	String	Pipeline	No	All incremental tables (users, groups, devices, group_members, group_push_mappings)	Earliest change time to ingest, in yyyy-MM-ddTHH:mm:ss.SSSZ format, for example 2020-01-01T00:00:00.000Z. Defaults to 365 days before the first sync. Applies only to the first sync of each table. Later syncs resume from the stored cursor.

Destination table schemas

users

Primary key: id

Sync mode: Incremental

Cursor field: lastUpdated

Field	Data type
id	STRING
status	STRING
created	TIMESTAMP
activated	TIMESTAMP
statusChanged	TIMESTAMP
lastLogin	TIMESTAMP
lastUpdated	TIMESTAMP
passwordChanged	TIMESTAMP
realmId	STRING
transitioningToStatus	STRING
type	STRUCT<id: STRING>
profile	VARIANT
credentials	STRUCT<password: STRUCT<hash: STRUCT<algorithm: STRING, digestAlgorithm: STRING, iterationCount: INT, keySize: INT, salt: STRING, saltOrder: STRING, value: STRING, workFactor: INT>, hook: STRUCT<type: STRING>, value: STRING>, provider: STRUCT<name: STRING, type: STRING>, recovery_question: STRUCT<answer: STRING, question: STRING>>
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

groups

Primary key: id

Sync mode: Incremental

Cursor field: lastUpdated

Field	Data type
id	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
objectClass	ARRAY<STRING>
type	STRING
profile	VARIANT
_links	VARIANT
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

devices

Primary key: id

Sync mode: Incremental

Cursor field: lastUpdated

Field	Data type
id	STRING
status	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
resourceType	STRING
resourceId	STRING
resourceAlternateId	STRING
resourceDisplayName	STRUCT<sensitive: BOOLEAN, value: STRING>
profile	STRUCT<diskEncryptionType: STRING, displayName: STRING, imei: STRING, integrityJailbreak: BOOLEAN, managed: BOOLEAN, manufacturer: STRING, meid: STRING, model: STRING, osVersion: STRING, platform: STRING, registered: BOOLEAN, secureHardwarePresent: BOOLEAN, serialNumber: STRING, sid: STRING, tpmPublicKeyHash: STRING, udid: STRING>
registrationGrants	ARRAY<VARIANT>
_links	VARIANT
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

group_rules

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
name	STRING
type	STRING
status	STRING
allGroupsValid	BOOLEAN
created	TIMESTAMP
lastUpdated	TIMESTAMP
conditions	STRUCT<expression: STRUCT<type: STRING, value: STRING>, people: STRUCT<groups: STRUCT<exclude: ARRAY<STRING>>, users: STRUCT<exclude: ARRAY<STRING>>>>
actions	STRUCT<assignUserToGroups: STRUCT<groupIds: ARRAY<STRING>>>
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

applications

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
name	STRING
label	STRING
status	STRING
signOnMode	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
orn	STRING
accessibility	STRUCT<errorRedirectUrl: STRING, loginRedirectUrl: STRING, selfService: BOOLEAN>
visibility	STRUCT<appLinks: VARIANT, autoLaunch: BOOLEAN, autoSubmitToolbar: BOOLEAN, hide: STRUCT<iOS: BOOLEAN, web: BOOLEAN>>
features	ARRAY<STRING>
expressConfiguration	STRUCT<enabledCapabilities: ARRAY<STRING>, supportedCapabilities: ARRAY<STRING>>
licensing	STRUCT<seatCount: INT>
profile	VARIANT
settings	VARIANT
credentials	VARIANT
universalLogout	STRUCT<identityStack: STRING, protocol: STRING, status: STRING, supportType: STRING>
_links	VARIANT
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

policies

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
name	STRING
type	STRING
status	STRING
description	STRING
priority	INT
system	BOOLEAN
created	TIMESTAMP
lastUpdated	TIMESTAMP
conditions	VARIANT
settings	VARIANT
_links	VARIANT
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

identity_providers

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
name	STRING
type	STRING
status	STRING
issuerMode	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
protocol	VARIANT
policy	VARIANT
properties	VARIANT
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

network_zones

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
name	STRING
type	STRING
status	STRING
system	BOOLEAN
created	TIMESTAMP
lastUpdated	TIMESTAMP
usage	STRING
gateways	ARRAY<STRUCT<type: STRING, value: STRING>>
proxies	ARRAY<STRUCT<type: STRING, value: STRING>>
locations	VARIANT
asns	VARIANT
matchClientProxies	BOOLEAN
ipServiceCategories	STRUCT<include: ARRAY<STRING>, exclude: ARRAY<STRING>>
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

user_types

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
name	STRING
displayName	STRING
description	STRING
default	BOOLEAN
createdBy	STRING
lastUpdatedBy	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

custom_roles

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
label	STRING
isCloneable	BOOLEAN
description	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

resource_sets

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
label	STRING
description	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

profile_mappings

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
source	STRUCT<id: STRING, name: STRING, type: STRING, _links: VARIANT>
target	STRUCT<id: STRING, name: STRING, type: STRING, _links: VARIANT>
properties	VARIANT
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

api_tokens

Primary key: id

Sync mode: Full refresh only

Field	Data type
id	STRING
name	STRING
clientName	STRING
userId	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
expiresAt	TIMESTAMP
network	STRUCT<connection: STRING, include: ARRAY<STRING>, exclude: ARRAY<STRING>>
tokenWindow	STRING
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

group_members

Primary key: groupId, id

Sync mode: Incremental

Cursor field: groupLastMembershipUpdated

Field	Data type
groupId	STRING
groupLastMembershipUpdated	TIMESTAMP
id	STRING
status	STRING
created	TIMESTAMP
activated	TIMESTAMP
statusChanged	TIMESTAMP
lastLogin	TIMESTAMP
lastUpdated	TIMESTAMP
passwordChanged	TIMESTAMP
realmId	STRING
transitioningToStatus	STRING
type	STRUCT<id: STRING>
profile	VARIANT
credentials	STRUCT<password: STRUCT<hash: STRUCT<algorithm: STRING, digestAlgorithm: STRING, iterationCount: INT, keySize: INT, salt: STRING, saltOrder: STRING, value: STRING, workFactor: INT>, hook: STRUCT<type: STRING>, value: STRING>, provider: STRUCT<name: STRING, type: STRING>, recovery_question: STRUCT<answer: STRING, question: STRING>>
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

group_role_assignments

Primary key: groupId, id

Sync mode: Full refresh only

Field	Data type
groupId	STRING
id	STRING
label	STRING
type	STRING
status	STRING
assignmentType	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
role	STRING
resource-set	STRING
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

application_users

Primary key: appId, id

Sync mode: Full refresh only

Field	Data type
appId	STRING
id	STRING
externalId	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
lastSync	TIMESTAMP
scope	STRING
status	STRING
statusChanged	TIMESTAMP
passwordChanged	TIMESTAMP
syncState	STRING
profile	VARIANT
credentials	STRUCT<password: STRUCT<value: STRING>, userName: STRING>
_links	VARIANT
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

application_groups

Primary key: appId, id

Sync mode: Full refresh only

Field	Data type
appId	STRING
id	STRING
lastUpdated	TIMESTAMP
priority	INT
profile	VARIANT
_links	VARIANT
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

group_push_mappings

Primary key: appId, id

Sync mode: Incremental

Cursor field: lastUpdated

Field	Data type
appId	STRING
id	STRING
status	STRING
sourceGroupId	STRING
targetGroupId	STRING
appConfig	VARIANT
created	TIMESTAMP
lastUpdated	TIMESTAMP
lastPush	TIMESTAMP
errorSummary	STRING
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

device_users

Primary key: deviceId, userId

Sync mode: Full refresh only

Field	Data type
deviceId	STRING
userId	STRING
created	TIMESTAMP
managementStatus	STRING
screenLockType	STRING
user	VARIANT
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

policy_rules

Primary key: policyId, id

Sync mode: Full refresh only

Field	Data type
policyId	STRING
id	STRING
name	STRING
type	STRING
status	STRING
priority	INT
system	BOOLEAN
created	TIMESTAMP
lastUpdated	TIMESTAMP
conditions	VARIANT
actions	VARIANT
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

custom_role_permissions

Primary key: roleId, label

Sync mode: Full refresh only

Field	Data type
roleId	STRING
label	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
conditions	VARIANT
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

resource_set_resources

Primary key: resourceSetId, id

Sync mode: Full refresh only

Field	Data type
resourceSetId	STRING
id	STRING
orn	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
conditions	VARIANT
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

user_role_assignments

Primary key: userId, id, assignmentType

Sync mode: Full refresh only

Field	Data type
userId	STRING
id	STRING
label	STRING
type	STRING
status	STRING
assignmentType	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
role	STRING
resource-set	STRING
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

user_factors

Primary key: userId, id, factorType

Sync mode: Full refresh only

Field	Data type
userId	STRING
id	STRING
factorType	STRING
provider	STRING
vendorName	STRING
status	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
profile	VARIANT
_links	VARIANT
_embedded	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.

user_authenticator_enrollments

Primary key: userId, id

Sync mode: Full refresh only

Field	Data type
userId	STRING
id	STRING
key	STRING
name	STRING
nickname	STRING
status	STRING
type	STRING
created	TIMESTAMP
lastUpdated	TIMESTAMP
profile	VARIANT
_links	VARIANT

Note

This table doesn't support slowly changing dimensions (SCD) type 2 because it has VARIANT columns.