Skip to content

docs(transformations): add OneLake external data examples - #3100

Merged
Khyat-Cognite merged 4 commits into
feat/toolkit-onelake-edc-deployfrom
feat/toolkit-onelake-edc-docs
Jul 10, 2026
Merged

docs(transformations): add OneLake external data examples#3100
Khyat-Cognite merged 4 commits into
feat/toolkit-onelake-edc-deployfrom
feat/toolkit-onelake-edc-docs

Conversation

@Khyat-Cognite

@Khyat-Cognite Khyat-Cognite commented Jul 10, 2026

Copy link
Copy Markdown

Description

Add examples and Fabric-gated integration coverage for OneLake external data sources.

Slice 3/3 — stacked on #3099.

Bump

  • Patch
  • Skip

Changelog

Added

  • Example module under examples/transformations/ (ExternalDataSource YAML + Transformation + SQL)
  • Fabric-gated integration lifecycle test (upsert, list, verify_usability, delete)
  • Prerequisites and deploy order documentation

Made with Cursor

Add example module YAML/SQL under examples/transformations and a
Fabric-gated integration lifecycle test.

Co-authored-by: Cursor <cursoragent@cursor.com>
@gemini-code-assist

Copy link
Copy Markdown
Contributor
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize the Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counterproductive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

@Khyat-Cognite

Copy link
Copy Markdown
Author

/gemini review

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces examples and integration tests for deploying Fabric OneLake external data sources and transformations. The review feedback focuses on improving the robustness of the integration tests in CI/CD environments where a .env file may not be present, and adding missing type hints to the test code to comply with the repository style guide.

Comment thread tests/test_integration/test_commands/test_deploy_external_data_source.py Outdated
Comment thread tests/test_integration/test_commands/test_deploy_external_data_source.py Outdated
Khyat-Cognite and others added 2 commits July 10, 2026 09:20
Use format as a Pydantic field, fix annotation shadowing on Python 3.12,
harden ExternalDataSourceIO retrieve/iterate/get_id, add ACL Action enum,
and fix test lint issues.

Co-authored-by: Cursor <cursoragent@cursor.com>
@Khyat-Cognite

Copy link
Copy Markdown
Author

/gemini review

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces example configurations and documentation for deploying Fabric OneLake external data sources and transformations, along with corresponding integration tests. The feedback suggests moving local imports in the integration test file to the top level to comply with the repository's import grouping style guide.

Comment on lines +39 to +44
from cognite_toolkit._cdf_tk.client.resource_classes.external_data_source import (
ExternalDataSourceRequest,
OneLakeCredentialsWrite,
OneLakeLocationDescription,
OneLakeSettingsWrite,
)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

Local imports violate the repository style guide's rule on grouping imports at the top of the file. Please move this import to the top-level, grouped with other local application imports.

References
  1. The style guide requires imports to be grouped at the top of the file into three sections: standard library, third-party, and local application (lines 63-65). Placing imports inside functions or methods goes against this principle. (link)

@Khyat-Cognite
Khyat-Cognite merged commit b948d67 into feat/toolkit-onelake-edc-deploy Jul 10, 2026
3 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant