[Build] POC: Add UC OSS integration test workflow#30
Open
huan233usc wants to merge 3 commits intomasterfrom
Open
[Build] POC: Add UC OSS integration test workflow#30huan233usc wants to merge 3 commits intomasterfrom
huan233usc wants to merge 3 commits intomasterfrom
Conversation
Add a GitHub Actions workflow that: 1. Builds Unity Catalog OSS server from source 2. Starts a local UC server with managed tables enabled 3. Creates catalog, schema, and managed tables 4. Publishes Delta to local Maven (publishM2) 5. Runs unity-catalog-commit-coordinator-integration-tests.py via spark-submit --packages (validates POM dependency resolution) This is a POC to validate the end-to-end flow. Made-with: Cursor
…erties - build/sbt package (not server/assembly) to generate classpath file - Write config to etc/conf/server.properties (not --config-file flag) - Remove unsupported --port flag (default 8080 is fine) Made-with: Cursor
Replace `--get-field default` (unsupported) with direct JSON parsing of spark-versions.json to find the default Spark version. Extract version info once in a dedicated step and reference via outputs. Also switch from inline python3 SparkSession to pyspark CLI with --packages and --conf flags for cleaner table creation. Made-with: Cursor
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add a GitHub Actions workflow that:
This is a POC to validate the end-to-end flow.
Made-with: Cursor
Which Delta project/connector is this regarding?
Description
How was this patch tested?
Does this PR introduce any user-facing changes?