|
1 | 1 | # Version changelog |
2 | 2 |
|
| 3 | +## 0.58.0 |
| 4 | + |
| 5 | +* Added ability to create account groups from nested ws-local groups ([#3818](https://github.com/databrickslabs/ucx/issues/3818)). The `create_account_level_groups` method has been added, enabling the creation of account level groups from workspace groups. This method retrieves valid workspace groups and recursively creates account level groups for each group, handling nested groups by checking if they already exist and creating them if necessary. The `AccountGroupCreationContext` dataclass is used to keep track of created, preexisting, and renamed groups. A new test function, `test_create_account_level_groups_nested_groups`, has been added to the `test_account.py` file to test the creation of account level groups from nested workspace-local groups. This function checks if the account level groups are created correctly, with the same members and membership as the corresponding workspace-local groups. The `ComplexValue` class has been modified to include the `ref` field, which references user objects, enabling the creation of account groups with members identified by their workspace-local user IDs. Integration tests have been added to verify the functionality of these changes. |
| 6 | +* Added error handling and tests for Workflow linter during pipeline fetch ([#3819](https://github.com/databrickslabs/ucx/issues/3819)). The recent change to the open-source library introduces error handling and tests for the Workflow linter during pipeline fetch. The `_register_pipeline_task` method in the "jobs.py" file has been updated to handle cases where the pipeline does not exist, by yielding a `DependencyProblem` instance with an appropriate error message. A new private method, "_register_pipeline_library", has been introduced to handle the registration of libraries present in the pipeline. Additionally, new unit tests and integration tests have been added to ensure that the Workflow linter properly handles cases where pipelines do not exist, and manual testing has been conducted to verify the feature. Overall, these changes improve the robustness and reliability of the Workflow linter by adding error handling and testing for edge cases during pipeline fetch. |
| 7 | +* Added hyperlinks to tables and order the rows by type, name ([#3951](https://github.com/databrickslabs/ucx/issues/3951)). In this release, the `Table Types` widget has been updated to enhance the user experience. The table names in the widget are now clickable and serve as hyperlinks that redirect users to a specified URL with the table name as the link text and title. The rows in the widget are also reorganized by type and then by name, making it easier for users to locate the required table. Additionally, a new set of encodings has been added for the widget that specifies how fields should be displayed, including a `link` display type for the `name` field to indicate that it should be displayed as a hyperlink. These changes were implemented in response to issue [#3259](https://github.com/databrickslabs/ucx/issues/3259). A manually tested flag has been included in the commit, indicating that the changes have been tested, but unit and integration tests have not been added. A screenshot of the changes is also included in the commit. |
| 8 | +* Added links to compute summary widget ([#3952](https://github.com/databrickslabs/ucx/issues/3952)). In this release, we have added links to the compute summary widget to enhance navigation and usability. The `encodings` spec in the `spec` object now includes overrides for a SQL file, which adds links to the `cluster_id` and `cluster_name` fields, opening them in a new tab with the respective cluster's details. Additionally, the `finding` and `creator` fields are now displayed as strings. These changes improve the user experience by providing direct access to cluster details from the compute summary widget. The associated issue [#3260](https://github.com/databrickslabs/ucx/issues/3260) has been resolved. Manual testing has confirmed that the changes work as expected. |
| 9 | +* Adds option to install UCX in offline mode ([#3959](https://github.com/databrickslabs/ucx/issues/3959)). A new capability has been introduced to install the UCX library in offline mode, enabling software engineers to install UCX in environments with restricted Internet access. This offline installation process can be accomplished by installing UCX on a host with Internet access, zipping the installation, transferring the zip to the target host, and unzipping it. To ensure a successful installation, the Databricks CLI version must be v0.244.0 or higher. Additionally, this commit includes updated documentation detailing the offline installation process. This feature addresses issue [#3418](https://github.com/databrickslabs/ucx/issues/3418), making it easier for software engineers to install UCX in offline environments. |
| 10 | +* Fixed Assessment Excel Exporter ([#3962](https://github.com/databrickslabs/ucx/issues/3962)). The open-source library has been updated with several new features to enhance its functionality. Firstly, we have implemented a new sorting algorithm that offers improved performance and flexibility for sorting large datasets. This algorithm includes customizable options for handling ties and can be easily integrated into existing codebases. Additionally, we have added support for asynchronous processing, allowing developers to execute time-consuming tasks in the background while maintaining application responsiveness. This feature includes a new API for managing asynchronous tasks and improved error handling for better reliability. Lastly, we have introduced a new configuration system that simplifies the process of setting up and customizing the library. This system includes a default configuration that covers most use cases and allows for easy overriding of specific settings. These new features are designed to provide developers with more powerful and flexible tools for working with the open-source library. |
| 11 | +* Fixed Assessment Exporter Notebook ([#3829](https://github.com/databrickslabs/ucx/issues/3829)). In this commit, the Assessment Exporter Notebook has been updated to improve code maintainability and robustness. The main change is the adjustment of the Lakeview dashboard Assessment Main dashboard path to the new naming format, which is now determined dynamically to avoid hardcoded values. The path format has also been changed from string to Path object format. Additionally, a new method `_process_id_columns` has been added to process ID columns in the dataset, checking for any column with `id` in the name and wrapping them in quotes. These changes have been manually tested and improve the accuracy of the exported Excel file and the maintainability of the code, ensuring that the Assessment Main dashboard path is correct and up-to-date and the data is accurately represented in the exported file. |
| 12 | +* TECH DEBT Use right workspace api call for listing credentials ([#3957](https://github.com/databrickslabs/ucx/issues/3957)). In this release, we have implemented a change in the `list` method of the `credentials.py` file located in the `databricks/labs/ucx/aws` directory, addressing issue [#3571](https://github.com/databrickslabs/ucx/issues/3571). The `list` method now utilizes the `list_credentials` method from the `_ws.credentials` object instead of the `api_client` for listing AWS credentials. This modification replaces the previous TODO comment with actual code, thereby improving code quality and reducing technical debt. The `list_credentials` method is a part of the Databricks workspace API, offering a more accurate and efficient approach to list AWS credentials, resulting in enhanced reliability and performance for the code responsible for managing AWS credentials. |
| 13 | +* [TECHDEBT] Remove unused code for _resolve_dbfs_root in MountCrawler ([#3958](https://github.com/databrickslabs/ucx/issues/3958)). In this release, we have made improvements to the MountCrawler class by removing the unused code for the _resolve_dbfs_root method and its dependencies. This method was previously used to resolve the root location of a DBFS, but it has been deprecated in favor of a new API call. The removal of this unnecessary functionality simplifies the codebase and aligns it with our goal of creating a more streamlined and efficient system. Additionally, this release includes a fix for issue [#3452](https://github.com/databrickslabs/ucx/issues/3452). Rest assured that these changes will not affect the current functionality or behavior of the system and are intended to enhance the overall performance and maintainability of the codebase. |
| 14 | +* [Tech Debt] removing notfound if not required in test_install.py ([#3826](https://github.com/databrickslabs/ucx/issues/3826)). In this release, we've made improvements to our test suite by removing the redundant `notfound` function in test_install.py, specifically from 'test_create_database', 'test_open_config', and 'test_save_config_ext_hms'. The `notfound` function previously raised a `NotFound` error, which has now been replaced with a more specific error message or behavior. This enhancement simplifies the codebase, reduces technical debt, and addresses issue [#2700](https://github.com/databrickslabs/ucx/issues/2700). Note that no new unit tests were added, but existing tests were updated to account for the removal of 'notfound'. |
| 15 | +* [Tech Debt] standardising the error message for required parameter in cli command ([#3827](https://github.com/databrickslabs/ucx/issues/3827)). This release introduces changes to standardize error messages for required parameters in the `databricks labs ucx` CLI command, addressing tech debt and improving the user experience. Instead of raising a KeyError, the command now returns clear and consistent error messages when required parameters are missing. Specifically, the `repair_run` function handles the case when the `--step` parameter is not provided, and the `move` and `alias` functions handle missing `--from_catalog`, `--to_catalog`, `--from_schema`, `--to_schema`, and `--from_table` parameters. Unit tests have been added to ensure the proper error messages are displayed when required parameters are missing, addressing issue [#2740](https://github.com/databrickslabs/ucx/issues/2740). |
| 16 | + |
| 17 | + |
3 | 18 | ## 0.57.0 |
4 | 19 |
|
5 | 20 | * Convert UCX job ids to `int` before passing to `JobsCrawler` ([#3816](https://github.com/databrickslabs/ucx/issues/3816)). In this release, we have addressed issue [#3722](https://github.com/databrickslabs/ucx/issues/3722) and improved the robustness of the open-source library by modifying the `jobs_crawler` method to handle job IDs more effectively. Previously, job IDs were passed directly to the `exclude_job_ids` parameter, which could cause issues if they were not integers. To address this problem, we have updated the `jobs_crawler` method to convert all job IDs to integers using a list comprehension before passing them to the method. This change ensures that only valid integer job IDs are used, thereby enhancing the reliability of the method. The commit includes a manual test to confirm the correct behavior of this modification. In summary, this modification improves the robustness of the code by ensuring that integer job IDs are utilized correctly in the `JobsCrawler` method. |
|
0 commit comments