* Add direction arg to orderByClause

* Update order_by.ts

* Fix TypeScript error

* Update order_by.ts

---------

Co-authored-by: Anton Kulyk <kuliks.anton@gmail.com>

* update and test number display for gauge viz

* update and test numeric display for progress viz

* display null in scalar viz

Added both FE and BE tooling for integration with LLMs, called "metabot". FE adds prompts for querying models and databases. BE takes these prompts, calls a LLM, parses the response, and returns the result.

* WIP Initial commit, not sure of difference between Clause and Field

* Finish wrappers for remove-clause and replace-clause

Added `pretty` option to POST api/dataset/native route. Defaults to `true` such that invocations of this endpoint will return pretty-formatted SQL. In the case of previewing the native SQL editor with templating, we pass `false` so that what is typed is what is presented. In all other cases we accept the default.

* Move `SortStep` to its own directory

* Add tests for `SortStep`

* Clean up `SortStep`

* Improve a11y

This reverts commit 25a1b259.

* Add more MLv2 wrappers

* Don't use MLv2 directly

* Update tests

* Add dedicated `OrderByClause` type

* Rename `query` to `fromLegacyQuery`

* Remove too precise `orderableColumns` test

Agreed that should be better covered on the CLJS side

* Use type/JSON instead of type/SerializedJSON

* Tidy migration

* Update migration

* Fix rollback migration for h2

* whitespace

* Add test for migration

* Fix test

* Add rollback

* whitespace

* Test JSONB type as well as JSON

* Don't fingerprint JSON columns

* Remove comment, that might be wrong in the future

* Update test

* Add tests for fingerprinting

* Use base-type JSON for fingerprinting base query

* Add test for visibility-type=details-only

* undo .

* Change migration id

* Fix migration test

* Merge master

* Exclude mariadb from tests

* Make is-mariadb? public

* Migration for adding nfc_enabled

* Add nfc_enabled to field settings

* Update describe-nested-field-columns to only unfold fields that have not been disabled

* Remove spy

* Tidy

* Fix

* Clear nested fields immediately if folding is disabled

* Clear nested fields on nfc_enabled change

* Trim trailing whitespace

* Tidy

* Fix

* Add enable-json-unfolding-test

* Move to field api test

* nfc_enabled -> json_unfolding

* Tidy test

* Make json-unfolding in database details just the default for new settings

* Restore original visibility-type logic

* Fix

* Sync field json_unfolding according to db json_folding

* Rename to json-unfolding-default

* Add test for the case when the json-unfolding is false for the database

* Implement default json unfolding for first sync

* Update comment

* Update comment

* Restore PUT field

* Migration for populating json_unfolding for mysql and postgres

* Remove migration and use default on the frontend instead

* Update json-unfolding database setting copy

* Move Unfold JSON setting under semantic type setting

* Separate sentences with spaces

* Capitalize

* Restore handleChangeSemanticType

* Use base_type TYPE.JSON instead

* Change order of migrations

* Add h2 migration

* Add test for migration

* Update test description

* Remove validCheckSum

Co-authored-by: Ngoc Khuat <qn.khuat@gmail.com>

* Use ?? instead of ||

* Fix tests

* Remove outdated serdes stuff

* Remove unnecessary and

* Fix mysql migration

* Remove unused require

* Fix test

* Add false default value for json_unfolding

* Fix json-unfolding nil case

* Other suggestions

* whitespace

* Tidy describe-nested-field-columns

* Update comment

* Remove unused clear-nested-fields!

* Remove unused return value

* Fix H2 migration to use base_type not database_type

* Always set json-unfolding during sync

* Fix test

* Fix test

* Fix test

* Add comment explaining nested-field-column support for MySQL

* Fix tests

* Fix tests

* Fix test

* Fix test

* Default json_unfolding to false for new fields

* Fix merge

* Add json_unfolding to mock tables

* Don't capitalize prepositions

* Update setting description

* whitespace

* whitespace

* Fix fetch_metadata

* Fix fetch_metadata

* Fix tests

* Fix test

* Fix clj-kondo

* Remove postgres database-supports test

* Fix postgres test

* Fix postgres test

* Fix mysql migration

* Fix clj-kondo

* Don't test mariadb

* Fix mysql test

* Fix mysql json-unfolding nil case

* Add comments to test

* Add upterm step to mariadb test

* Move upterm step before tests

* Fix postgresql migration

* move upterm step to test-driver action

* Remove upterm step from drivers.yml

* Comment out everything else in test-driver

* Fix mariadb migration

* Remove upterm action

* Whitespace

* Only handle JSONObjects with JSON_VALUE, not JSONArray

* Fix fields.sync_metadata/update-field-metadata-if-needed!

* Add comment explaining `json-unfolding-default`

* Add comment for JSON_VALUE test

* Update json-unfolding-default-true-test to use fresh db

* Fix test descriptions

* Don't capitalize setting display name

* Fix update json_unfolding

* Fix unfolding json for only one JSON column, not all

* Add e2e test for JSON unfolding setting

* Fix test

* whitespace

* Fix test

* Fix json-unfolding for nested field columns

* Fix mysql and postgres tests for nested field columns

* Coerce nil json-unfolding to false for sync_metadata

* Add test for nil json-unfolding for sync_metadata

* Fix test

* Don't update json_unfolding from intial sync

* Add json_unfolding to update-field-test

* Fix tests

---------

Co-authored-by: Ngoc Khuat <qn.khuat@gmail.com>

* Move `LimitStep` to its own directory

* Add unit-tests to `LimitStep`

* Clean up `LimitStep` and convert to TypeScript

* Include MLv2 query instance to notebook steps

* Implement notebook update with MLv2 query

* Update v2 `limit` wrapper signatures

* Add v2 query to `updateQuery` type

* Use MLv2 to manage limit in the notebook editor

* Extend notebook step's helper functions for MLv2

* Use MLv2 in limit step helpers

* Fix `topLevelQuery` generated from the wrong place

* Respect query staging for `revert` step

* remove _internal pages and resources

* remove internal jest config

* [MLv2] Basic QP support for MLv2 queries

* Fix data/id init on launch

* MLv2 Order bys in JS (WIP)

* Fix Kondo errors

* Order bys in Cljs

* Add missing docstrings

* Prettier

* Seriously Kondo!

* Appease ESLint

* Fix docstring

* Move `notebook/lib/types` to `notebook/types`

* Extract notebook test-utils

* Fix `reportTimezone` type inconsistency

* Use `NotebookStepUiComponentProps` type

* Convert `FilterStep` to TypeScript

* Convert `AggregateStep` to TypeScript

* Convert `BreakoutStep` to TypeScript

* Convert `SortStep` to TypeScript

* Convert `DataStep` to TypeScript

* Convert `SummarizeStep` to TypeScript

* Fix closing the sort popover

* use redux toolkit

* update combineReducers import

* remove redux

This supports both parsing out the tags and constructing the template tags map, with `card-id` and all.

This is not quite a FE no-op because the humanization of text is slightly different between `metabase.util.humanization` and the JS humanization library.

This improves JS<->CLJS conversion to handle UUIDs and be smarter about enums, both of which were needed to handle converting template tag maps.

Extracted a `js=` test helper to `metabase.test.util.js/=` since many tests need to compare JS objects, which are not JS `==` to each other.

* set different min and default dashcard sizes

* add defaultsize type

* adjust text card default size

* allow smaller scalar values

* don't show titles in question viz

* add support for country names in world choropleth map

* manually add alternative country names

* add additional name for fårö islands

* fix curaçao spelling

* add unit test

* Add TypeScript wrapper for limit helpers

* Use v2 limit in `StructuredQuery`

* Add redux action for managing limit in QB

* Switch `QuestionRowCount` to use ML v2

* Add utils to convert v2 queries into v1

* Use `toLegacyQuery`

* Fix CLJS limit functions unavailable in Jest

* Fix tests

* Style tweaks

* Fix type error

* Use opaque type for ML `Query`

* Use `Lib` instead of `MetabaseLib`

* Drop v2 folder

* Fix MBQL in unit tests

* Don't import individual functions from MLv2

* Export `limit` CLJC functions

* Tweak CLJS imports

* Ensure implicit actions are created in a deterministic order

* Add missing lint-staged step for JS, TS under `e2e/*`

* Merge outdated ExpressionPopover and ExpressionWidget (#29050)

* Refactor negative filters formatting to make them pass isExpression validation - not-null, not-empty, does-not-contain

* Refactored ExpressionEditorTextfield to TS (#29337)

* Remove footer divider

* Fixed issue with aggregation step in admin data-model metrics section

* move component tests out of test dir

* fix export

* update test paths

* oops its a regex

* use read only notebook instead of GUI query editor to view queries

* remove edit formatting elements for readOnly variant

* add unit tests

* add back support for native queries

* update tests

* fix types

* Improved implementation

* Amazing code cleanup

* Cleanup

* More tests

* Add entity menu example to storybook

* Update frontend/src/metabase/components/EntityMenu.stories.tsx

Co-authored-by: Ryan Laurie <30528226+iethree@users.noreply.github.com>

* Update frontend/src/metabase/components/EntityMenu.stories.tsx

Co-authored-by: Ryan Laurie <30528226+iethree@users.noreply.github.com>

---------

Co-authored-by: Ryan Laurie <30528226+iethree@users.noreply.github.com>

* Add basic tests to `NotebookStep`

* Fix irreversible steps have "remove" button

* Use `aria-label` instead of a test ID

* Use `IconButtonWrapper`

* Move `NotebookStep` into its own directory

* Convert `NotebookStep` to TypeScript

* Extracts steps

* Move styled file

* Extract `ActionButton`

* Clean up

* Turn `NotebookStep` into a functional component

* Extract `OpenSteps` type

* Remove commented out code

* Fix typo

* Convert `steps` to TypeScript

* Convert `NotebookSteps` to TypeScript

* Turn `NotebookSteps` into functional component

* Turn `NotebookSteps` into a functional component

* Move `NotebookSteps` into its own directory

* Extract styled component

* Fix type

* keep standalone values when collapsing column

* adjusting unit test

* PR Feedback

* adding space

* removing only

* Adjusting behavior and tests

* adjusting data_grid unit tests