QP: use MLv2 metadata provider. Eliminate 50% of app DB calls and improve performance by 10%+ (#33221)

* QP use MLv2 metadata provider (34/2)

* (22/2)

* (21 / 0)

* (20 / 4)

* (7 / 2)

* (2/0)

* Cleanup; (3/0)

* Last two test fixes

* (36 / 2)

* (8 / 1)

* Reorder stuff

* Test fixes 

* Test fixes

* Some test fixes

* More test fixes 

* Test fix 

* MongoDB test fix

* B I G  cached metadata provider performance improvements

* Revert breaking change

* Fix Kondo

* Make sure application database metadata provider returns Database :features

* Test fix 

* Parallel tests for QP macroexpansion middleware

* `with-current-user` is fine in parallel tests.

* Add test util remap metadata providers and rework remap middleware to use mock MLv2 data

* Address PR feedback

* Improve unrelated flaky test

* Some test improvements

* Fix lint error

* MLv2-ize `nest-query-test`

* Fix typo in PR feedback changes

* More parallelization and test fixes 

* Convert lots more tests to mock metadata

* Test fix? 

* Fix Card update logic

* Another Card update logic fix 

* Another round of fixes 

* Hopefully no more test fixes 

* Evil test fixes 

* Test fix 1

* Test fix

* Parallel QP tests; linter improvements; move QP test fns

* Cleanup

* Move query->expected-cols

* Fix QP test namespace

* Test fix 

* Fix merge issues

* Revert unrelated changes

* Test fix 

* Fix some things that are actually ^:parallel safe

* Remove Oracle logic for destroying DBs from different sessions since we don't test on AWS anymore

* Use ReentrantReadWriteLock for getting + creating test datasets to avoid race conditions

* Add non-`metabase.test` versions of things to the disallowed list for `^:parallel` tests

* QP: use Malli

* Fix schema names

* Fix missing namespaces

* Fix busted stuff

* Simplify the new schema

* Test fix 

* Test fixes 

* MongoDB fixes 

* FAST mu/defn

* Malli registry

* Misc fixes

* Some cleanup

* Misc cleanup and test fixes 

* mu/disable-enforcement

* Test fix

* Fix Cljs version of `disable-enforcement`

* Misc improvements

* Update tests

* Fix Kondo warnings

* Fix Kondo warnings

* Fix busted Malli schema

* PR feedback

* Fix busted schema

* Kondo fixx

* Test fixes 

* Use Malli version of `describe` now that PR was merged

* Work around https://github.com/metosin/malli/issues/924

* Test fixes 

* Improvements

* Test fix

* Migrate collection and permissions namespaces to Malli

* Fix docstring

* Fix Kondo warnings

* FAST mu/defn

* Malli registry

* Misc fixes

* Some cleanup

* Misc cleanup and test fixes 

* mu/disable-enforcement

* Test fix

* Fix Cljs version of `disable-enforcement`

* initial commit

* remove print

* add fix

* remove load

* fix tests

* MLv2: Kondo linter improvements & cleanup

* Revert version bump

This reverts commit 9da0bd76.

* Extra Metric tests; include `:description` in the Metric `display-info`

* Add `available-metrics` function & TS wrappers

* Support passing a Metric to `lib/aggregate`

* Include `:selected` information in Metric display info

* Fix indentation

* Revert changes to arithmetic type-of calculation

* Test fixes 

* Address PR feedback

* Address PR feedback

* Update docstring

* Implement `suggested-join-condition`

* Update docstring

* OOOF fix typo in `filter-clause`

* Fix premature i18n lookup

* Address PR feedback

* MLv2 JS join function wrappers

* PR feedback from #31590

* `join-conditions` returns raw MBQL clauses!

* WIP

* Simplify `with-join-alias` and `with-join-fields`

* Simplify join and add with-join-conditions

* Un-revert dev

* Wow! Remove unresolved nonsense.

* Remove dev

* Remove dev

* Test fixes 

* PR feedback

* WIP

* defop doesn't need query or stage-number anymore

* Fix Cljs tests for base PR

* Test fixes 

* Test fix 

* Update JS wrappers

* MLv2: remove the source-table: card__<id> hack once and for all

* lint rule to prevent using model/defomdel and clean up model.interface

* remove models/do-post-select

* no more mdb.u/primary-key

* Squash

* Replace connection-with-timezone usages

* Add deprecation warning.

* Fix docstring

* Ban `tt/with-temp` and convert usages to Toucan 2

* Ban `tt/with-temp*` and convert usages to Toucan 2

* Revert changes not meant for this PR

* Ban `mt/with-temp` and replace usages with `t2.with-temp/with-temp`

* Fixes 



* Fix indentation

* fix syntax in models.secret_test

---------

Co-authored-by: Ngoc Khuat <qn.khuat@gmail.com>

* Ban `tt/with-temp` and convert usages to Toucan 2

* Ban `tt/with-temp*` and convert usages to Toucan 2

* Revert changes not meant for this PR

* Ban `tt/with-temp` and convert usages to Toucan 2

* Revert changes not meant for this PR

* Dashboard Tab entity (#29802)

* add dashboard tab entity

* Dashboard tabs CRUD (#29861)

* Dashboard tabs frontend (#30189)

* rename `DashboardHeader.tsx` to `DashboardHeaderView` to avoid collision with `DashboardHeader.jsx`

commit-id:7cdfd86a

* add tabs to dash

commit-id:d3c2fa74

* improve code structure and other fixes

* rename `dashboardtab_id` to `dashboard_tab_id`

* remove explicit `position` logic

* improve code quality

* add renaming functionality

* add two new tabs when creating first tab

* hide tabs if there is only one

* add unit test for `DashboardTabs` component

* refactor

* fix type errors

* add `tabId` to text cards

* add `tabId` to link cards

* add `tabId` to action button

* use disabled state when only one tab remains

* refetch cards with filter value when changing tabs

* add e2e test

* fix broken e2e tests

* add horizontal scrolling

* fix unit test

* fix create tab button being on right

* fix performance issue when switching tabs

* add `ttag` to `tabs.ts`

* use `aria-label` in e2e test helper

* fix type error after rebasing

* making ordered_tabs optional for tests purposes

* fix failing unit tests

* fix failing e2e tests

* fix flaky revision history e2e test

* fix type error after merging feature branch with master and rebasing

* fix revisions unit test

* fix `ActionParmatersInputsForm.tsx` to stop `actions-on-dashboards.cy.spec.js` from flaking

---------

Co-authored-by: Ngoc Khuat <qn.khuat@gmail.com>

---------

Co-authored-by: Emmad Usmani <emmadusmani@berkeley.edu>

* MLv2: use kebab-case keys in Clojure & camelCase in JS

* Revert changes to tests

* Fix clj-kondo analysis for `defclause`

* Fix Kondo config

* Fix typo

* Add QP test middleware to validate converted pMBQL queries against MLv2 schema

* Revert 'fix' for #29944

* Fix ups

* Hack

* Fix final test failure

* Remove unused namespace

* Fix Kondo warning

* Skip #29958

This is a great way to make sure the conversion in both directions
is robust; every feature of MBQL is exercised somewhere in the BE tests.

In a few cases the `mbql-query` is called from a context where a
`(is ...)` test won't work - those places can use a `mbql-query-no-test`
instead. There were actually only two of these.

This exposed several issues in `->legacy-MBQL` which have now been fixed.

* [MLv2] Basic QP support for MLv2 queries

* Fix data/id init on launch

* Fix Kondo errors

* Add missing docstrings

* Seriously Kondo!

This supports both parsing out the tags and constructing the template tags map, with `card-id` and all.

This is not quite a FE no-op because the humanization of text is slightly different between `metabase.util.humanization` and the JS humanization library.

This improves JS<->CLJS conversion to handle UUIDs and be smarter about enums, both of which were needed to handle converting template tag maps.

Extracted a `js=` test helper to `metabase.test.util.js/=` since many tests need to compare JS objects, which are not JS `==` to each other.

* Improved implementation

* Amazing code cleanup

* Cleanup

* More tests

* use resolve-model with keyword check

* do the same for primary-key and fix a check in serialization

* db/update-where -> t2/update

---------

Co-authored-by: Cal Herries <39073188+calherries@users.noreply.github.com>

* (db/simple-insert! Model opts) -> (t2/insert! (t2/table-name Model)
opts)

* (db/simple-delete! model opts) => (t2/delete! (t2/table-name) opts)

* (db/simple-insert-many! Model opts) => (t2/insert! (t2/table-name Model) opts)

* (db/transaction body) -> (t2/with-transaction [_conn] body)

* (db/with-call-counting) -> (t2/with-call-count)

* db/execute -> t2/query-one

* db/count -> t2/count

* db/exists -> t2/exists

* Use type/JSON instead of type/SerializedJSON

* Tidy migration

* Update migration

* Fix rollback migration for h2

* whitespace

* Add test for migration

* Fix test

* Add rollback

* whitespace

* Test JSONB type as well as JSON

* Don't fingerprint JSON columns

* Remove comment, that might be wrong in the future

* Update test

* Add tests for fingerprinting

* Use base-type JSON for fingerprinting base query

* Add test for visibility-type=details-only

* undo .

* Change migration id

* Fix migration test

* Merge master

* Exclude mariadb from tests

* Make is-mariadb? public

* convert db\/insert! to t2

It's broken there because it tries to capture the Var returned by
`defn` in a `let`. Vars aren't real in CLJS, so this doesn't work.
The compile succeeds but the JS output is subtly broken.