See: https://security.snyk.io/vuln/SNYK-JAVA-ORGBOUNCYCASTLE-6612984

[Fixes #13922]

* Parse wildcards in native queries

Add query_field.direct_reference

* Do away with old Model refs in Card model test

* Do not show stale cards with a select *

* Remove unused marginalia aliases

* Upgrade deps.edn

From `neil deps upgrade`

* Un-bump jetty-server

* Downgrade H2 due to many problems

* Dep bumping for Athena

* Dep bumps for BigQuery

* Dep bumps for Presto

* Dep bumps for Redshift

* Dep bumps for Snowflake

* Dep bumps for SQLite

* Upgrade to Mongo 5

* Bump next.jdbc

* Wow

* Test fix 

* Fixes

* Actions should use strings for column names (fix :update-row and :create-row normalization)

* MLv2 schema should check against keys for the other query type

* Ok, have I fixed things?

* More fixes 

* Fix indentation

* Another round of test fixes. 

* Hopefully the last few test fixes 

* We need to test normalization for queries that have keyword keys as well.

* Fix Cljs i18n namespaces

* Sort namespaces

* Only test against H2

* Rename `metabase.mbql` to `metabase.legacy-mbql`

* Fix Kondo warnings

* Test fixes 

* Register MBQL clause schemas and test fixes 

* Test fixes and PR feedback

* Test fix

* Remove the normalization tests

* Test fixes 

* Fix kondo

* Fix import

* Another fix 

* Merge

* FIXES

* Add another missing REQUIRE

* SQL Lineage: Create the QueryField model

This links Cards (with native queries) to Fields, showing us which
queries use which Fields.

QueryFields are automatically maintained as part of the Card lifecycle

Cards with stale queries (powered by QueryField info) are exposed via the `card?f=stale` API

* No more Schema, only Malli

* Remove the rest of Schema

* Fix Kondo warnings

* Port some decoding code

* More porting

* Almost all done?

* Parsing fixes 

* More fixes

* Fix Kondo errors

* Test & lint fixes 

* Test fix 

* PR feedback

* wip

* SLO works with auth slo handler route

* move slo handling endpoint to /auth/sso/handle_slo

* fix slo redirect url

* SLO works, and the sso-handle-slo for saml is where it belongs

- a ton of cleanup

* fix api/session namespace + add docstrings

* cleaning up logout action

* add slo logout test along with slo response xml

* whitespace + linter

* add docstring

* update exclusions in deps.edn

* un-require metabase-enterprise ns from oss ns

* add docs for how to setup SLO to metabase docs

* docs: clarify that setting up SLO is optional

* move slo logout endpoint into ee code

- removes sso-info defenterprise since it is no longer needed

* use current version of saml20-clj

---------

Co-authored-by: Nick Fitzpatrick <nickfitz.582@gmail.com>

* Endpoint stubs

* It's alive!!!

The summarization endpoint is live, calling OpenAI, and connected to the `POST "metabot/card/summarize"`. `POST card/` also taps the results.

* Updating prompt

* Updated response shape

* [WIP] working front-end suggest button

* Incorporating viz settings

* add suggest description to save question modal

* Updating prompt

* merge title and description suggestion into one button

* Updating prompt

* Removing dead code

* Removing unused param and fn cleanup

* Fix string comment

* Adding dashboard summary endpoint stubs

* auto-request title and description

* dashboard summary wip

* dashboard summary wip

* dashboard summary wip

* better prompt

* remove dead component

* add suggest description button in dashboard sidebar

* fix dashboard description suggestion request

* better prompt

* swap out button when generating dashboard suggestion

* adding keywords

* adding keywords

* adding keywords

* adding keywords

* polish loading question name and description suggestions

* polish UI for dashboard description suggestion

* Stubbed in usage middleware

* Beginning EE Push

Moved metabot/summarize endpoints to autodescribe/summarize in the ee codebase to push this towards being an ee feature and distinguish it from metabot features.

Added snowplow tracking.

* Isolating EE LLM Code

This change completely separates metabot code from ee llm code.

It also introduces a composable client mechanism for creating LLM clients for different tasks.

* Task-Oriented LLM Refactoring

LLM code is now organized clearly into a directory of tasks. Each ns in the tasks package provides a certain LLM task to be used in the API.

* Adding unit test

* Adding admin UI elements for EE OpenAI key

* prettier on frontend/src/metabase/services.js

* Cleaning up description text

* Updating api calls

* FE stuff -- hiding things when feature not enabled.

* Figuring out linting for snowplow file

* Figuring out linting for snowplow file

* Fixing unit test

* add token feature llm-autodscription

* change added from 0.50 to 0.49

* extract logic from SaveQuestionModal into ee plugin

* extract logic from DashboardInfoSidebar to ee plugin

* Fixing unit test

* tests

* cleaning up code for SaveQuestionModal

* gate llm question name behind openAI key setting

* remove styles from SaveQuestionModal.css

* clean up code for dashboard

* lint

* Enabling triggering based on `:llm-autodescription` feature flag

* Starting to look at using a badge for LLM results (#38797)

* Starting to look at using a badge for LLM results

* WIP - Using an Indicator to show AI "stuff"

* Prototype of LLM with badge/indicator

* Removing dashboard description AI

* Ensuring LLM icon only shows when key is present. Updating icon to newer design. TODO: Put the icon in the right place.

* Cleanup -- still need to figure out how to position the indicator and not collapse the radio when selected.

* Updating save question form with LLM values does not reset form

* Cleanup

* Correct icon placement

* Adding MB branding to star

* add ai icon, tweak display

* Fix z-index, tweak padding

* cleanup

* remove inactive code

* Cleaning llm description task cobwebs out

* fix collection creation

* Cleaning lint and merge errors

* Adding "save-question-modal" test id back in

* Fixing jest test

* Touching a file to unstick CI

* Untouching a file to unstick CI

* Fixing some includes from the rebase.

* eslint fixes

* eslint fixes

* Fixing types

* Using `PLUGIN_IS_EE_BUILD.isEEBuild()` instead of `isEnterprise()`

* Removing dead styling

* Adding test ids and fixing cypress tests

* Fixing e2e tests

* Incorporating feedback

* Update frontend/src/metabase-types/api/settings.ts

Co-authored-by: Jesse Devaney <22608765+JesseSDevaney@users.noreply.github.com>

* Update frontend/src/metabase/core/components/EditableText/EditableText.tsx

Co-authored-by: Jesse Devaney <22608765+JesseSDevaney@users.noreply.github.com>

* Update frontend/src/metabase/core/components/Input/Input.tsx

Co-authored-by: Jesse Devaney <22608765+JesseSDevaney@users.noreply.github.com>

* Update frontend/src/metabase/core/components/TextArea/TextArea.styled.tsx

Co-authored-by: Jesse Devaney <22608765+JesseSDevaney@users.noreply.github.com>

* Update frontend/src/metabase/core/components/TextArea/TextArea.styled.tsx

Co-authored-by: Jesse Devaney <22608765+JesseSDevaney@users.noreply.github.com>

* Update frontend/src/metabase/dashboard/components/DashboardInfoSidebar/DashboardInfoSidebar.tsx

Co-authored-by: Jesse Devaney <22608765+JesseSDevaney@users.noreply.github.com>

* Fixing import

* Rebasing on master to fix conflicts

* Fixing types

* Revert "Update frontend/src/metabase/core/components/EditableText/EditableText.tsx"

This reverts commit fe11817086bff50f90336f30d33a1431cae662c5.

* Revert "Update frontend/src/metabase/core/components/Input/Input.tsx"

This reverts commit eef21407ee32e636a8b4e2594d502d5bbaa36870.

* Revert "Update frontend/src/metabase/core/components/TextArea/TextArea.styled.tsx"

This reverts commit dd1c22b993a6576d92547749d2eb93cb68411585.

* Revert "Update frontend/src/metabase/core/components/TextArea/TextArea.styled.tsx"

This reverts commit b169d05364e92c032ae5b6c972888a86079921e2.

* Fixing e2e tests

* address feedback

* Fixing e2e tests

* Fixing modal for models

---------

Co-authored-by: Jesse Devaney <22608765+JesseSDevaney@users.noreply.github.com>
Co-authored-by: Emmad Usmani <emmadusmani@berkeley.edu>
Co-authored-by: Kyle Doherty <5248953+kdoh@users.noreply.github.com>
Co-authored-by: Anton Kulyk <kuliks.anton@gmail.com>
Co-authored-by: Ryan Laurie <iethree@gmail.com>

We do this for our JS and TS code. This change configures shadow-cljs to
emit the source maps in release mode, and bumps the versions of
shadow-cljs and the transitive dependency `source-maps-js` to enable
webpack to consume these source maps correctly.

(The output source maps have some quirks, and broke some consumers.
Mainly that inlining of CLJS functions can result in empty namespaces,
and while the file contents were correctly inlined,
`sourceContents: ""` looks falsy in JS. Webpack would try to read the
nonexistent source files and fail to build.)

* Redshift: drop session schema when test suite finishes [ci skip]

* Update Hawk version

* PR feedback

* Bump Hawk version

* Skip after-run for drivers that don't have test extensions

---------

Co-authored-by: Cal Herries <39073188+calherries@users.noreply.github.com>

pulling in https://github.com/camsaul/toucan2/pull/162 to fix #38516

* Remove references to shared/ directory which no longer exists

* Update shadow-cljs and pinned cider/nrepl versions

* Support legacy metadata and raw Dates for brush filter helper functions

* Fix fn name

* Apply suggestions from code review

Co-authored-by: metamben <103100869+metamben@users.noreply.github.com>

---------

Co-authored-by: metamben <103100869+metamben@users.noreply.github.com>

Co-authored-by: metamben <103100869+metamben@users.noreply.github.com>

* Add dev fn to render dashboards with static-viz renderers

Run `(dev.render-png/render-dashboard-to-html 1)` to render the dashboard with id 1 to a handy html file.

This file will render each dashcard in the dashboard 3 ways:
 - as a png, like you would see in Slack or in an email body (if it's a chart)
 - as html/svg, like you'd see in the email body (for tables).. might also be helpful to inspect the svg output from
 the graaljs interpreter
 - 10 row table representing what the .csv attachment for the dashcard would look like

Note: to get this branch working properly, there are a couple lines commented out to pass the linter... it's a work in
progress and will be cleaned up for better use.

Todo:
 - [ ] avoid with-redefs to pass the linter
 - [ ] add a preview endpoint that can be used so that you don't need to run a Clojure repl to get the same result.

* Eliminate with-redefs to allow csv 'render'

* Make a 'preview' ns to power `api/pulse/preview_dashboard/:id`

* Make dev.render-png dashboard preview fns the same as the preview ns

* Dashboard Subscription preview ns now also uses csv attachment code

This change now uses the csv attachment code to include an html table representing what we expect to see from csv exports.

* Add dev fn to render dashboards with static-viz renderers

Run `(dev.render-png/render-dashboard-to-html 1)` to render the dashboard with id 1 to a handy html file.

This file will render each dashcard in the dashboard 3 ways:
 - as a png, like you would see in Slack or in an email body (if it's a chart)
 - as html/svg, like you'd see in the email body (for tables).. might also be helpful to inspect the svg output from
 the graaljs interpreter
 - 10 row table representing what the .csv attachment for the dashcard would look like

Note: to get this branch working properly, there are a couple lines commented out to pass the linter... it's a work in
progress and will be cleaned up for better use.

Todo:
 - [ ] avoid with-redefs to pass the linter
 - [ ] add a preview endpoint that can be used so that you don't need to run a Clojure repl to get the same result.

* Eliminate with-redefs to allow csv 'render'

* Make a 'preview' ns to power `api/pulse/preview_dashboard/:id`

* Make dev.render-png dashboard preview fns the same as the preview ns

* Dashboard Subscription preview ns now also uses csv attachment code

This change now uses the csv attachment code to include an html table representing what we expect to see from csv exports.

* Collect all element styles into a single style tag to use with the server's nonce

This allows the dashboard_preview endpoint to render properly by gathering all of the element styles into a single
style tag, which can then be given the server's nonce value so that CSP doesn't strip the style out.

This is useful for the preview endpoint so that we get an accurate picture of what our tables will look like in
emails, plus it makes the presentation look just a bit more readable.

* dev render_png fns match output used on the endpoint now too.

* Hickory dependency out of dev into regular deps

* Bump dependencies based on vulnerabilities

* More deps bumped

* Bump more deps

* Rollback H2 dependency bump

* Add comments and make guava match elsewhere.

* Adding results_metadata to qp middleware

This adds two middlewares to `metabase.query-processor.middleware.results-metadata`:
- `inject-result-metadata`: Adds `result_metadata` from the context, if present, into the query map during preprocessing.
- `merge-existing-metadata`: A post-processing middleware that merges `results_metadata` (if present) from the query data into the metadata.

This has the effect of preserving existing metadata, which is particularly important for user-curated metadata, such as semantic type overrides.

This may also facilitate addressing the following TODO in the same ns:

```
;; 1. Is there some way we could avoid doing this every single time a Card is ran? Perhaps by passing the current Card
;;    metadata as part of the query context so we can compare for changes
```

* Preserving result_metadata in query processor

This PR uses `qp.util/combine-metadata` to simplify the combination of provided `:result_metadata` with computed metadata. It also updates pulse rendering code to use this new code path and adds and updates tests to vet this logic.

* fmt

* Modifying PR to document and use existing fns

The current qp pipeline will correctly propagate custom metadata if a question is derived from a model or if the model is processed like so:

```clojure
(qp/process-query
  (assoc-in dataset_query [:info :metadata/dataset-metadata] result_metadata))
```

This PR fixes rendering unit tests to clarify this and provides a much better working example in the `dev.render-png` ns.

* Updating test

* Adding Pulse w/Metadata Tests

This pr adds a unit test that constructs a dashboard and simulates a pulse email, then checks the resulting HTML for correctness.

A dependency on the [hickory](https://github.com/clj-commons/hickory) library was added to dev. This allows us to easily parse HTML into data and navigate the parse tree.

Note that it does NOT check the attachments for formatting correctness.

Spelling and import consistency changes were also made.

This reverts commit 10cdb49d.

CI fails because of commit that is being reverted.