Skip to content
Snippets Groups Projects
This project is mirrored from https://github.com/metabase/metabase. Pull mirroring updated .
  1. Oct 16, 2024
  2. Oct 15, 2024
    • Raphael Krut-Landau's avatar
    • github-automation-metabase's avatar
    • bryan's avatar
      Adds missing schemas + data for metrics to snowplow stats ping (#48476) · e5c181bd
      bryan authored
      * adds data + schema for metrics stats ping
      
      * remove comment
      
      * annotate todos
      
      * fill in the rest of the metrics values
      
      - and add defaults
      
      * fix some definitions + use a single timestamp
      
      * shuffle stuff around to appease the namespace linter
      
      - we aren't reaching into the api API, so the linter is more of a
        formality here.
      
      * update docstring
      
      * fix jsonschema, maybe
      
      * review responses
      
      - revert changes to 1-0-0
      - add metrics section to new file: 1-0-1
      - bump ::instance_stats to "1-0-1"
      - add tags into 1-0-1
      - make the code return tags (empty for now until we know what to tag things.)
      
      - also fix test that broke from shuffling settings around
      
      * remove a footgun
      
      * add tags to metrics,
      
      add grouped_metrics to jsonschema 1-0-1
      
      format 1-0-1
      
      * indent
      
      * cljfmt
      
      * version should match filename
      
      * update instance stats 1-0-1 schema
      
      * require `tags` in grouped_metric + snowcat comment
      
      * fix formatting noise
      
      * update schema to make it valid
      
      * remove grouped_metrics from instance_stats schema
      
      * cljfmt appeasement
      
      * unbin cache_num_queries_cached value
      
      - alphabetize metrics generation
      
      * we can now guarantee metric values will be ints
      
      * jsonschema for instance_uuid, settings, and grouped_metrics
      
      * add analytics_uuid and make it required
      
      * lint + alphabetize instance stats json schema
      
      * update setting key type
      
      - add maxLength to some strings
      
      * lint jsonschema
      
      - Add description to setting.items.tags
      - add maxLength, and {min,max}imum to setting.items.value
      
      * Bump instance stats to 2-0-0
      
      - remove analytics_uuid string length == 36 check
      - adds assertion to ensure required fields are set (and it passes)
      - adds info for embedding settings
      
      * adds a grouped-metric to stats ping
      
      - adds length info to the schema to pass jsonschema linting
      
      * cljfmt
      Unverified
      e5c181bd
    • Aleksandr Lesnenko's avatar
    • Anton Kulyk's avatar
      Fix maps visualization crashing on x-rays (#48742) · 54b141c7
      Anton Kulyk authored
      * Add default value for `hiddenIndices`
      
      * Add e2e test
      Unverified
      54b141c7
    • Uladzimir Havenchyk's avatar
      fix circular deps in query_builder/components (#48604) · 880119e7
      Uladzimir Havenchyk authored
      * fix circular deps in query_builder/components
      
      * js -> ts
      Unverified
      880119e7
    • adam-james's avatar
      Incremental Pivot Processing for Exports (#46995) · 8d52a03f
      adam-james authored
      
      * Incremental Pivot Processing for Exports
      
      WIP
      
      Fixes pivot exports for CSV and xlsx.
      
      The CSV export should use less memory by incrementally building up the data structure and aggregating necessary row
      data right away, so the memory overhead becomes only as large as the total pivot result.
      
      In cases where the pivot rows/cols do combine into many many columns and rows, this can still be a large set of data,
      but it should behave much better now in most cases.
      
      The Excel export is a little more straightforward: create the export rows in the same fashion, streaming one row at a
      time, and just post-process the sheet to add the pivot table in one shot at the end.
      
      * WIP adding row totals.
      
      * aggregate totals as rows are added
      
      Row, column, section, and grand totals are all aggregated as each row is added.
      This means the final step of building pivot output becomes just an exercise of lookups/arrangement, no further
      aggregation is needed.
      
      * CSV pivot works per-row, export respects formatting
      
      This is a big step forward; we don't need to hold the entire dataset in memory, we instead aggregate a row's data into
      the pivot datastructure, which only holds onto:
      
      - unique values for each pivot-row in a sorted set
      - unique values for each pivot-col in a sorted set
      - grand total for each measure N values, where N is number of measures, ususally 1 or 2
      - row totals for each combination of each pivot-row * N measures
      - col totals for each combination of each pivot-col * N measures
      - totals for each 'section', determined by unique values of first pivot-row * N measures
      - values for each measure in every 'cell'; Row Combos * Col Combos * N Measures
      
      So, there can still be a decent amount of data to store; but it will never hold onto all of the 'raw rows' from the
      dataset.
      
      We can never completely guarantee that Row Combos * Col Combos * N Measures remains small, but two things let us move
      forward anyway:
      
      - there's now visible feedback in the app that the download is running (or if it's failed)
      - Pivot table utility diminishes rapidly with huge output anyway; users still need to curate/set up their data
      - effectively to improve the table's utility, so we can assume that a slow-to-download pivot table is also slow to
      - use/less effective, and will likely be something the user doesn't want (as often).
      
      * some test fixes
      
      * now, if we export 'raw pivot rows', they don't show pivot-grouping
      
      and they also don't include the 'extra' rows for totals/subtotals/grand totals (any row with pivot-grouping > 0).
      
      This means that now the non-pivot version of a pivot table export will match what a user sees if they change the viz
      to a regular table.
      
      * remove old test
      
      * re-incorporate some changes from master
      
      * fix csv for non-pivots due to oversight in my changes
      
      This is just a temporary change, I think I should clean up this bit of the code a little, I can probably make it a
      little more readable and use some cleaner logic regarding if the rows are 'raw pivot rows' or not.
      
      * start moving format_rows to POST bod, add pivot_results too
      
      There's still wiring work to do, but this starts to add format_rows and pivot_results to POST body for the various API
      endpoints. Also modify tests to improve coverage/consistency across downloads and alerts/subscriptions.
      
      The tests will not pass on this commit, but fixes will be incoming
      
      * native pivot tables in xlsx
      
      * add precondition to pass migration linter
      
      * try to get migrations fixed
      
      * pasing pivot-results through api and attachments
      
      * fix tests for format_rows in BODY vs query param
      
      * tests!
      
      * might have the tests all fixed now
      
      * the pivoted export now respects col/row totals settings
      
      * add test coverage for public questions and dashboards
      
      * col and row totals work as expected
      
      * build-pivot refactor for clarity
      
      * docstring change + tiny refactor in helper fn
      
      * see if dashcard download works with format_rows
      
      * csv pivot handles nil values
      
      * pass format_rows and pivot_results in :params not :body
      
      * fix some other tests
      
      * pivot-grouping col filtered out of xlsx
      
      * pivot-grouping-col removed for all rows
      
      * configurable pivot exports and attachments (#47880)
      
      * exports fe
      
      * specs
      
      * ui
      
      * specs
      
      * format/unformatted now works for xlsx
      
      * format test changes for xlsx formatting
      
      * embedding endpoints accept pivot_results
      
      * cljfmt and eslint fix
      
      * empty
      
      * embedding test should have formatting defaulted to true
      
      * embed test fixes
      
      * Use `Chip` for export settings widget
      
      * downloads e2e test fix
      
      * fix public download limit test
      
      * public card download defaults
      
      * fix public download defaults in some tests
      
      * Fix visual test
      
      ---------
      
      Co-authored-by: default avatarAleksandr Lesnenko <alxnddr@users.noreply.github.com>
      Co-authored-by: default avatarNoah Moss <32746338+noahmoss@users.noreply.github.com>
      Co-authored-by: default avatarAnton Kulyk <kuliks.anton@gmail.com>
      Unverified
      8d52a03f
    • Aleksandr Lesnenko's avatar
      fix iframe dashcards crash subscriptions (#48589) · ba06b99e
      Aleksandr Lesnenko authored
      
      * fix iframe dashcards crash subscriptions
      
      * add a test to ensure iframes are filtered out of subscriptions
      
      ---------
      
      Co-authored-by: default avatarAdam James <adam.vermeer2@gmail.com>
      Co-authored-by: default avataradam-james <21064735+adam-james-v@users.noreply.github.com>
      Unverified
      ba06b99e
    • Romeo Van Snick's avatar
      Remove "Replace or save question" UI when saving and edited question from a metric (#48669) · b8997a1e
      Romeo Van Snick authored
      * Remove 'Save as new question' toggle when saving questions from editing a metrics' ad-hoc question
      
      * Allow visitQuestion to work for metrics
      
      * Use visitQuestion in metric test
      
      * Add test for #48555 (showing the 'Save as new?' ui for metrics)
      
      * Add issue info to repro
      
      * Use visitMetric, visitModel and visitQuestion helpers in createQuestion
      
      * Move check to make it more clear what the save ui does
      
      * Use cy.button for Done button
      
      * Remove unnecessary .within
      
      * Sign in as normal user
      
      * Add missing dataset alias
      Unverified
      b8997a1e
    • Uladzimir Havenchyk's avatar
    • Kamil Mielnik's avatar
      Refactor remaining e2e API commands to TS helper functions (#48672) · 46af3b4c
      Kamil Mielnik authored
      * Refactor createDashboardWithQuestions, createQuestionAndAddToDashboard and editDashboardCard to TS function helpers
      
      * Fix createNativeQuestionAndDashboard that got out of sync
      Unverified
      46af3b4c
    • Ngoc Khuat's avatar
      Unverified
      1a2a9c81
    • Nicolò Pretto's avatar
      fix flaky test on embed share behaviour snowplow events (#48665) · dcb843bf
      Nicolò Pretto authored
      
      * increase time tolerance to make tests less flaky on ci when CPU is under heavy load
      
      * Update e2e/test/scenarios/sharing/public-sharing-embed-button-behavior.cy.spec.js
      
      Co-authored-by: default avatarUladzimir Havenchyk <125459446+uladzimirdev@users.noreply.github.com>
      
      ---------
      
      Co-authored-by: default avatarUladzimir Havenchyk <125459446+uladzimirdev@users.noreply.github.com>
      Unverified
      dcb843bf
    • Romeo Van Snick's avatar
      Change Metrics and Summaries copy (#48451) · 86ff88a1
      Romeo Van Snick authored
      * Rename Common Metrics to Metrics
      
      * Rename Basic Metrics to Summaries
      
      * Update chill mode button copy to 'Add a summary or metric'
      
      * Rename 'Pick the metric you want to see' button to include summary
      
      * Fix type in test
      
      * Rename Summaries to Basic functions
      
      * Fix test
      
      * Undo cross-version test changes
      Unverified
      86ff88a1
  3. Oct 14, 2024
  4. Oct 11, 2024
Loading