Skip to content
Snippets Groups Projects
This project is mirrored from https://github.com/metabase/metabase. Pull mirroring updated .
  1. Oct 14, 2024
  2. Oct 11, 2024
  3. Oct 10, 2024
  4. Oct 09, 2024
    • Cal Herries's avatar
      Lean on DB queries for describe-table for Mongo (#46598) · 6324f948
      Cal Herries authored
      
      This PR reimplements driver/describe-table for MongoDB. Before we would query a sample of documents from a collection and analyse them in Clojure. Instead, we now now execute a query that does a similar aggregation, but most of the calculation is done in the Mongo database.
      
      Based on a few tests the performance is slightly slower when the collection contains small or deeply nested documents but much faster for large ones. But the main difference is in memory usage. This uses very little memory in the Metabase instance because all of the aggregation is done in the database.
      
      
      Nested fields are a naturally recursive problem but here we unroll potential recursions to a `max-depth` number of queries that look for nesting at each depth level.
      
      * ~ use DB to describe the table
      
      * ~ optimize root query
      
      * ~ nested-level-query works and gets objects too
      
      * + root query gets objects too
      
      * + driver/describe-table :mongo works
      
      * ~ remove old implementation
      
      * Various fixes for faster sync
      
      Upgraded driver to 5.2.0
      Updated data load to insert many rather than 1 row at a time.
      Dropped max-depth to 7, see comment.
      
      ---------
      
      Co-authored-by: default avatarCase Nelson <case@metabase.com>
      Unverified
      6324f948
    • Jeff Bruemmer's avatar
      docs - add time grouping (#47930) · 10fc583f
      Jeff Bruemmer authored
      Unverified
      10fc583f
    • Jeff Bruemmer's avatar
      docs - snowflake connection update (#47780) · 9e6c8a05
      Jeff Bruemmer authored
      * account v host snowflake connection
      
      * add screenshot
      Unverified
      9e6c8a05
    • Jeff Bruemmer's avatar
      Unverified
      53d7fc7e
Loading