Skip to content
Snippets Groups Projects
This project is mirrored from https://github.com/metabase/metabase. Pull mirroring updated .
  1. Feb 02, 2024
  2. Feb 01, 2024
  3. Jan 31, 2024
  4. Jan 24, 2024
  5. Jan 03, 2024
  6. Dec 13, 2023
  7. Dec 08, 2023
  8. Nov 21, 2023
  9. Nov 15, 2023
  10. Nov 14, 2023
  11. Oct 27, 2023
  12. Oct 25, 2023
  13. Oct 23, 2023
  14. Oct 22, 2023
  15. Oct 20, 2023
  16. Oct 19, 2023
  17. Oct 17, 2023
  18. Oct 16, 2023
  19. Oct 11, 2023
  20. Oct 10, 2023
    • Nemanja Glumac's avatar
      E2E isolate mongo (#34423) · 899ad8ab
      Nemanja Glumac authored
      * Tag Mongo-dependent E2E tests
      
      * Run mongo tests only if `CYPRESS_QA_DB_MONGO` is `true`
      
      * Adjust E2E workflow to run mongo tests separately
      
      * Guard against missing mongo env var
      
      * Fix workflow
      
      * Fix qa snapshots
      
      * Tag additional Mongo E2E tests
      
      * Omit tests tagged with `@mongo` in regular runs
      Unverified
      899ad8ab
  21. Oct 06, 2023
  22. Sep 21, 2023
  23. Sep 07, 2023
    • Nemanja Glumac's avatar
      Fix e2e skipped test naming 2 (#33804) · 15ad8b3c
      Nemanja Glumac authored
      The original attempt was #33777.
      
      As revealed in #33799, the issue hasn't been fully fixed.
      Take a look at this run: https://github.com/metabase/metabase/actions/runs/6110515399
      
      The skipped test names are now in this format: e2e-tests-collectionsslow-ee
      Let's see how do we create a name:
      
      name: e2e-tests-${{ matrix.folder }}${{ matrix.context }}-${{ matrix.edition }}
      So it's obvious that both folder and context are included, when in reality we need only one of the two.
      
      The flaw in the logic was trying to remove the runner from the matrix. At least ONE matrix parameter needs to be different in the slow context. We achieve this by setting the runner to ubuntu-latest instead of ubuntu-22.04. This should now finally fix the names.
      
      [ci skip]
      Unverified
      15ad8b3c
    • Nemanja Glumac's avatar
      Fix e2e skipped tests naming (#33777) · 5afb2ed0
      Nemanja Glumac authored
      * Update additional context for E2E stubbed/skipped tests
      
      * Include two new E2E groups to stubbed/skipped E2E tests
      Unverified
      5afb2ed0
  24. Sep 06, 2023
    • Nemanja Glumac's avatar
      [POC] Faster E2E tests in CI (#33124) · be30839e
      Nemanja Glumac authored
      * Run slow E2E tests using faster runner
      
      * Tag slow tests
      
      * Add additional x-ray tests to the slow batch
      Unverified
      be30839e
    • Nemanja Glumac's avatar
      Fix `download-uberjar` job logic (#33745) · 69e076d9
      Nemanja Glumac authored
      This log shows the output of the files changed:
      https://github.com/metabase/metabase/actions/runs/6087912385/job/16537680230#step:3:602
      
      ```
      Changes output set to ["shared_sources","frontend_sources","frontend_specs","frontend_all","backend_sources","backend_specs","backend_all","sources","e2e_specs","e2e_all","codeql","i18n","visualizations"]
      ```
      
      Yet, the `download-uberjar` job ran, and the `build` never ran.
      This resulted in E2E test failures due to missing FE changes.
      
      The fault in the logic introduced in #33190 was thinking that
      `needs.files-changed.outputs.e2e_specs == 'true'` means the only output,
      when in reality it means one of many outputs.
      
      This PR should fix this by making sure that `needs.files-changed.outputs.e2e_all != 'true'`
      is also respected. This translates to - if there were no source code changes.
      
      [ci skip]
      Unverified
      69e076d9
  25. Sep 05, 2023
  26. Aug 21, 2023
  27. Aug 09, 2023
  28. Aug 04, 2023
  29. Jul 27, 2023
    • Nemanja Glumac's avatar
      Run E2E tests on Chrome v114 (#32688) · 53450025
      Nemanja Glumac authored
      As of two days ago we started seeing Chrome crashing in E2E tests.
      An example of the failed run: https://github.com/metabase/metabase/actions/runs/5665970958/job/15354475344
      
      ```
      We detected that the Chromium Renderer process just crashed.
      
      This is the equivalent to seeing the 'sad face' when Chrome dies.
      
      This can happen for a number of different reasons:
      
      - You wrote an endless loop and you must fix your own code
      - You are running Docker (there is an easy fix for this: see link below)
      - You are running lots of tests on a memory intense application.
          - Try enabling experimentalMemoryManagement in your config file.
          - Try lowering numTestsKeptInMemory in your config file.
      - You are running in a memory starved VM environment.
          - Try enabling experimentalMemoryManagement in your config file.
          - Try lowering numTestsKeptInMemory in your config file.
      - There are problems with your GPU / GPU drivers
      - There are browser bugs in Chromium
      ```
      
      I'm not quite sure whether this is a bug in Chrome v115 or some interplay between Cypress and this particular Chrome version, but running all tests on older Chrome version v114 seems to be working just fine.
      https://github.com/metabase/metabase/actions/runs/5677579526?pr=32688
      
      Proposal
      Let's merge this ASAP as a hotfix to unblock everyone, and then we'll follow-up when there's a clear resolution of this problem (most likely upstream).
      Unverified
      53450025
  30. Jul 25, 2023
  31. Jul 11, 2023
    • Nemanja Glumac's avatar
      Overhaul E2E tests token activation logic (#32186) · a54b3dc6
      Nemanja Glumac authored
      
      * Start all tests without a token
      
      * Update tests
      
      * Fix tests in `admin` group
      
      * Fix tests in `dashboard-filters` group
      
      * Fix tests `visualizations` group
      
      * Batch fixes
      
      * Fix database banner snowplow test
      
      * Fix full-app mobile view banner test
      
      * Simplify and remove `isPremiumActive` check
      
      * Fix the helper
      
      * Fix helper to fail fast
      
      * Fix tests
      
      * Ensure token scope is set
      
      * Ensure CYPRESS_ env tokens are present
      
      * Set token only if running Metabase ee
      
      * Improve JSDoc
      
      * Slightly tweak log message
      
      * Update E2E dev guide
      
      * Update cross-version tests
      
      * Remove premium token from Cypress backend setup
      
      * Improve a comment
      
      * Fix test
      
      * Update embedding copy
      
      ---------
      
      Co-authored-by: default avatarAlexander Polyankin <alexander.polyankin@metabase.com>
      Unverified
      a54b3dc6
  32. Jul 10, 2023
Loading