{ "doc": { "id": "cloud/faq", "title": "Frequently Asked Questions (FAQ) | Cypress Cloud", "description": "Get answers to common questions about Cypress Cloud.", "section": "cloud", "source_path": "/llm/markdown/cloud/faq.md", "version": "6a908a532b1fca4ed18538a4c1c5a9bc7f24f403", "updated_at": "2026-05-01T19:25:18.656Z", "headings": [ { "id": "cloud/faq#cypress-cloud-faq", "text": "Cypress Cloud FAQ", "level": 1 }, { "id": "cloud/faq#general", "text": "General", "level": 2 }, { "id": "cloud/faq#what-is-cypress-cloud", "text": "What is Cypress Cloud?", "level": 3 }, { "id": "cloud/faq#what-does-cypress-record", "text": "What does Cypress record?", "level": 3 }, { "id": "cloud/faq#how-is-this-different-than-ci", "text": "How is this different than CI?", "level": 3 }, { "id": "cloud/faq#what-counts-as-a-test-result", "text": "What counts as a test result?", "level": 3 }, { "id": "cloud/faq#what-counts-as-a-user", "text": "What counts as a user?", "level": 3 }, { "id": "cloud/faq#how-much-does-it-cost", "text": "How much does it cost?", "level": 3 }, { "id": "cloud/faq#what-is-the-difference-between-public-and-private-projects", "text": "What is the difference between public and private projects?", "level": 3 }, { "id": "cloud/faq#what-happens-once-i-reach-the-test-results-limit", "text": "What happens once I reach the test results limit?", "level": 3 }, { "id": "cloud/faq#what-happens-if-i-downgrade-my-account", "text": "What happens if I downgrade my account?", "level": 3 }, { "id": "cloud/faq#can-i-choose-not-to-use-cypress-cloud", "text": "Can I choose not to use Cypress Cloud?", "level": 3 }, { "id": "cloud/faq#using-cypress-cloud", "text": "Using Cypress Cloud", "level": 2 }, { "id": "cloud/faq#what-is-the-projectid-for", "text": "What is the projectId for?", "level": 3 }, { "id": "cloud/faq#what-is-a-record-key", "text": "What is a Record Key?", "level": 3 }, { "id": "cloud/faq#how-do-i-record-my-tests", "text": "How do I record my tests?", "level": 3 }, { "id": "cloud/faq#can-i-delete-a-run-from-cypress-cloud", "text": "Can I delete a run from Cypress Cloud?", "level": 3 }, { "id": "cloud/faq#can-i-host-cypress-cloud-data-myself", "text": "Can I host Cypress Cloud data myself?", "level": 3 }, { "id": "cloud/faq#why-is-test-parallelization-based-on-spec-files-and-not-on-the-individual-functions", "text": "Why is test parallelization based on spec files and not on the individual functions?", "level": 3 }, { "id": "cloud/faq#my-ci-setup-is-based-on-docker-but-is-very-custom-how-can-i-load-balance-my-test-runs", "text": "My CI setup is based on Docker, but is very custom. How can I load balance my test runs?", "level": 3 }, { "id": "cloud/faq#im-working-with-a-restrictive-vpn-which-subdomains-do-i-have-to-allow-on-my-vpn-for-cypress-cloud-to-work-properly", "text": "I'm working with a restrictive VPN. Which subdomains do I have to allow on my VPN for Cypress Cloud to work properly?", "level": 3 }, { "id": "cloud/faq#cypress-cloud-account", "text": "Cypress Cloud Account", "level": 2 }, { "id": "cloud/faq#what-is-my-organization-id", "text": "What is my Organization ID?", "level": 3 }, { "id": "cloud/faq#what-if-i-cant-access-my-cypress-cloud-account", "text": "What if I can't access my Cypress Cloud account?", "level": 3 }, { "id": "cloud/faq#can-i-delete-my-cypress-account", "text": "Can I delete my Cypress account?", "level": 3 }, { "id": "cloud/faq#test-replay", "text": "Test Replay", "level": 2 }, { "id": "cloud/faq#what-is-test-replay", "text": "What is Test Replay?", "level": 3 }, { "id": "cloud/faq#how-is-cypress-test-replay-different-from-other-replay-services", "text": "How is Cypress Test Replay different from other \"replay\" services?", "level": 3 }, { "id": "cloud/faq#how-much-does-test-replay-cost", "text": "How much does Test Replay cost?", "level": 3 }, { "id": "cloud/faq#can-i-use-test-replay-for-tests-recorded-in-different-browsers", "text": "Can I use Test Replay for tests recorded in different browsers?", "level": 3 }, { "id": "cloud/faq#can-i-replay-tests-from-historical-cypress-cloud-runs", "text": "Can I replay tests from historical Cypress Cloud runs?", "level": 3 }, { "id": "cloud/faq#can-i-enable-or-disable-test-replay-for-specific-individual-tests-or-is-it-a-global-setting-can-i-configure-my-settings-so-that-test-replay-is-only-enabled-for-failing-test-retries", "text": "Can I enable or disable Test Replay for specific, individual tests, or is it a global setting? Can I configure my settings so that Test Replay is only enabled for failing test retries?", "level": 3 }, { "id": "cloud/faq#can-i-share-my-test-replays", "text": "Can I share my test replays?", "level": 3 }, { "id": "cloud/faq#will-test-replay-write-any-assets-to-the-file-system", "text": "Will Test Replay write any assets to the file system?", "level": 3 }, { "id": "cloud/faq#is-the-network-tab-feature-available-exclusively-in-test-replay", "text": "Is the network tab feature available exclusively in Test Replay?", "level": 3 }, { "id": "cloud/faq#can-i-console-log-data-in-the-console-view-of-the-developer-tools-panel", "text": "Can I console.log() data in the console view of the Developer Tools panel?", "level": 3 }, { "id": "cloud/faq#cloud-ai", "text": "Cloud AI ✨", "level": 2 }, { "id": "cloud/faq#what-is-cloud-ai", "text": "What is Cloud AI?", "level": 3 } ] }, "content": { "type": "root", "children": [ { "type": "heading", "depth": 1, "children": [ { "type": "text", "value": "Cypress Cloud FAQ" } ] }, { "type": "heading", "depth": 2, "children": [ { "type": "text", "value": "General" } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What is Cypress Cloud?" } ] }, { "type": "paragraph", "children": [ { "type": "link", "title": null, "url": "https://on.cypress.io/cloud", "children": [ { "type": "text", "value": "Cypress Cloud" } ] }, { "type": "text", "value": " gives you access to tests you've recorded - typically when running Cypress tests from your " }, { "type": "link", "title": null, "url": "/llm/markdown/app/continuous-integration/overview.md", "children": [ { "type": "text", "value": "CI provider" } ] }, { "type": "text", "value": " - and provides you insight into what happened during your tests run." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "You can read more " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/get-started/introduction.md", "children": [ { "type": "text", "value": "here" } ] }, { "type": "text", "value": "." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What does Cypress record?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Cypress captures the following:" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "When you run Cypress via `cypress run` passing the `--record` flag the following data is sent to the Cloud for every run:" } ] }, { "type": "list", "ordered": false, "start": null, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Standard output in the terminal" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Test results" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Test definitions" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Cypress configuration (minus Cypress environment variables)" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Screenshots" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Videos" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "OS environment variables related to CI and git information" } ] } ] } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "You have the option to " }, { "type": "link", "title": null, "url": "/llm/markdown/app/guides/screenshots-and-videos.md#Control-which-videos-to-keep-and-upload-to-Cypress-Cloud", "children": [ { "type": "text", "value": "delete videos or screenshots" } ] }, { "type": "text", "value": " before being sent to the Cloud so those are not captured." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "When " }, { "type": "link", "title": null, "url": "#Test-Replay", "children": [ { "type": "text", "value": "Test Replay" } ] }, { "type": "text", "value": " capturing is enabled, the additional data outlined below will be sent to the Cloud. You can " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/test-replay.md#Opt-out-of-Test-Replay", "children": [ { "type": "text", "value": "disable capturing" } ] }, { "type": "text", "value": " this data." } ] }, { "type": "list", "ordered": false, "start": null, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "The rendered DOM and CSS styles for the application under test" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Cypress commands and events represented in the Command Log" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Network traffic within your application under test" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Browser console logs" } ] } ] } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Cypress Cloud does not capture anything related to the code of your application under test or the code within any associated repositories that are associated with your project." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "How is this different than CI?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Cypress Cloud is complementary to your " }, { "type": "link", "title": null, "url": "/llm/markdown/app/continuous-integration/overview.md", "children": [ { "type": "text", "value": "CI provider" } ] }, { "type": "text", "value": ", and plays a completely different role." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "It doesn't replace or change anything related to CI. You will still run Cypress tests in your CI provider." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "The difference between " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/get-started/introduction.md", "children": [ { "type": "text", "value": "Cypress Cloud" } ] }, { "type": "text", "value": " and your CI provider is that your CI provider has no idea what is going on inside of the Cypress process. It's programmed to know whether or not a process failed - based on whether it had an exit code greater than `0`." } ] }, { "type": "paragraph", "children": [ { "type": "link", "title": null, "url": "/llm/markdown/cloud/get-started/introduction.md", "children": [ { "type": "text", "value": "Cypress Cloud" } ] }, { "type": "text", "value": " provides you with the low level details of what happened during your run. Using both your CI provider + Cypress together gives the insight required to debug your test runs." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "When a run happens and a test fails - instead of going and inspecting your CI provider's `stdout` output, you can log into " }, { "type": "link", "title": null, "url": "https://on.cypress.io/cloud", "children": [ { "type": "text", "value": "Cypress Cloud" } ] }, { "type": "text", "value": ", see the `stdout` as well as screenshots and video of the tests running. It should be instantly clear what the problem was." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What counts as a test result?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Which " }, { "type": "link", "title": null, "url": "https://www.cypress.io/pricing", "children": [ { "type": "text", "value": "pricing tier" } ] }, { "type": "text", "value": " is best for you depends on the number of tests you record each month in your organization." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Tests are recorded when " }, { "type": "link", "title": null, "url": "/llm/markdown/app/references/command-line.md#cypress-run", "children": [ { "type": "text", "value": "cypress run" } ] }, { "type": "text", "value": " is called with the `--record` flag while supplying the record `--key`. This means your " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/recorded-runs.md#Latest-Runs", "children": [ { "type": "text", "value": "test run data" } ] }, { "type": "text", "value": " is being \"recorded\" to Cypress Cloud." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "We consider each time the `it()` function is called to be a single test. So you will generally have several tests recorded within each spec file and likely several spec files within a single run. Only the " }, { "type": "link", "title": null, "url": "/llm/markdown/app/core-concepts/writing-and-organizing-tests.md#Test-statuses", "children": [ { "type": "text", "value": "passed and failed tests" } ] }, { "type": "text", "value": " are counted. The pending and skipped tests are NOT counted." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "You can always see how many tests you've recorded from your organization's " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/billing-and-usage.md", "children": [ { "type": "text", "value": "Billing & Usage" } ] }, { "type": "text", "value": " page within Cypress Cloud." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What counts as a user?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "A " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/users.md", "children": [ { "type": "text", "value": "user" } ] }, { "type": "text", "value": " is anyone with a login to Cypress Cloud who has been invited to see and review the test results of your organization." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "How much does it cost?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Please see our " }, { "type": "link", "title": null, "url": "https://www.cypress.io/pricing", "children": [ { "type": "text", "value": "Pricing Page" } ] }, { "type": "text", "value": " for more details." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What is the difference between public and private projects?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "A public project means that anyone can see the recorded runs for it. It's similar to how public projects on GitHub, Travis, or CircleCI are handled. Anyone who knows your `projectId` will be able to see the recorded runs, screenshots, and videos for public projects." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "A private project means that only " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/users.md", "children": [ { "type": "text", "value": "users" } ] }, { "type": "text", "value": " you explicitly invite to your " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/organizations.md", "children": [ { "type": "text", "value": "organization" } ] }, { "type": "text", "value": " can see its recorded runs. Even if someone knows your `projectId`, they will not have access to your runs unless you have invited them." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What happens once I reach the test results limit?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Tests running with the `--record` flag will run as normal when the limit is reached, but parallelization will be disabled and new test results will be hidden from the dashboard until your plan is upgraded or a new usage cycle begins. The usage cycle resets each month." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "In order to avoid any interruption in service, we recommend that you review your usage and select a plan that satisfies your usage requirements. You can do this by:" } ] }, { "type": "list", "ordered": true, "start": 1, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Logging into " }, { "type": "link", "title": null, "url": "https://cloud.cypress.io", "children": [ { "type": "text", "value": "Cypress Cloud" } ] } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Select your organization" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Navigate to the Billing and Usage tab" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Review your organization's usage" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Scroll down and select Upgrade under your plan of choice" } ] } ] } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What happens if I downgrade my account?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Downgrading your account will not result in loss of access to Cypress Cloud." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "However, it will make your Cypress Cloud account subject to the limitations of your new plan. For example, downgrading to the Starter plan will limit data retention to 30 days and test results to 500 per billing period." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I choose not to use Cypress Cloud?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Of course. Cypress Cloud is a separate service from the Cypress app and will always remain optional. We hope you'll find a tremendous amount of value in it, but it is not coupled with being able to run your tests." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "You can always run your tests in CI using " }, { "type": "link", "title": null, "url": "/llm/markdown/app/references/command-line.md#cypress-run", "children": [ { "type": "text", "value": "cypress run" } ] }, { "type": "text", "value": " without the `--record` flag which does not communicate with our external servers and will not record any test results." } ] }, { "type": "heading", "depth": 2, "children": [ { "type": "text", "value": "Using Cypress Cloud" } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What is the projectId for?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "The `projectId` is a 6-character string that helps identify your project once you've " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/recorded-runs.md#Latest-Runs", "children": [ { "type": "text", "value": "set up your tests to record" } ] }, { "type": "text", "value": ". It's generated by Cypress and typically is found in your " }, { "type": "link", "title": null, "url": "/llm/markdown/app/references/configuration.md", "children": [ { "type": "text", "value": "Cypress configuration" } ] }, { "type": "text", "value": "." } ] }, { "type": "list", "ordered": false, "start": null, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "cypress.config.js" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "cypress.config.ts" } ] } ] } ] }, { "type": "code", "lang": null, "meta": null, "value": "const { defineConfig } = require('cypress')module.exports = defineConfig({ projectId: 'a7bq2k',})" }, { "type": "code", "lang": null, "meta": null, "value": "import { defineConfig } from 'cypress'export default defineConfig({ projectId: 'a7bq2k',})" }, { "type": "paragraph", "children": [ { "type": "text", "value": "For further detail see the " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/projects.md#Identification", "children": [ { "type": "text", "value": "Identification" } ] }, { "type": "text", "value": " section of the " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/get-started/introduction.md", "children": [ { "type": "text", "value": "Cypress Cloud" } ] }, { "type": "text", "value": " docs." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What is a Record Key?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "A Record Key is a GUID that's generated automatically by Cypress once you've " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/recorded-runs.md#Latest-Runs", "children": [ { "type": "text", "value": "set up your tests to record" } ] }, { "type": "text", "value": ". It helps identify your project and authenticate that your project is even allowed to record tests." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "You can find your project's record key inside of the Settings tab." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "For further details see the " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/projects.md#Identification", "children": [ { "type": "text", "value": "Identification" } ] }, { "type": "text", "value": " section of the " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/get-started/introduction.md", "children": [ { "type": "text", "value": "Cypress Cloud" } ] }, { "type": "text", "value": " docs." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "How do I record my tests?" } ] }, { "type": "list", "ordered": true, "start": 1, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "First " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/get-started/setup.md#Setup", "children": [ { "type": "text", "value": "set up the project to record" } ] }, { "type": "text", "value": "." } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Then " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/recorded-runs.md#Latest-Runs", "children": [ { "type": "text", "value": "record your runs" } ] }, { "type": "text", "value": "." } ] } ] } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "After recording your tests, you will see them in " }, { "type": "link", "title": null, "url": "https://on.cypress.io/cloud", "children": [ { "type": "text", "value": "Cypress Cloud" } ] }, { "type": "text", "value": " and in the Cypress App " }, { "type": "link", "title": null, "url": "/llm/markdown/app/core-concepts/open-mode.md#Runs", "children": [ { "type": "text", "value": "Runs" } ] }, { "type": "text", "value": " tab." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I delete a run from Cypress Cloud?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "You can " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/recorded-runs.md#Archive-run", "children": [ { "type": "text", "value": "archive a run" } ] }, { "type": "text", "value": " so that it does not display in the runs list or in analytics." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Note: Archiving the recorded runs has no effect on the amount of tests recorded and counted as your usage billed for the month." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I host Cypress Cloud data myself?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "No. A self-hosted version of Cypress Cloud is not available at this time." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Why is test parallelization based on spec files and not on the individual functions?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Cypress " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/smart-orchestration/parallelization.md", "children": [ { "type": "text", "value": "test parallelization" } ] }, { "type": "text", "value": " is indeed based on specs. For each spec, Cypress scaffolds the new running context, in a sense isolating each spec file from any previous spec files, and ensuring a clean slate for the next spec. Doing this for each individual test would be very very expensive and would slow down the test runs significantly." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Spec file durations are also more meaningful and consistent than timings of individual tests, we can order specs by the moving average of the previously recorded durations. This would be much less useful when load balancing quickly finishes individual tests." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Thus, to better load balance the specs, you would want more spec files with approximately the same running duration. Otherwise, a single very long running test might limit how fast all your tests finish, and how fast the run completes. Due to starting a new test execution context before each spec file and encoding and uploading video after, making spec files run shorter than approximately 10 seconds would also be fruitless - because Cypress overhead would eat any time savings." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "My CI setup is based on Docker, but is very custom. How can I load balance my test runs?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Even if your CI setup is very different from the " }, { "type": "link", "title": null, "url": "/llm/markdown/app/continuous-integration/overview.md#CI-Examples", "children": [ { "type": "text", "value": "CI examples we have" } ] }, { "type": "text", "value": " and " }, { "type": "link", "title": null, "url": "https://github.com/cypress-io/cypress-example-kitchensink#ci-status", "children": [ { "type": "text", "value": "run with our sample projects" } ] }, { "type": "text", "value": ", you can still take advantage of the test load balancing using Cypress Cloud. Find a variable across your containers that is the same for all of them, but is different from run to run. For example, it could be an environment variable called `CI_RUN_ID` that you set when creating the containers to run Cypress. You can pass this variable via CLI argument " }, { "type": "link", "title": null, "url": "/llm/markdown/app/references/command-line.md#cypress-run-ci-build-id-lt-id-gt", "children": [ { "type": "text", "value": "`--ci-build-id`" } ] }, { "type": "text", "value": " when starting Cypress in each container:" } ] }, { "type": "code", "lang": null, "meta": null, "value": "cypress run --record --parallel --ci-build-id $CI_RUN_ID" }, { "type": "paragraph", "children": [ { "type": "text", "value": "For reference, here are " }, { "type": "link", "title": null, "url": "https://github.com/cypress-io/cypress/blob/develop/packages/server/lib/util/ci_provider.js", "children": [ { "type": "text", "value": "the variables" } ] }, { "type": "text", "value": " we extract from the popular CI providers, and for most of them, there is some variable that is set to the same value across multiple containers running in parallel. If there is NO common variable, try using the commit SHA string. Assuming you do not run the same tests more than once against the same commit, it might be good enough for the job." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "I'm working with a restrictive VPN. Which subdomains do I have to allow on my VPN for Cypress Cloud to work properly?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "If you are running the tests from within a restrictive VPN you will need to allow some URLs so that Cypress can have effective communication with Cypress Cloud." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "The URLs are the following:" } ] }, { "type": "list", "ordered": false, "start": null, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://api.cypress.io` - Cypress API, Studio, cy.prompt()" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://assets.cypress.io` - Asset CDN (Org logos, icons, videos, screenshots, etc.)" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://authenticate.cypress.io` - Authentication API" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://capture.cypress.io` - Cypress Test Replay" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://s3.amazonaws.com/capture.cypress.io` - Uploading Cypress Test Replay from Test Runner" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://cloud.cypress.io` - Cypress Cloud, Studio" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://docs.cypress.io` - Cypress documentation" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://download.cypress.io` - CDN download of Cypress binary" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`https://on.cypress.io` - URL shortener for link redirects" } ] } ] } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "If you are using GitHub Enterprise or GitLab for Enterprise (Self-managed), you may also need to add the following to the version control IP allowlist:" } ] }, { "type": "list", "ordered": false, "start": null, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`3.211.102.119` - Dedicated IP" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`18.213.72.78` - Dedicated IP" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`35.169.145.173` - Dedicated IP" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`44.199.152.70` - Dedicated IP" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "`52.70.95.89` - Dedicated IP" } ] } ] } ] }, { "type": "heading", "depth": 2, "children": [ { "type": "text", "value": "Cypress Cloud Account" } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What is my Organization ID?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Your Organization ID is a unique identifier that is linked to your organization. Instructions on how to find your ID are in the " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/organizations.md#Organization-ID", "children": [ { "type": "text", "value": "Cypress Cloud Guide." } ] } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What if I can't access my Cypress Cloud account?" } ] }, { "type": "list", "ordered": true, "start": 1, "spread": true, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "If you haven't signed up, see the " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/account-management/users.md#Sign-Up-with-an-Invitation", "children": [ { "type": "text", "value": "Sign Up with an Invitation" } ] }, { "type": "text", "value": " instructions." } ] } ] }, { "type": "listItem", "spread": true, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Try resetting your password. If you never received the email, try the following:" } ] }, { "type": "list", "ordered": false, "start": null, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Try signing in with Google or GitHub" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Check the trash and spam folder" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Verify it's the correct email address" } ] } ] } ] } ] } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "If the troubleshooting tips above did not resolve the issue or involves SSO, reach out to " }, { "type": "link", "title": null, "url": "mailto:support@cypress.io", "children": [ { "type": "text", "value": "support" } ] }, { "type": "text", "value": "." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I delete my Cypress account?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "You can delete your Cypress account from " }, { "type": "link", "title": null, "url": "https://cloud.cypress.io/profile", "children": [ { "type": "text", "value": "your Cypress Cloud profile" } ] }, { "type": "text", "value": ". Deleting your account cannot be undone! By deleting your Cypress account, all associated data in your account will be permanently deleted." } ] }, { "type": "heading", "depth": 2, "children": [ { "type": "text", "value": "Test Replay" } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What is Test Replay?" } ] }, { "type": "paragraph", "children": [ { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/test-replay.md", "children": [ { "type": "text", "value": "Test Replay" } ] }, { "type": "text", "value": " enables you and your team to troubleshoot and debug failed tests faster. After updating to Cypress `v13`, the new feature will automatically record all browser events and allow you to “replay” what your application under test looked like." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Wind back the clock to any point in an application's test execution and directly interact with tests as they happened in CI. Debug complex problems as if you were there when they first happened. You can:" } ] }, { "type": "list", "ordered": false, "start": null, "spread": false, "children": [ { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Inspect the DOM at the exact time of a test failure to debug tests quickly" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "View important debugging dimensions such as network requests, console logs, and more" } ] } ] }, { "type": "listItem", "spread": false, "checked": null, "children": [ { "type": "paragraph", "children": [ { "type": "text", "value": "Save time recreating errors in CI locally - replay tests as they happened in CI" } ] } ] } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "How is Cypress Test Replay different from other \"replay\" services?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "There is an important distinction between session replay services (LogRocket, FullStory, DataDog, etc) and Cypress Test Replay. In session replay, user actions are captured as the application is used and delivered back in a replay-able format, usually video or stitched DOM snapshots. These are valuable tools for gathering product insight such as user behavior, per session." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Cypress Test Replay captures every detail of your test runs as they happen in CI. Remember, these tests are running in a headless manner on a virtual machine with no UI being rendered. Sometimes tests will error or fail indicating an issue in your application. Since Cypress Cloud is monitoring the health of your CI test suite, each Test Replay offers a chance to step back in time to analyze and leverage " }, { "type": "link", "title": null, "url": "/llm/markdown/app/core-concepts/open-mode.md#Time-traveling", "children": [ { "type": "text", "value": "time travel debugging" } ] }, { "type": "text", "value": ", network requests, console logs, JavaScript errors, and element rendering to address problems directly. This is incredibly valuable for developer and team productivity. No more hours wasted recreating CI issues on your local machine!" } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "How much does Test Replay cost?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Nothing. It's free and included in all Cypress Cloud plans." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "To get started with Cypress Cloud, " }, { "type": "link", "title": null, "url": "https://cloud.cypress.io/signup", "children": [ { "type": "text", "value": "sign up" } ] }, { "type": "text", "value": " to start your 30 day free trial - including all premium Cypress Cloud features and plenty of test results to let you experience the power of Cypress Cloud!" } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I use Test Replay for tests recorded in different browsers?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Test Replay leverages " }, { "type": "link", "title": null, "url": "https://chromedevtools.github.io/devtools-protocol/", "children": [ { "type": "text", "value": "Chrome DevTools Protocol(CDP)" } ] }, { "type": "text", "value": ", so currently supports Chromium-based browsers (Chrome, Edge, and Electron) only." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Test Replay would be disabled, with a message that it's only available on Chromium, for tests run in Firefox or WebKit (Safari). You can still record and capture test " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/recorded-runs.md#Artifacts", "children": [ { "type": "text", "value": "artifacts" } ] }, { "type": "text", "value": " (screenshots, videos and CI logs) via other browsers in separate " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/smart-orchestration/parallelization.md#Grouping-test-runs", "children": [ { "type": "text", "value": "run groups" } ] }, { "type": "text", "value": "." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I replay tests from historical Cypress Cloud runs?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Test Replay is available for tests recorded using Cypress `v13` and up. Tests recorded prior to this will not have Test Replay enabled in Cypress Cloud. You will still have any artifacts collected during the pre `v13` test runs." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I enable or disable Test Replay for specific, individual tests, or is it a global setting? Can I configure my settings so that Test Replay is only enabled for failing test retries?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "At this time, users can only opt-out of Test Replay via " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/test-replay.md#Opt-out-of-Test-Replay", "children": [ { "type": "text", "value": "project-level settings" } ] }, { "type": "text", "value": " in Cypress Cloud. There is no local option for opting out at this time." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I share my test replays?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Yes! You can share Test Replays with any team members who have access to view your Cypress Cloud runs like QA, marketing, design, etc. Open the replay, copy the URL from the browser address bar and pass it along." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Will Test Replay write any assets to the file system?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Yes, but they are stored in a temporary directory and deleted after the run. There is nothing to `.gitignore`." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Is the network tab feature available exclusively in Test Replay?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "All of the data within Test Replay's Developer Tools in Cypress Cloud (including network events) are already available to you when running tests locally in the Cypress app via your browser's built-in developer tools (e.g. Chrome DevTools). When reviewing a test run that occurred in CI, you can review the network events within Test Replay in Cypress Cloud." } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "Can I `console.log()` data in the console view of the Developer Tools panel?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Yes. This displays console logs from within the application under test or your spec files. You may need to use `JSON.stringify(Object)` to display deeply nested data." } ] }, { "type": "heading", "depth": 2, "children": [ { "type": "text", "value": "Cloud AI ✨" } ] }, { "type": "heading", "depth": 3, "children": [ { "type": "text", "value": "What is Cloud AI?" } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "Cloud AI is part of Cypress AI: capabilities in Cypress Cloud (such as Test Intent Summaries, Error Summaries, and UI Coverage Test Generation) plus AI in the Cypress App (" }, { "type": "link", "title": null, "url": "/llm/markdown/app/guides/cypress-studio.md", "children": [ { "type": "text", "value": "Studio AI" } ] }, { "type": "text", "value": " and " }, { "type": "link", "title": null, "url": "/llm/markdown/api/commands/prompt.md", "children": [ { "type": "text", "value": "cy.prompt()" } ] }, { "type": "text", "value": ") when you're connected to Cloud. These capabilities are continuously being added to improve insights and make it easier to accomplish tasks." } ] }, { "type": "paragraph", "children": [ { "type": "text", "value": "See " }, { "type": "link", "title": null, "url": "/llm/markdown/cloud/features/cypress-ai-features.md", "children": [ { "type": "text", "value": "AI at Cypress" } ] }, { "type": "text", "value": " for the full picture." } ] } ] }, "token_estimate": 3537 }