Nakamoto Testing - Core Requirements of a Mainnet Representative Testing

[AshtonStephens]

This ticket discusses and tracks the core requirements and ideas that the Stacks Testing needs to meet such that the automatically deployed infrastructure mimics mainnet as closely as possible.

Relevant Draft SIP: SIP-021 stacksgov/sips#155
Somewhat Relevant Discussion: stacksgov/sips#161
Testing Standards Document: stacks-network/stacks#515 (Should replace with the approved location)

Big questions:

• Do we need a full existing mainnet chain state for each test node or start fro a new genesis block
  • If a new genesis sync then we'll need at least one miner
• What types of tests are we running and what is the expected behavior?
• What metrics and logs are needed by open source developers?
• What outputs from the test need to be recorded / what events should be exposed

[AshtonStephens]

Just started this after a discussion with @wileyj

[AshtonStephens]

We'll need to discuss with @xoloki and @jferrant about signer tests and requirements.

[wileyj]

I've gathered some additional/changed details over the past few days. I expect I'll have a more complete picture later this week

[wileyj]

Suite of tests for 2.4 release: https://github.com/stacks-network/stacks-test-scripts-2.1