diff --git a/.github/ISSUE_TEMPLATE/test_request.md b/.github/ISSUE_TEMPLATE/test_request.md index 1b309b5ded..60f1ed48d8 100644 --- a/.github/ISSUE_TEMPLATE/test_request.md +++ b/.github/ISSUE_TEMPLATE/test_request.md @@ -4,19 +4,18 @@ about: Checklist of testing process title: 'Manual testing of build#' labels: 'ctg-qa' assignees: '' - --- **Initial set-up** *Check that the IntelliJ Idea UTBot plugin can be successfully installed* -- [ ] Choose appropriate workflow from the list (by default, filter by main branch and take the latest one) https://github.com/UnitTestBot/UTBotJava/actions/workflows/publish-plugin-and-cli.yml +- [ ] Choose appropriate [workflow from the list](https://github.com/UnitTestBot/UTBotJava/actions/workflows/build-and-run-tests.yml?query=branch%3Amain) - [ ] Download plugin - [ ] Check downloaded zip-file size < 100 MB -- [ ] Open IntelliJ IDE +- [ ] Open IntelliJ IDEA - [ ] Remove previously installed UTBot plugin -- [ ] Clone or reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git) +- [ ] Clone or reuse [UTBot project](https://github.com/UnitTestBot/UTBotJava.git) - [ ] Open the project in the IDE - [ ] Install the downloaded plugin @@ -29,27 +28,35 @@ assignees: '' - [ ] Generate tests for the class - [ ] Remove results - [ ] Generate and Run test for a method +- [ ] Check only expected tests are red (failing on exceptions) +- [ ] Check there are no yellow tests (failing on asserts) **Manual scenario #2** - [ ] Use default plugin settings - [ ] Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file -- [ ] Generate tests with different Mocking options combinations +- [ ] Generate and Run tests with different Mocking options +- [ ] Check only expected tests are red (failing on exceptions) +- [ ] Check there are no yellow tests (failing on asserts) +- [ ] Check generated tests consistency, layout, naming, correct mocking **Manual scenario #3** -- [ ] Create a new Gradle project with JDK 8 -- [ ] Add a simple java file to test +- [ ] Create a new Gradle project with JDK 17 +- [ ] Add a sample java file to test - [ ] Generate a test in the existing test root +- [ ] Check generated tests consistency, layout, naming **Manual scenario #4** - [ ] Create a new Maven project with JDK 8 -- [ ] Add a simple java file to test +- [ ] Add a sample java file to test - [ ] Generate a test with a new test root +- [ ] Check generated tests consistency, layout, naming **Manual scenario #5** -- [ ] Create a new Idea project with JDK 11 -- [ ] Add a simple java file to test +- [ ] Create a new IntelliJ project with JDK 11 +- [ ] Add a sample java file to test - [ ] Generate tests for several classes +- [ ] Check generated tests consistency, layout, naming