From 8579ecfdb94223b53447eeea756149d817b4377b Mon Sep 17 00:00:00 2001 From: Alena Lisevych Date: Thu, 6 Jul 2023 10:59:41 +0300 Subject: [PATCH 1/3] Issue template for testing checklist correction --- .github/ISSUE_TEMPLATE/test_request.md | 14 +++++++++----- 1 file changed, 9 insertions(+), 5 deletions(-) diff --git a/.github/ISSUE_TEMPLATE/test_request.md b/.github/ISSUE_TEMPLATE/test_request.md index 1b309b5ded..702c88365a 100644 --- a/.github/ISSUE_TEMPLATE/test_request.md +++ b/.github/ISSUE_TEMPLATE/test_request.md @@ -34,22 +34,26 @@ assignees: '' - [ ] Use default plugin settings - [ ] Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file -- [ ] Generate tests with different Mocking options combinations +- [ ] Generate and Run tests with different Mocking options +- [ ] Check tests consistency, layout, naming, how mocking is done **Manual scenario #3** -- [ ] Create a new Gradle project with JDK 8 -- [ ] Add a simple java file to test +- [ ] Create a new Gradle project with JDK 17 +- [ ] Add a sample java file to test - [ ] Generate a test in the existing test root +- [ ] Check tests consistency, layout, naming **Manual scenario #4** - [ ] Create a new Maven project with JDK 8 -- [ ] Add a simple java file to test +- [ ] Add a sample java file to test - [ ] Generate a test with a new test root +- [ ] Check tests consistency, layout, naming **Manual scenario #5** - [ ] Create a new Idea project with JDK 11 -- [ ] Add a simple java file to test +- [ ] Add a sample java file to test - [ ] Generate tests for several classes +- [ ] Check tests consistency, layout, naming From a302ca4da6f66d38a192f328af90f74658982943 Mon Sep 17 00:00:00 2001 From: Alena Lisevych Date: Thu, 6 Jul 2023 11:09:16 +0300 Subject: [PATCH 2/3] Issue template for manual testing checklist extended --- .github/ISSUE_TEMPLATE/test_request.md | 17 ++++++++++------- 1 file changed, 10 insertions(+), 7 deletions(-) diff --git a/.github/ISSUE_TEMPLATE/test_request.md b/.github/ISSUE_TEMPLATE/test_request.md index 702c88365a..74c2ca3a72 100644 --- a/.github/ISSUE_TEMPLATE/test_request.md +++ b/.github/ISSUE_TEMPLATE/test_request.md @@ -4,7 +4,6 @@ about: Checklist of testing process title: 'Manual testing of build#' labels: 'ctg-qa' assignees: '' - --- **Initial set-up** @@ -14,7 +13,7 @@ assignees: '' - [ ] Choose appropriate workflow from the list (by default, filter by main branch and take the latest one) https://github.com/UnitTestBot/UTBotJava/actions/workflows/publish-plugin-and-cli.yml - [ ] Download plugin - [ ] Check downloaded zip-file size < 100 MB -- [ ] Open IntelliJ IDE +- [ ] Open IntelliJ IDEA - [ ] Remove previously installed UTBot plugin - [ ] Clone or reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git) - [ ] Open the project in the IDE @@ -29,31 +28,35 @@ assignees: '' - [ ] Generate tests for the class - [ ] Remove results - [ ] Generate and Run test for a method +- [ ] Check only expected tests are red (failing on exceptions) +- [ ] Check there are no yellow tests (failing on asserts) **Manual scenario #2** - [ ] Use default plugin settings - [ ] Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file - [ ] Generate and Run tests with different Mocking options -- [ ] Check tests consistency, layout, naming, how mocking is done +- [ ] Check only expected tests are red (failing on exceptions) +- [ ] Check there are no yellow tests (failing on asserts) +- [ ] Check generated tests consistency, layout, naming, correct mocking **Manual scenario #3** - [ ] Create a new Gradle project with JDK 17 - [ ] Add a sample java file to test - [ ] Generate a test in the existing test root -- [ ] Check tests consistency, layout, naming +- [ ] Check generated tests consistency, layout, naming **Manual scenario #4** - [ ] Create a new Maven project with JDK 8 - [ ] Add a sample java file to test - [ ] Generate a test with a new test root -- [ ] Check tests consistency, layout, naming +- [ ] Check generated tests consistency, layout, naming **Manual scenario #5** -- [ ] Create a new Idea project with JDK 11 +- [ ] Create a new IntelliJ project with JDK 11 - [ ] Add a sample java file to test - [ ] Generate tests for several classes -- [ ] Check tests consistency, layout, naming +- [ ] Check generated tests consistency, layout, naming From d7bc11d47b0654738a7a8ff9517d23e1ee533e3f Mon Sep 17 00:00:00 2001 From: Alena Lisevych Date: Thu, 6 Jul 2023 11:55:38 +0300 Subject: [PATCH 3/3] Links in test checklist template corrected --- .github/ISSUE_TEMPLATE/test_request.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/.github/ISSUE_TEMPLATE/test_request.md b/.github/ISSUE_TEMPLATE/test_request.md index 74c2ca3a72..60f1ed48d8 100644 --- a/.github/ISSUE_TEMPLATE/test_request.md +++ b/.github/ISSUE_TEMPLATE/test_request.md @@ -10,12 +10,12 @@ assignees: '' *Check that the IntelliJ Idea UTBot plugin can be successfully installed* -- [ ] Choose appropriate workflow from the list (by default, filter by main branch and take the latest one) https://github.com/UnitTestBot/UTBotJava/actions/workflows/publish-plugin-and-cli.yml +- [ ] Choose appropriate [workflow from the list](https://github.com/UnitTestBot/UTBotJava/actions/workflows/build-and-run-tests.yml?query=branch%3Amain) - [ ] Download plugin - [ ] Check downloaded zip-file size < 100 MB - [ ] Open IntelliJ IDEA - [ ] Remove previously installed UTBot plugin -- [ ] Clone or reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git) +- [ ] Clone or reuse [UTBot project](https://github.com/UnitTestBot/UTBotJava.git) - [ ] Open the project in the IDE - [ ] Install the downloaded plugin