Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 17 additions & 10 deletions .github/ISSUE_TEMPLATE/test_request.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,19 +4,18 @@ about: Checklist of testing process
title: 'Manual testing of build#'
labels: 'ctg-qa'
assignees: ''

---

**Initial set-up**

*Check that the IntelliJ Idea UTBot plugin can be successfully installed*

- [ ] Choose appropriate workflow from the list (by default, filter by main branch and take the latest one) https://github.com/UnitTestBot/UTBotJava/actions/workflows/publish-plugin-and-cli.yml
- [ ] Choose appropriate [workflow from the list](https://github.com/UnitTestBot/UTBotJava/actions/workflows/build-and-run-tests.yml?query=branch%3Amain)
- [ ] Download plugin
- [ ] Check downloaded zip-file size < 100 MB
- [ ] Open IntelliJ IDE
- [ ] Open IntelliJ IDEA
- [ ] Remove previously installed UTBot plugin
- [ ] Clone or reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git)
- [ ] Clone or reuse [UTBot project](https://github.com/UnitTestBot/UTBotJava.git)
- [ ] Open the project in the IDE
- [ ] Install the downloaded plugin

Expand All @@ -29,27 +28,35 @@ assignees: ''
- [ ] Generate tests for the class
- [ ] Remove results
- [ ] Generate and Run test for a method
- [ ] Check only expected tests are red (failing on exceptions)
- [ ] Check there are no yellow tests (failing on asserts)

**Manual scenario #2**

- [ ] Use default plugin settings
- [ ] Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file
- [ ] Generate tests with different Mocking options combinations
- [ ] Generate and Run tests with different Mocking options
- [ ] Check only expected tests are red (failing on exceptions)
- [ ] Check there are no yellow tests (failing on asserts)
- [ ] Check generated tests consistency, layout, naming, correct mocking

**Manual scenario #3**

- [ ] Create a new Gradle project with JDK 8
- [ ] Add a simple java file to test
- [ ] Create a new Gradle project with JDK 17
- [ ] Add a sample java file to test
- [ ] Generate a test in the existing test root
- [ ] Check generated tests consistency, layout, naming

**Manual scenario #4**

- [ ] Create a new Maven project with JDK 8
- [ ] Add a simple java file to test
- [ ] Add a sample java file to test
- [ ] Generate a test with a new test root
- [ ] Check generated tests consistency, layout, naming

**Manual scenario #5**

- [ ] Create a new Idea project with JDK 11
- [ ] Add a simple java file to test
- [ ] Create a new IntelliJ project with JDK 11
- [ ] Add a sample java file to test
- [ ] Generate tests for several classes
- [ ] Check generated tests consistency, layout, naming