Skip to content

ci: GHA: use scripts/report-coverage.sh#6553

Merged
blueyed merged 1 commit into
pytest-dev:masterfrom
blueyed:ci-gha-use-report-coverage.sh
Jan 24, 2020
Merged

ci: GHA: use scripts/report-coverage.sh#6553
blueyed merged 1 commit into
pytest-dev:masterfrom
blueyed:ci-gha-use-report-coverage.sh

Conversation

@blueyed

@blueyed blueyed commented Jan 24, 2020

Copy link
Copy Markdown
Contributor

This allows for more control, e.g. -X fix with codecov-bash, and it has all the coverage-calls we need already etc.

@blueyed
blueyed requested a review from nicoddemus January 24, 2020 11:55
@nicoddemus

Copy link
Copy Markdown
Member

TBH I prefer using the action instead of a custom script, so I'm -0 (but not completely opposed).

@blueyed

blueyed commented Jan 24, 2020

Copy link
Copy Markdown
Contributor Author

@nicoddemus
Why do you prefer the action? It wraps codecov-bash apparently also only (#6463 (comment)), while not handling e.g. retries which we have with our curl invocation already.
Also it seems to be basically a large, obfuscated code blob, while using the bash script ourselves is more transparent.
Additionally, it might result in differences with regard to what is reported between Travis and GHA.

blueyed added a commit to blueyed/pytest that referenced this pull request Jan 24, 2020
This should make it obvious if missing coverage is due to the upload
having failed.

Using pytest-dev#6553 would be an
alternative, but this can be used already if that takes longer.

Ref: pytest-dev#6463 (comment)
blueyed added a commit to blueyed/pytest that referenced this pull request Jan 24, 2020
This should make it obvious if missing coverage is due to the upload
having failed.

Using pytest-dev#6553 would be an
alternative, but this can be used already if that takes longer.

Ref: pytest-dev#6463 (comment)
@blueyed

blueyed commented Jan 24, 2020

Copy link
Copy Markdown
Contributor Author

Alternative: #6560 - but failed on the first run already, and then the 2nd..!

@blueyed
blueyed force-pushed the ci-gha-use-report-coverage.sh branch 2 times, most recently from b5f9b8e to e5a362d Compare January 24, 2020 17:53
@nicoddemus

Copy link
Copy Markdown
Member

Actually it does retries automatically, I've seen it sleeping for 30s a number of times before trying to upload again before codecov doesn't respond.

Also it seems to be basically a large, obfuscated code blob, while using the bash script ourselves is more transparent.

Not sure if you mean the yaml configuration or the action code itself.

Additionally, it might result in differences with regard to what is reported between Travis and GHA.

But this is temporary, I hope. Which would be fine to narrow down why GH action coverage is less than Travis.

Like I said, I'm -0 on this, so please go ahead if think it is better. 👍

@blueyed
blueyed merged commit 5dcd24f into pytest-dev:master Jan 24, 2020
@blueyed
blueyed deleted the ci-gha-use-report-coverage.sh branch January 24, 2020 18:20
@blueyed

blueyed commented Jan 24, 2020

Copy link
Copy Markdown
Contributor Author

Not sure if you mean the yaml configuration or the action code itself.

The JS code (the action).

But this is temporary, I hope. Which would be fine to narrow down why GH action coverage is less than Travis.

Well, it also is helpful to have it failing. As seen in #6560 it failed twice in a row, which likely is the reason for flaky coverage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants