Reliability reports by platforms

[legendecas]

          The reliability reports are generated by dates and can not be filtered to list what's failing on a specific platform. Would it be helpful to generate a reliability summary filtered by platforms? It can help us to find out the reliability of each platform.

Originally posted by @legendecas in nodejs/node#56583 (comment)

A possible improvement is to generate JSON reliability reports so that the reports can be processed programatically and be filtered by platforms.

A reliability history by platform can provide supporting figures for us to determine if a platform is unstable.

[0hmX]

Hey @legendecas, I would love to help with this one. Three of my PRs are stuck due to a bad CI, and it's annoying to ask the maintainer every time for a CI run. If solving this issue helps, I am ready to. I have set up the repository and run the tests; all are passing. I need to know which command I need to look at.

[legendecas]

The report workflow is defined at https://github.com/nodejs/reliability/blob/81db301596de4717b67c8463d841665f4d8ee053/.github/workflows/reliability_report.yml#L43-L48.

The command is defined at

node-core-utils/bin/ncu-ci.js

Lines 466 to 481 in 0bd46f4

	async aggregate() {
	const { argv, cli } = this;
	if (this.queue.length === 0) {
	return;
	}
	const aggregator = new FailureAggregator(cli, this.json);
	this.json = aggregator.aggregate();
	cli.log('');
	cli.separator('Stats');
	cli.log('');
	aggregator.display();
	if (argv.markdown || argv.copy) {
	this.markdown = aggregator.formatAsMarkdown();
	}
	}

.

There is a --json option available, along with --markdown (link). It can be updating the workflow in the nodejs/reliability to pick up the option --json, as it seems already been supported at

node-core-utils/bin/ncu-ci.js

Line 472 in 0bd46f4

this.json = aggregator.aggregate();

.