Versions Compared

Old Version 4

changes.mady.by.user Mahesh Jethanandani

Saved on

compared with

New Version 5

changes.mady.by.user Mahesh Jethanandani

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Expand
titleReporting

Reporting (8 Points) 

(Result/Proof point (column A: enter Met/Unmet; Column B: enter relevant URLs/comments)


SMO
CriteriaResult / Proof point 

Bug-reporting process

The project MUST provide a process for users to submit bug reports (e.g., using an issue tracker or a mailing list). (URL required) yesTools (mailing list, JIRA, Gerrit)
The project SHOULD use an issue tracker for tracking individual issues.yesJIRA
The project MUST acknowledge a majority of bug reports submitted in the last 2-12 months (inclusive); the response need not include a fix.yesTODO
The project SHOULD respond to a majority (>50%) of enhancement requests in the last 2-12 months (inclusive).yesTODO
The project MUST have a publicly available archive for reports and responses for later searching. (URL required)no

Governance

2021-02-19

Depends on previous  two criterion 

As part of release checklist store the snapshot copy of the reports of previous two criterion into wiki page.

RC-3 in Release criteria checklist template

Vulnerability report process

The project MUST publish the process for reporting vulnerabilities on the project site. (URL required)the process for reporting vulnerabilities on the project site. (URL required)yes

Governance

2021-02-19

Jira issues will need to be labelled for security bugs.

If private vulnerability reports are supported, the project MUST include how to send the information in a way that is kept private. (URL required) 

Examples include a private defect report submitted on the web using HTTPS (TLS) or an email encrypted using OpenPGP. If vulnerability reports are always public (so there are never private vulnerability reports), choose "not applicable" (N/A).

N/A

Governance

2021-02-19

NA (We don't support private vulnerability)

The project's initial response time for any vulnerability report received in the last 6 months MUST be less than or equal to 14 days. 

If there have been no vulnerabilities reported in the last 6 months, choose "not applicable" (N/A).

no

Governance

2021-02-19

JIRA Report & Release checklist as criteria

RC-3 in Release criteria checklist template



Expand
titleQuality

Quality (13 Points) 

(Result/Proof point (column A: enter Met/Unmet; Column B: enter relevant URLs/comments)


Project A
CriteriaResult / Proof point 

Working build system

If the software produced by the project requires building for use, the project MUST provide a working build system that can automatically rebuild the software from source code. 

It is SUGGESTED that common tools be used for building the software.

The project SHOULD be buildable using only FLOSS tools.

Automated test suite

The project MUST use at least one automated test suite that is publicly released as FLOSS (this test suite may be maintained as a separate FLOSS project).

A test suite SHOULD be invocable in a standard way for that language.
For example, "make check", "mvn test", or "rake test" (Ruby).

It is SUGGESTED that the test suite cover most (or ideally all) the code branches, input fields, and functionality.

It is SUGGESTED that the project implement continuous integration (where new or changed code is frequently integrated into a central code repository and automated tests are run on the result).

New functionality testing

The project MUST have a general policy (formal or not) that as major new functionality is added to the software produced by the project, tests of that functionality should be added to an automated test suite. 
As long as a policy is in place, even by word of mouth, that says developers should add tests to the automated test suite for major new functionality, select "Met.

The project MUST have evidence that the test_policy for adding tests has been adhered to in the most recent major changes to the software produced by the project.
Major functionality would typically be mentioned in the release notes. Perfection is not required, merely evidence that tests are typically being added in practice to the automated test suite when new major functionality is added to the software produced by the project.

It is SUGGESTED that this policy on adding tests (see test_policy) be documented in the instructions for change proposals. 
However, even an informal rule is acceptable as long as the tests are being added in practice.

Warning flags

The project MUST enable one or more compiler warning flags, a "safe" language mode, or use a separate "linter" tool to look for code quality errors or common simple mistakes, if there is at least one FLOSS tool that can implement this criterion in the selected language.

The project MUST address warnings.

It is SUGGESTED that projects be maximally strict with warnings in the software produced by the project, where practical.

Some warnings cannot be effectively enabled on some projects. What is needed is evidence that the project is striving to enable warning flags where it can, so that errors are detected early.




...