| Project A |
| Criteria | Result / Proof point |
|---|
Working build system |
| If the software produced by the project requires building for use, the project MUST provide a working build system that can automatically rebuild the software from source code. | Met | Make |
| It is SUGGESTED that common tools be used for building the software. | Met | Make |
| The project SHOULD be buildable using only FLOSS tools. | Met | Make |
Automated test suite |
| The project MUST use at least one automated test suite that is publicly released as FLOSS (this test suite may be maintained as a separate FLOSS project). | In Progress | Test suite to be added as part of commitadded |
A test suite SHOULD be invocable in a standard way for that language.
For example, "make check", "mvn test", or "rake test" (Ruby). | In Progress | - "make test" to be added
- Postman scripts
|
| It is SUGGESTED that the test suite cover most (or ideally all) the code branches, input fields, and functionality. | In Progress | The test suite will cover the code branch, and all possible input values and functionality. Tests will include suites developed as part of OAM repository. |
| It is SUGGESTED that the project implement continuous integration (where new or changed code is frequently integrated into a central code repository and automated tests are run on the result). | In Progress | Jenkins will be used to provide CI/CD. |
New functionality testing |
The project MUST have a general policy (formal or not) that as major new functionality is added to the software produced by the project, tests of that functionality should be added to an automated test suite.
As long as a policy is in place, even by word of mouth, that says developers should add tests to the automated test suite for major new functionality, select "Met. | Met | All new and existing functionality will be tested as part of the CI/CD pipleline. See above. |
The project MUST have evidence that the test_policy for adding tests has been adhered to in the most recent major changes to the software produced by the project.
Major functionality would typically be mentioned in the release notes. Perfection is not required, merely evidence that tests are typically being added in practice to the automated test suite when new major functionality is added to the software produced by the project. | In Progress | All new and existing functionality will be tested as part of CI/CD. See above. New test functionality will be tracked in Jira and Gerrit. Unit test will be verified using Sonar. |
It is SUGGESTED that this policy on adding tests (see test_policy) be documented in the instructions for change proposals.
However, even an informal rule is acceptable as long as the tests are being added in practice. | Met | Only informal rules exist. In practice tests are will be continuously added. |
Warning flags |
| The project MUST enable one or more compiler warning flags, a "safe" language mode, or use a separate "linter" tool to look for code quality errors or common simple mistakes, if there is at least one FLOSS tool that can implement this criterion in the selected language. |
|
|
| The project MUST address warnings. |
|
|
It is SUGGESTED that projects be maximally strict with warnings in the software produced by the project, where practical. Some warnings cannot be effectively enabled on some projects. What is needed is evidence that the project is striving to enable warning flags where it can, so that errors are detected early. |
|
|
