TrustCB B.V.
Registered address:
Van den Berghlaan 48, 2132 AT
Hoofddorp, The Netherlands
nscib@trustcb.com
https://trustcb.com/common-criteria/nscib/
https://nscib.nl
TrustCB B.V. is a registered company at the
Netherlands Chamber of Commerce (KVK),
under number 858360275.
Version
2023-06
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
Certification Report
MindSpore v1.9
Sponsor and developer: Huawei Technologies Co., Ltd.
D4 Area Administration Building, Southern Factory of
Huawei Technologies Co., Ltd
No 6 Xincheng Avenue, Songshan Lake Technology
Industrial Park
Dongguan City, 523808,
People’s Republic of China.
Evaluation facility: SGS Brightsight B.V.
Brassersplein 2
2612 CT Delft
The Netherlands
Report number: NSCIB-CC-2300002-01-CR
Report version: 1
Project number: NSCIB-2300002-01
Author(s): Andy Brown
Date: 15 April 2024
Number of pages: 12
Number of appendices: 0
Reproduction of this report is authorised only if the report is reproduced in its entirety.
Page: 2/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
CONTENTS
Foreword 3
Recognition of the Certificate 4
International recognition 4
European recognition 4
1 Executive Summary 5
2 Certification Results 7
2.1 Identification of Target of Evaluation 7
2.2 Security Policy 7
2.3 Assumptions and Clarification of Scope 7
2.3.1 Assumptions 7
2.3.2 Clarification of scope 7
2.4 Architectural Information 7
2.5 Documentation 8
2.6 IT Product Testing 8
2.6.1 Testing approach and depth 9
2.6.2 Independent penetration testing 9
2.6.3 Test configuration 9
2.6.4 Test results 9
2.7 Reused Evaluation Results 9
2.8 Evaluated Configuration 9
2.9 Evaluation Results 9
2.10 Comments/Recommendations 10
3 Security Target 11
4 Definitions 11
5 Bibliography 12
Page: 3/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
Foreword
The Netherlands Scheme for Certification in the Area of IT Security (NSCIB) provides a third-party
evaluation and certification service for determining the trustworthiness of Information Technology (IT)
security products. Under this NSCIB, TrustCB B.V. has the task of issuing certificates for IT security
products, as well as for protection profiles and sites.
Part of the procedure is the technical examination (evaluation) of the product, protection profile or site
according to the Common Criteria assessment guidelines published by the NSCIB. Evaluations are
performed by an IT Security Evaluation Facility (ITSEF) under the oversight of the NSCIB Certification
Body, which is operated by TrustCB B.V. in cooperation with the Ministry of the Interior and Kingdom
Relations.
An ITSEF in the Netherlands is a commercial facility that has been licensed by TrustCB B.V. to
perform Common Criteria evaluations; a significant requirement for such a licence is accreditation to
the requirements of ISO Standard 17025 “General requirements for the accreditation of calibration and
testing laboratories”.
By awarding a Common Criteria certificate, TrustCB B.V. asserts that the product or site complies with
the security requirements specified in the associated (site) security target, or that the protection profile
(PP) complies with the requirements for PP evaluation specified in the Common Criteria for
Information Security Evaluation. A (site) security target is a requirements specification document that
defines the scope of the evaluation activities.
The consumer should review the (site) security target or protection profile, in addition to this
certification report, to gain an understanding of any assumptions made during the evaluation, the IT
product's intended environment, its security requirements, and the level of confidence (i.e., the
evaluation assurance level) that the product or site satisfies the security requirements stated in the
(site) security target.
Reproduction of this report is authorised only if the report is reproduced in its entirety.
Page: 4/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
Recognition of the Certificate
Presence of the Common Criteria Recognition Arrangement (CCRA) and the SOG-IS logos on the
certificate indicates that this certificate is issued in accordance with the provisions of the CCRA and
the SOG-IS Mutual Recognition Agreement (SOG-IS MRA) and will be recognised by the participating
nations.
International recognition
The CCRA was signed by the Netherlands in May 2000 and provides mutual recognition of certificates
based on the Common Criteria (CC). Since September 2014 the CCRA has been updated to provide
mutual recognition of certificates based on cPPs (exact use) or STs with evaluation assurance
components up to and including EAL2+ALC_FLR.
For details of the current list of signatory nations and approved certification schemes, see
http://www.commoncriteriaportal.org.
European recognition
The SOG-IS MRA Version 3, effective since April 2010, provides mutual recognition in Europe of
Common Criteria and ITSEC certificates at a basic evaluation level for all products. A higher
recognition level for evaluation levels beyond EAL4 (respectively E3-basic) is provided for products
related to specific technical domains. This agreement was signed initially by Finland, France,
Germany, The Netherlands, Norway, Spain, Sweden and the United Kingdom. Italy joined the SOG-IS
MRA in December 2010.
For details of the current list of signatory nations, approved certification schemes and the list of
technical domains for which the higher recognition applies, see https://www.sogis.eu.
Page: 5/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
1 Executive Summary
This Certification Report states the outcome of the Common Criteria security evaluation of the
MindSpore v1.9. The developer of the MindSpore v1.9 is Huawei Technologies Co., Ltd. located in
Dongguan City, People's Republic of China and they also act as the sponsor of the evaluation and
certification. A Certification Report is intended to assist prospective consumers when judging the
suitability of the IT security properties of the product for their particular requirements.
The TOE is an open source deep learning training/inference framework software developed by
Huawei. It will be referred to as the TOE throughout this document.
MindSpore is provided as a library that is used by AI Application developers to provide AI services.
In the evaluated configuration, an AI Application developer will use MindSpore-MindSpore along with
the MindSpore-MindArmour library to improve the generated AI Application deep learning models into
a protected model or to attack the original model in the field of Computer Vision. The security
functionality allows for evaluation and comparison of the robustness of models, leading to model
design improvements; it is therefore an important part of the security functionality.
Model hardening use case included in [ST] scope
Attack use case included in [ST] scope
Out of scope are the creation of AI Applications that define and train a deep learning model using a
training dataset and MindSpore. Also out of scope is the creation of AI Applications that use trained
models and MindSpore to conduct inference of samples
Page: 6/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
The TOE has been evaluated by SGS Brightsight B.V. located in Delft, The Netherlands. The
evaluation was completed on 15 April 2024 with the approval of the ETR. The certification procedure
has been conducted in accordance with the provisions of the Netherlands Scheme for Certification in
the Area of IT Security [NSCIB].
The scope of the evaluation is defined by the security target [ST], which identifies assumptions made
during the evaluation, the intended environment for the MindSpore v1.9, the security requirements,
and the level of confidence (evaluation assurance level) at which the product is intended to satisfy the
security requirements. Consumers of the MindSpore v1.9 are advised to verify that their own
environment is consistent with the security target, and to give due consideration to the comments,
observations and recommendations in this certification report.
The results documented in the evaluation technical report [ETR] 1 for this product provide sufficient
evidence that the TOE meets the EAL4: augmented (EAL4+) assurance requirements for the
evaluated security functionality. This assurance level is augmented with ALC_FLR.2 (Flaw reporting
procedures).
The evaluation was conducted using the Common Methodology for Information Technology Security
Evaluation, Version 3.1 Revision 5 [CEM] for conformance to the Common Criteria for Information
Technology Security Evaluation, Version 3.1 Revision 5 [CC] (Parts I, II and III).
TrustCB B.V., as the NSCIB Certification Body, declares that the evaluation meets all the conditions
for international recognition of Common Criteria Certificates and that the product will be listed on the
NSCIB Certified Products list. Note that the certification results apply only to the specific version of the
product as evaluated.
1 The Evaluation Technical Report contains information proprietary to the developer and/or the
evaluator, and is not available for public review.
Page: 7/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
2 Certification Results
2.1 Identification of Target of Evaluation
The Target of Evaluation (TOE) for this evaluation is the MindSpore v1.9 from Huawei Technologies
Co., Ltd. located in Dongguan City, People's Republic of China.
The TOE is comprised of the following main components:
Delivery
item type
Identifier Version
Software
MindSpore-MindSpore 1.9.0
MindSpore-MindArmour 1.9.1
MindSpore-MindInsight 1.9.0
To ensure secure usage a set of guidance documents is provided, together with the MindSpore v1.9.
For details, see section 2.5 “Documentation” of this report.
2.2 Security Policy
The TOE provides the following security functionalities:
• Generation of adversarial samples
• Hardening of inference model against adversarial samples.
2.3 Assumptions and Clarification of Scope
2.3.1 Assumptions
The assumptions defined in the Security Target are not covered by the TOE itself. These aspects lead
to specific Security Objectives to be fulfilled by the TOE-Environment. For detailed information on the
security objectives that must be fulfilled by the TOE environment, see section 4.2 of the [ST].
2.3.2 Clarification of scope
The evaluation did not reveal any threats to the TOE that are not countered by the evaluated security
functions of the product.
2.4 Architectural Information
The logical architecture, originating from the Security Target [ST] of the TOE can be depicted as
follows:
Page: 8/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
Logical architecture of the TOE.
The TOE is purely a software TOE. The whole framework is labelled as MindSpore 1.9, comprised of
the following components:
• MindSpore 1.9.0
• MindArmour 1.9.1
• MindInsight 1.9.0
The software components are used together to generate, attack, defend and apply inference to
computer vision deep learning models.
2.5 Documentation
The following documentation is provided with the product by the developer to the customer:
Identifier Version
MindArmour API References 1.9
MindInsight API References 1.9
MindSpore API References 1.9
CC MindSpore 1.9 AGD_PRE_User 0.2.1
CC MindSpore 1.9 AGD_OPE 0.2.1
2.6 IT Product Testing
Testing (depth, coverage, functional tests, independent testing): The evaluators examined the
developer’s testing activities documentation and verified that the developer has met their testing
responsibilities.
Page: 9/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
2.6.1 Testing approach and depth
The developer created test cases intended to fully test the TSF related to each SFR, plus test cases
intended to test the TSFI APIs.
In order to perform the testing described above, the developer prepared a complete set of scripts to
run each test case plus the necessary scripts to satisfy the pre-conditions and/or ordering
dependencies.
The evaluator repeated all the developer test cases.
The evaluator created additional test cases intended to verify the version of the TOE, and further
additional test cases intended to test the accuracy of the adversarial samples created by the TOE on
other AI models.
2.6.2 Independent penetration testing
The penetration test was focused on testing the TOE protected models against adversarial samples
created by other AI frameworks.
The total test effort expended by the evaluators was 6 weeks. During that test campaign, 100% of the
total time was spent on logical tests.
2.6.3 Test configuration
The evaluator tested the TOE in the following configuration:
• MindSpore 1.9.0
• MindArmour 1.9.1
• MindInsight 1.9.0
This is the same configuration as stated in the ST.
2.6.4 Test results
The testing activities, including configurations, procedures, test cases, expected results and observed
results are summarised in the [ETR], with references to the documents containing the full details.
The developer’s tests and the independent functional tests produced the expected results, giving
assurance that the TOE behaves as specified in its [ST] and functional specification.
No exploitable vulnerabilities were found with the independent penetration tests.
The algorithmic security level of cryptographic functionality has not been rated in this certification
process, but the current consensus on the algorithmic security level in the open domain, i.e., from the
current best cryptanalytic attacks published, has been taken into account.
2.7 Reused Evaluation Results
There has been extensive reuse of the ALC aspects for the sites involved in the development and
production of the TOE, by use of 3 Site Technical Audit Reports.
2.8 Evaluated Configuration
The TOE is defined uniquely by its name and version number MindSpore v1.9.
2.9 Evaluation Results
The evaluation lab documented their evaluation results in the [ETR], which references an ASE
Intermediate Report and other evaluator documents, and Site Technical Audit Report(s) for the site(s)
[STAR] 2
2 The Site Technical Audit Report contains information necessary to an evaluation lab and
certification body for the reuse of the site audit report in a TOE evaluation.
Page: 10/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
The verdict of each claimed assurance requirement is “Pass”.
Based on the above evaluation results the evaluation lab concluded the MindSpore v1.9, to be CC
Part 2 extended, CC Part 3 conformant, and to meet the requirements of EAL 4 augmented with
ALC_FLR.2. This implies that the product satisfies the security requirements specified in Security
Target [ST].
2.10 Comments/Recommendations
The user guidance as outlined in section 2.5 “Documentation” contains necessary information about
the usage of the TOE.
In addition, all aspects of assumptions, threats and policies as outlined in the Security Target not
covered by the TOE itself must be fulfilled by the operational environment of the TOE.
The customer or user of the product shall consider the results of the certification within his system risk
management process. For the evolution of attack methods and techniques to be covered, the
customer should define the period of time until a re-assessment for the TOE is required and thus
requested from the sponsor of the certificate.
The strength of the cryptographic algorithms and protocols was not rated in the course of this
evaluation. This specifically applies to the following proprietary or non-standard algorithms, protocols
and implementations: None.
Page: 11/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
3 Security Target
The MindSpore 1.9 Security Target, v0.2.2, 26th February 2024 [ST] is included here by reference.
4 Definitions
This list of acronyms and definitions contains elements that are not already defined by the CC or CEM:
AI Artificial Intelligence
IT Information Technology
ITSEF IT Security Evaluation Facility
JIL Joint Interpretation Library
NSCIB Netherlands Scheme for Certification in the area of IT Security
PP Protection Profile
TOE Target of Evaluation
Page: 12/12 of report number: NSCIB-CC-2300002-01-CR, dated 15 April 2024
®
TrustCB
is
a
registered
trademark.
Any
use
or
application
requires
prior
approval.
5 Bibliography
This section lists all referenced documentation used as source material in the compilation of this
report.
[CC] Common Criteria for Information Technology Security Evaluation, Parts I, II and
III, Version 3.1 Revision 5, April 2017
[CEM] Common Methodology for Information Technology Security Evaluation,
Version 3.1 Revision 5, April 2017
[ETR] Evaluation Technical Report Mindspore v1.9– EAL4+, 22-RPT-1367, Version
3.0, 10 April 2024
[NSCIB] Netherlands Scheme for Certification in the Area of IT Security, Version 2.6,
02 August 2022
[ST] MindSpore 1.9 Security Target, v0.2.2, 26th February 2024
(This is the end of this report.)