Proposal Preparation Instructions: Call for Proposals for Research Projects Using the HPCI System in Fiscal Year 2019

Proposal Preparation Instructions: Call for Proposals for Research Projects Using the HPCI System in Fiscal Year 2019 The Registered Institution for Facilities Use Promotion HPCI Operation Office Research Organization for Information Science and Technology (RIST) Introduction Computational resources of the High-Performance Computing Infrastructure (HPCI) including K computer are useful in various fields such as the scientific, technological, academic research, industrial and medical fields. RIST calls for proposals for research projects using the HPCI System in order to promote projects promising to yield excellent achievements by taking full advantage of the potential of HPCI's shared computational resources. K computer will stop the operation in Fiscal Year (FY) 2019 and the transition phase to Post-K computer will start. On that account, the following points need to be noted when you apply for this call for proposals. K computer HPCI shared computational resources other than K computer 1 Important Points The project period is scheduled to be half a year, provided that it may be shortened or the resource provision may be cancelled. Details will be announced by the end of December. To prepare for the cancellation of resourcing, the applicants can specify other HPCI shared computational resources as the second or the third choice in place of K computer. The proposals not awarded for K computer use will also be reviewed for the second or the third choice. (The third choice has started to become available since this call for proposals). The concurrent use of K computer and the other HPCI shared computational resources is not possible. A new category Junior Researcher Promotion projects has been set as has already been available in K computer. In addition to the second choice, the applicants can specify the third choice for the HPCI resources other than K computer. However, if the concurrent use of multiple systems is requested, the second choice or the third choice cannot be specified. *Information regarding this call for proposals is available in the HPCI Portal site [1] : [1] http://www.hpci-office.jp/pages/e_h31_boshu

1. Outline of the Call (1) Schedules and Project Period (JST) September 4, 2018, Tuesday October 4, 2018, Thursday November 6, 2018, Tuesday November 20, 2018, Tuesday Beginning of February 2019 Call for proposals; application forms become available Online submission opens Online submission closes (17:00 JST) Deadline of printed project proposals with stamps or signature (must-arrive) Announcement of awards Project Period K computer: April 1, 2019 - September 30, 2019* *the period may be shortened or the project may be cancelled HPCI resources other than K computer: April 1, 2019 - March 31, 2020 (2) Available Resources and Project Categories Available computational resources and project categories. K computer General projects Junior Researcher Promotion projects Industrial Use projects (Non-proprietary Use) HPCI shared General projects computational resources Junior Researcher Promotion projects [*] other than K computer Industrial Use projects (Non-proprietary Use) * Junior Researcher Promotion projects had only been available for K computer applicants, but it becomes available for the applicants of the HPCI shared computational resources other than K computer. Shared computational resources managed by the own rules of the HPCI Resource Providers HPCI Shared Storage Project categories corresponding to each system are shown in the Table 1 and 2 in 2. (1). 2

(3) Eligibility 1) The Project Representative must have an HPCI-ID and be able to obtain an approval of the proposing project from the organization representative (or a senior manager at a similar level) that they belong to. The Project Representative engages in execution of the project. 2) Project members who use computational resources must have an HPCI-ID and engage in execution of the project. 3) Junior Researcher Promotion Project should consist of the Project Representative, Deputy Project Representative(s), and members who are equal to or less than 39 years old as of April 1, 2019. 4) The Project Representative of an Industrial Use project must be the person who belongs to a company registered in Japan in principle. Exceptionally, if the proposing project is concerned with K Industrial Use Consortium Project (*defined below), the Project Representative can be the person who belongs to a company registered in Japan or a corporation registered in Japan (university, research institution etc.). * K Industrial Use Consortium Project is a research project in which five or more companies participate, forming a consortium or group, and address challenging issues that cannot be solved by a single company. 5) A person who belongs to a foreign company must make a proposal jointly with persons who belong to a corporation registered in Japan. In the case, the Project Representative must be a person who belongs to a corporation registered in Japan. 6) The members of a Post-K R&D project (*defined below) cannot submit a proposal on the issues described as commissioned tasks in the Project Plans. Only if the proposing project is to address issues other than the commissioned tasks, members of the Post-K R&D projects can submit proposals. * Post-K R&D projects are government-commissioned projects. Post-K R&D projects work on research and development of the applications related to socially and scientifically important issues to be addressed at Post-K computer (Priority Issues and Exploratory Challenges). 3

2. Details of the Call (1) Project Categories Project categories of K computer are as shown in Table 1 below. <Table 1: Project categories of K computer> Category of Application Resource K computer Project Category General Project Junior Researcher Promotion Project Industrial Use Project (Nonproprietary Use) Class for halfyear (NH) *1 5M 2M 2M 1M Description Projects involving general research themes. Awarded projects are expected to yield scientifically and socially excellent achievements by fully utilizing the capacity of K computer. Projects for researchers who are equal to or less than 39 years old as of April 1, 2019 (whoever born on or after April 2, 1979) 4M* This category is for industrial users to demonstrate effectiveness and values of 2.5M highly parallel simulation technology by solving their industrial problems with the use of K computer. *4M NH 1M class is available only for consortiums or groups of more than five companies. *1) NH: Node-Hours. The value listed in each class is an upper limit. User Fee Free of charge Free of charge Free of charges Publication Required Required Required Project categories of the HPCI shared computational resources other than K computer are as shown in Table 2 below. Proposals are classified into two and screened in the respective classes: The L class for projects needing larger resources and the S class for projects needing smaller resources. Each HPCI system has their own criteria for the class setting. Please see Attachment 1 for the Classification of the application of the HPCI shared computational resources other than K computer and Upper Limit of Available 4

Resources, and Attachment 2 for a complete list of the HPCI Provided Resources. When submitting a proposal, check into which class your proposal falls, and indicate it in the application form (Additional Sheet 1) referring to the following points. Also, the Junior Researcher Promotion projects do not have the L class, so computational resources must be requested within the limit of S class. Please note that - some HPCI resources do not have the L class, and - there is a limit to the amount of resources to request. Referring to the Attachments 1 and 2, please make sure not to request above the limit. <Table 2: Project categories of the HPCI System other than K computer> Category of Application Project Resource Category Class Description User Fee Publications HPCI shared computational resources other than K computer General Project L S Projects involving general research themes using the HPCI shared computational resources other than K computer. The future use of super high-speed computer is seen as the next step for the projects in this category. Scientifically and Socially excellent achievements are also expected. Free of charge Required Junior Researcher Promotion Project S Projects for researchers who are equal to or less than 39 years old as of April 1, 2019 (whoever born on or after April 2, 1979) (Available from this call) Free of charge Required Industrial Use Project (Nonproprietary Use) L S This category is for industrial users to demonstrate effectiveness and values of highly parallel simulation technology by solving their industrial problems with Free of charge Required 5

the use of the HPCI shared computational resources other than K computer. Resource Description User fee Publication Shared computational resources managed by the own rules of the HPCI resource providers Computational resources are operated as the HPCI Resources, but the projects will be selected by own rules of the resource providers instead of going through the HPCI s comprehensive selection process. (In FY 2019 the ABCI system from AIST is provided as charged computational resources.) Up to the rules of each resource provider Up to the rules of each resource provider HPCI Resource Types Description Storage*2) Shared CPU Simultaneous Use Projects to use the storage together with the HPCI shared computational resources*3). The project period complies with the requesting computational resources. User fee Free of charge Publication Required Sharing use Projects to share and analyze data among project members or community members. They do not necessarily use computational resources. *2) To request the CPU Simultaneous Use, select K computer or HPCI computational resources other than K computer in the Project Category first, and select the HPCI Shared Storage in the Requested resources section. Additional requests for CPU Simultaneous Use may be accepted if enough resources remain in the HPCI Shared Storage after the projects start. A condition that the users of the HPCI Shared Storage must agree is to move the accumulated data to users own institutions or elsewhere before their projects finish. *3) They do not include projects using computational resources managed by the own rules of the HPCI resource providers 6

1) Available Resources Regarding the detailed information of the HPCI shared computational resources, applications, and software such as numerical libraries, please refer to the List of available resources for the research projects of FY2019 [2]. [2] http://www.hpci-office.jp/pages/e_h31_boshu_hpci_resource This information is updated occasionally. Please make sure to refer to the latest version. 2) Usage fee No usage fee will be charged in principle for the HPCI shared computational resources used by the projects accepted under this call for proposals (except for computational resources managed by the own rules of the HPCI resource providers). 3) Characteristic of the machines The HPCI System provides a wide range of computational resources. For K computer, visit the websites below [3]. For the HPCI system other than K computer, please see Appendix 1 HPCI Provided Resources in FY2019 and [3] above as well as the websites of each Resource Provider. When applying for the use, please request the computational resources necessary for your project. [3] http://www.r-ccs.riken.jp/en/k-computer/system http://www.hpci-office.jp/pages/e_r-ccs_riken_2019-1 (2) Patterns of Application Application patterns of the HPCI system are as shown below: Pattern 1 First choice: K computer Second choice (optional): One HPCI system other than K computer Third choice (optional): One HPCI system other than K computer or the second-choice system ** If awarded resources are K computer, the project period will be half a year. On the other hand, it will be one year in the case of the second or the third choices (HPCI computational resources other than K computer). 7

Pattern 2 First choice: One HPCI system other than K computer Second choice: One HPCI system other than K computer or the first-choice system Third choice: One HPCI system other than K computer, the first-choice or secondchoice systems Pattern 3 First choice: Multiple HPCI systems other than K computer Second and third choices cannot be specified. The concurrent use of multiple HPCI computational resources other than K computer is available for the projects which truly need to use each requesting system. For example, - A project using mainly one system and using another system for pre/post processing - The requesting system will stop during the project s period due to the system update, so it should continue to use the successor system. **HPCI Shared Storage can be requested with any of the above patterns. It is also possible to request only for HPCI Shared Storage individually. ** This time, it is not possible to request the concurrent use of K computer and other HPCI resources in one project. (3) Conditions of Use 1) General Project of K computer Projects in this category must satisfy the four conditions below: a) Projects are scientifically excellent or socially significant. Breakthroughs can be expected with the use of K computer, or pioneering achievements are sought to be accomplished. b) Resources, data transfer capability, or other characteristics of K computer are essentially needed. c) The methodology is already well verified: efficiency of highly parallelized software, computational processes, data gathering, and analysis methods of the results. The resource utilization plan and the research structure are proper. In addition, in the view 8

of developing human resources, the research plan structure is intended to let new members actively participate in the project through on the job training. d) Project execution and utilization of the results are limited to peaceful purposes. Execution of the project is proper in terms of related laws and social values. For the other categories of K computer, see 2) for Junior Researcher Promotion projects and 4) Industrial Use projects of K computer (Non-proprietary Use). 2) Junior Researcher Promotion project of K computer All the members of a project in this category must be less than or equal to 39 years old as of April 1, 2019 (whoever born on or after April 2, 1979). Projects in this category must satisfy the four conditions below: a) The proposal has excellent ideas which promise further development of the research in the future. b) Resources, data transfer capability, or other characteristics of K computer are essentially needed. c) The methodology is already well verified: efficiency of highly parallelized software, computational processes, data gathering, and analysis methods of the results. The resource utilization plan and the research structure are proper. d) Project execution and utilization of the results are limited to peaceful purposes. Execution of the project is proper in terms of related laws and social values. 3) Industrial Use projects of K computer (Non-proprietary Use) Projects seeking industrial use must fulfill all the conditions from a) to f). Exceptionally, K Industrial Use Consortium project must satisfy the conditions from g) to l). Industrial Use project of K computer (other than the Consortium projects) a) The scale of analyses and simulations are beyond the scale possible to execute within the in-house environment. b) Business strategy for industrial use is clearly defined. c) Ripple effects for promotion of industrial uses can be highly expected. d) Resources, data transfer capability, or other characteristics of K computer are essentially needed. e) The methodology is already well verified: efficiency of highly parallelized software, computational processes, data gathering, and analysis methods of the results. The 9

resource utilization plan and the research structure are proper. In addition, in the view of developing human resources, the research plan structure is intended to let new members actively participate in the project through on the job training. f) Project execution and utilization of the results are limited to peaceful purposes. Execution of the project is proper in terms of related laws and social values. K Industrial Use Consortium project g) Projects address challenging issues that cannot be solved by a single company but can be accomplished by forming a consortium or group of five or more companies and by sharing know-hows, roles, etc. h) Business strategy for the industrial use is clearly defined. In addition, each corporation has their own clear business strategy. i) Ripple effects for promotion of industrial uses can more likely be expected than a single company carrying out the project alone. j) Resources, data transfer capability, or other characteristics of K computer are essentially needed. k) The methodology is already well verified: efficiency of highly parallelized software, computational processes, data gathering, and analysis methods of the results. The resource utilization plan and the research structure are proper. In addition, in the view of developing human resources, the research plan structure is intended to let new members actively participate in the project through on the job training. l) Project execution and utilization of the results are limited to peaceful purposes. Execution of the project is proper in terms of related laws and social values. In principle, Industrial Use projects need to run jobs with 200 nodes or more on average. Otherwise the resources other than K computer should be requested except in case of capacity computing such as parameter study, which requires more than 0.5 MNH of K computer. 4) General Project for the HPCI System other than K computer Projects in this category must satisfy either one of the conditions from a) to c) below, and all the conditions from d) to f). a) The project is challenging to carry out large scale and capacity computations. b) Use of super high-speed computers can be expected in the future. 10

c) Use of multiple computational resources is expected. d) Computational resources provided by the HPCI System are essentially needed. e) The methodology is already well verified: efficiency of highly parallelized software, computational processes, data gathering, and analysis methods of the results. The resource utilization plan and the research structure are proper. In addition, in the view of developing human resources, the research plan structure is intended to let new members actively participate in the project through on the job training. f) Project execution and utilization of the results are limited to peaceful purposes. Execution of the project is proper in terms of related laws and social values. 5) Junior Researcher Promotion project for the HPCI System other than K computer All the members of a project in this category must be less than or equal to 39 years old as of April 1, 2019 (whoever born on or after April 2, 1979). Projects in this category must satisfy the four conditions below: a) The proposal has excellent ideas which promise further development of the research in the future. b) Computational resources provided by the HPCI System are essentially needed. c) The methodology is already well verified: efficiency of highly parallelized software, computational processes, data gathering, and analysis methods of the results. The resource utilization plan and the research structure are proper. d) Project execution and utilization of the results are limited to peaceful purposes. Execution of the project is proper in terms of related laws and social values. 6) Industrial Use Project for the HPCI System other than K computer (Non-proprietary) Projects seeking industrial use must fulfill all the conditions from a) to f). a) The scale of analyses and simulations are beyond the scale possible to execute within the in-house environment. b) Business strategy for the industrial use is clearly defined. c) Ripple effects for promotion of industrial uses can be highly expected. d) Computational resources provided by the HPCI System are essentially needed. e) The methodology is already well verified: efficiency of highly parallelized software, computational processes, data gathering, and analysis methods of the results. The resource utilization plan and the research structure are proper. In addition, in the view 11

of developing human resources, the research plan structure is intended to let new members actively participate in the project through on the job training. f) Project execution and utilization of the results are limited to peaceful purposes. Execution of the project is proper in terms of related laws and social values. 7) Project using shared computational resources managed by the own rules of the HPCI resource providers Computational resources are operated as the HPCI shared resources, but the projects will be awarded by the own rules of the resource providers instead of going through the HPCI s comprehensive selection process. In FY 2019 the ABCI system from AIST is provided as charged computational resources. The available project categories are General Projects and Industrial Use projects, whose user fee is charged and the publication of research achievements is not required. The available system is limited to ABCI. Please refer to the AIST s webpage for the user fee [4] and the usage policy [5]. Additionally, the submission of the Program Information sheet (Additional Sheet 2) described in 3. Application Procedure below is not necessary if requesting the ABCI system from AIST. Also, regarding the items in 5. Publication of Research Achievements and Reporting Requirements, the selected projects are classified as the non-disclosure type, so only the submission of a user report is mandatory. [4] https://abci.ai/ja/how_to_use/tariffs.html [in Japanese] [5] https://abci.ai/ja/how_to_use/data/yakkan.pdf [in Japanese] 8) Project using HPCI Shared Storage The CPU Simultaneous Use is to use the storage system together with the HPCI shared computational resources. That is, it should not be used simply for long-term storage of data without the actual use (e.g. data analysis). Conditions of the use are: there must be a clear usage plan of the HPCI shared computational resources; data analysis must be executed as planned; the data on the HPCI Shared Storage will certainly be moved and stored in the storage facility of the user before the completion of the project. The HPCI Shared Storage in the category of Sharing Use should serve for sharing of the computational data among the members of the community to jointly analyze the data. The number of users for sharing, easiness of the use, and significance of the utilization will be considered. 12

Additionally, the submission of the Program Information sheet (Additional Sheet 2) described in 3. Application Procedure below is not necessary if requesting the Sharing Use of the HPCI Shared Storage. 3. Application Procedures (1) HPCI-ID Registration Applicants need HPCI-ID to submit a proposal. If you do not have one, please obtain your HPCI-ID via the HPCI Online Application System [6] before submitting a proposal. Please refer to the HPCI Quick Start Guide [7] for how to use the system. HPCI-ID is necessary for the Deputy Representative(s) and the members who participate in your project, too. Information entered during the registration process (including e-mail addresses) will be used for notification of results or other correspondences. Please keep the information updated. (Only one HPCI-ID is issued for a person and its validation lasts ten years.) [6] https://www.hpci-office.jp/entry/login/index/lang/en [7] http://www.hpci-office.jp/materials/hpci-startguide_e.pdf (2) Submission of Project Proposals The proposal must be submitted by the Project Representative or the Deputy Project Representative. Proposal submission is possible from the HPCI Online Application System [6]. Before submitting a proposal, please access the HPCI portal site and download an application form [8] (Microsoft Word format) and a program information sheet [9] (Microsoft EXCEL format) to fill them in with referring to A Guide for Proposal Writing [10]. The latest version of each document is available from the following URL. Note that the submission of the Program Information sheet (Additional Sheet 2) is not necessary if requesting the ABCI system from AIST or the Sharing Use of the HPCI Shared Storage. Please refer to the HPCI Quick Start Guide [7] for how to use the system. [8] http://www.hpci-office.jp/materials/h31_boshu_application_form_e.docx [9] http://www.hpci-office.jp/materials/h31_boshu_program_analysis.xlsx [10] http://www.hpci-office.jp/materials/h31_kinyu_e.pdf 13

Cautionary Note 1) In case of continuing an ongoing project, please make sure to indicate continuation on the HPCI Online Application System [6] and describe relating information in 3.1 of the application form. Please refer to HPCI Quick Start Guide [7] for how to apply for the continuing use. 2) If the project contains multiple sub-projects, please make a submission separately for each sub-project so that they are evaluated respectively. 3) The application form has a part to fill out a data management plan as well as research plans. Details are described in A Guide for Proposal Writing. 4) Each HPCI System other than K computer has basically two classes (L class/ S class). Please be aware that proposals are classified into either of the two classes in accordance with the requested amount of resources. If you request multiple HPCI systems, your proposal may be classified into the L class even in the case where the request one HPCI system is less than the upper limit of its S class. 5) If the project requests multiple resources other than K computer (the pattern 3 in 2. (2)), the necessity must be specifically described in 2.4 of the application form. 6) If your application pattern is 1 or 2, the second or third choices cannot be specified in the HPCI Online Application System [6]. Please make sure to describe the second choice (and the third choice if any) in 2.2.1 of the application form (Additional Sheet 1). 7) In principle, all the project members must be listed in the application form. If it is not possible to list names, the reason needs to be implied in the form. (e.g. a new member is expected to be assigned but his/her name is unknown, some tasks are planned to be outsourced to a vendor of application software, etc.) 8) If requesting K computer, please fill out the information of the research project working for half a year between April 2019 and September 2019 and its expecting research achievements etc. (3) Assignment of Contact Person RIST contacts the Project Representative to inquire about the application contents, notify of the selection results, or send him/her other important notifications. Please indicate a Contact Person, who is expected to be different from the Project Representative, so that important notices certainly reach to the Project Representative. The Contact Person does not need to have an HPCI-ID. 14

(4) Mailing of the Project Proposal After completion of the online submission, applicants need to print out the proposal and to mail/bring it to the address indicated in the section 8 below, together with the signature of the Project Representative, the name of the organization to which the Project Representative belongs, and the representative s name of the organization with his/her signature. For mailing, please indicate in red on the envelope that the project proposal is enclosed, and send it by the registered mail. For the mailing address, please see 8. Contact information and the mailing address for submission of project proposals. Also, when sending the printed project proposal, it is not necessary to enclose the application form (Additional Sheet 1) and the program information (Additional Sheet 2). If these documents are enclosed, they will be discarded upon reception. 4. Selection of Projects (1) Screening Process Submitted project proposals will be screened by the Project Screening Committee consisting of experts from industry, academia, and government. Submitted project proposals to use K computer will be reviewed and selected based on the Basic policies on screening of the research project proposals for the Specific High-speed Computer Facilities (K computer) [11]. Project proposals to use the HPCI computers other than K computer will be reviewed and selected based on the Basic policies on screening of the research project proposals for the HPCI System [12]. The review results are escalated to the Selection Committee, and they make remarks on the results. After these processes, the selection will be made by the head of the Registered Institution for Facilities Use Promotion for K computer, and by the head of HPCI Operation Office for the HPCI System other than K computer. [11] http://www.hpci-office.jp/materials/selection_overview_k_en.pdf [12] http://www.hpci-office.jp/materials/selection_overview_hpci_en.pdf Selection of the Industrial Use Project (Non-proprietary Use) To increase new entries and to foster human resources, the screening process for the newly participating companies will take place separately from repeatedly participating 15

companies. That is, among the organizations which the Project Representatives belong, RIST will extract the companies using the HPCI system for the first or the second time. The Trial Use or Proprietary Use will not be counted. If it was not as a Project Representative, participation to a Non-proprietary Use project will not be counted either. In addition, if proposals are from different divisions (of different field of business) or from group/subsidiary companies, they will be considered as proposals from different companies (organizations). (2) Selection results for the request of using multiple resources If concurrent use of multiple HPCI systems other than K computer (Pattern 3 in 2. (2)) is requested, awarding will be made only when all the requests for the selected systems are approved. No resources will be awarded if the requests are partially approved. (3) Notification of Awards Project Representatives and Contact Persons will be notified by e-mail by the beginning of February 2018. Upon notification of awards, please go through the process to issue HPCI Accounts by following the URL written in the notification. (4) Handling of Personal Information Upon the submission of a proposal, all the project members including the Project Representative and the contact person must agree with the following points regarding handling of personal information and its disclosure. The Project Representative needs to confirm all the project members and the contact person that they agree with the following before submitting the proposal. 1) The Registered Institution/ HPCI Operation Office takes appropriate measures to ensure protection of the personal information obtained through the operation and uses the information to the extent necessary to complete the work as the Registered Institution and the HPCI Operation Office. See the following website [13] for more details. [13] http://www.hpci-office.jp/pages/e_privacypolicy 2) If proposals are accepted, the organization written in (c) will use the personal data specified in (a) for the purpose written in (b) base on the Article 23 of the Act on the Protection of Personal Information. For more details, please see the following website [14]. 16

[14] http://www.hpci-office.jp/pages/e_privacypolicy_sharing (a) Personal Information to be jointly used: The information regarding the awarded research projects including: 1) HPCI-ID, 2) Full Name (English, Japanese, the name written in ID card), 3) affiliation and department name, 4) position, 5) address and contact information of working place (postal code, address, phone number, FAX number, email address), 6) address and contact information of residency (nationality, address, whether the person has lived in Japan for six months or longer, whether the person is temporarily returning to the home country, the date of entry into Japan / departure from Japan) (b) Purpose of Utilization for joint use: Account management regarding services provided by the HPCI resource providers including identification, account issue, certificate issue, statistical analysis, etc. (c) Organizations specified for the joint use Each HPCI Resource Provider: The organization(s) receiving the information will be decided per application. (5) Disclosure of Project Application Form If proposals are accepted, the application forms (Additional Sheet 1) uploaded by applicants will be disclosed to the corresponding HPCI resource providers for the purpose of issuing accounts. Before disclosure, the Project Representative will be asked to confirm the consent to the joint use of the project information in the HPCI Online Application System [4]. If the application form contains any information to be protected and used only for proposal evaluation, the applicant is able to upload it again after modification. Please refer to the HPCI Quick Start Guide [7] for detailed procedure. Please note that accounts may not be issued until completion of this confirmation procedure. 5. Publication of Research Achievements and Reporting Requirements In order to further develop and promote high-performance computing, the research achievements of HPCI projects will be made available to the public. Projects accepted at this call for proposals must follow the requirements. I. Submission of a user report within 60 days of the completion of the project. However, in the case where intellectual property rights are sought for, disclosure of the project 17

II. information may be postponed for two years if the request is approved. Publication of research achievements in one of the following methods from A) to D) within three years after completion of the project. In the case where publication is not possible within three years, it can be postponed by maximum of one year if the request is approved. A) Refereed papers including refereed proceedings and/or PhD theses with project numbers indicated. B) HPCI Research Report (electronic journal issued by the Registered Institution) C) Public technical reports issued by companies (applies only to the Industrial Use projects). D) Patent (acquisition of patent right) If the finished projects do not comply with these reporting requirements, penalties may be imposed (e.g. suspension of the future proposals for the HPCI projects). For more details, please refer to the following page [15]. [15] http://www.hpci-office.jp/pages/e_procedure_achievements The submitted user reports will be used for reference when selecting the excellent achievement research projects at the Project Report Meeting. After the completion of the projects, users are asked to make presentations at the Project Report Meeting. All the information is managed in accordance with the Basic policy on management of the information concerning the Usage Promotion Services for the Specific High-speed Computer Facilities (K computer) [16]. [16] http://www.hpci-office.jp/materials/e_about_info_control.pdf The following information will be publicly disclosed: After awarding Project ID, Project name, Project Representative s name, affiliation, name of country, awarded resource name, and awarded node-hours. After completion of projects Project ID, Project name, Project Representative name, affiliation, name of country, 18

awarded resource name, awarded node-hours, objectives of the project, summary of achievements, period of the project execution, software information, and system use information. 6. Intellectual Property Rights (1) Intellectual property rights that arise from the use of the HPCI System by a user, shall, in principle, belong to the user or the organization to which the user belongs. (2) An invention that has been made as a result of the use of the HPCI System by nonresidents or persons who do not have Japanese nationality shall be handled as follows: - Among the intellectual property rights, if the users intend to claim legal protection of the invention by such as patents, the user shall notify the Registered Institution thereof in advance, and rights and cost allocation of the invention shall be determined taking the degree of contributions of the inventors and the Registered Institution into account. - With respect to the invention made as a result of the joint research with Japanese educational organizations such as universities or with national institutes of Japan, rights to the invention and the allocation of benefits derived therefrom shall be agreed among the concerned parties prior to the commencement of the joint research and shall be contained in the arrangement setting forth the terms and conditions of the joint research. - Decisions related to the intellectual property rights for outcomes other than inventions shall be made among the concerned parties taking the degree of contribution into account. 7. Others (1) Requested Computational Resources Depending on the budgetary situation and competitiveness of other proposals, the requested amount of resources may not be awarded. Also, the awards do not themselves guarantee the amount of resources to be used. Well-planned use of the resources is 19

recommended, as computer tends to be heavily loaded towards the end of the term of half a year. (2) Preferential Use Service At this call for proposals, prudential use service is not available. (3) Measures Taken at the Time of the System Troubles and Emergencies The awarded resources may not be fully provided due to troubles, disasters and other reasons. In those cases, lost computational resources will not be compensated. Furthermore, users will not be compensated in the case of data disappearance or any other damages of the users due to unexpected failures. (4) Export Control In order to prevent unexpected technological outflow or law violation before it happens, it is essential that each project member understand the regulations of the Foreign Exchange and Foreign Trade Act and comply with such regulations. When submitting proposals, applicants need to mark a checkbox to confirm that all the project members understand the security export control. (5) Cancellation of the Project If the Project Representative wishes to cancel the project after awarding due to unexpected reasons, they shall notify the Helpdesk (helpdesk@hpci-office.jp) within ten days after awarding in principle. (6) Change of the Project Representative Substitution of the Project Representative with a Deputy Project Representative will be approved only if the Project Screening Committee agrees with the reasons of the change and confirms that progress of the project and achievement of goals will not be affected by this change. The request shall be made in writing. In case the Project Representative cannot request the change, the Deputy Project Representative will be allowed to request it. 20

(7) Slow Use of the Resources If the resource consumption in the first term does not reach 10% of the resources allocated to an awarded project, the awards for the project may be cancelled, or a penalty may be imposed if no improvements can be expected through the project period (e.g. suspension of the proposal submissions by the Project Representative or the Deputy Project Representative in the next fiscal year). Please use the awarded resources as scheduled in the application form. The projects which are likely to fall into the case above may be asked about the status. (8) Promotional Priority Use projects A maximum of 10% of the total resource might be allocated to the Promotional Priority Use projects essential to the policies decided by the Ministry of Education, Culture, Sports, Science and Technology (MEXT). If this allocation is implemented, allocated resources of already awarded projects might be adjusted. (9) Collaborative Use with Large Experimental Facility Projects If HPCI System resources are used in cooperation with the Large Experimental Facilities in view of complementally enhancing the effectiveness of numerical simulations and experimental approaches, the outline of the cooperative use such as facility names, names of projects which are planned or being executed in those facilities shall be briefly described with the project IDs in 3.2. Related projects in the application form (Additional Sheet 1). (10) If a product is developed through the use of K computer, state that it is an achievement of K computer on the product or in a brochure. (11) For the use of the HPCI System, user policies set by each Resource Provider must be complied with. 21

8. Contact Information and the Mailing Address for Submission of Project Proposals 1) Contact Information (Helpdesk) RIST Kobe Center, 7-1-26 Minatojima-minami-machi, Chuo-ku, Kobe-shi, 650-0047 Phone: +81-(0)78-940-5795, FAX +81-(0)78-304-4959 E-mail : helpdesk@hpci-office.jp 2) Mailing address RIST Kobe Center, Kobe Kimec Center Building 6F 1-5-2 Minatojima-minami-machi, Chuo-ku, Kobe-shi, 650-0047 Japan Phone: +81-(0)78-599-9511 22

Appendix 1: Classification of the application of the HPCI shared computational resources other than K computer and Upper Limit of Available Resources 1. Classification of the use of the HPCI System other than K computer From FY 2018, proposals for the HPCI System other than K computer are classified into two and screened in the respective classes: The L class for projects needing larger resources and the S class for projects needing smaller resources. The application form (Additional Sheet 1) has a section to fill in a class, so select a corresponding class with referring to the criteria for classification below. Criteria for classification: (a) Requesting only one of the HPCI System other than K computer (Pattern 1 and 2) Your project is classified into S class if your requesting resources do not exceed the upper limit of the S class written in the Appendix 2 HPCI Provided Resources. If not, it goes to the L class. (b) Requesting multiple systems of the HPCI System other than K computer (Pattern 3) First calculate the percentage of your requesting resources to the upper limit of S class for each system. If the total of the percentages does not exceed 100%, your project is classified as the S class. If not, it goes to the L class. e.g. 1) case of using the HPCI system A mainly and B for pre/post processing When the upper limit of S class is 200,000 node-hours (NH) in A and 100,000 NH in B, a project requests 190,000 NH for A and 10,000 NH for B. The total of the percentages becomes 105%. That is, your project is classified as L class. Total: 190,000/200,000 + 10,000/100,000 = 1.05 (= 105%) e.g. 2) case of using the HPCI system C first and using D after the stop of C When the upper limit of S class is 100,000 NH in C and 200,000 NH in D, a project requests 60,000 NH for C and 70,000 NH for D. The total of the percentages becomes 95%. That is, your project is classified as S class. Total: 60,000/100,000 + 70,000/200,000 = 0.95 (= 95%) 23

* The class should be indicated if you request the HPCI resources other than K computer, regardless of the order of the choices or whether to request K computer. * If your request corresponds to the case (a), the same class should be indicated for the both choices. If they are not the same class, the request will be considered as the L class. 2. Upper Limit of Available Resources To prevent oligopoly of computational resources, the following limits are set for the request for the HPCI computational resources other than K computer. (a) Requesting one HPCI system other than K computer (Pattern 1 and 2) - The requesting resources should not exceed the available resources written in Appendix 2 - In the case of Junior Researcher Promotion projects, the available resources is limited to the upper limit of S class (b) Concurrent use of multiple HPCI systems other than K computer (Pattern 3) - The requesting resources should not exceed the available resources. In addition, the percentage calculated in 1.(b) should not exceed 250%. - In the case of Junior Researcher Promotion projects, the available resources is limited to the upper limit of S class 24

Appendix 2: HPCI shared computational resources and Shared Storage in FY 2019 (as of Sep 4) (For K computer, please see [3] in the Proposal Preparation Instructions.) Glossary - Available resources: the amount of resources that one project can request. * If requesting multiple resources, see Appendix 1. - Upper limit of S class: The boundary value between the S class and the L class. - Gen: General projects - JRP: Junior Researcher Promotion projects - Ind: Industrial Use projects (Non-proprietary) The following information will be updated occasionally. Please refer to the latest information: http://www.hpci-office.jp/pages/e_h31_boshu_hpci_resource Resources of the HPCI System other than K computer (subject to a comprehensive screening, free of charge) NH...node-hours, NM...node-months, NY...node-years Common...common to Gen, Ind, and JRP Provider Resource Name Provided resources Conditions of Use Hokkaido University Supercomputer Grand Chariot (Subsystem A) [Xeon] Supercomputer Polaire (Subsystem B) [XeonPhi (KNL)] 320 nodes (983 TFLOPS) 12,800 cores 2,803,200 NH CPU: Xeon Gold 6148 2.4GHx / 20C x2 MEM: 384GB 3 TFLOPS/node 150 nodes (457 TFLOPS) 10,200 cores 1,314,000 NH CPU: Xeon Phi 7250 1.4GHz / 68C MEM: 96GB 3 TFLOPS/node 25 Shared use By the unit of 3 million node-seconds (833 NH), 15 million node-seconds (4,167 NH), 100 million node-seconds (27,778 NH), 250 million node-seconds (69,444 NH), max. 10 billion node-seconds (2,803,200 NH) Storage: 3TB unit, max. 960TB Gen & Ind: 876,000 NH (100 NY) JRP: 416,667 NH 416,667 NH Shared use By the unit of 3 million node-seconds (833 NH), 15 million node-seconds (4,167 NH), 100 million node-seconds (27,778 NH), 250 million nodeseconds (69,444 NH), max. 4,730 million nodeseconds (1,314,000 NH) Storage: 3TB unit, max. 450TB Gen & Ind: 876,000 NH (100 NY) JRP: 498,611 NH 498,611 NH

Provider Resource Name Provided resources Conditions of Use Tohoku University Supercomputer SX-ACE [SX] 2,560 nodes (About 707 TFLOPS) 10,240 cores 12,718,080 NH (First-half 7,188,480/ Second-half 5,529,600) 4PB Shared use with non-hpci users or Dedicated use By the unit of half a year (6 months) Up to 1,024 nodes Storage: 20TB per project (extension possible) Max. acceptable projects: 20 projects per halfyear CPU: Vector processor 1.06GHz / 4C MEM: 64GB 276 GFLOPS/node (Shared) Gen & Ind: JRP: (Dedicated) (Shared) (Dedicated) 1,412,000 NH 588,200 NH 260,000 NH 588,200 NH (yearly) 260,000 NH (yearly) Parallel computer LX 406Re-2 [Xeon] 68 nodes (About 31 TFLOPS) 1,632 cores 587,520 NH (First half 293,760/ Second half 293,760) 4PB Shared use with non-hpci users or Dedicated use By the unit of half a year (6 months) Up to 24 nodes Storage: 20TB per project (extension possible) Max. acceptable projects: 20 projects per halfyear CPU: Xeon E5-2695v2 2.4GHz / 12C x2 MEM:128GB 460.8 GFLOPS/node (Shared) 160,000 NH (common) (Dedicated) Gen & Ind: 160,000 NH JRP: 70,000 NH (Shared) 208,333 NH (yearly) *1 (Dedicated) 70,000 NH (yearly) University of Tsukuba Cygnus (tentative) [CPU + GPU] (scheduled) May. 2019 - (Scheduled) 24 nodes 190,080 NH 800TB 40 cores general-purpose CPU (x86 compatible) and 4 GPU. High-performance FPGA loaded on a part of the nodes Peak memory bandwidth: 1.5 TFLOPS (CPU: double precision) + 28 TFLOPS (GPU: double precision) + FPGA (200 K gate, single precision arithmetic hard IP) (Scheduled) Shared use among HPCI projects - Available nodes and usage structure will be different among General, Junior Researcher Promotion, and Industrial Use projects. -Max. acceptable projects: about 10 projects Gen: 50, 000 NH JRP & Ind: 10,000 NH 200,000 NH *1 26

Provider Resource Name Provided resources Conditions of Use JCAHPC Oakforest- PACS [Xeon Phi (KNL)] 1,600 nodes (4,872 TFLOPS) 108,800 cores 13,824,000 NH 1,600TB CPU: Xeon Phi 7250 1.4GHz / 68C MEM: 96GB 3.4 TFLOPS/node Shared use Group course, Providing unit: token (NH) Job size: up to 2,048 nodes Resources should be requested in multiples of 8 NY (69,120 NH). Gen: 1,728,000 NH (200 NY) JRP: 864,000 NH (100 NY) Ind: 1,036,800 NH (120 NY) 864,000 NH (100 NY) The University of Tokyo Reedbush-U [Xeon] 60 nodes (72.58 TFLOPS) 2,160 cores 518,400 NH 60TB Shared use Group course, Providing unit: token (NH) Job size: up to 128 nodes Resources should be requested by the unit of 4 NY (34,560 NH) CPU: Xeon E5-2695 v4 2.1GHz / 18C x2 MEM: 256GB 1.2 TFLOPS/node (common) 172,800 NH (20 NY) 518,400 NH (60 NY)*1 Reedbush-H [Xeon + GPU(Tesla)] 30 nodes (354.29 TFLOPS) 1,080 cores + GPU 60 slots 259,200 NH 120TB CPU: Xeon E5-2695 v4 2.1GHz / 18C x2 GPU: NVIDIA Tesla P100 x2 MEM: 256GB 11.8 TFLOPS/node Shared use Group course, Providing unit: token (NH) Job size: up to 32 nodes Resources should be requested by the unit of 1 NY (8,640 NH) Gen & JRP: 69,120 NH (8 NY) Ind: 34,560 NH (4 NY) 241,920 NH (28 NY) *1 Joint Center for Advanced High-Performance Computing (JCAHPC) is a computer center co-established by the Center for Computational Sciences at the University of Tsukuba (CCS), and the Information Technology Center at the University of Tokyo (ITC) 27

Provider Resource Name Provided resources Conditions of Use The University of Tokyo Reedbush-L [Xeon + GPU(Tesla)] 16 nodes (358.55 TFLOPS) 576 cores + GPU 64 slots 138,240 NH 64TB CPU: Xeon E5-2695 v4 2.1GHz / 18C x2 GPU: NVIDIA Tesla P100 x4 MEM:256GB 22.4 TFLOPS/node Shared use Group course, Providing unit: token (NH) Job size: up to 16 nodes Resources should be requested by the unit of 1 NY (8,640 NH) Gen & JRP: 69,120 NH (8 NY) Ind: 34,560 NH (4 NY) 138,240 NH (16 NY) *1 Oakbridge-II (tentative) [General purpose CPU] (Scheduled) Oct. 2019 - (Scheduled) 200 nodes 864,000 NH (Scheduled) Shared use Group course, Providing unit: token (NH) (common) 160,000 NH 480,000 NH *1 Tokyo Institute of Technology Cloudy, Big- Data and Green Supercomputer "TSUBAME3.0" [Xeon + GPU(Tesla)] 540 nodes (CPU 15,120 cores, 702 TFLOPS + GPU 2,160 slots, 11.45 PFLOPS), SUSE Linux Enterprise Server 12 SP2 Gen: 900,000 NH JRP: 100,000 NH Ind: 300,000 NH 3,000TB CPU: Xeon E5-2680v4 2.4GHz / 14C x2 GPU: NVIDIA Tesla P100 x4 MEM:256GB 22.5 TFLOPS/node Quarterly shared use. If all-year use is necessary, specify all the quarters (the first through the fourth). Requesting resources should be specified by the unit of 1,000NH. Storage: 1-300TB per project - The sum of resources for all quarters should not exceed the upper limit for a year. If exceeded, the resources for each quarter are reduced uniformly so that it is equal to the upper limit. - Storage is available per one-month period. 120 NH is subtracted from the allocated computational resources if 1TB is used for one year. Resources for each quarter need to be requested with taking this into account. Gen & Ind: 1 st -3 rd quarters: 75,000 NH each, 4 th quarter: 10,000 NH JRP: 1 st -3 rd quarters: 46,000 NH each, 4 th quarter: 6,000 NH 1 st -3 rd quarters: 46,000 NH each, 4 th quarter: 6,000 NH 28