Large Models’ Training Lab to Accelerate AI Research

Open Date:

29/12/2024

Deadline for Submission:

06/03/2025

Time zone:

Israel
Large model training lab_480x300

Summary:

One of the main areas of activity of the National Program for Artificial Intelligence is the creation and accessibility of computing infrastructures for the benefit of the research and development community in Israel. Within this framework, a request for information (RFI) was issued in October 2021, which was jointly prepared by the Innovation Authority and the Directorate of Development of Technological Means and Infrastructures at the Ministry of Defense (MAFAT). From the responses collected and further extensive work, it was decided to establish three complementary computing infrastructures:

  1. Infrastructure for accelerating artificial intelligence (AI) research, through training large models;
  2. Infrastructure for testing and developing supercomputing technologies;
  3. Research infrastructure in the field of scientific computing.

Program Description

This call is intended for the establishment and operation of large-models’ training lab to accelerate research in artificial intelligence(AI). The lab will provide R&D services to Israeli corporations and/or Israeli research institutions. It should be noted that the goal of the R&D lab is not to replace existing infrastructures and cloud services in Israel, but rather add value and new capabilities that cannot be implemented today in existing R&D infrastructures, at a relevant financial cost-effective scale to users while still offering performance that meets the needs, as detailed below.

We invite applications to establish such lab as well as to provide supporting services to laboratory users. The proposed lab will focus on training large models, and the supporting services will be aimed at enabling optimal use of the infrastructure as part of research and development processes in the field of artificial intelligence. These services may include, among other things”

  • Assistance in the preparation, optimization, and accessibility of data,
  • Planning of model training processes, and methods for analyzing results.

The services will be provided by R&D lab employees, who will have expertise in machine learning, statistics, programming, and information systems, with the goal of creating solutions in the field of artificial intelligence.

Financial Support 

The total grant for an approved application under this process will be up to NIS 160 million for the approved program period, with the grant rate being 55% or 66% of the approved budget, as detailed in the benefit program. 

Criteria

The establishment and/or access of an R&D lab in the State of Israel used to train large-volume models should feature the following: A volume of at least 1,000 accelerators (GPUs), with a minimum of a single accelerator performance being 60 teraFLOPS at a precision level of 32FP, 80GB internal memory, 2 Tbit/s bandwidth, and an effective clock speed of 1,500 MHz (or the total processing capacity of the computer with an equivalent accelerator composition in terms of processing power, processing speed, bandwidth and memory) in performing large model training throughout the entire program period.

Examples of possible accelerators currently available on the market that meet the above requirements (the following examples do not constitute a closed or exhaustive list of possible accelerators that meet the requirements detailed above, rather are intended for the convenience of readers only):

  • AMD – MI300X OAM
  • INTEL – Intel Gaudi 3 AI
  • NVIDIA – SXMH100

The lab’s infrastructure must include:

  • Required hardware,
  • Required software,
  • Required service, including communication solutions, storage infrastructure, cooling infrastructure, scheduler software and management and control tools for users who will contact the R&D laboratory to use it to train a new large model or adjust an existing large model, as a single service or as part of a package of services.

In addition, the use of the aforementioned accelerators will be provided to eligible customers at a discount from the market price, all as detailed below.

 

Application Process

  1. Applications can be submitted by March 6th, 2024, at 12:00 noon (IST). Applications submitted after this deadline will not be
  2. Queries may be e-mailed to yaelh@innovationisrael.org.il prior to the webinar which will take place on January 20, 2024 at 10:00 (Israel Time).

For additional information, please contact:

Name: Yael Hay-Knobel
Position: Head of R&D Infrastructure Department
Organization: Israel Innovation Authority
Name: Zvi Goltzman
Position: Deputy Head of the National Program for AI at Israel Innovation Authority, Semiconductors Sector Lead
Organization: Israel Innovation Authority