2023-05853 - PhD Position F/M Dynamic Parallelization of Sparse Codes for Machine Learning and High-Performance Computing
Contract type : Fixed-term contract
Level of qualifications required : Graduate degree or equivalent
Fonction : PhD PositionAbout the research centre or Inria department
The Inria research centre in Lyon (previously the Lyon branch of the Inria centre in Grenoble) is the 9th Inria research centre, formally created in December 2021. It brings together approximately 270 people (including 110 Inria employees) in 15 research teams and research support services.
Its staff are distributed at this stage on 2 campuses: in Villeurbanne La Doua (Centre / INSA Lyon / UCBL) on the one hand, and Lyon Gerland (ENS de Lyon) on the other. A third site should be opened in the course of 2022. The teams are mainly hosted with our partners. The centre's teams work closely with research and higher education institutions (ENS de Lyon, UCBL, INSA Lyon, etc.), their laboratories, and other research organisations in Lyon (CNRS, INRAE, competitiveness clusters, etc.), but also with Lyon and regional economic players. Many international collaborations are also underway.
The Lyon centre is active in the fields of software, distributed and high- performance computing, embedded systems, quantum computing and privacy in the digital world, but also in digital health and computational biology.Context
This PhD thesis will be held at Inria Lyon, located at LIP laboratory (ENS de Lyon), France in collaboration with :
LIP is a renewed French research laboratory covering a wide spectrum of key topics of computer and information sciences as well as on various inter- disciplinary initiatives. LIP main strength is the creative interaction between long-term fundamental research, innovative software/hardware design and shorter-term projects/transfers through industrial collaborations.Assignment
Since the early days of parallel computing, industry is pushing towards programming models, languages and compilers to help the programmer in the tedious task to parallelize a program. Automatic parallelisation focuses on programming automatically parallel computers from a sequential specification. In the past decades, a general unified framework, the polyhedral model , was designed to solve that problem for regular loop kernels manipulating dense tensors (arrays). With the polyhedral model, compilers may reason about programs at iteration-level, giving rise to powerful automatic parallelization algorithms. However, most kernels of interest (high-performance computing, machine learning) manipulate sparse tensors.
The overall goal of this PhD thesis is to extend the scope of automatic parallelization to sparse tensors.Main activities
Specifically, this PhD thesis will investigate how to delay the optimization of sparse code at runtime when the sparse structure is known. Given the dense specification, we aim at producing a code able to specialize itself on the input sparse structure, resulting in a parallel code using state-of-the art linear algebra libraries }. Many issues and trade- offs must be investigated. To quote a few:
The PhD student will address all these questions and validate his approach on scientific benchmarks by using sparse tensors from the Florida sparse matrix collection; as well as machine learning applications.Skills
Notions in compilers, parallelism, parallel architectures. Experience with C++.Benefits package
1st and 2nd year: 2 051 euros gross salary /month
3rd year: 2 158 euros gross salary / monthGeneral Information
Theme/Domain : Architecture, Languages and Compilation Scientific computing (BAP E)
Town/city : Lyon
Inria is the French national research institute dedicated to digital science and technology. It employs 2,600 people. Its 200 agile project teams, generally run jointly with academic partners, include more than 3,500 scientists and engineers working to meet the challenges of digital technology, often at the interface with other disciplines. The Institute also employs numerous talents in over forty different professions. 900 research support staff contribute to the preparation and development of scientific and entrepreneurial projects that have a worldwide impact.Instruction to apply
Applications must be submitted online on the Inria website.
Processing of applications sent by other channels is not guaranteed.
Defence Security : This position is likely to be situated in a restricted area (ZRR), as defined in Decree No. 2011-1425 relating to the protection of national scientific and technical potential (PPST).Authorisation to enter an area is granted by the director of the unit, following a favourable Ministerial decision, as defined in the decree of 3 July 2012 relating to the PPST. An unfavourable Ministerial decision in respect of a position situated in a ZRR would result in the cancellation of the appointment.
Recruitment Policy : As part of its diversity policy, all Inria positions are accessible to people with disabilities.
Warning : you must enter your e-mail address in order to save your application to Inria. Applications must be submitted online on the Inria website. Processing of applications sent from other channels is not guaranteed.