NoC based virtualized accelerators as cloud services

2
HAL Id: hal-01821101 https://hal.archives-ouvertes.fr/hal-01821101 Submitted on 22 Jun 2018 HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. NoC based virtualized accelerators as cloud services Hiliwi Leake Kidane, El-Bay Bourennane To cite this version: Hiliwi Leake Kidane, El-Bay Bourennane. NoC based virtualized accelerators as cloud services. 11ème Colloque du GDR SoC-SiP, Jun 2016, Nantes, France. hal-01821101

Transcript of NoC based virtualized accelerators as cloud services

Page 1: NoC based virtualized accelerators as cloud services

HAL Id: hal-01821101https://hal.archives-ouvertes.fr/hal-01821101

Submitted on 22 Jun 2018

HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, estdestinée au dépôt et à la diffusion de documentsscientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et derecherche français ou étrangers, des laboratoirespublics ou privés.

NoC based virtualized accelerators as cloud servicesHiliwi Leake Kidane, El-Bay Bourennane

To cite this version:Hiliwi Leake Kidane, El-Bay Bourennane. NoC based virtualized accelerators as cloud services. 11èmeColloque du GDR SoC-SiP, Jun 2016, Nantes, France. �hal-01821101�

Page 2: NoC based virtualized accelerators as cloud services

RESEARCH POSTER PRESENTATION DESIGN © 2015

www.PosterPresentations.com

Hardware accelerators(HwAcc) provide good performance in computation intensive

applications. Integrating hardware accelerators in a cloud environment is the optimal way to

improve the quality of service. However, mapping all possible application statically into the

reconfigurable fabric of the FPGA is rather impractical and prohibitively expensive in terms of

resource and power consumption. This problem can be alleviated via time multiplexing the

access to the underlying hardware resources, FPGA, by designing dynamically reconfigurable

accelerators in the cloud. Similarly, the connection and communication between the accelerators

and the reconfigurable control will not be efficient without the use of Network-on-Chip (NoC).

In order to address these issues, we propose a NoC based virtualized accelerators for cloud

computing.

Abstract

OBJECTIVES

Reconfigurable IPs as a Service (RIPaaS)

In this service the user will not have direct access to the FPGA.

REFERENCES

1. F. Chen, Y. Shan, Y. Zhang, et al., “Enabling FPGAs in the cloud”, in Proceedings of the 11th

ACM Conf. on Computing Frontiers, ACM, 2014, p. 3.

2. S. Byma, J. G. Steffan, H. Bannazadeh, et al., “FPGAs in the Cloud: Booting Virtualized

Hardware Accelerators with OpenStack”, Field-Programmable Custom Computing Machines

(FCCM), 2014 IEEE 22nd Annual Int’l Symposium on, pp. 109–116, 2014.

3. J. Dondo Gazzano, F. Sanchez Molina, F. Rincon, et al., “Integrating reconfigurable

hardware-based grid for high performance computing”, The Scientific World Journal, 2015.

4. O. Knodel and R. G. Spallek, “RC3E : Provision and Management of Reconfigurable

Hardware Accelerators in a Cloud Environment,” 2015.

5. S. A. Fahmy, K. Vipin, and S. Shreejith, “Virtualized fpga accelerators for efficient cloud

computing,” in Cloud Computing Technology and Science (CloudCom), 2015 IEEE 7th

International Conference on, Nov 2015, pp. 430–435.

The main objective of this project is to integrate virtualized FPGA into cloud computing and

then propose two possible FPGA based cloud service:

1. Reconfigurable IPs as a Service (RIPaaS)

2. Reconfigurable Region as a Service(RRaaS)

LE2I, Université Bourgogne - Franche-Comté , Dijon, France

Hiliwi Leake Kidane, El-Bay Bourennane

METHOD

In recent years, it has been demonstrated that FPGA resources deployed in a cloud

environment can be accessed with the same Openstack software technology used to access

virtual machines

OpenStack is a cloud operating system that controls large pools of compute, storage, and

networking resources throughout a datacenter

Similar to the above VM, the FPGA can be virtualized using the DPR technique so that multi-

users cab share it in time multiplexing. The static region of the FPGA will be the Hypervisor..

The NoC will allow HWacc to communicate in parallel between each other and the control

manager. In addition, it is faster than OpenFlow, a software-defined networking (SDN) proposed

by [2] which is based on header matching

OpenStack

ControllerAPI

Server

Agent MB

vRR

R

R

R

R

R R

R

R

R

NI

vRR

NI

NI

vRR

NI

vRR

NI

vRR

NI

vRR

NI

vRR

NI

vRR

NI

Bitstream

LibraryAgent

Development

For

RRaaS

Client_IP.bit

Client Request for vRR

provider sends HDL

Template of selected vRR

Client sends own

implementation

Client selects vRR

provider sends List of

available vRR Client_IP.hdl

XST

Client_IP.ngc

TopLevel static.ngc

Xilinx PR Flow

BitGen

Client_IP.bit

Xilinx DPR design flow

Reconfigurable Region as a Service(RRaaS)

In this service, the user has access to the top-level of available virtualized reconfigurable region.

Development flow for RRaaS

OpenStack

ControllerAPI

Server

Agent

VMVM VM

Hypervisor User

Future works

•Extend the NoC into dynamically reconfigurable

•Implement application layer to access the resources from remote or provide the service for

remote users

•Deploye the NoC based virtualized accelerators into server and test via API

Conclusions

We have implemented a NoC based virtualized FPGA and tested locally to share the FPGA

resources on cloud context. Integration of hardware accelerators in the cloud improves

performance and computational efficiency. Moreover, the dynamic partial reconfigurable

accelerators save resources as underutilized accelerators share the same resources in time

multiplexing. The NoC provides a layered and scalable communication between accelerators.

Reconfig.

Region « A »

A3.bit

A2.bit

A1.bit

FPGA

Client Request for HWacc

Check availability

Check in BitS library

Dynamically reconfi.

Reject request &

recommend RRRunning

or idle

Ack & IP address

available

Figure 1. Basics of Partial reconfiguration and Cloud Computing

Figure 2. Virtual Machine service using Openstack

Figure 3. virtualized FPGA cloud services managed by Openstack

Figure 4. Flow diagram of HW accelerators as a service

Figure 5. Flow diagram of RRaaS

Application (SaaS)

Platform (PaaS)

Infrastructure(IaaS)

Compute Network

Database Object storage

communication Finance

end

end

NoC based virtualized accelerators as cloud services

Colloque SoC-SiP 2016Colloque SoC-SiP 2016

Colloque SoC-SiP 2016