Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm...
Transcript of Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm...
![Page 1: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/1.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Lempel-Ziv-Markov Chain Algorithm Modeling using Models ofComputation and ForSyDe
10th Aerospace Technology Congress, Stockholm
Augusto Horita, Ricardo Bonna, Denis Loubach,Ingo Sander, Ingemar Söderquist
[email protected], [email protected], [email protected], [email protected], [email protected]
Advanced Computing, Control & Embedded Systems Laboratory / University of Campinas - UNICAMP
October 8-9, 2019
![Page 2: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/2.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Outline
1 Introduction
2 Background
3 Case Study
4 Summary
5 Acknowledgments
2/20
![Page 3: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/3.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Outline
1 Introduction
2 Background
3 Case Study
4 Summary
5 Acknowledgments
3/20
![Page 4: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/4.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Introduction
Aircraft data link optimization trough data compression
LZMA: widely used lossless compression algorithm (Benchmark by SPEC)
Model-Based Design (MBD) to cope with the avionics safety-critical systems standards(DO-331)
Synchronous dataflow: adequate to model the dataflow behavior of compression algorithms
4/20
![Page 5: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/5.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Introduction
We present the formal model and simulation of Lempel-Ziv Markov Chain algorithm(LZMA) using the synchronous dataflow (SDF) model of computation (MoC)
5/20
![Page 6: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/6.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Outline
1 Introduction
2 Background
3 Case Study
4 Summary
5 Acknowledgments
6/20
![Page 7: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/7.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Background
Model of Computation (MoC)According tagged signal model (TSM)1 framework, systems can be modeled as compositionsof processes acting on signals
Signal: a set of events ei = (ti, vi), which are elementary units of information composedby a tag ti ∈ T and a value vi ∈ V
Process: a set of possible relations between input signals SI and output signals SO.The set of output signals is given by the intersection between the input signals and theprocess SO = SI ∩ P
1Lee1998a. 7/20
![Page 8: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/8.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Background
Synchronous dataflow (SDF) MoC
Dataflows are untimed MoCs
Directed graphs where each node represents a process and each arc a signal path2
Each input and output port is associated with a token rate
An actor can fire only if the input signal paths have enough tokens to supply the amountneeded
2Lee1987a. 8/20
![Page 9: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/9.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Background
Lempel-Ziv Markov Chain Algorithm (LZMA)
Compression algorithm based on Lempel-Ziv 1977 (LZ77)3
Higher compression rate, faster decompression, controlled necessary memory4
Open source, implemented in many languages (C, C++, Java)
3Ziv1977a.4Salomon2007a. 9/20
![Page 10: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/10.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Background
LZMA
Input DataStream
UncompressedData
Delta Encoding Delta Decoding
Sliding
Dictionary
Encoding (LZ77)
Sliding
Dictionary
Decoding (LZ77)
Range Encoding Range Decoding
CompressedData
LZMA Flowchart5
5Leavline2013a.
10/20
![Page 11: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/11.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Outline
1 Introduction
2 Background
3 Case Study
4 Summary
5 Acknowledgments
11/20
![Page 12: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/12.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Lempel-Ziv-Markov Chain Modeling
LZMA formal model - SDF MoC
ForSyDe framework
It was used the following tools’ versions:
ForSyDe v3.3.2.0
Glasgow Haskell Compiler v8.0.1
12/20
![Page 13: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/13.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Lempel-Ziv-Markov Chain Modeling
Aswe Are
Sis 1 1 Sfc
[LZtok]
1 1
Hdr
Scs
1
[SWEFBtok]
1 1
[REFBtok]
1
LZMA SDF model
Inputs: stream to be compressed Sis
Processes: Aswe and Are
Output: compressed stream Scs
13/20
![Page 14: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/14.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Lempel-Ziv-Markov Chain Modeling
LZMA signatures and definitions
1 -- LZ (Sliding Window) Encoding actor definition2 -- Input is the lzma input stream Sis3 -- Output is the first step compressed stream Sfc4 lzA :: Signal Char -> Signal (Maybe (Maybe Int , Char))5 lzA Sis = Sfc6 where (Sfc , fb) = actor22SDF (1,1) (1,1) lzF Sis fb’7 fb ’ = delaySDF [([],"" ,0)] fb89 -- Range Encoding actor definition.10 -- Input is the first step compressed stream Sfc11 -- Output is the compressed LZMA stream output Scs12 rgA :: Signal (Maybe (Maybe Int , Char))13 -> Signal [Char]14 rgA sFc = sCs ’15 where (sCs ,sFb) = actor22SDF (1,1) (1,1) rangeFunc sFc sFb ’16 sCs ’ = delaySDF initHdr sCs17 sFb ’ = delaySDF [(rangeInit ,0, chr 0)] sFb18 initHdr = [([ dictsize] ++ [inpLen ])]19 inpLen = (intToDigit (lengthS sFc))
14/20
![Page 15: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/15.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Lempel-Ziv-Markov Chain Modeling
LZMA model process network
1 lzmaSdf :: Signal Char -> Signal [Char]2 lzmaSdf sLzmaIs = sLzmaOut3 where sLzmaOut = rgA (lzA sLzmaIs)
Input: sLzmaIsProcess: lzmaSdfOutput: sLzmaOut
15/20
![Page 16: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/16.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Outline
1 Introduction
2 Background
3 Case Study
4 Summary
5 Acknowledgments
16/20
![Page 17: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/17.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Summary
Our paper presented
a simplified LZMA modeling based on the SDF MoC using the ForSyDe framework
Some configurations and behaviors assumptions were adopted towards the definition of actorsports fixed token rates
Future work: model LZMA based on the scenario-aware dataflow (SADF) MoC, which supportsvariable token rates
17/20
![Page 18: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/18.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Outline
1 Introduction
2 Background
3 Case Study
4 Summary
5 Acknowledgments
18/20
![Page 19: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/19.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack
Acknowledgments
Research Development Foundation (Fundacao de Desenvolvimento da Pesquisa) -FUNDEP/MCTIC/MDIC
19/20
![Page 20: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,](https://reader033.fdocuments.us/reader033/viewer/2022051815/6040bca82b54950515343780/html5/thumbnails/20.jpg)
FT 2019
Bonna, R.
Introduction
Background
Case Study
Summary
Ack Thank you for your attention
Email: [email protected] page: http://www.fem.unicamp.br/∼acceslab/
20/20