Paralell collections in Scala

15
Parallel collections i Scala 2.9 Alf Kristian Støyle Know IT Objectnet

Transcript of Paralell collections in Scala

Page 1: Paralell collections in Scala

Parallel collections iScala 2.9Alf Kristian Støyle

Know IT Objectnet

Page 2: Paralell collections in Scala

http://www.nassaulibrary.org/ncla/nclacler_files/LILC7.JPG

http://www.nassaulibrary.org/ncla/nclacler_files/LILC7.JPG
http://www.nassaulibrary.org/ncla/nclacler_files/LILC7.JPG
Page 3: Paralell collections in Scala

http://schoolchat.wordpress.com/2008/04/22/keeping-pollution-levels-low/

http://schoolchat.files.wordpress.com/2008/04/22/keeping-pollution-levels-low/
http://schoolchat.files.wordpress.com/2008/04/22/keeping-pollution-levels-low/
Page 4: Paralell collections in Scala

Embarrassingly parallel

Page 5: Paralell collections in Scala

Fork/Join

Page 6: Paralell collections in Scala

Work stealing

Page 7: Paralell collections in Scala

Double-ended queue - deque

Page 8: Paralell collections in Scala

Double-ended queue - deque

Page 9: Paralell collections in Scala

Double-ended queue - deque

Page 10: Paralell collections in Scala

val persons: List[Person] = ...val (kids, adults) = persons.partition(_.age < 18)

Page 11: Paralell collections in Scala

val paralellList = List(1, 2, 3).par

Page 12: Paralell collections in Scala

val paralellList = List(1, 2, 3)

val sequentialList = paralellList.seq

.par

Page 13: Paralell collections in Scala

• parallel arrays - scala.collection.parallel.mutable.ParArray • parallel ranges - scala.collection.parallel.immutable.ParRange • parallel hash maps - scala.collection.parallel.mutable.ParHashMap • parallel hash sets - scala.collection.parallel.mutable.ParHashSet • parallel hash tries - scala.collection.parallel.immutable.{ParHashMap, ParHashSet} • parallel vectors - scala.collection.parallel.immutable.ParVector

http://www.scala-lang.org/node/8976

http://w
http://w
Page 14: Paralell collections in Scala

REPL demo(https://gist.github.com/919224)

https://gist.github.com/919224
https://gist.github.com/919224
Page 15: Paralell collections in Scala

Q & A


Paralell Computing

Paralell Computing

Data types and Variables - polito.itdbdmg.polito.it/wordpress/wp-content/uploads/2017/05/02-scala_par… · Variables •[private] var ... Collections and complex data types in Scala

Data types and Variables - polito.itdbdmg.polito.it/wordpress/wp-content/uploads/2017/05/02-scala_par… · Variables •[private] var ... Collections and complex data types in Scala

Are you ready for functional programming JavaScript vs. Scala · Functions as first-class objects and data collections. ... Why Scala? Cuts down the boilerplate Tightly fuses object-oriented

Are you ready for functional programming JavaScript vs. Scala · Functions as first-class objects and data collections. ... Why Scala? Cuts down the boilerplate Tightly fuses object-oriented

Big Data Analysis with Scala and Spark Heather Miller€¦ · Recall transformers and accessors from Scala sequential and parallel collections. Transformations and Actions Recall

Big Data Analysis with Scala and Spark Heather Miller€¦ · Recall transformers and accessors from Scala sequential and parallel collections. Transformations and Actions Recall

Bond Anti-Corruption Group Paralell Report to UNCAC

Bond Anti-Corruption Group Paralell Report to UNCAC

SCALA: ECONOMIC EMPOWERMENT OF LOW … EN/SCALA-Call... · SCALA: ECONOMIC EMPOWERMENT OF LOW-INCOME POPULATIONS CALL FOR THE DEVELOPMENT OF THE SCALA KNOWLEDGE OBSERVATORY: SCALA

SCALA: ECONOMIC EMPOWERMENT OF LOW … EN/SCALA-Call... · SCALA: ECONOMIC EMPOWERMENT OF LOW-INCOME POPULATIONS CALL FOR THE DEVELOPMENT OF THE SCALA KNOWLEDGE OBSERVATORY: SCALA

Spring scala - Sneaking Scala into your corporation

Spring scala - Sneaking Scala into your corporation

Scala Days 2018 You Are a - Lightbend...scala/scala-parallel-collections scala/scala-collection-compat scala/scala-java8-compat scala/scala-swing scala/scala-async scala/scala-continuations

Scala Days 2018 You Are a - Lightbend...scala/scala-parallel-collections scala/scala-collection-compat scala/scala-java8-compat scala/scala-swing scala/scala-async scala/scala-continuations

Scala By Example - The Scala Programming Language

Scala By Example - The Scala Programming Language

Scala Concurrency and Parallel Collections › ... › content › 1 › lecture9.pdf · Scala Parallel Collections Scala Parallel Collections To make this code parallel, we can just

Scala Concurrency and Parallel Collections › ... › content › 1 › lecture9.pdf · Scala Parallel Collections Scala Parallel Collections To make this code parallel, we can just

Scala 2.8 Collections

Scala 2.8 Collections

Scala collections wizardry - Scalapeño

Scala collections wizardry - Scalapeño

scala-gopher: async implementation of CSP for scala

scala-gopher: async implementation of CSP for scala

Fundamentos de Scala (Scala Basics) (español) Catecbol

Fundamentos de Scala (Scala Basics) (español) Catecbol

Scala like distributed collections - dumping time-series data with apache spark

Scala like distributed collections - dumping time-series data with apache spark

XML PROCESSING WITH SCALA AND YAIDOM€¦ · INTRODUCING SCALA HIGHER-ORDER FUNCTIONS Scala has a rich Collections API The most commonly used collections are immutable Typically,

XML PROCESSING WITH SCALA AND YAIDOM€¦ · INTRODUCING SCALA HIGHER-ORDER FUNCTIONS Scala has a rich Collections API The most commonly used collections are immutable Typically,

Bootstrapping a Scala Mindset (Scala eXchange 2014)

Bootstrapping a Scala Mindset (Scala eXchange 2014)

Parallel Machine Learning Implementations in ScalaThe Scala parallel collections were introduced in Scala 2.9.0. They are composed ofaparallelcounterpart to“classical” sequential

Parallel Machine Learning Implementations in ScalaThe Scala parallel collections were introduced in Scala 2.9.0. They are composed ofaparallelcounterpart to“classical” sequential

Scala 55 Connect - linoleum-design-boden.de · The Scala Connect Underlayment is a perfect addition to the Scala Connect collections of DLW Flooring. Together with the Scala Connect

Scala 55 Connect - linoleum-design-boden.de · The Scala Connect Underlayment is a perfect addition to the Scala Connect collections of DLW Flooring. Together with the Scala Connect

Scala eXchange: Building robust data pipelines in Scala

Scala eXchange: Building robust data pipelines in Scala