Transformations and Actions in PySpark

Transformations and Actions in PySpark

Below are the Transformations and Actions available in the PySpark.

S.No.TransformationAction
1map( )collect( )
2flatmap( )take( )
3filter( )takeordered( )
4distinct( )top( )
5union( )first( )
6intersection( )count( )
7substract( )countByvalue( )
8join( )min( )
9cartesian( )max( )
10mean( )
11stddev( )
12stats( )
13groupByKey( )
14reduceByKey( )reduce( )
15sortBy( )fold( )
16sortByKey( )
17
18
19saveAsTextfile()
20coalesce( )
21repartition( )
22partitionBy( )
23
24zip( )
25zipwithIndex( )
26
27keys( )
28values( )
29mapValues( )foreach( )

Leave a Reply