Monday, February 11, 2019

PySpark - getNumPartitions


It is easy to find the no of partitons in RDD , this can be achieved by using the getnumberPartition() method. We will see the following by writing a simple code :-

In the above example , we are checking the number of partitions and we can see that in both the cases the number of partitions are 1.

No comments:

Post a Comment

Delta Lake - Time Travel

  Time Travel allows you to query, restore, or compare data from a previous version of a Delta table. Delta Lake automatically keeps tra...