Stack Exchange

Daniel Darabos

Budapest, Hungary

Engineer at Lynx Analytics

top accounts reputation activity favorites subscriptions
Top Questions
Top Answers
278
(Why) do we need to call cache or persist on a RDD
stackoverflow.com

96
What is a task in Spark? How does the Spark worker execute the jar file?
stackoverflow.com

56
Count number of rows in an RDD
stackoverflow.com

54
Which operations preserve RDD order?
stackoverflow.com

51
How to sort an RDD in Scala Spark?
stackoverflow.com

43
How can I connect to a postgreSQL database into Apache Spark using scala?
stackoverflow.com

42
Spark Context Textfile: load multiple files
stackoverflow.com

41
Defining Independent FlagSets in GoLang
stackoverflow.com

41
How to assign unique contiguous numbers to elements in a Spark RDD
stackoverflow.com

40
In Apache Spark, why does RDD.union not preserve the partitioner?
stackoverflow.com

36
Require kryo serialization in Spark (Scala)
stackoverflow.com

35
Does a join of co-partitioned RDDs cause a shuffle in Apache Spark?
stackoverflow.com

33
How to write the resulting RDD to a csv file in Spark python
stackoverflow.com

33
Modify collection inside a Spark RDD foreach
stackoverflow.com

29
Are there any important biographies of nobodies?
history.stackexchange.com

27
What can a company do against insiders going rogue and negatively affecting essential infrastructure?
security.stackexchange.com

27
Debugging “Managed memory leak detected” in Spark 1.6.0
stackoverflow.com

24
How to Define Custom partitioner for Spark RDDs of equally sized partition where each partition has equal number of elements?
stackoverflow.com

23
What is meant by “HDFS lacks random read and write access”?
stackoverflow.com

22
Apache Spark Moving Average
stackoverflow.com

22
Would Spark unpersist the RDD itself when it realizes it won't be used anymore?
stackoverflow.com

21
How to implement “Cross Join” in Spark?
stackoverflow.com

20
Spark RDD's - how do they work
stackoverflow.com

20
When specifying local[n1,n2,n3] for spark master, what are the three parameters?
stackoverflow.com

19
When are accumulators truly reliable?
stackoverflow.com

18
How to save DataFrame directly to Hive?
stackoverflow.com

17
What is the difference between an RDD partition and a slice?
stackoverflow.com

16
Write to multiple outputs by key Spark - one Spark job
stackoverflow.com

16
getting number of visible nodes in PySpark
stackoverflow.com

15
How to transpose an RDD in Spark
stackoverflow.com

1 2 3