Stack Exchange

Daniel Darabos

Budapest, Hungary

Engineer at Lynx Analytics

top accounts reputation activity bookmarks subscriptions
Top Questions
Top Answers
315
(Why) do we need to call cache or persist on a RDD
stackoverflow.com

107
What is a task in Spark? How does the Spark worker execute the jar file?
stackoverflow.com

66
Count number of rows in an RDD
stackoverflow.com

63
Which operations preserve RDD order?
stackoverflow.com

51
How to sort an RDD in Scala Spark?
stackoverflow.com

46
In Apache Spark, why does RDD.union not preserve the partitioner?
stackoverflow.com

45
How can I connect to a postgreSQL database into Apache Spark using scala?
stackoverflow.com

45
How to assign unique contiguous numbers to elements in a Spark RDD
stackoverflow.com

43
Spark Context Textfile: load multiple files
stackoverflow.com

42
Defining Independent FlagSets in GoLang
stackoverflow.com

42
Require kryo serialization in Spark (Scala)
stackoverflow.com

39
How to write the resulting RDD to a csv file in Spark python
stackoverflow.com

38
Does a join of co-partitioned RDDs cause a shuffle in Apache Spark?
stackoverflow.com

35
Modify collection inside a Spark RDD foreach
stackoverflow.com

29
Are there any important biographies of nobodies?
history.stackexchange.com

29
Debugging “Managed memory leak detected” in Spark 1.6.0
stackoverflow.com

28
How to save DataFrame directly to Hive?
stackoverflow.com

27
What can a company do against insiders going rogue and negatively affecting essential infrastructure?
security.stackexchange.com

26
Would Spark unpersist the RDD itself when it realizes it won't be used anymore?
stackoverflow.com

26
How to Define Custom partitioner for Spark RDDs of equally sized partition where each partition has equal number of elements?
stackoverflow.com

23
What is meant by “HDFS lacks random read and write access”?
stackoverflow.com

23
How to implement “Cross Join” in Spark?
stackoverflow.com

22
Apache Spark Moving Average
stackoverflow.com

20
Spark RDD's - how do they work
stackoverflow.com

20
When specifying local[n1,n2,n3] for spark master, what are the three parameters?
stackoverflow.com

20
When are accumulators truly reliable?
stackoverflow.com

18
getting number of visible nodes in PySpark
stackoverflow.com

17
How to detect CSS3 resize events
stackoverflow.com

17
What is the difference between an RDD partition and a slice?
stackoverflow.com

17
What are the cons of stateless password generators?
security.stackexchange.com

1 2 3