Stack Exchange

Daniel Darabos

Budapest, Hungary

Engineer at Lynx Analytics

top accounts reputation activity bookmarks subscriptions
Top Questions
Top Answers
330
(Why) do we need to call cache or persist on a RDD
stackoverflow.com

115
What is a task in Spark? How does the Spark worker execute the jar file?
stackoverflow.com

69
Count number of rows in an RDD
stackoverflow.com

67
Which operations preserve RDD order?
stackoverflow.com

51
How to sort an RDD in Scala Spark?
stackoverflow.com

49
In Apache Spark, why does RDD.union not preserve the partitioner?
stackoverflow.com

47
Defining Independent FlagSets in GoLang
stackoverflow.com

45
How to assign unique contiguous numbers to elements in a Spark RDD
stackoverflow.com

45
How can I connect to a postgreSQL database into Apache Spark using scala?
stackoverflow.com

44
Spark Context Textfile: load multiple files
stackoverflow.com

43
Require kryo serialization in Spark (Scala)
stackoverflow.com

42
How to write the resulting RDD to a csv file in Spark python
stackoverflow.com

40
Does a join of co-partitioned RDDs cause a shuffle in Apache Spark?
stackoverflow.com

35
Modify collection inside a Spark RDD foreach
stackoverflow.com

32
How to save DataFrame directly to Hive?
stackoverflow.com

29
Debugging "Managed memory leak detected" in Spark 1.6.0
stackoverflow.com

29
Are there any important biographies of nobodies?
history.stackexchange.com

28
How to Define Custom partitioner for Spark RDDs of equally sized partition where each partition has equal number of elements?
stackoverflow.com

27
Would Spark unpersist the RDD itself when it realizes it won't be used anymore?
stackoverflow.com

27
What can a company do against insiders going rogue and negatively affecting essential infrastructure?
security.stackexchange.com

25
How to implement "Cross Join" in Spark?
stackoverflow.com

23
Apache Spark Moving Average
stackoverflow.com

23
What is meant by "HDFS lacks random read and write access"?
stackoverflow.com

22
When are accumulators truly reliable?
stackoverflow.com

21
How to detect CSS3 resize events
stackoverflow.com

20
Spark: Difference between Shuffle Write, Shuffle spill (memory), Shuffle spill (disk)?
stackoverflow.com

20
When specifying local[n1,n2,n3] for spark master, what are the three parameters?
stackoverflow.com

20
Spark RDD's - how do they work
stackoverflow.com

19
getting number of visible nodes in PySpark
stackoverflow.com

18
Low JDBC write speed from Spark to MySQL
stackoverflow.com

1 2 3 4