4. current community

    your communities

    more stack exchange communities

    company blog

Stack Exchange

Daniel Darabos

Budapest, Hungary

Engineer at Lynx Analytics

top accounts reputation activity favorites subscriptions
Top Questions
Top Answers
259
(Why) do we need to call cache or persist on a RDD
stackoverflow.com

87
What is a task in Spark? How does the Spark worker execute the jar file?
stackoverflow.com

55
Count number of rows in an RDD
stackoverflow.com

51
Which operations preserve RDD order?
stackoverflow.com

51
How to sort an RDD in Scala Spark?
stackoverflow.com

43
How can I connect to a postgreSQL database into Apache Spark using scala?
stackoverflow.com

42
Spark Context Textfile: load multiple files
stackoverflow.com

40
In Apache Spark, why does RDD.union not preserve the partitioner?
stackoverflow.com

39
How to assign unique contiguous numbers to elements in a Spark RDD
stackoverflow.com

38
Defining Independent FlagSets in GoLang
stackoverflow.com

33
Modify collection inside a Spark RDD foreach
stackoverflow.com

33
Does a join of co-partitioned RDDs cause a shuffle in Apache Spark?
stackoverflow.com

33
How to write the resulting RDD to a csv file in Spark python
stackoverflow.com

32
Require kryo serialization in Spark (Scala)
stackoverflow.com

27
What can a company do against insiders going rogue and negatively affecting essential infrastructure?
security.stackexchange.com

25
Debugging “Managed memory leak detected” in Spark 1.6.0
stackoverflow.com

22
How to Define Custom partitioner for Spark RDDs of equally sized partition where each partition has equal number of elements?
stackoverflow.com

22
What is meant by “HDFS lacks random read and write access”?
stackoverflow.com

21
Would Spark unpersist the RDD itself when it realizes it won't be used anymore?
stackoverflow.com

20
Apache Spark Moving Average
stackoverflow.com

20
How to implement “Cross Join” in Spark?
stackoverflow.com

20
Spark RDD's - how do they work
stackoverflow.com

19
When specifying local[n1,n2,n3] for spark master, what are the three parameters?
stackoverflow.com

17
When are accumulators truly reliable?
stackoverflow.com

17
How to save DataFrame directly to Hive?
stackoverflow.com

17
What is the difference between an RDD partition and a slice?
stackoverflow.com

15
Write to multiple outputs by key Spark - one Spark job
stackoverflow.com

15
How to transpose an RDD in Spark
stackoverflow.com

15
getting number of visible nodes in PySpark
stackoverflow.com

14
java+spark: org.apache.spark.SparkException: Job aborted: Task not serializable: java.io.NotSerializableException
stackoverflow.com

1 2 3