Tour
About Us
Meta
Loading…
Log in
current community
Stack Exchange
chat
Meta Stack Exchange
your communities
Sign up
or
log in
to customize your list.
more stack exchange communities
company blog
Stack Exchange
All Sites
Top Users
Digests
Daniel Darabos
Budapest, Hungary
Engineer at Lynx Analytics
top
accounts
reputation
activity
bookmarks
subscriptions
Top Questions
32
votes
Debugging “Managed memory leak detected” in Spark 1.6.0
apache-spark
asked Dec 18 '15 at 15:45
stackoverflow.com
19
votes
Accessing Spark SQL RDD tables through the Thrift Server
apache-spark
apache-spark-sql
asked Nov 24 '14 at 15:56
stackoverflow.com
13
votes
Fast Parquet row count in Spark
apache-spark
parquet
asked Nov 16 '16 at 10:15
stackoverflow.com
12
votes
Downloading file from the right Apache Mirror with wget
url
download
asked Jul 26 '16 at 14:13
stackoverflow.com
11
votes
Make YARN clean up appcache before retry
apache-spark
yarn
asked Aug 18 '15 at 21:18
stackoverflow.com
9
votes
Find close pairs in very high dimensional space with sparse vectors
algorithms
high-dimensional
asked Sep 10 '15 at 20:58
stats.stackexchange.com
8
votes
Get all Apache Spark executor logs
apache-spark
asked May 14 '15 at 9:52
stackoverflow.com
7
votes
How to set the number of partitions for newAPIHadoopFile?
hadoop
apache-spark
asked Aug 22 '14 at 7:14
stackoverflow.com
7
votes
“borrowed value does not live long enough” with a generic function that returns impl trait
generics
rust
borrow-checker
asked Sep 17 '19 at 14:05
stackoverflow.com
6
votes
How to tell amount of usable memory in executors
apache-spark
asked Mar 11 '15 at 12:12
stackoverflow.com
1
2
next
Top Answers
315
(Why) do we need to call cache or persist on a RDD
stackoverflow.com
107
What is a task in Spark? How does the Spark worker execute the jar file?
stackoverflow.com
66
Count number of rows in an RDD
stackoverflow.com
63
Which operations preserve RDD order?
stackoverflow.com
51
How to sort an RDD in Scala Spark?
stackoverflow.com
46
In Apache Spark, why does RDD.union not preserve the partitioner?
stackoverflow.com
45
How can I connect to a postgreSQL database into Apache Spark using scala?
stackoverflow.com
45
How to assign unique contiguous numbers to elements in a Spark RDD
stackoverflow.com
43
Spark Context Textfile: load multiple files
stackoverflow.com
42
Defining Independent FlagSets in GoLang
stackoverflow.com
42
Require kryo serialization in Spark (Scala)
stackoverflow.com
39
How to write the resulting RDD to a csv file in Spark python
stackoverflow.com
38
Does a join of co-partitioned RDDs cause a shuffle in Apache Spark?
stackoverflow.com
35
Modify collection inside a Spark RDD foreach
stackoverflow.com
29
Are there any important biographies of nobodies?
history.stackexchange.com
29
Debugging “Managed memory leak detected” in Spark 1.6.0
stackoverflow.com
28
How to save DataFrame directly to Hive?
stackoverflow.com
27
What can a company do against insiders going rogue and negatively affecting essential infrastructure?
security.stackexchange.com
26
Would Spark unpersist the RDD itself when it realizes it won't be used anymore?
stackoverflow.com
26
How to Define Custom partitioner for Spark RDDs of equally sized partition where each partition has equal number of elements?
stackoverflow.com
23
What is meant by “HDFS lacks random read and write access”?
stackoverflow.com
23
How to implement “Cross Join” in Spark?
stackoverflow.com
22
Apache Spark Moving Average
stackoverflow.com
20
Spark RDD's - how do they work
stackoverflow.com
20
When specifying local[n1,n2,n3] for spark master, what are the three parameters?
stackoverflow.com
20
When are accumulators truly reliable?
stackoverflow.com
18
getting number of visible nodes in PySpark
stackoverflow.com
17
How to detect CSS3 resize events
stackoverflow.com
17
What is the difference between an RDD partition and a slice?
stackoverflow.com
17
What are the cons of stateless password generators?
security.stackexchange.com
1
2
3
next
Stack Exchange works best with JavaScript enabled