Stack Exchange

javadba

Mountain View, CA

Scala/Spark developer since 2013 and Hadoop/Map-Reduce/Hive/HBase since 2011. My focus has been on data pipelines and machine learning apps. In a prior life I was a Java and databases developer for server side multithreaded and distributed applications.

top accounts reputation activity subscriptions

Top Questions

Homebrew cask option not recognized?

homebrew homebrew-cask asked May 23, 2015 at 14:05

stackoverflow.com

How to display hidden files with Visual Studio Code

macos visual-studio-code asked Oct 16, 2017 at 22:23

stackoverflow.com

IntelliJ how to zoom in / out

intellij-idea zoom asked Jun 30, 2013 at 0:20

stackoverflow.com

Tables in Markdown (in Jupyter)

markdown jupyter asked Feb 7, 2018 at 4:02

stackoverflow.com

When/how does a topic "marked for deletion" get finally removed?

apache-kafka kafka asked Jun 1, 2014 at 4:05

stackoverflow.com

Error running basic tensorflow example

python ubuntu tensorflow asked Mar 12, 2016 at 2:55

stackoverflow.com

How to convert a DataFrame back to normal RDD in pyspark?

python apache-spark pyspark asked Mar 12, 2015 at 1:36

stackoverflow.com

"Could not load dynamic library 'libcudnn.so.8'" when running tensorflow on ubuntu 20.04

python tensorflow asked Apr 6, 2021 at 22:23

stackoverflow.com

Where is the history file for ipython

python ipython asked Jun 3, 2015 at 19:52

stackoverflow.com

Create hive table using "as select" or "like" and also specify delimiter

hive sql-like create-table asked Mar 7, 2014 at 12:10

stackoverflow.com

Top Answers

Is it possible to get the current spark context settings in PySpark?

stackoverflow.com

Number of partitions in RDD and performance in Spark

stackoverflow.com

How are stages split into tasks in Spark?

stackoverflow.com

How to set Master address for Spark examples from command line

stackoverflow.com

How to restore default layout for intellij Run/Debug window/tabs?

stackoverflow.com

Show partitions on a pyspark RDD

stackoverflow.com

Pythonic way to combine for-loop and if-statement

stackoverflow.com

How to match a string, but case-insensitively?

stackoverflow.com

Recursively fetch file contents from subdirectories using sc.textFile

stackoverflow.com

How to install sbt on ubuntu/debian with apt-get

stackoverflow.com

Neo4j sharding aspect

stackoverflow.com

How to run a single test in scalatest from maven

stackoverflow.com

How to check if collection contains any element from other collection in Scala?

stackoverflow.com

How to create a Spark Dataset from an RDD

stackoverflow.com

Why is "abstract override" required not "override" alone in subtrait?

stackoverflow.com

Json serialization error using matplotlib mpld3 with LinkedBrush

stackoverflow.com

How to run a Scala script within IntelliJ IDEA?

stackoverflow.com

Hive command to execute NOT IN clause

stackoverflow.com

Strange behavior within MS Word: using Command-Shift-L launches Safari sometimes

apple.stackexchange.com

Addition of two RDD[mllib.linalg.Vector]'s

stackoverflow.com

How to convert a Scala Array to ArrayBuffer?

stackoverflow.com

How to sort an RDD in Scala Spark?

stackoverflow.com

Hadoop DistCp using wildcards?

stackoverflow.com

Why does Spark fail with java.lang.OutOfMemoryError: GC overhead limit exceeded?

stackoverflow.com

What do columns ‘rawPrediction’ and ‘probability’ of DataFrame mean in Spark MLlib？

stackoverflow.com

Test accuracy is greater than train accuracy what to do?

stackoverflow.com

Spark : check your cluster UI to ensure that workers are registered

stackoverflow.com

Multiple table join in hive

stackoverflow.com

UnsatisfiedLinkError: no snappyjava in java.library.path when running Spark MLLib Unit test within Intellij

stackoverflow.com

Is there a 'foreach' function in Python 3?

stackoverflow.com