Skip to main content

Stack Exchange

Alexandros Biratsis

Amsterdam, Netherlands

top accounts reputation activity subscriptions
Top Questions
No questions with score of 5 or more
Top Answers
18
Compare two dataframes Pyspark
stackoverflow.com

18
Selecting only numeric/string columns names from a Spark DF in pyspark
stackoverflow.com

11
Pyspark: Create Schema from Json Schema involving Array columns
stackoverflow.com

11
How to check if array column is inside another column array in PySpark dataframe
stackoverflow.com

11
Does pyspark changes order of instructions for optimization?
stackoverflow.com

10
Find a character index in string in spark sql
stackoverflow.com

9
How to add leading zero padding with the specified number of digits in scala spark?
stackoverflow.com

9
Pyspark - Looping through structType and ArrayType to do typecasting in the structfield
stackoverflow.com

7
How to convert nested JSON to map object in scala
stackoverflow.com

7
How to check if a Hive table exists using PySpark
stackoverflow.com

7
Dealing with non-uniform JSON columns in spark dataframe
stackoverflow.com

7
How can I convert all decimal columns in a Scala data frame to double type?
stackoverflow.com

6
How to create an unique autogenerated Id column in a spark dataframe
stackoverflow.com

6
Import a GitHub repo into Databricks community edition
stackoverflow.com

6
Initializing a dictionary in python with a key value and no corresponding values
stackoverflow.com

5
How to handle data skew in the spark data frame for outer join
stackoverflow.com

5
howto add hive properties at runtime in spark-shell
stackoverflow.com

5
Spark 2.2 Join fails with huge dataset
stackoverflow.com

5
when is it not performance practical to use persist() on a spark dataframe?
stackoverflow.com

5
Schema comparison of two dataframes in scala
stackoverflow.com

5
Merge Maps in scala dataframe
stackoverflow.com

5
Convert a JSON string to a struct column without schema in Spark
stackoverflow.com