ClassLoading issue when running code using SparkSubmit

Description

When running the app using spark-submit the application can't find certain classes. It is caused by this code

When running the app using spark submit, we don't set the fallback class-loader and parent class-loader is used to load classes which are not defined in our custom repl. The parent class-loader is however system class loader which can't see the classes.

The fix is simple - we just need to pass context classloader to the interpreterClassloader

This is fix to this issue as well https://0xdata.atlassian.net/projects/SW/issues/SW-152?filter=allopenissues

Fixed

Assignee

Jakub Hava

Reporter

Jakub Hava

Labels

None

CustomerVisible

No

testcase 1

None

testcase 2

None

testcase 3

None

h2ostream link

None

Affected Spark version

None

AffectedContact

None

AffectedCustomers

None

AffectedPilots

None

AffectedOpenSource

None

Support Assessment

None

Customer Request Type

None

Support ticket URL

None

End date

None

Baseline start date

None

Baseline end date

None

Task progress

None

Task mode

None

ReleaseNotesHidden

None

Fix versions

Priority

Major