Improve hint description for disabling automatic usage of broadcast joins

Description

{{We recommend to disable them by
configuring `spark.sql.autoBroadcastJoinThreshold` variable to value `-1`:
sqlContext.sql("SET spark.sql.autoBroadcastJoinThreshold=-1")}}

Configuring spark settings via SQL context is considered to be legacy. All settings should be configured via SparkSession.Builder.

Activity

Show:
Marek Novotny
April 5, 2019, 11:31 AM

Yes, that was my original plan

Jakub Hava
April 5, 2019, 10:26 AM

do you want to have a look on this one?

Jakub Hava
April 5, 2019, 10:25 AM

Yup, looks great, but one fix version to add - For SW 2.1 - 2.1.53. I think we can target this fix for the next release.

Marek Novotny
April 5, 2019, 10:17 AM

cc , I'm not sure with the fix versions, please can you take a look?

Fixed

Assignee

Marek Novotny

Reporter

Marek Novotny

Labels

None

CustomerVisible

No

testcase 1

None

testcase 2

None

testcase 3

None

h2ostream link

None

Affected Spark version

None

AffectedContact

None

AffectedCustomers

None

AffectedPilots

None

AffectedOpenSource

None

Support Assessment

None

Customer Request Type

None

Support ticket URL

None

End date

None

Baseline start date

None

Baseline end date

None

Task progress

None

Task mode

None

ReleaseNotesHidden

None

Fix versions

Priority

Minor