Override spark locality so we use only nodes on which h2o is running.
Description
This would eliminate problem when a new executor without h2o tries to join the computation
Activity
Show:
Jakub Hava
June 12, 2017, 3:40 PM
Edited
Already testing the solution in case of conversion from Spark -> H2O
Jakub Hava
June 12, 2017, 4:23 PM
The opposite conversion should work automatically as we are converting from the node on which we already have h2o
Jakub Hava
June 12, 2017, 6:48 PM
Tested on YARN where I requested 1000 executors, 168 were discovered. All run fine. Then I enforced location only for 2 executors out of 1000 to really see it works.
Fixed
Assignee
Reporter
Labels
None
CustomerVisible
No
testcase 1
None
testcase 2
None
testcase 3
None
h2ostream link
None
Affected Spark version
None
AffectedContact
None
AffectedCustomers
None
AffectedPilots
None
AffectedOpenSource
None
Support Assessment
None
Customer Request Type
None
Support ticket URL
None
End date
None
Baseline start date
None
Baseline end date
None
Task progress
None
Task mode
None
ReleaseNotesHidden
None
Priority
