出坑-低版本k8s运行高版本spark operator
Spark Operator on Kubernetes(k8s)视频教程介绍:
1. 基于两套kubernetes环境分别演示不同版本spark operator部署
2. 手把手操作踩坑消缺
3. 原始部署方式,更直观了解spark operator
4. 学习后可以选择任意spark operator版本自由部署,适用于离线部署
常见错误或踩坑解决分析:
【错误1】
rawResources failed to read Resources: Load from path ../crds failed: '../crds' must be a file"
【错误2】
error validating "spark-operator.yaml": error validating data: ValidationError(Deployment.spec.template.metadata): unknown field "initializers" in io.k8s.apimachinery.pkg.apis.meta.v1.ObjectMeta; if you choose to ignore these errors, turn validation off with --validate=false
【错误3】
ProtocolException: Expected HTTP 101 response but was '403 Forbidden'
io.fabric8.kubernetes.client.KubernetesClientException:
Exception in thread "main" io.fabric8.kubernetes.client.KubernetesClientException:
【错误4】
failed to create or update CustomResourceDefinition sparkapplications.sparkoperator.k8s.io:
unable to recognize "spark-operator-crds.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1beta1"
公开笔记对他人可见,有机会被管理员评为“优质笔记”
{{ noteEditor.content.length }}/2000
讲师收到你的提问会尽快为你解答。若选择公开提问,可以获得更多学员的帮助。
课程大纲
- 第一章 Spark Operator on k8s
- 1-1试看 课程介绍04:11
- 1-2环境介绍04:41
- 1-3latest版本spark operator部署15:28
- 1-4latest版本spark operator环境测试06:10
- 1-5spark业务镜像构建&运行部署15:08
- 1-6踩坑-rawResources failed06:24
- 1-7出坑-低版本k8s运行高版本spark operator13:53
- 1-8spark operator2.4.x部署踩坑一14:12
- 1-9spark operator2.4.x部署出坑一08:24
- 1-10spark operator2.4.x部署踩坑二08:58