Create Spark Helm Chart

€30-250 EUR

Berlangsung

Dibuat

hampir 4 tahun yang lalu

€30-250 EUR

Dibayar ketika dikirim

Hi, what I need is the following: - I need a helm script (kubernetes) which "installs" the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka provider (and it's security mechanism - [login to view URL] = [login to view URL]) - Zeppelin has to deploy jobs to cluster and NOT execute them standalone - The kubernetes cluster doesn't use level 4 load balancer, so we can't simply use the following helm chart ([login to view URL]) - Kubernetes Level 7 Loadbalancers are used - Basic neccessary setup (Nodes needs to have the corresponding spark versions deployed) - Acceptance criteria: I have a structured streaming script, which we can use to check if setup works, in the meantime you can use your script for development. - Kubernetes Version is v1.16.3. - I can't grant you access to the cluster nor to the confluent stream. Thanks for your time.

ID Proyek: 25391090

Tentang proyek

7 proposal

Proyek remot

Aktif 4 tahun yang lalu

Ingin menghasilkan uang?

Alamat email

Keuntungan menawar di Freelancer

Tentukan anggaran dan garis waktu Anda

Dapatkan bayaran atas pekerjaan Anda

Uraikan proposal Anda

Gratis mendaftar dan menawar pekerjaan

Diberikan kepada:

@vivmistry

I am a DevOps Consultant & Certified Kubernetes Administrator with 13+ years of experience specializes in implementing and maintaining DevOps Tools using different tools like Jenkins, Docker, Kubernetes, Python, Groovy for both public & private cloud-hosted applications. and comfortable working with both Windows & Linux Operating Systems. In my latest project have setup DevOps, CI/CD Automation Framework for an Enterprise IT that supports 30+ applications and 100+ Automation Jobs. Given an opportunity, will be pleased to create the required Helm Chart. In case you need more information about me, please check my Linkedin Profile: [login to view URL]

€200 EUR dalam 7 hari

0,0

(0 ulasan)

0,0

7 freelancer menawar dengan rata-rata €303 EUR untuk pekerjaan ini

@alonlong

● I have been in software development for 10+ years. ● I am a Golang developer with 5+ years of experience. ● I was responsible for many projects which is based on the microservice architecture and the design and development of service mesh. ● I am very familiar with the design of api gateway. ● I have developed many microservices which are based on grpc or http protocol. ● I am good at docker and kubernetes technology, and I have been responsible for company's containerization pre-research, solution design and practices. ● I use Git to manage project code and I like to research Golang open source code. ● I worked on the following technologies - Golang ,Websocket, gRPC, Docker, Kubernetes, Git ,GORM, Nginx, MongoDB, Kafka, PostgreSQL, MySQL and so on.

€500 EUR dalam 15 hari

5,0

(7 ulasan)

5,3

@usamaahmadkhan

Hi I am a DevOps Engineer with hands on experience in managing Kubernetes cluster. I understand your problem and can modify the helm chart as per your use case. I have also worked with Kafka in K8s and can modify it as per requirement. Let me know if you need my services. Thanks Usama

€280 EUR dalam 7 hari

5,0

(10 ulasan)

4,2

@iwanthereds

Hi there. Thank you for your posting. As a senior cloud developer, I am familiar with k8s and spark. I've been operating several k8s clusters (managed clusters, and on-premise clusters) for several years. Writing helm charts is the normal job for me, and so I am familair with helm template and jinja. Already, I wrote many helm charts to manage my clusters and apps on those clusters. Spark is also my job. Let's discuss the details. Regards.

€250 EUR dalam 7 hari

5,0

(5 ulasan)

2,7

@Ayouma

Hi, I'm a software engineer with 5 years of experience in Bigdata technologies (Kubernetes, Docker, Spark, Kafka, Scala, Python,..) in Paris on different activity areas like banking and energy :). For your project, I'm just worked on a similar project Kubernetes with the confluent operator. For more details feel free to send a msg :) Thanks in advance Ayoub

€500 EUR dalam 10 hari