Scala Jobs

Hello We are facing a random error with Slick 3. That is the brief history. We are building an ETL pipeline Spark, Minio as S3 Storage ( Minio is an open-source alternative to AWS) and Delta tables. The pipeline has a web interface created using Play Framework (Scala). Cluster is consisted of: 7 workers nodes of 16 cores and 64GB RAM each configured in client mode. 1 Storage node and are both set to 600 is disabled App data (session data, users data, and some other records in) is saved in PostgreSQL using Slick 3 mapper. Data processed size is exponentially growing and now it is around 50GB. (In production, we aim to process Terabytes of data) Data processing flow consists essentially in data Aggregation using group-by and saving data into S3 Storage following these steps 1...

We need some specific training to an Individual (My son) on the following: Apache Kafka working on streaming data & Writing Java & Scala Code Need One on one consultations.

Create an Ingestion MicroService that will allows us to integrate JSON format file look at some statistics and visualize the entering of data inflows details : You are asked to use a JSON file named "" in the folder datasets and to write each elements of the said in a kafka topic however the "ingested data" need to be valid the following are the criteria of a valid data : the name of the person has to be of at least 5 characters the person has to be legal and 75 at the upmost the person email has to be valid if the data does not meet at one of those criteria it shall be written in a topic of rejection , with the reason of its rejection You are expected to use a kafka-docker for the kafka instance and named your topics as followed : validation topic = ingestion-vali...