Hi, I have a Master of System's Engineering degree and I am a Computer Engineer with over 20 yrs of experience.
I can help you with your project.
Let's chat so I can understand better what you want to accomplish, if this project will need to increase capacity in the future or not, for instance.
Then, if you want I could first explore for simpler alternatives to solve your problem.
On the other hand, following your proposed path, I set up some milestones as a guide. We should first check requirements (hw, sw, like hugepages, drivers, and so on) of course.
As I understand, this project doesn't include working on the Kafka side. Just providing the data to an already set up Kafka platform.
Feel free to contact me at any time so we can discuss all the details!
Best regards!