Hi,
I have 6 years of experience in spark sql and I have developed many solutions in it. I have worked with dataframes, rdd and datasets.
I have gone through the attached file and have understood the requirement.
Task will be completed within time and budget and regular updates will be provided.
Let's discuss further.